[NETVIRT-1153]  Conflicting modification for path ... id=L3.215519089261197.20.100403.10... OptimisticLockFailedException Created: 14/Mar/18  Updated: 25/Nov/19  Resolved: 25/Nov/19

Status: Resolved
Project: netvirt
Component/s: General
Affects Version/s: Oxygen, Fluorine
Fix Version/s: Oxygen-SR3, Fluorine

Type: Bug Priority: Medium
Reporter: Sam Hague Assignee: Hanamantagoud Kandagal
Resolution: Won't Do Votes: 0
Labels: csit:exception, feedback
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File odl1_karaf.t20.log.tar.xz    
Issue Links:
Relates
relates to NETVIRT-1466 OptimisticLockFailedException in VpnF... Open

 Description   

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-openstack-queens-gate-stateful-oxygen/107/odl_1/odl1_karaf.log.gz

2018-03-14T09:53:32,349 | WARN  | opendaylight-cluster-data-shard-dispatcher-41 | ShardDataTree                    | 230 - org.opendaylight.controller.sal-distributed-datastore - 1.7.0.SNAPSHOT | member-1-shard-inventory-config: Store Tx member-1-datastore-config-fe-0-txn-143453-0: Conflicting modification for path /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[{(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:215519089261197}]/AugmentationIdentifier{childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address]}/(urn:opendaylight:flow:inventory?revision=2013-08-19)table/table[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=20}]/flow/flow[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=L3.215519089261197.20.100403.10}].
2018-03-14T09:53:32,350 | INFO  | org.opendaylight.yang.gen.v1.urn.opendaylight.netvirt.neutronvpn.rev150602.subnetmaps.Subnetmap_AsyncDataTreeChangeListenerBase-DataTreeChangeHandler-0 | VpnSubnetRouteHandler            | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | SUBNETROUTE: onSubnetAddedToVpn: Added PortOpDataEntry and VpnInterfaces to SubnetOpData for subnet 736be8d7-af02-45a3-811f-a8d8d44a2c0f subnetIp 2001:db8:0:2::/64 vpn 4ae8cd92-48ca-49b5-94e1-b2921a261661 TaskState Advertised lastTaskState Idle
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-4 | VpnUtil                          | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | getRts: vpn targets not available for 7f6aa926-55c8-4791-9ed1-e85188c7fe6a
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-0 | VpnUtil                          | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | getRts: vpn targets not available for 7f6aa926-55c8-4791-9ed1-e85188c7fe6a
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-4 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: label 100406 dpn 92619840549784 prefix 2001:db8:0:2:f816:3eff:fe25:1b80/128 nexthoplist [10.30.170.63] vpnid 100385 vpnIntfcName 874144f6-90eb-4996-b4ce-80625a50a688 rd 2206:2 elanTag null
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-6 | VpnInterfaceManager              | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addVpnInterface: Addition of interface ba5bc437-53bf-47b4-9b71-b314a8f3d0f1 in VPN 4ae8cd92-48ca-49b5-94e1-b2921a261661 on dpn 215519089261197 processed successfully
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-0 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: label 100405 dpn 454290805321 prefix 2001:db8:0:2:f816:3eff:fef2:a33d/128 nexthoplist [10.30.170.78] vpnid 100385 vpnIntfcName 5f4aa540-0db3-40d2-b15e-94c0ab0a18a8 rd 2206:2 elanTag null
2018-03-14T09:53:32,350 | WARN  | ForkJoinPool-1-worker-4 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: elanTag is null for label 100406 prefix 2001:db8:0:2:f816:3eff:fe25:1b80/128 rd 2206:2 vpnId 100385
2018-03-14T09:53:32,350 | WARN  | ForkJoinPool-1-worker-0 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: elanTag is null for label 100405 prefix 2001:db8:0:2:f816:3eff:fef2:a33d/128 rd 2206:2 vpnId 100385
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-4 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: Added label route info to label 100406 prefix 2001:db8:0:2:f816:3eff:fe25:1b80/128 nextHopList [10.30.170.63] vpnId 100385 interface 874144f6-90eb-4996-b4ce-80625a50a688 rd 2206:2 elantag null
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-0 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | addToLabelMapper: Added label route info to label 100405 prefix 2001:db8:0:2:f816:3eff:fef2:a33d/128 nextHopList [10.30.170.78] vpnId 100385 interface 5f4aa540-0db3-40d2-b15e-94c0ab0a18a8 rd 2206:2 elantag null
2018-03-14T09:53:32,350 | INFO  | ForkJoinPool-1-worker-4 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | ADD: addPrefixToBGP: Adding Fib entry rd 2206:2 prefix 2001:db8:0:2:f816:3eff:fe25:1b80/128 nextHop [10.30.170.63] label 100406 gwMac 00:00:00:00:00:00
2018-03-14T09:53:32,351 | INFO  | ForkJoinPool-1-worker-0 | L3vpnPopulator                   | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | ADD: addPrefixToBGP: Adding Fib entry rd 2206:2 prefix 2001:db8:0:2:f816:3eff:fef2:a33d/128 nextHop [10.30.170.78] label 100405 gwMac fe:16:3e:f2:a3:3d
2018-03-14T09:53:32,352 | INFO  | ForkJoinPool-1-worker-1 | VpnOpStatusListener              | 367 - org.opendaylight.netvirt.vpnmanager-impl - 0.6.0.SNAPSHOT | VpnOpStatusListener.update: updating BGPVPN for vpn 4ae8cd92-48ca-49b5-94e1-b2921a261661 with RD 2206:2 Type is L3, IPv4 is false, IPv6 is true
2018-03-14T09:53:32,351 | ERROR | opendaylight-cluster-data-akka.actor.default-dispatcher-47 | LocalThreePhaseCommitCohort      | 230 - org.opendaylight.controller.sal-distributed-datastore - 1.7.0.SNAPSHOT | Failed to prepare transaction member-1-datastore-config-fe-0-txn-143453-0 on backend
org.opendaylight.controller.md.sal.common.api.data.OptimisticLockFailedException: Optimistic lock failed.
	at org.opendaylight.controller.cluster.datastore.ShardDataTree.lambda$processNextPendingTransaction$0(ShardDataTree.java:740) ~[230:org.opendaylight.controller.sal-distributed-datastore:1.7.0.SNAPSHOT]
	at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPending(ShardDataTree.java:778) [230:org.opendaylight.controller.sal-distributed-datastore:1.7.0.SNAPSHOT]
	at org.opendaylight.controller.cluster.datastore.ShardDataTree.processNextPendingTransaction(ShardDataTree.java:725) [230:org.opendaylight.controller.sal-distributed-datastore:1.7.0.SNAPSHOT]
	at org.opendaylight.controller.cluster.datastore.ShardDataTree.startCanCommit(ShardDataTree.java:808) [230:org.opendaylight.controller.sal-distributed-datastore:1.7.0.SNAPSHOT]
	at org.opendaylight.controller.cluster.datastore.SimpleShardDataTreeCohort.canCommit(SimpleShardDataTreeCohort.java:84) [230:org.opendaylight.controller.sal-distributed-datastore:1.7.0.SNAPSHOT]


 Comments   
Comment by Sam Hague [ 25/May/18 ]

seen in: https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-openstack-queens-gate-stateful-fluorine/457/odl_1/odl1_karaf.log.gz

Comment by Sam Hague [ 30/May/18 ]

another sighting: https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-openstack-queens-gate-stateful-fluorine/503/robot-plugin/log_07_vpn_basic.html.gz#s1-t21-k10-k3-k1-k1-k1-k3-k2

Comment by Sam Hague [ 23/Jul/18 ]

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-gate-stateful-fluorine/36/odl_1/odl1_exceptions.txt.gz

2018-07-23T10:30:23,102 | INFO  | CommitFutures-8  | VpnFootprintService$DpnEnterExitVpnWorker | 355 - org.opendaylight.netvirt.vpnmanager-impl - 0.7.0.SNAPSHOT | onFailure: Failed to establish/clear footprint for vpn 4ae8cd92-48ca-49b5-94e1-b2921a261441 rd 2200:2 on dpn 110396829665893 org.opendaylight.controller.md.sal.common.api.data.OptimisticLockFailedException: Optimistic lock failed for path /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[{(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:110396829665893}]/AugmentationIdentifier{childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address]}/(urn:opendaylight:flow:inventory?revision=2013-08-19)table/table[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=20}]/flow/flow[{(urn:opendaylight:flow:inventory?revision=2013-08-19)id=L3.110396829665893.20.100087.10}]	at org.opendaylight.controller.sal.core.compat.LegacyDOMDataBrokerAdapter$1.newWithCause(LegacyDOMDataBrokerAdapter.java:66) [234:org.opendaylight.controller.sal-core-compat:1.8.0.SNAPSHOT]	at org.opendaylight.controller.sal.core.compat.LegacyDOMDataBrokerAdapter$1.newWithCause(LegacyDOMDataBrokerAdapter.java:62) [234:org.opendaylight.controller.sal-core-compat:1.8.0.SNAPSHOT]	at org.opendaylight.yangtools.util.concurrent.ExceptionMapper.apply(ExceptionMapper.java:106) [412:org.opendaylight.yangtools.util:2.0.7]	at org.opendaylight.controller.sal.core.compat.LegacyDOMDataBrokerAdapter$DOMDataTransactionAdapter$1.onFailure(LegacyDOMDataBrokerAdapter.java:301) [234:org.opendaylight.controller.sal-core-compat:1.8.0.SNAPSHOT]	at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1387) [32:com.google.guava:23.6.1.jre]	at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:398) [32:com.google.guava:23.6.1.jre]	at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1015) [32:com.google.guava:23.6.1.jre]	at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:868) [32:com.google.guava:23.6.1.jre]	at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:713) [32:com.google.guava:23.6.1.jre]	at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:94) [32:com.google.guava:23.6.1.jre]	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:?]	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:?]	at java.lang.Thread.run(Thread.java:748) [?:?]Caused by: org.opendaylight.yangtools.yang.data.api.schema.tree.ConflictingModificationAppliedException: Node was created by other transaction.	at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.checkConflicting(SchemaAwareApplyOperation.java:80) ~[417:org.opendaylight.yangtools.yang-data-impl:2.0.7]	at 
Comment by Jamo Luhrsen [ 30/Oct/18 ]

saw this recently:
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-1cmb-0ctl-0cmp-openstack-queens-upstream-stateful-snat-conntrack-oxygen/33/robot-plugin/log_09_vpn_basic_ipv6.html.gz#s1-t12

Comment by Abhinav Gupta [ 25/Nov/19 ]

will reopen if seen in Sodium+ releases

Generated at Wed Feb 07 20:23:21 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.