OpenDaylight JIRA https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 [NETVIRT-957] CSIT Sporadic failures - v6 Vpnservice suite - missing instance ip in flow table on compute node https://jira.opendaylight.org/browse/NETVIRT-957 netvirt <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/210/log.html.gz#s1-s5-t15" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/210/log.html.gz#s1-s5-t15</a></p> <p>Operating System: All<br/> Platform: All</p> NETVIRT-957 CSIT Sporadic failures - v6 Vpnservice suite - missing instance ip in flow table on compute node Bug Resolved Cannot Reproduce Sridhar Gaddam Jamo Luhrsen Fri, 13 Oct 2017 19:26:30 +0000 Mon, 4 Dec 2017 12:52:12 +0000 Mon, 4 Dec 2017 12:52:12 +0000 Nitrogen Nitrogen-SR1 General 0 4 <p>Hi Sridhar ,</p> <p> </p> <p>We request you to work this out with Philip.</p> <p>1st hypothesis, I woudl tend to think there are some exceptions before</p> <p> <a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/210/odl1_err_warn_exception.log.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/210/odl1_err_warn_exception.log.gz</a></p> <p> </p> <p>operational-fe-0-chn-6-txn-13688-0: Data validation failed for path /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>]. org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children. 2017-10-13 09:23:50,113 | WARN | lt-dispatcher-45 | ConcurrentDOMDataBroker | 219 - org.opendaylight.controller.sal-distributed-datastore - 1.6.1.SNAPSHOT | Tx: DOM-CHAIN-5-13688 Error during phase CAN_COMMIT, starting Abort TransactionCommitFailedException{message=Data did not pass validation., errorList=[RpcError [message=Data did not pass validation., severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[</p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children.]]} Caused by: org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children. 2017-10-13 09:23:50,113 | ERROR | ult-dispatcher-5 | LocalThreePhaseCommitCohort | 219 - org.opendaylight.controller.sal-distributed-datastore - 1.6.1.SNAPSHOT | Failed to prepare transaction member-1-datastore-operational-fe-0-chn-6-txn-13688-0 on backend TransactionCommitFailedException{message=Data did not pass validation., errorList=[RpcError [message=Data did not pass validation., severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[</p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children.]]} Caused by: org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children. 2017-10-13 09:23:50,115 | WARN | CommitFutures-9 | TransactionChainManager | 347 - org.opendaylight.openflowplugin.common - 0.5.1.SNAPSHOT | Transaction chain failed, recreating chain due to TransactionCommitFailedException{message=Data did not pass validation., errorList=[RpcError [message=Data did not pass validation., severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[</p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children.]]} Caused by: org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children. 2017-10-13 09:23:50,117 | ERROR | CommitFutures-9 | TransactionChainManager | 347 - org.opendaylight.openflowplugin.common - 0.5.1.SNAPSHOT | Transaction commit failed. TransactionCommitFailedException{message=Data did not pass validation., errorList=[RpcError [message=Data did not pass validation., severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[</p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children.]]} Caused by: org.opendaylight.yangtools.yang.data.api.schema.tree.ModifiedNodeDoesNotExistException: Node /(urn:opendaylight:inventory?revision=2013-08-19)nodes/node/node[<br class="atl-forced-newline" /></p> {(urn:opendaylight:inventory?revision=2013-08-19)id=openflow:273006426598225} <p>]/AugmentationIdentifier</p> {childNames=[(urn:opendaylight:flow:inventory?revision=2013-08-19)port-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-group, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-match-types, (urn:opendaylight:flow:inventory?revision=2013-08-19)table, (urn:opendaylight:flow:inventory?revision=2013-08-19)group, (urn:opendaylight:flow:inventory?revision=2013-08-19)manufacturer, (urn:opendaylight:flow:inventory?revision=2013-08-19)software, (urn:opendaylight:flow:inventory?revision=2013-08-19)ip-address, (urn:opendaylight:flow:inventory?revision=2013-08-19)serial-number, (urn:opendaylight:flow:inventory?revision=2013-08-19)table-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-actions, (urn:opendaylight:flow:inventory?revision=2013-08-19)hardware, (urn:opendaylight:flow:inventory?revision=2013-08-19)description, (urn:opendaylight:flow:inventory?revision=2013-08-19)switch-features, (urn:opendaylight:flow:inventory?revision=2013-08-19)supported-instructions, (urn:opendaylight:flow:inventory?revision=2013-08-19)stale-meter, (urn:opendaylight:flow:inventory?revision=2013-08-19)meter]} <p>/(urn:opendaylight:flow:inventory?revision=2013-08-19)group/group[<br class="atl-forced-newline" /></p> {(urn:opendaylight:flow:inventory?revision=2013-08-19)group-id=150021} <p>] does not exist. Cannot apply modification to its children. 2017-10-13 09:23:54,546 | INFO | nsole user karaf | core | 112 - org.apache.karaf.log.core - 4.0.10 | ROBOT MESSAGE: Starting test Verify L3VPN Datapath With Router Association 2017-10-13 09:24:22,610 | INFO | nsole user karaf | core | 112 - org.apache.karaf.log.core - 4.0.10 | ROBOT MESSAGE: Starting test Dissociate L3VPN From Routers</p> <p>With the recent fixes that went into Netvirt, this issue is no longer seen.<br/> I had a look at the CSIT runs and the test-case is consistently passing.</p> <p><a href="https://jenkins.opendaylight.org/releng/job/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/526/robot/openstack/08%20vpn%20basic%20ipv6/Verify%20L3VPN%20Datapath%20With%20Router%20Association/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/job/netvirt-csit-1node-openstack-ocata-upstream-stateful-nitrogen/526/robot/openstack/08%20vpn%20basic%20ipv6/Verify%20L3VPN%20Datapath%20With%20Router%20Association/</a></p> <p>Issue no longer seen, hence closing it.</p> Development External issue ID 9290 External issue URL Rank 0|i01v07: Status Whiteboard csit:sporadic_failures