https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/OPNFLWPLUG-826 OpenFlowPlugin <p>Description<br/> ************<br/> 1.Load Newton setup(Devstuck) :<br/> Host1=controller+compute<br/> Host2=compute<br/> 2.Lunch vm on Host 2.<br/> 3.Accosiate Fip to vm<br/> 4.connect to vm via ssh - o.k<br/> 5.send ping from vm to 8.8.8.8 -o.k</p> <p>*Dump pipeline of compute which vm create on.<br/> *Restart ovs<br/> *Try to send ping and ssh to vm - fail.<br/> *Dump pipeline again </p> <p>resault<br/> ********<br/> It can be seen that pipeline is empty from rules.</p> <p>Note<br/> ****<br/> Restart ovs of Host 1 and dump pipeline - pipeline is empty as well.</p> <p>Operating System: All<br/> Platform: All</p> OPNFLWPLUG-826

ovs recovery failed

Bug Resolved Done Unassigned zan cohen Tue, 22 Nov 2016 16:01:08 +0000 Mon, 27 Sep 2021 09:01:58 +0000 Thu, 2 Mar 2017 11:19:31 +0000 General 0 3 <p>Logs:<br/> \\10.0.1.216\pub\zan_cohen\Bugzila_7223</p> <p>controller restart doesn't solve the problem as work around!!</p> <p>Defect doesn't reconstruct permanently.</p> <p>Failed to establish connection after OVS restart.</p> <p>After initial logs analysis, it seems the role setting flow didn't finish successfully, related thread didn't return from the callback function getGenerationIdFromDevice()</p> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li> <ul> <li>From karaf log: ********************</li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> </li> </ul> <p>2016-11-22 16:05:20,135 | INFO | entLoopGroup-9-3 | SalRoleServiceImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:75770075299928]]]]} <p>], augmentation=[]]<br/> 2016-11-22 16:05:20,135 | INFO | entLoopGroup-9-3 | SalRoleServiceImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2016-11-22 16:05:20,135 | INFO | entLoopGroup-9-3 | SalRoleServiceImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | RoleChangeTask called on device:openflow:75770075299928 OFPRole:BECOMESLAVE<br/> 2016-11-22 16:05:20,135 | INFO | entLoopGroup-9-3 | RoleService | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:75770075299928<br/> 2016-11-22 16:05:20,140 | INFO | entLoopGroup-9-3 | LifecycleServiceImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Starting clustering MASTER services for node openflow:75770075299928<br/> 2016-11-22 16:05:20,140 | INFO | entLoopGroup-9-3 | DeviceContextImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Starting device context cluster services for node openflow:75770075299928</p> <p>2016-11-22 16:05:30,139 | WARN | pool-41-thread-1 | DeviceContextImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | New role BECOMESLAVE was not propagated to device openflow:75770075299928 during 10 sec<br/> 2016-11-22 16:05:30,141 | ERROR | pool-41-thread-1 | SalRoleServiceImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | SetRoleService set Role BECOMESLAVE for Node: KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:75770075299928]]]]} <p> fail . Reason java.util.concurrent.CancellationException: Task was cancelled.<br/> 2016-11-22 16:05:30,141 | WARN | pool-41-thread-1 | DeviceManagerImpl | 268 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Was not able to set role SLAVE to device on node openflow:75770075299928 <br/> **************************************************************</p> <p>The following message appears each 10 sec "New role BECOMESLAVE was not propagated to device openflow:75770075299928 during 10 sec"</p> <p>I seemed to hit the same issue as well. Using a single node setup, I just restarted ODL (/bin/stop and then /bin/start), and the OVS couldn't connect the the ODL again.</p> <p>I saw reccuring prints of:</p> <p>2017-02-23 18:09:04,519 | INFO | ntLoopGroup-9-93 | ConnectionAdapterImpl | 306 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.2.SNAPSHOT | Hello received / branch<br/> 2017-02-23 18:09:04,521 | INFO | ntLoopGroup-9-93 | DeviceManagerImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | ConnectionEvent: Device connected to controller, Device:/10.0.118.2:57396, NodeId:Uri [_va<br/> lue=openflow:198223095212864]<br/> 2017-02-23 18:09:04,522 | INFO | ntLoopGroup-9-93 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value<br/> =KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.open daylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:198223095212864]]]]} <p>], augmentation=[]]<br/> 2017-02-23 18:09:04,522 | INFO | ntLoopGroup-9-93 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2017-02-23 18:09:04,522 | INFO | ntLoopGroup-9-93 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | RoleChangeTask called on device:openflow:198223095212864 OFPRole:BECOMESLAVE<br/> 2017-02-23 18:09:04,522 | INFO | ntLoopGroup-9-93 | RoleService | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:198223095212864<br/> 2017-02-23 18:09:04,522 | WARN | ntLoopGroup-9-93 | LifecycleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Failed to register cluster singleton service for node org.opendaylight.openflowplugin.impl<br/> .connection.ConnectionContextImpl$DeviceInfoImpl@4f7874de, with exception: java.lang.RuntimeException: org.opendaylight.mdsal.eos.common.api.CandidateAlreadyRegisteredException: Candidate has already been registered for DOMEntity [type=org.<br/> opendaylight.mdsal.ServiceEntityType, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[</p> {(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=openflow:198 223095212864} <p>]]<br/> 2017-02-23 18:09:06,531 | WARN | pool-40-thread-1 | DeviceContextImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | New role BECOMESLAVE was not propagated to device openflow:198223095212864 during 10 sec<br/> 2017-02-23 18:09:06,531 | ERROR | pool-40-thread-1 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | SetRoleService set Role BECOMESLAVE for Node: KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=N odeKey [_id=Uri [_value=openflow:198223095212864]]]]} <p> fail . Reason java.util.concurrent.CancellationException: Task was cancelled.<br/> 2017-02-23 18:09:06,531 | WARN | pool-40-thread-1 | DeviceManagerImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Was not able to set role SLAVE to device on node openflow:198223095212864<br/> 2017-02-23 18:09:08,386 | WARN | ssionScavenger-4 | teInvalidatingHashSessionManager | 53 - org.ops4j.pax.web.pax-web-jetty - 3.2.9 | Timing out for 1 session(s) with id jxdj4yx1r8jexufsv20palhi<br/> 2017-02-23 18:09:12,520 | INFO | ntLoopGroup-9-94 | ConnectionAdapterImpl | 306 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.2.SNAPSHOT | Hello received / branch<br/> 2017-02-23 18:09:12,522 | INFO | ntLoopGroup-9-94 | DeviceManagerImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | ConnectionEvent: Device connected to controller, Device:/10.0.118.2:57398, NodeId:Uri [_va<br/> lue=openflow:198223095212864]<br/> 2017-02-23 18:09:12,523 | INFO | ntLoopGroup-9-94 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value<br/> =KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.open daylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:198223095212864]]]]} <p>], augmentation=[]]<br/> 2017-02-23 18:09:12,523 | INFO | ntLoopGroup-9-94 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2017-02-23 18:09:12,523 | INFO | ntLoopGroup-9-94 | SalRoleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | RoleChangeTask called on device:openflow:198223095212864 OFPRole:BECOMESLAVE<br/> 2017-02-23 18:09:12,523 | INFO | ntLoopGroup-9-94 | RoleService | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:198223095212864<br/> 2017-02-23 18:09:12,523 | WARN | ntLoopGroup-9-94 | LifecycleServiceImpl | 311 - org.opendaylight.openflowplugin.impl - 0.3.2.SNAPSHOT | Failed to register cluster singleton service for node org.opendaylight.openflowplugin.impl<br/> .connection.ConnectionContextImpl$DeviceInfoImpl@4f7874de, with exception: java.lang.RuntimeException: org.opendaylight.mdsal.eos.common.api.CandidateAlreadyRegisteredException: Candidate has already been registered for DOMEntity [type=org.<br/> opendaylight.mdsal.ServiceEntityType, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[</p> {(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=openflow:198 223095212864} <p>]]</p> <p>Errors starting in:<br/> 2017-02-23 15:01:22,522 | INFO | entLoopGroup-9-2 | ConnectionAdapterImpl | 306 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.2.SNAPSHOT | Hello received / branch</p> <p>Attachment karaf.log.gz has been added with description: karaf.log</p> <p>Attachment file.pcap has been added with description: pcap file -OF port</p> <p>Attachment karaf.zip has been added with description: karaf.log -TRACE</p> <p>I did the same scenario as Kobi with debug level of karaf.log set to TRACE.<br/> I also use tcpdump on port 6653.<br/> both attached</p> <p>fix in stable/boron SR3:<br/> <a href="https://git.opendaylight.org/gerrit/#/c/51489/7" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/51489/7</a></p> Development External issue ID 7223 External issue URL Rank 0|i033jr: