https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/OPNFLWPLUG-757 OpenFlowPlugin <p>The latest regression run reports failure in normal flow installation. Flows are pushed via Bulkomatic and verified in mininet switch. </p> <p>GERRIT_BRANCH: stable/boron<br/> GERRIT_REFSPEC: refs/heads/stable/boron<br/> BRANCH: stable/boron<br/> CONTROLLERFEATURES: odl-jolokia,odl-openflowplugin-flow-services-ui,odl-openflowplugin-app-bulk-o-matic</p> <p><a href="https://jenkins.opendaylight.org/releng/view/openflowplugin/job/openflowplugin-csit-3node-periodic-bulkomatic-clustering-daily-only-boron/70/robot/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/openflowplugin/job/openflowplugin-csit-3node-periodic-bulkomatic-clustering-daily-only-boron/70/robot/</a> </p> <p>This issue is seen from last 3 days consistently in regression (boron + Lithium plugin), below given the console logs, one can observe out of 3 DPN in one of the DPN 1000 flows are not installed.</p> <p>==============================================================================<br/> openflowplugin-bulkomatic-clustering-daily.txt.Cluster Reconcilliation Mult...<br/> ==============================================================================<br/> Check Shards Status And Initialize Variables :: Check Status for a... | PASS |<br/> ------------------------------------------------------------------------------<br/> Get Inventory Follower Before Cluster Restart :: Find a follower i... | PASS |<br/> ------------------------------------------------------------------------------<br/> Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS |<br/> ------------------------------------------------------------------------------<br/> Add Bulk Flow From Follower :: 3000 Flows (1K per DPN) in 3 DPN ad... | PASS |<br/> ------------------------------------------------------------------------------<br/> Get Bulk Flows and Verify In Cluster :: Initiate get operation and... | PASS |<br/> ------------------------------------------------------------------------------<br/> Verify Flows In Switch Before Cluster Restart :: Verify flows are ... | FAIL |<br/> Keyword 'MininetKeywords.Mininet Sync Status' failed after retrying for 1 minute 40 seconds. The last error was: '*** s1 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=0</p> <ul> <li> <ul> <li> <ul> <li>s2 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=1000</li> <li>s3 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=1000<br/> mininet&gt;' contains 'flow_count=1000' 2 times, not 3 times.<br/> ------------------------------------------------------------------------------</li> </ul> </li> </ul> </li> </ul> <p>Also the same issue is observed in 2 node cluster suite, steps given as below</p> <p><a href="https://jenkins.opendaylight.org/releng/view/openflowplugin/job/openflowplugin-csit-3node-periodic-bulkomatic-clustering-daily-only-boron/70/console" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/openflowplugin/job/openflowplugin-csit-3node-periodic-bulkomatic-clustering-daily-only-boron/70/console</a></p> <p>==============================================================================<br/> openflowplugin-bulkomatic-clustering-daily.txt.Cluster Reconcilliation Mult...<br/> ==============================================================================<br/> Check Shards Status And Initialize Variables :: Check Status for a... | PASS |<br/> ------------------------------------------------------------------------------<br/> Get Inventory Follower Before Cluster Restart :: Find a follower i... | PASS |<br/> ------------------------------------------------------------------------------<br/> Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS |<br/> ------------------------------------------------------------------------------<br/> Add Bulk Flow From Follower :: 3000 Flows (1K per DPN) in 3 DPN ad... | PASS |<br/> ------------------------------------------------------------------------------<br/> Get Bulk Flows and Verify In Cluster :: Initiate get operation and... | PASS |<br/> ------------------------------------------------------------------------------<br/> Verify Flows In Switch Before Cluster Restart :: Verify flows are ... | FAIL |<br/> Keyword 'MininetKeywords.Mininet Sync Status' failed after retrying for 1 minute 40 seconds. The last error was: '*** s1 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=0</p> <ul> <li> <ul> <li> <ul> <li>s2 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=1000</li> <li>s3 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=1000<br/> mininet&gt;' contains 'flow_count=1000' 2 times, not 3 times.<br/> ------------------------------------------------------------------------------</li> </ul> </li> </ul> </li> </ul> <p>Thanks<br/> Sanjib</p> <p>Operating System: All<br/> Platform: All</p> OPNFLWPLUG-757

Flow installation in OVS switch causes ofplugin regression failures in jenkins

Bug Resolved Duplicate Unassigned Sanjib Mohapatra Fri, 26 Aug 2016 17:56:20 +0000 Mon, 27 Sep 2021 09:01:53 +0000 Thu, 22 Sep 2016 18:30:05 +0000 General 0 5 <p>Hi Shuva</p> <p>As discussed, I did the manual installation of latest boron build (distribution-karaf-0.5.0-20160827.064516-4640.zip), </p> <p>Scenario1<br/> =========</p> <ul class="alternate" type="square"> <li>It’s a 3 node cluster ( leader , follower1, follower2)</li> <li>Start Mininet Connect To Follower Node1, connect 3 DPNs to it</li> <li>9000 Flows (3K per DPN) in 3 DPN added via Follower Node1 and verify it gets applied in all instances.</li> <li>Initiate (Bulkomatic) get operation and check flow count across cluster nodes in config DS</li> <li>Verify flows are installed in switches , the test passes manually as opposed to regression ( in regression it is failing sporadically)</li> <li>However all the reconciliation cases are failing manually as well as in regression,</li> </ul> <p>Basic flow installation when connected to follower node1</p> <ul> <li> <ul> <li> <ul> <li>s1 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=3000</li> <li>s2 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=3000</li> <li>s3 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=3000</li> </ul> </li> </ul> </li> </ul> <p>Reconciliation when connected to follower node2</p> <p>mininet&gt; dpctl dump-aggregate -O OpenFlow13</p> <ul> <li> <ul> <li> <ul> <li>s1 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=0</li> <li>s2 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=3000</li> <li>s3 ------------------------------------------------------------------------<br/> OFPST_AGGREGATE reply (OF1.3) (xid=0x2): packet_count=0 byte_count=0 flow_count=0<br/> mininet&gt;</li> </ul> </li> </ul> </li> </ul> <p>Logs captured from follower node2 during reconciliation, error and exceptions are highlighted</p> <p>2016-08-27 01:25:05,693 | INFO | entLoopGroup-5-1 | SystemNotificationsListenerImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ConnectionEvent: Connection closed by device, Device:/10.183.181.54:56777, NodeId:null<br/> 2016-08-27 01:25:05,704 | INFO | entLoopGroup-5-1 | ConnectionContextImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Unregister outbound queue successful.<br/> 2016-08-27 01:25:06,035 | INFO | entLoopGroup-5-2 | ConnectionAdapterImpl | 170 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.0.SNAPSHOT | Hello received / branch<br/> 2016-08-27 01:25:06,089 | INFO | entLoopGroup-5-2 | DeviceManagerImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ConnectionEvent: Device connected to controller, Device:/10.183.181.54:56778, NodeId:Uri <span class="error">&#91;_value=openflow:1&#93;</span><br/> 2016-08-27 01:25:06,152 | INFO | entLoopGroup-5-2 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:1]]]]} <p>], augmentation=[]]<br/> 2016-08-27 01:25:06,159 | INFO | entLoopGroup-5-2 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2016-08-27 01:25:06,160 | INFO | entLoopGroup-5-2 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | RoleChangeTask called on device:openflow:1 OFPRole:BECOMESLAVE<br/> 2016-08-27 01:25:06,161 | INFO | entLoopGroup-5-2 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:1<br/> 2016-08-27 01:25:06,256 | INFO | entLoopGroup-5-3 | ConnectionAdapterImpl | 170 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.0.SNAPSHOT | Hello received / branch<br/> 2016-08-27 01:25:06,259 | INFO | entLoopGroup-5-2 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange called for device:Uri <span class="error">&#91;_value=openflow:1&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,281 | INFO | entLoopGroup-5-2 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange onSuccess for device:Uri <span class="error">&#91;_value=openflow:1&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,293 | INFO | entLoopGroup-5-3 | DeviceManagerImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ConnectionEvent: Device connected to controller, Device:/10.183.181.54:56779, NodeId:Uri <span class="error">&#91;_value=openflow:2&#93;</span><br/> 2016-08-27 01:25:06,303 | INFO | entLoopGroup-5-3 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:2]]]]} <p>], augmentation=[]]<br/> 2016-08-27 01:25:06,303 | INFO | entLoopGroup-5-3 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2016-08-27 01:25:06,303 | INFO | entLoopGroup-5-3 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | RoleChangeTask called on device:openflow:2 OFPRole:BECOMESLAVE<br/> 2016-08-27 01:25:06,303 | INFO | entLoopGroup-5-3 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:2<br/> 2016-08-27 01:25:06,360 | INFO | entLoopGroup-5-3 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange called for device:Uri <span class="error">&#91;_value=openflow:2&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,389 | INFO | entLoopGroup-5-3 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange onSuccess for device:Uri <span class="error">&#91;_value=openflow:2&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,427 | INFO | entLoopGroup-5-4 | ConnectionAdapterImpl | 170 - org.opendaylight.openflowjava.openflow-protocol-impl - 0.8.0.SNAPSHOT | Hello received / branch<br/> 2016-08-27 01:25:06,434 | INFO | entLoopGroup-5-4 | DeviceManagerImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ConnectionEvent: Device connected to controller, Device:/10.183.181.54:56780, NodeId:Uri <span class="error">&#91;_value=openflow:3&#93;</span><br/> 2016-08-27 01:25:06,444 | INFO | entLoopGroup-5-4 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:3]]]]} <p>], augmentation=[]]<br/> 2016-08-27 01:25:06,444 | INFO | entLoopGroup-5-4 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2016-08-27 01:25:06,446 | INFO | entLoopGroup-5-4 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | RoleChangeTask called on device:openflow:3 OFPRole:BECOMESLAVE<br/> 2016-08-27 01:25:06,446 | INFO | entLoopGroup-5-4 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:3<br/> 2016-08-27 01:25:06,452 | INFO | entLoopGroup-5-4 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange called for device:Uri <span class="error">&#91;_value=openflow:3&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,452 | INFO | entLoopGroup-5-4 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange onSuccess for device:Uri <span class="error">&#91;_value=openflow:3&#93;</span>, role:BECOMESLAVE<br/> 2016-08-27 01:25:06,610 | INFO | entLoopGroup-5-2 | StringValueObjectFactory | 46 - org.opendaylight.mdsal.yang-binding - 0.9.0.SNAPSHOT | Instantiated factory for class org.opendaylight.yang.gen.v1.urn.ietf.params.xml.ns.yang.ietf.yang.types.rev130715.MacAddress<br/> 2016-08-27 01:25:06,626 | WARN | entLoopGroup-5-2 | DeviceContextImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Error processing port status message:<br/> org.opendaylight.controller.md.sal.common.api.data.TransactionChainClosedException: Cannot write into transaction.<br/> at org.opendaylight.openflowplugin.impl.device.TransactionChainManager.writeToTransaction(TransactionChainManager.java:233)<span class="error">&#91;180:org.opendaylight.openflowplugin.impl:0.3.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowplugin.impl.device.DeviceContextImpl.writeToTransaction(DeviceContextImpl.java:223)<span class="error">&#91;180:org.opendaylight.openflowplugin.impl:0.3.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowplugin.impl.device.DeviceContextImpl.processPortStatusMessage(DeviceContextImpl.java:331)<span class="error">&#91;180:org.opendaylight.openflowplugin.impl:0.3.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowplugin.impl.device.listener.OpenflowProtocolListenerFullImpl.onPortStatusMessage(OpenflowProtocolListenerFullImpl.java:94)<span class="error">&#91;180:org.opendaylight.openflowplugin.impl:0.3.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.connection.ConnectionAdapterImpl.consumeDeviceMessage(ConnectionAdapterImpl.java:129)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.connection.AbstractConnectionAdapterStatistics.consume(AbstractConnectionAdapterStatistics.java:66)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.connection.ConnectionAdapterImpl.consume(ConnectionAdapterImpl.java:43)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.DelegatingInboundHandler.channelRead(DelegatingInboundHandler.java:46)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.connection.AbstractOutboundQueueManager.channelRead(AbstractOutboundQueueManager.java:195)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)<span class="error">&#91;114:io.netty.codec:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293)<span class="error">&#91;114:io.netty.codec:4.0.37.Final&#93;</span><br/> at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:267)<span class="error">&#91;114:io.netty.codec:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293)<span class="error">&#91;114:io.netty.codec:4.0.37.Final&#93;</span><br/> at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:267)<span class="error">&#91;114:io.netty.codec:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.handler.timeout.ReadTimeoutHandler.channelRead(ReadTimeoutHandler.java:152)<span class="error">&#91;116:io.netty.handler:4.0.37.Final&#93;</span><br/> at org.opendaylight.openflowjava.protocol.impl.core.IdleHandler.channelRead(IdleHandler.java:39)<span class="error">&#91;170:org.opendaylight.openflowjava.openflow-protocol-impl:0.8.0.SNAPSHOT&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:321)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1280)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:328)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:890)<span class="error">&#91;113:io.netty.transport:4.0.37.Final&#93;</span><br/> at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:879)<span class="error">&#91;117:io.netty.transport-native-epoll:4.0.37.Final&#93;</span><br/> at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:387)<span class="error">&#91;117:io.netty.transport-native-epoll:4.0.37.Final&#93;</span><br/> at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:296)<span class="error">&#91;117:io.netty.transport-native-epoll:4.0.37.Final&#93;</span><br/> at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)<span class="error">&#91;112:io.netty.common:4.0.37.Final&#93;</span><br/> at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:145)<span class="error">&#91;112:io.netty.common:4.0.37.Final&#93;</span><br/> at java.lang.Thread.run(Thread.java:745)<span class="error">&#91;:1.8.0_102&#93;</span><br/> 2016-08-27 01:25:07,879 | INFO | ult-dispatcher-6 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ========== Starting clustering MASTER services for node openflow:2 ==========<br/> 2016-08-27 01:25:07,879 | INFO | ult-dispatcher-6 | DeviceContextImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Starting device context cluster services for node openflow:2<br/> 2016-08-27 01:25:07,911 | INFO | entLoopGroup-5-3 | DeviceInitializationUtils | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | IP address of switch is: /10.183.181.54:56779<br/> 2016-08-27 01:25:07,916 | INFO | entLoopGroup-5-3 | StringValueObjectFactory | 46 - org.opendaylight.mdsal.yang-binding - 0.9.0.SNAPSHOT | Instantiated factory for class org.opendaylight.yang.gen.v1.urn.ietf.params.xml.ns.yang.ietf.inet.types.rev130715.Ipv4Address<br/> 2016-08-27 01:25:07,916 | INFO | entLoopGroup-5-3 | StringValueObjectFactory | 46 - org.opendaylight.mdsal.yang-binding - 0.9.0.SNAPSHOT | Instantiated factory for class org.opendaylight.yang.gen.v1.urn.ietf.params.xml.ns.yang.ietf.inet.types.rev130715.Ipv4Prefix<br/> 2016-08-27 01:25:07,917 | INFO | entLoopGroup-5-3 | StringValueObjectFactory | 46 - org.opendaylight.mdsal.yang-binding - 0.9.0.SNAPSHOT | Instantiated factory for class org.opendaylight.yang.gen.v1.urn.ietf.params.xml.ns.yang.ietf.inet.types.rev130715.Ipv6Address<br/> 2016-08-27 01:25:07,917 | INFO | entLoopGroup-5-3 | StringValueObjectFactory | 46 - org.opendaylight.mdsal.yang-binding - 0.9.0.SNAPSHOT | Instantiated factory for class org.opendaylight.yang.gen.v1.urn.ietf.params.xml.ns.yang.ietf.inet.types.rev130715.Ipv6Prefix<br/> 2016-08-27 01:25:08,840 | INFO | entLoopGroup-5-3 | DeviceInitializationUtils | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Static node Uri <span class="error">&#91;_value=openflow:2&#93;</span> info: OFPMPMETERFEATURES collected<br/> 2016-08-27 01:25:08,904 | INFO | entLoopGroup-5-3 | DeviceInitializationUtils | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Static node Uri <span class="error">&#91;_value=openflow:2&#93;</span> info: OFPMPGROUPFEATURES collected<br/> 2016-08-27 01:25:09,021 | INFO | entLoopGroup-5-3 | DeviceInitializationUtils | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Static node Uri <span class="error">&#91;_value=openflow:2&#93;</span> info: OFPMPPORTDESC collected<br/> 2016-08-27 01:25:09,233 | INFO | ult-dispatcher-6 | StatisticsContextImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Starting statistics context cluster services for node openflow:2<br/> 2016-08-27 01:25:09,297 | INFO | ult-dispatcher-6 | StatisticsManagerImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Scheduling statistics poll for device: Uri <span class="error">&#91;_value=openflow:2&#93;</span><br/> 2016-08-27 01:25:09,407 | INFO | ult-dispatcher-6 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMEMASTER, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:2]]]]} <p>], augmentation=[]]<br/> 2016-08-27 01:25:09,408 | INFO | ult-dispatcher-6 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Requesting state change to BECOMEMASTER<br/> 2016-08-27 01:25:09,408 | INFO | ult-dispatcher-6 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | RoleChangeTask called on device:openflow:2 OFPRole:BECOMEMASTER<br/> 2016-08-27 01:25:09,408 | INFO | ult-dispatcher-6 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:2<br/> 2016-08-27 01:25:09,408 | INFO | ult-dispatcher-6 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Caching flows IDs ...<br/> 2016-08-27 01:25:09,427 | INFO | ult-dispatcher-6 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | ========== Start-up clustering MASTER services for node openflow:2 was SUCCESSFUL ==========<br/> 2016-08-27 01:25:09,622 | INFO | entLoopGroup-5-3 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange called for device:Uri <span class="error">&#91;_value=openflow:2&#93;</span>, role:BECOMEMASTER<br/> 2016-08-27 01:25:09,754 | INFO | entLoopGroup-5-3 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | submitRoleChange onSuccess for device:Uri <span class="error">&#91;_value=openflow:2&#93;</span>, role:BECOMEMASTER<br/> 2016-08-27 01:25:35,738 | WARN | ult-dispatcher-6 | OperationLimiter | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | Failed to acquire operation permit for transaction member-3-datastore-operational-fe-0-chn-3-txn-19<br/> 2016-08-27 01:25:35,738 | WARN | entLoopGroup-5-3 | OperationLimiter | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | Failed to acquire operation permit for transaction member-3-datastore-operational-fe-0-chn-3-txn-19<br/> 2016-08-27 01:26:23,833 | WARN | lt-dispatcher-52 | ReliableDeliverySupervisor | 150 - com.typesafe.akka.slf4j - 2.4.7 | Association with remote system <span class="error">&#91;akka.tcp://opendaylight-cluster-data@10.183.181.51:2550&#93;</span> has failed, address is now gated for <span class="error">&#91;5000&#93;</span> ms. Reason: <span class="error">&#91;Failed to write message to the transport&#93;</span> Caused by: <span class="error">&#91;null&#93;</span><br/> 2016-08-27 01:26:23,834 | ERROR | lt-dispatcher-44 | Remoting | 150 - com.typesafe.akka.slf4j - 2.4.7 | Failed to write message to the transport<br/> akka.remote.EndpointException: Failed to write message to the transport<br/> Caused by: java.lang.NullPointerException<br/> at org.opendaylight.controller.cluster.datastore.modification.MutableCompositeModification.writeExternal(MutableCompositeModification.java:120)<span class="error">&#91;166:org.opendaylight.controller.sal-distributed-datastore:1.4.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.cluster.datastore.messages.BatchedModifications.writeExternal(BatchedModifications.java:78)<span class="error">&#91;166:org.opendaylight.controller.sal-distributed-datastore:1.4.0.SNAPSHOT&#93;</span><br/> at java.io.ObjectOutputStream.writeExternalData(ObjectOutputStream.java:1459)<span class="error">&#91;:1.8.0_102&#93;</span><br/> at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1430)<span class="error">&#91;:1.8.0_102&#93;</span><br/> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)<span class="error">&#91;:1.8.0_102&#93;</span><br/> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)<span class="error">&#91;:1.8.0_102&#93;</span><br/> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply$mcV$sp(Serializer.scala:235)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(Serializer.scala:235)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.serialization.JavaSerializer$$anonfun$toBinary$1.apply(Serializer.scala:235)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at akka.serialization.JavaSerializer.toBinary(Serializer.scala:235)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.remote.serialization.MessageContainerSerializer.serializeSelection(MessageContainerSerializer.scala:45)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.serialization.MessageContainerSerializer.toBinary(MessageContainerSerializer.scala:34)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.MessageSerializer$.serialize(MessageSerializer.scala:37)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(Endpoint.scala:886)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.EndpointWriter$$anonfun$serializeMessage$1.apply(Endpoint.scala:886)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at akka.remote.EndpointWriter.serializeMessage(Endpoint.scala:885)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.EndpointWriter.writeSend(Endpoint.scala:780)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.remote.EndpointWriter$$anonfun$4.applyOrElse(Endpoint.scala:755)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.actor.Actor$class.aroundReceive(Actor.scala:484)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:447)<span class="error">&#91;159:com.typesafe.akka.remote:2.4.7&#93;</span><br/> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.actor.ActorCell.invoke(ActorCell.scala:495)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.dispatch.Mailbox.run(Mailbox.scala:224)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at akka.dispatch.Mailbox.exec(Mailbox.scala:234)<span class="error">&#91;149:com.typesafe.akka.actor:2.4.7&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)<span class="error">&#91;145:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> 2016-08-27 01:26:28,491 | WARN | lt-dispatcher-24 | ClusterCoreDaemon | 150 - com.typesafe.akka.slf4j - 2.4.7 | Cluster Node <span class="error">&#91;akka.tcp://opendaylight-cluster-data@10.183.181.53:2550&#93;</span> - Marking node(s) as UNREACHABLE <span class="error">&#91;Member(address = akka.tcp://opendaylight-cluster-data@10.183.181.51:2550, status = Up)&#93;</span>. Node roles <span class="error">&#91;member-3&#93;</span><br/> 2016-08-27 01:26:28,491 | INFO | lt-dispatcher-36 | ShardManager | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | Received UnreachableMember: memberName MemberName</p> {name=member-1}, address: akka.tcp://opendaylight-cluster-data@10.183.181.51:2550<br/> 2016-08-27 01:26:28,492 | INFO | lt-dispatcher-16 | EntityOwnershipShard | 162 - org.opendaylight.controller.sal-akka-raft - 1.4.0.SNAPSHOT | member-3-shard-entity-ownership-operational: onPeerDown: PeerDown <span class="error">&#91;memberName=member-1, peerId=member-1-shard-entity-ownership-operational&#93;</span><br/> 2016-08-27 01:26:28,492 | INFO | lt-dispatcher-20 | ShardManager | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | Received UnreachableMember: memberName MemberName{name=member-1} <p>, address: akka.tcp://opendaylight-cluster-data@10.183.181.51:2550<br/> 2016-08-27 01:26:28,952 | INFO | lt-dispatcher-21 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Stopping role context cluster services for node ServiceGroupIdentifier</p> {value=openflow:2} <p>2016-08-27 01:26:28,953 | INFO | lt-dispatcher-21 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | SetRole called with input:SetRoleInput [_controllerRole=BECOMESLAVE, _node=NodeRef [_value=KeyedInstanceIdentifier</p> {targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:2]]]]} <p>], augmentation=[]]<br/> 2016-08-27 01:26:28,953 | INFO | lt-dispatcher-21 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Requesting state change to BECOMESLAVE<br/> 2016-08-27 01:26:28,953 | INFO | lt-dispatcher-21 | SalRoleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | RoleChangeTask called on device:openflow:2 OFPRole:BECOMESLAVE<br/> 2016-08-27 01:26:28,953 | INFO | lt-dispatcher-21 | RoleService | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | getGenerationIdFromDevice called for device: openflow:2<br/> 2016-08-27 01:26:28,954 | INFO | lt-dispatcher-21 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Stopping statistics context cluster services for node ServiceGroupIdentifier</p> {value=openflow:2} <p>2016-08-27 01:26:28,954 | INFO | lt-dispatcher-21 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Stopping rpc context cluster services for node ServiceGroupIdentifier</p> {value=openflow:2} <p>2016-08-27 01:26:28,984 | INFO | lt-dispatcher-21 | LifecycleServiceImpl | 180 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Stopping device context cluster services for node ServiceGroupIdentifier</p> {value=openflow:2} <p>2016-08-27 01:26:28,999 | WARN | lt-dispatcher-45 | ClusterSingletonServiceGroupImpl | 131 - org.opendaylight.mdsal.singleton-dom-impl - 2.1.0.SNAPSHOT | Unexpected lost doubleCandidate DOMEntity [type=org.opendaylight.mdsal.AsyncServiceCloseEntityType, id=/(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)entity/entity[</p> {(urn:opendaylight:params:xml:ns:yang:mdsal:core:general-entity?revision=2015-09-30)name=openflow:2} <p>]] leadership. Close service instance openflow:2<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | kka://opendaylight-cluster-data) | 150 - com.typesafe.akka.slf4j - 2.4.7 | Cluster Node <span class="error">&#91;akka.tcp://opendaylight-cluster-data@10.183.181.53:2550&#93;</span> - Marking node(s) as REACHABLE <span class="error">&#91;Member(address = akka.tcp://opendaylight-cluster-data@10.183.181.51:2550, status = Up)&#93;</span>. Node roles <span class="error">&#91;member-3&#93;</span><br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardManager | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | Received ReachableMember: memberName MemberName</p> {name=member-1} <p>, address: akka.tcp://opendaylight-cluster-data@10.183.181.51:2550<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardInformation | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | updatePeerAddress for peer member-1-shard-default-operational with address akka.tcp://opendaylight-cluster-data@10.183.181.51:2550/user/shardmanager-operational/member-1-shard-default-operational<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardInformation | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | updatePeerAddress for peer member-1-shard-car-operational with address akka.tcp://opendaylight-cluster-data@10.183.181.51:2550/user/shardmanager-operational/member-1-shard-car-operational<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardInformation | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | updatePeerAddress for peer member-1-shard-topology-operational with address akka.tcp://opendaylight-cluster-data@10.183.181.51:2550/user/shardmanager-operational/member-1-shard-topology-operational<br/> 2016-08-27 01:26:29,499 | INFO | ult-dispatcher-2 | Shard | 162 - org.opendaylight.controller.sal-akka-raft - 1.4.0.SNAPSHOT | Peer address for peer member-1-shard-default-operational set to akka.tcp://opendaylight-cluster-data@10.183.181.51:2550/user/shardmanager-operational/member-1-shard-default-operational<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardInformation | 166 - org.opendaylight.controller.sal-distributed-datastore - 1.4.0.SNAPSHOT | updatePeerAddress for peer member-1-shard-entity-ownership-operational with address akka.tcp://opendaylight-cluster-data@10.183.181.51:2550/user/shardmanager-operational/member-1-shard-entity-ownership-operational<br/> 2016-08-27 01:26:29,499 | INFO | lt-dispatcher-21 | ShardInformation | 166 - org.opendaylight.controller.sal-distributed-da...</p> <p>One thing I realized is that Singleton does not support restart of the device owner when switches only connect to the owner. Entity owner, inventory and topology API freeze and never leave this state after owner goes down.</p> <p>I think this issue can be closed as I do not see flows failing straight installation (no instance reboot). Instead we should work on: <a href="https://bugs.opendaylight.org/show_bug.cgi?id=6459" class="external-link" target="_blank" rel="nofollow noopener">https://bugs.opendaylight.org/show_bug.cgi?id=6459</a></p> <p>This issue is a mix of:</p> <p><a href="https://bugs.opendaylight.org/show_bug.cgi?id=6459" class="external-link" target="_blank" rel="nofollow noopener">https://bugs.opendaylight.org/show_bug.cgi?id=6459</a><br/> <a href="https://bugs.opendaylight.org/show_bug.cgi?id=6755" class="external-link" target="_blank" rel="nofollow noopener">https://bugs.opendaylight.org/show_bug.cgi?id=6755</a></p> <p>So closing it.</p> Duplicate OPNFLWPLUG-748 Development External issue ID 6552 External issue URL Rank 0|i0334f: