[OPNFLWPLUG-761] In a 3 node cluster fail over scenario, flows were not installed in compute node. Created: 31/Aug/16  Updated: 27/Sep/21  Resolved: 23/Sep/16

Status: Resolved
Project: OpenFlowPlugin
Component/s: General
Affects Version/s: None
Fix Version/s: None

Type: Bug
Reporter: Prashanth Jakkam Assignee: Unassigned
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All

Attachments: Zip Archive odl1.zip     Zip Archive odl2.zip     Zip Archive odl3.zip     Zip Archive org.opendaylight.controller Category=Shards,name=member-3-shard-inventory-operational,type=DistributedOperationalDatastore.zip    
External issue ID: 6596

 Description   

Steps to reproduce in a 3 node cluster:

Used stable/bo.

Used ODL 3 node (feature: odl-ovsdb-openstack)

3 Openstack nodes, 1 control and 2 compute nodes

1.create a network1.

2.create a network 2

3.Down ODL 1.

4.Create VM instance1 on compute 1.

Flows were not added to compute 1 but flows were installed in control and compute 2 nodes.

This issue is not consistently reproducible.

 Comments   
Comment by Prashanth Jakkam [ 31/Aug/16 ]

Attachment odl1.zip has been added with description: karaf logs for odl1.

Comment by Prashanth Jakkam [ 31/Aug/16 ]

Attachment odl2.zip has been added with description: Karaf logs for odl2

Comment by Prashanth Jakkam [ 31/Aug/16 ]

Attachment odl3.zip has been added with description: karaf logs for odl3

Comment by Prashanth Jakkam [ 01/Sep/16 ]

Used following distribution when we faced this issue

https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/distribution-karaf/0.5.0-SNAPSHOT/distribution-karaf-0.5.0-20160825.061228-4604.tar.gz

Comment by Prashanth Jakkam [ 01/Sep/16 ]

Attachment org.opendaylight.controller Category=Shards,name=member-3-shard-inventory-operational,type=DistributedOperationalDatastore.zip has been added with description: Entity-owner info and shard leader information for network-topology,inventory-topology is attached.

Comment by Prashanth Jakkam [ 01/Sep/16 ]

Have observed following messages in karaf log, it looks like "No queue present" and "xid" value was not available and flows were not installed in compute node.

2016-08-29 22:28:29,103 | ERROR | on-dispatcher-52 | OutboundQueueProviderImpl | 297 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | No queue present, failing request
2016-08-29 22:28:29,103 | WARN | on-dispatcher-52 | RpcContextImpl | 297 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | Xid cannot be reserved for new RequestContext, node:openflow:211928108265611
2016-08-29 22:28:29,105 | ERROR | on-dispatcher-52 | SalFlowServiceImpl | 297 - org.opendaylight.openflowplugin.impl - 0.3.0.SNAPSHOT | flow add failed for flow=AddFlowInput [_flowName=UcastOut_1065_2_fa:16:3e:d6:3b:4c, _flowRef=FlowRef [_value=KeyedInstanceIdentifier

{targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.tables.table.Flow, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:211928108265611]]], org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.FlowCapableNode, org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.tables.Table[key=TableKey [_id=110]], org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.tables.table.Flow[key=FlowKey [_id=Uri [_value=UcastOut_1065_2_fa:16:3e:d6:3b:4c]]]]}

], _flowTable=FlowTableRef [_value=KeyedInstanceIdentifier

{targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.tables.Table, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:211928108265611]]], org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.FlowCapableNode, org.opendaylight.yang.gen.v1.urn.opendaylight.flow.inventory.rev130819.tables.Table[key=TableKey [_id=110]]]}

], _hardTimeout=0, _idleTimeout=0, _instructions=Instructions{getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=ApplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=OutputAction{getOutputNodeConnector=Uri [_value=openflow:211928108265611:2], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, _match=Match{getEthernetMatch=EthernetMatch{getEthernetDestination=EthernetDestination{getAddress=MacAddress [_value=fa:16:3e:d6:3b:4c], augmentations={}}, augmentations={}}, getTunnel=Tunnel{getTunnelId=1065, augmentations={}}, augmentations={}}, _node=NodeRef [_value=KeyedInstanceIdentifier

{targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:211928108265611]]]]}

], _tableId=110, _transactionUri=Uri [_value=DOM-116], _barrier=false, _strict=true, augmentation=[]], errors=Request quota exceeded

Comment by Andrej Leitner [ 22/Sep/16 ]

Hi Prashanth,
more issues were fixed during last weeks is this one still actual?

Comment by Prashanth Jakkam [ 23/Sep/16 ]

Issue was not reproducible and was also not seen in CSIT. Closing the bug.

Generated at Wed Feb 07 20:33:19 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.