https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/NETVIRT-288 netvirt <p>when we reload the vm (meaning it was created in the past but was removed),<br/> it (the vm) didn't get replay from the dhcp due to old rules thus not getting ip.</p> <p>you can look at the file attached below in table 220 there are conflicting rules one of them is old (you can see by the duration), both rules match on the reg "reg6=0x2200" but the action is different. because the old rule has higher priority the packet continue to the wrong port.</p> <p>Operating System: All<br/> Platform: All</p> NETVIRT-288

OVS egress table (220) contains stale rules that send the packet to the wrong port

Bug Resolved Done Faseela K Tal Rosenzweig Tue, 22 Nov 2016 14:11:33 +0000 Thu, 3 May 2018 14:37:00 +0000 Mon, 12 Dec 2016 06:46:15 +0000 Carbon General 0 4 <p>Attachment oldflows.txt has been added with description: flows rules on each table</p> <p>reducing severity pending explanation of OpenStack scenario done and what's not working.. I don't see the problem you mentioned in the attached flow dump</p> <p>openstack scenario - <br/> create vm, delete vm, recreate same vm, vm dosent get dhcp replay (no ip).</p> <p>the problem - <br/> if the vm has no ip it cannot connect to the net.<br/> preventing full configuration for the vm thus the vm is stuck</p> <p>Attachment karaf.rar has been added with description: Karaf log</p> <p>It seems that the old flow reg6=0x2200 wasn't deleted when the VM was deleted, and judging by the reg value and actions I believe this was a port without security enabled on it (resulting in priority=7).</p> <p>Then a new port was assigned lport 0x2200, but this port has security enabled - so even though the new rules are inserted properly, the reg6=0x2200 flow now has priority=6, which is lower than the zombie flow.</p> <p>This is the end result of the flows:<br/> cookie=0x8000007, duration=83219.368s, table=220, n_packets=913, n_bytes=90732, priority=7,reg6=0x2200 actions=output:64<br/> cookie=0x8000007, duration=11452.879s, table=220, n_packets=0, n_bytes=0, priority=7,reg6=0xe0002200 actions=output:145<br/> cookie=0x6900000, duration=11452.879s, table=220, n_packets=0, n_bytes=0, priority=6,reg6=0x2200 actions=load:0xe0002200-&gt;NXM_NX_REG6[],write_metadata:0xe000220000000000/0xfffffffffffffffe,goto_table:251</p> <p>@Alon,</p> <p>As you stated it should be a port without port security and the flow deletion failed for it and thus having two conflicting flows. This needs to be fixed in the service handling the ouput flow may be in genius?</p> <p>Hi Tal,<br/> Is it possible to check if table 220 flows are getting deleted upon deletion of VM?<br/> Thanks,<br/> Faseela</p> <p>(In reply to Faseela K from comment #6)<br/> &gt; Hi Tal,<br/> &gt; Is it possible to check if table 220 flows are getting deleted upon<br/> &gt; deletion of VM?<br/> &gt; Thanks,<br/> &gt; Faseela</p> <p>Hi Faseela,<br/> usually the flow is deleted upon vm deletion,<br/> but this specific time it seems the flow in table 220 wasn't.</p> <p>Hi Tal,<br/> Is it possible to get the interface uuid for the problematic interface which output to port 251, or atleast the tap port name?</p> <p>unbindService() should be called on interface-config DCN.</p> <p>@Alon,</p> <p>Thhe unbind service in interface-config is for the issue we see in the CSIT. This is due to a different reason.</p> <p>(In reply to Aswin Suryanarayanan from comment #10)<br/> &gt; @Alon,<br/> &gt; <br/> &gt; Thhe unbind service in interface-config is for the issue we see in the<br/> &gt; CSIT. This is due to a different reason.</p> <p>Ahh ok my bad, thanks, assigning to Faseela until we figure out more.</p> <p>Hi Tal,<br/> I hope you are on the latest master code, but still to be sure, please see if you have a distribution where the below patch is merged :</p> <p><a href="https://git.opendaylight.org/gerrit/#/c/47674/2" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/47674/2</a></p> <p>From the karaf logs, I don't see the relevant logs for port 145, i see only delete calls, but no add calls for the corresponding problematic interface for table 220.</p> <p>***<b>remove 220 entry for output : port 64</b>********<br/> 2016-11-22 09:57:12,344 | INFO | ool-49-thread-34 | FlowBasedServicesConfigListener | 350 - org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service Binding Entry removed for Interface: 24962fd1-c40e-4086-86a6-9e71c34e2978, Data: BoundServices{getServiceName=default.24962fd1-c40e-4086-86a6-9e71c34e2978, getServicePriority=7, getServiceType=class org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735, getFlowPriority=7, getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=ApplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=OutputAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=64&#93;</span>, augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}</p> <p>****<b>remove 220 entry for port 145</b>***********</p> <p>2016-11-22 16:16:43,297 | INFO | ool-49-thread-36 | FlowBasedServicesConfigListener | 350 - org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service Binding Entry removed for Interface: 9e42db80-4ba5-4f10-92ce-de92c14e8d13, Data: BoundServices{getServiceName=default.9e42db80-4ba5-4f10-92ce-de92c14e8d13, getServicePriority=7, getServiceType=class org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735, getFlowPriority=7, getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=ApplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=OutputAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=145&#93;</span>, augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}</p> <p>Thanks,<br/> Faseela</p> <p>Attachment karaf.log.rar has been added with description: karaf.log.1</p> <p>(In reply to Faseela K from comment #12)<br/> &gt; Hi Tal,<br/> &gt; I hope you are on the latest master code, but still to be sure, please see<br/> &gt; if you have a distribution where the below patch is merged :<br/> &gt; <br/> &gt; <a href="https://git.opendaylight.org/gerrit/#/c/47674/2" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/47674/2</a><br/> &gt; <br/> &gt; From the karaf logs, I don't see the relevant logs for port 145, i see only<br/> &gt; delete calls, but no add calls for the corresponding problematic interface<br/> &gt; for table 220.<br/> &gt; <br/> &gt; ***<b>remove 220 entry for output : port 64</b>********<br/> &gt; 2016-11-22 09:57:12,344 | INFO | ool-49-thread-34 |<br/> &gt; FlowBasedServicesConfigListener | 350 -<br/> &gt; org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service<br/> &gt; Binding Entry removed for Interface: 24962fd1-c40e-4086-86a6-9e71c34e2978,<br/> &gt; Data:<br/> &gt; BoundServices{getServiceName=default.24962fd1-c40e-4086-86a6-9e71c34e2978,<br/> &gt; getServicePriority=7, getServiceType=class<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735,<br/> &gt; getFlowPriority=7,<br/> &gt; getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=A<br/> &gt; pplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=Outp<br/> &gt; utAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=64&#93;</span>,<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}],<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}<br/> &gt; <br/> &gt; ****<b>remove 220 entry for port 145</b>***********<br/> &gt; <br/> &gt; 2016-11-22 16:16:43,297 | INFO | ool-49-thread-36 |<br/> &gt; FlowBasedServicesConfigListener | 350 -<br/> &gt; org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service<br/> &gt; Binding Entry removed for Interface: 9e42db80-4ba5-4f10-92ce-de92c14e8d13,<br/> &gt; Data:<br/> &gt; BoundServices{getServiceName=default.9e42db80-4ba5-4f10-92ce-de92c14e8d13,<br/> &gt; getServicePriority=7, getServiceType=class<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735,<br/> &gt; getFlowPriority=7,<br/> &gt; getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=A<br/> &gt; pplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=Outp<br/> &gt; utAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=145&#93;</span>,<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}],<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}<br/> &gt; <br/> &gt; <br/> &gt; Thanks,<br/> &gt; Faseela</p> <p>Hi Faseela,<br/> i attached the log karaf.log.1 there you can see the Service Binding Entry created for Interface 145.</p> <p>Hi Tal,<br/> could you please confirm if you are on the latest code?<br/> If so could you please reproduce the issue with TRACE logs enabled for org.opendaylight.genius.interfacemanager and attach those logs?<br/> Thanks,<br/> Faseela</p> <p>Faseela, it seems this was with code from a few weeks back.<br/> Tal, could you try to reproduce with latest code and turn on TRACE logs for the interfacemanager?</p> <p>Thanks</p> <p>(In reply to Faseela K from comment #12)<br/> &gt; Hi Tal,<br/> &gt; I hope you are on the latest master code, but still to be sure, please see<br/> &gt; if you have a distribution where the below patch is merged :<br/> &gt; <br/> &gt; <a href="https://git.opendaylight.org/gerrit/#/c/47674/2" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/47674/2</a><br/> &gt; <br/> &gt; From the karaf logs, I don't see the relevant logs for port 145, i see only<br/> &gt; delete calls, but no add calls for the corresponding problematic interface<br/> &gt; for table 220.<br/> &gt; <br/> &gt; ***<b>remove 220 entry for output : port 64</b>********<br/> &gt; 2016-11-22 09:57:12,344 | INFO | ool-49-thread-34 |<br/> &gt; FlowBasedServicesConfigListener | 350 -<br/> &gt; org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service<br/> &gt; Binding Entry removed for Interface: 24962fd1-c40e-4086-86a6-9e71c34e2978,<br/> &gt; Data:<br/> &gt; BoundServices{getServiceName=default.24962fd1-c40e-4086-86a6-9e71c34e2978,<br/> &gt; getServicePriority=7, getServiceType=class<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735,<br/> &gt; getFlowPriority=7,<br/> &gt; getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=A<br/> &gt; pplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=Outp<br/> &gt; utAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=64&#93;</span>,<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}],<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}<br/> &gt; <br/> &gt; ****<b>remove 220 entry for port 145</b>***********<br/> &gt; <br/> &gt; 2016-11-22 16:16:43,297 | INFO | ool-49-thread-36 |<br/> &gt; FlowBasedServicesConfigListener | 350 -<br/> &gt; org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service<br/> &gt; Binding Entry removed for Interface: 9e42db80-4ba5-4f10-92ce-de92c14e8d13,<br/> &gt; Data:<br/> &gt; BoundServices{getServiceName=default.9e42db80-4ba5-4f10-92ce-de92c14e8d13,<br/> &gt; getServicePriority=7, getServiceType=class<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface<br/> &gt; org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.<br/> &gt; servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735,<br/> &gt; getFlowPriority=7,<br/> &gt; getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=A<br/> &gt; pplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=Outp<br/> &gt; utAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=145&#93;</span>,<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}],<br/> &gt; augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}<br/> &gt; <br/> &gt; <br/> &gt; Thanks,<br/> &gt; Faseela</p> <p>Hi Faseela,</p> <p>The missing port creation is in karaf.log.1<br/> Copied the removal of port 64 and creation of port 145 for convenience.<br/> This was supposed to remove the output:64 flow from table 220, right? </p> <p>****<b>remove 220 entry for port 64</b>***********<br/> 2016-11-22 09:57:12,344 | INFO | ool-49-thread-34 | FlowBasedServicesConfigListener | 350 - org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service Binding Entry removed for Interface: 24962fd1-c40e-4086-86a6-9e71c34e2978, Data: BoundServices{getServiceName=default.24962fd1-c40e-4086-86a6-9e71c34e2978, getServicePriority=7, getServiceType=class org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735, getFlowPriority=7, getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=ApplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=OutputAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=64&#93;</span>, augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}</p> <p>****<b>create 220 entry for port 145</b>***********<br/> 2016-11-22 12:03:54,661 | INFO | ool-49-thread-36 | FlowBasedServicesConfigListener | 350 - org.opendaylight.genius.interfacemanager-impl - 0.1.2.SNAPSHOT | Service Binding Entry created for Interface: 9e42db80-4ba5-4f10-92ce-de92c14e8d13, Data: BoundServices{getServiceName=default.9e42db80-4ba5-4f10-92ce-de92c14e8d13, getServicePriority=7, getServiceType=class org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.ServiceTypeFlowBased, augmentations={interface org.opendaylight.yang.gen.v1.urn.opendaylight.genius.interfacemanager.servicebinding.rev160406.StypeOpenflow=StypeOpenflow{getFlowCookie=134217735, getFlowPriority=7, getInstruction=[Instruction{getInstruction=ApplyActionsCase{getApplyActions=ApplyActions{getAction=[Action{getAction=OutputActionCase{getOutputAction=OutputAction{getMaxLength=0, getOutputNodeConnector=Uri <span class="error">&#91;_value=145&#93;</span>, augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}], augmentations={}}, augmentations={}}, getOrder=0, augmentations={}}]}}}</p> <p>Resolved by Faseela here: <a href="https://git.opendaylight.org/gerrit/#/c/48922/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/48922/</a></p> Duplicate GENIUS-37 NETVIRT-287 Development External issue ID 7220 External issue URL Rank 0|i01qvj: