https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/NETVIRT-531 netvirt <p>L3 connectivity suite</p> <p>all instances received their dhcp lease</p> <p>the test cases to ping from the control nodes dhcp namespace to each<br/> instance is failing. However, the connectivity (ping) between instances<br/> across compute nodes is fine. My first suspect was to check the flow <br/> rules on the control node, but I didn't get very far (no time). here<br/> is a direct link to those rules:</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/212/archives/log.html.gz#s1-s1-s2-t9-k3-k1-k1-k1-k16-k4" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/212/archives/log.html.gz#s1-s1-s2-t9-k3-k1-k1-k1-k16-k4</a></p> <p>Operating System: All<br/> Platform: All</p> NETVIRT-531

CSIT Sporadic failures - no connectivity from control node to instances

Bug Resolved Cannot Reproduce Alon Kochba Jamo Luhrsen Tue, 14 Mar 2017 21:12:23 +0000 Thu, 6 Jul 2017 01:07:12 +0000 Thu, 6 Jul 2017 01:07:12 +0000 Carbon General 0 3 <p>L2 connectivity suite</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-transparent-boron/508/archives/log.html.gz#s1-s1-s1-t12" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-transparent-boron/508/archives/log.html.gz#s1-s1-s1-t12</a></p> <p>Seems to be a duplicate of <a href="https://jira.opendaylight.org/browse/NETVIRT-551" title="CSIT Sporadic failures - First port on compute (DHCP Server MAC) has ELAN drop rule instead of output to tunnel" class="issue-link" data-issue-key="NETVIRT-551"><del>NETVIRT-551</del></a> - L2 connectivity issues are cause by a drop rule in table=51.</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-learn-boron/240/archives/log.html.gz#s1-s1-s1-t12" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-learn-boron/240/archives/log.html.gz#s1-s1-s1-t12</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-transparent-carbon/451/archives/log.html.gz#s1-s1-s2-t13" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-transparent-carbon/451/archives/log.html.gz#s1-s1-s2-t13</a></p> <p>I don't think this is the table=19 or table=51,drop issue, but connectivity from<br/> all instances in network1 could not reach network2. reverse connectivity was fine<br/> as was all traffic to both network1 and network2 from network3. The traffic is<br/> sourced from the control node dhcp namespace.</p> <p>(In reply to Jamo Luhrsen from comment #4)<br/> &gt; <a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-</a><br/> &gt; newton-nodl-v2-upstream-transparent-carbon/451/archives/log.html.gz#s1-s1-s2-<br/> &gt; t13<br/> &gt; <br/> &gt; I don't think this is the table=19 or table=51,drop issue, but connectivity<br/> &gt; from<br/> &gt; all instances in network1 could not reach network2. reverse connectivity was<br/> &gt; fine<br/> &gt; as was all traffic to both network1 and network2 from network3. The traffic<br/> &gt; is<br/> &gt; sourced from the control node dhcp namespace.</p> <p>similar failures:</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-boron/311/archives/log.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-boron/311/archives/log.html.gz</a></p> <p>(In reply to Jamo Luhrsen from comment #5)<br/> &gt; (In reply to Jamo Luhrsen from comment #4)<br/> &gt; &gt; <a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-</a><br/> &gt; &gt; newton-nodl-v2-upstream-transparent-carbon/451/archives/log.html.gz#s1-s1-s2-<br/> &gt; &gt; t13<br/> &gt; &gt; <br/> &gt; &gt; I don't think this is the table=19 or table=51,drop issue, but connectivity<br/> &gt; &gt; from<br/> &gt; &gt; all instances in network1 could not reach network2. reverse connectivity was<br/> &gt; &gt; fine<br/> &gt; &gt; as was all traffic to both network1 and network2 from network3. The traffic<br/> &gt; &gt; is<br/> &gt; &gt; sourced from the control node dhcp namespace.<br/> &gt; </p> <p>similar failures:</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-boron/311/archives/log.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-boron/311/archives/log.html.gz</a></p> <p>and</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/371/archives/log.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/371/archives/log.html.gz</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-boron/373/archives/log.html.gz#s1-s1-s1-t13" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-boron/373/archives/log.html.gz#s1-s1-s1-t13</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-transparent-carbon/477/archives/log.html.gz#s1-s1-s3" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-transparent-carbon/477/archives/log.html.gz#s1-s1-s3</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/380/archives/log.html.gz#s1-s1-s2-t18" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-boron/380/archives/log.html.gz#s1-s1-s2-t18</a></p> <p>(In reply to Jamo Luhrsen from comment #8)<br/> &gt; <a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-</a><br/> &gt; mitaka-upstream-transparent-carbon/477/archives/log.html.gz#s1-s1-s3</p> <p>I tried to compare the compute nodes br-int flows in this failed run,<br/> to a passing run and I noticed some things missing that may or may<br/> not help with debugging.</p> <p>I don't see a table 21 rule to catch the FIP that failed to goto table 22<br/> which punts to controller (if my understanding is correct)</p> <p>attached is the snippet of karaf log from when the FIP was created<br/> until the end of the first failing test case in the robot log above.<br/> hopefully it helps</p> <p>Attachment odl1_karaf.log has been added with description: log that is referenced in comment 10</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-carbon/358/archives/log.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-carbon/358/archives/log.html.gz</a></p> <p>(In reply to Jamo Luhrsen from comment #12)<br/> &gt; <a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-</a><br/> &gt; newton-upstream-stateful-carbon/358/archives/log.html.gz</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-learn-boron/269/archives/log.html.gz#s1-s1-s1-t18" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-learn-boron/269/archives/log.html.gz#s1-s1-s1-t18</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-transparent-boron/514/archives/log.html.gz#s1-s1-s2-t22" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-transparent-boron/514/archives/log.html.gz#s1-s1-s2-t22</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/8/archives/log.html.gz#s1-s4-t9" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/8/archives/log.html.gz#s1-s4-t9</a></p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-carbon/487/archives/log.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-carbon/487/archives/log.html.gz</a></p> Development External issue ID 7982 External issue URL Rank 0|i01sdj: Status Whiteboard csit:sporadic_failures