https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/NETVIRT-1599 netvirt <p>Upgrade Failures:Connectivity check fails after upfrade and ovdb egress flows missing</p> <p>Logs:</p> <p>All the logs from this job</p> <p><a href="https://jenkins.opendaylight.org/releng/job/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-neon/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/job/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-neon/</a></p> NETVIRT-1599

Upgrade Failures:Connectivity check fails after upgrade and ovsdb egress flows missing

Bug Medium Verified Done Srinivas Rachakonda Jaya Priyadarshini Tue, 7 May 2019 07:28:11 +0000 Thu, 4 Jun 2020 03:53:44 +0000 Thu, 4 Jun 2020 03:52:53 +0000 Magnesium 0 1 <p>Hi,</p> <p>Steps to reproduce:</p> <ol> <li>Stop ODL.</li> <li>Disconnect OVS</li> <li>Wipe ODL Local data: data, journal, snapshot</li> <li>Start ODL and get full sync.</li> <li>Set upgrade flag.</li> <li>Connect back OVS to ODL &lt;&lt;&lt; errors seen in ovs-vswitchd.log</li> </ol> <p> </p> <p>Error messages:</p> <p> </p> <p>2020-01-20T13:32:26.913Z|00101|connmgr|INFO|br-int: removed primary controller "tcp:192.168.56.105:6653"</p> <p>2020-01-20T13:38:44.387Z|00102|connmgr|INFO|br-int: added primary controller "tcp:192.168.56.105:6653"</p> <p>2020-01-20T13:38:44.387Z|00103|rconn|INFO|br-int&lt;-&gt;tcp:192.168.56.105:6653: connecting...</p> <p>2020-01-20T13:38:44.480Z|00104|rconn|INFO|br-int&lt;-&gt;tcp:192.168.56.105:6653: connected</p> <p>2020-01-20T13:38:44.757Z|00105|connmgr|INFO|br-int&lt;-&gt;tcp:192.168.56.105:6653: sending OFPBFC_BAD_ID error reply to ONFT_BUNDLE_CONTROL message</p> <p>2020-01-20T13:38:57.418Z|00106|connmgr|INFO|br-int&lt;-&gt;tcp:192.168.56.105:6653: sending OFPBFC_TIMEOUT error reply to ONFT_BUNDLE_CONTROL message</p> <p> </p> <p> </p> <p>Thanks,</p> <p>Srinivas</p> <p>As per the analysis, Code fix is not required for this change only configuration change required at switch end. Please increase bundle-idle-timeout to  minimum of 3600 seconds (60 minutes) on switch, and please verify  and confirm, if bundle commit after upgrading is successful.</p> <p>switch command:</p> <p>sudo ovs-vsctl set Open_vSwitch . other_config:bundle-idle-timeout=3600</p> <p>--Dheena</p> <p>The suite is still failing with the changes made.</p> <p>Below are the steps performed:</p> <p> </p> <ol> <li>Stop ODL.</li> <li>Disconnect OVS</li> <li>Wipe Local data : data, journal, snapshots</li> <li>Start ODL</li> <li>Set Upgrade Flag</li> <li>Connect OVS</li> <li>Get Active Bundle: /restconf/operations/arbitrator-reconcile:get-active-bundle</li> <li>Commit Active bundle: /restconf/operations/arbitrator-reconcile:commit-active-bundle</li> <li>Check for flows on OVS &lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt;&lt; Fail as no flows are seen.</li> </ol> <p> </p> <p>JOB:</p> <p><a href="https://jenkins.opendaylight.org/sandbox/job/srini-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-sodium/12/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/sandbox/job/srini-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-sodium/12/</a></p> <p> </p> <p>ROBOT LOGS:</p> <p><a href="https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/srini-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-sodium/12/robot-plugin/log_full.html.gz" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/srini-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-sodium/12/robot-plugin/log_full.html.gz</a></p> <p> </p> <p>Update the same In JIRA.</p> <p>During upgrade, Bundle messages are being pushed to switch. However, when same group <br/> added with different flows in the switch resulted in OFPGMFC_GROUP_EXIST error and Bundle commit failed due to this. Modified flag &lt;group-add-mod-enabled&gt;<b>true</b>&lt;/group-add-mod-enabled&gt; in \etc\opendaylight\datastore\initial\config\default-openflow-switch-connection-config.xml and issue is resolved. Same steps need to incorporated in script and need to be reverted once test case is successful.</p> <p>The script is fixed with suggestions from design.</p> <p>Passed in Magnesium.</p> <p><a href="https://jenkins.opendaylight.org/releng/view/netvirt-csit/job/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-magnesium/262/" class="external-link" target="_blank" rel="nofollow noopener">https://jenkins.opendaylight.org/releng/view/netvirt-csit/job/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-magnesium/262/</a></p> Development Rank 0|i03npr: