https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/GENIUS-102 genius <p>Following the (many!) fixes that we did in <a href="https://jira.opendaylight.org/browse/NETVIRT-985" title="java.lang.OutOfMemoryError: Java heap space" class="issue-link" data-issue-key="NETVIRT-985"><del>NETVIRT-985</del></a>, a new round of testing on the latest stable/carbon using the "nova-boot scenario" has hit an OOM again. A new "trace:transaction" output reveals more TX leaks which we need to plug; see attached.</p> <p>The biggest one with 273x open newReadOnlyTransaction likely causing the new OOM this time appears in (1) ovsdb; <a href="https://git.opendaylight.org/gerrit/#/c/65567/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/65567/</a> seems to not have helped for that one - curious... or we made a mess in downstream porting?!</p> <p>Filing this in JIRA project ovsdb due to above; but the attached shows a number of other leaks in (2) openflowplugin and (3) genius.lockmanager &amp; (4) genius.interfacemanager (x90!) which we need to plug as part of this JIRA as well.</p> GENIUS-102

New OOM due to more TX leaks seen in the nova-boot scenario (interfacemanager)

Bug Highest Resolved Done Stephen Kitt Michael Vorburger Thu, 30 Nov 2017 14:03:41 +0000 Tue, 31 Jul 2018 09:52:47 +0000 Tue, 31 Jul 2018 09:52:47 +0000 Carbon Nitrogen Oxygen Oxygen-SR3 Oxygen Fluorine 0 3 <p><a href="https://git.opendaylight.org/gerrit/65662" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/65662</a> will fix the Genius issues.</p> <p><a href="https://git.opendaylight.org/gerrit/#/c/66096/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/66096/</a> takes care of (4) in <tt>SouthboundUtils.removeTerminationEndPoint()</tt>; that one was due to a completely <b>UNUSED</b> <tt>newWriteOnlyTransaction()</tt>!</p> <p><a href="https://jira.opendaylight.org/secure/ViewProfile.jspa?name=skitt" class="user-hover" rel="skitt">skitt</a> and I in discussion just realized that his WIP <a href="https://git.opendaylight.org/gerrit/#/c/65662/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/65662/</a> will address other leaks in genius.interfacemanager including e.g. the 35x newWriteOnlyTransaction in OvsInterfaceStateAddHelper, so he'll wrap that one up for master, and cherry-pick and work out conflicts for carbon and nitrogen.</p> <p><a href="https://git.opendaylight.org/gerrit/#/q/topic:OVSDB-435" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/q/topic:OVSDB-435</a> will have all changes re. this new OOM accross ovsdb, genius and openflowplugin.</p> <p>Attachments show a small (x4) leak OvsInterfaceStateRemoveHelper which does not appear in <a href="https://git.opendaylight.org/gerrit/#/c/65662/" class="external-link" target="_blank" rel="nofollow noopener">c/65662</a>, because it is removed in master; perhaps that can be look into as part of the <a href="https://git.opendaylight.org/gerrit/#/c/65662/" class="external-link" target="_blank" rel="nofollow noopener">c/65662</a> back-ports?</p> <p>Totally separate is a suspected (small) leak in ITM which was fixed in master only; that will now be in nitrogen &lt;<a href="https://git.opendaylight.org/gerrit/#/c/66100" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/66100</a>&gt; and carbon &lt;<a href="https://git.opendaylight.org/gerrit/#/c/66097" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/66097</a>&gt; as well.</p> <p>This is considered Done and complete - until we find the next ones (which <a href="https://jira.opendaylight.org/browse/NETVIRT-878" title="CSIT should help to detect possible memory leaks leading to OOM related to non-closed transactions (and tx chains) early" class="issue-link" data-issue-key="NETVIRT-878">NETVIRT-878</a> should help prevent).</p> <p>re-opening this because <a href="https://git.opendaylight.org/gerrit/#/c/70071/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/70071/</a> still needs to go into Oxygen SR3... and link to <a href="https://jira.opendaylight.org/browse/NETVIRT-1384" title="Umbrella: Numerous new transaction leaks" class="issue-link" data-issue-key="NETVIRT-1384"><del>NETVIRT-1384</del></a>.</p> <p><a href="https://jira.opendaylight.org/secure/ViewProfile.jspa?name=vorburger" class="user-hover" rel="vorburger">vorburger</a>, <a href="https://jira.opendaylight.org/secure/ViewProfile.jspa?name=skitt" class="user-hover" rel="skitt">skitt</a> Thanks for tracking this to completion. <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>also <a href="https://git.opendaylight.org/gerrit/#/c/70072/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/70072/</a> - we'll CSIT both of these together, then (hopefully) merge.</p> <p>now all merged</p> Blocks GENIUS-176 NETVIRT-878 NETVIRT-1384 NETVIRT-985 Cloners OVSDB-435 Development Rank 0|i038m7: