Uploaded image for project: 'genius'
  1. genius
  2. GENIUS-102

New OOM due to more TX leaks seen in the nova-boot scenario (interfacemanager)

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Highest
    • Resolution: Done
    • Carbon, Nitrogen, Oxygen
    • Oxygen-SR3, Oxygen, Fluorine
    • None
    • None

    Description

      Following the (many!) fixes that we did in NETVIRT-985, a new round of testing on the latest stable/carbon using the "nova-boot scenario" has hit an OOM again. A new "trace:transaction" output reveals more TX leaks which we need to plug; see attached.

      The biggest one with 273x open newReadOnlyTransaction likely causing the new OOM this time appears in (1) ovsdb; https://git.opendaylight.org/gerrit/#/c/65567/ seems to not have helped for that one - curious... or we made a mess in downstream porting?!

      Filing this in JIRA project ovsdb due to above; but the attached shows a number of other leaks in (2) openflowplugin and (3) genius.lockmanager & (4) genius.interfacemanager (x90!) which we need to plug as part of this JIRA as well.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. GENIUS-176 Convert all of genius to managed transactions (datastore-constrained)

          • Medium - Has the potential to affect progress.
          • In Progress

          Improvement - An improvement or enhancement to an existing feature or task. NETVIRT-878 CSIT should help to detect possible memory leaks leading to OOM related to non-closed transactions (and tx chains) early

          • Medium - Has the potential to affect progress.
          • In Progress

          Bug - A problem which impairs or prevents the functions of the product. NETVIRT-1384 Umbrella: Numerous new transaction leaks

          • Highest - This problem will block progress.
          • Resolved
          clones

          Bug - A problem which impairs or prevents the functions of the product. OVSDB-435 New OOM due to more TX leaks seen in the nova-boot scenario

          • Highest - This problem will block progress.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. NETVIRT-985 java.lang.OutOfMemoryError: Java heap space

          • Medium - Has the potential to affect progress.
          • Resolved
          # Subject Branch Project Status CR V
          65662,8 GENIUS-102: interface manager: use transaction manager master genius Status: MERGED +2 +1
          66096,2 Fix bad transaction leak in SouthboundUtils stable/carbon genius Status: MERGED +2 +1
          66097,3 Fix possible transaction leak in ItmInternalTunnelDeleteWorker stable/carbon genius Status: MERGED +2 +1
          66100,1 Fix possible transaction leak in ItmInternalTunnelDeleteWorker stable/nitrogen genius Status: MERGED +2 +1
          66152,3 GENIUS-102: interface manager: use transaction manager stable/nitrogen genius Status: MERGED +2 +1
          66153,3 GENIUS-102: interface manager: use transaction manager stable/carbon genius Status: MERGED +2 +1
          70071,4 GENIUS-102: interface manager: use transaction manager stable/oxygen genius Status: MERGED -1 +1

          Activity

            People

              skitt Stephen Kitt
              vorburger Michael Vorburger
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: