Uploaded image for project: 'controller'
  1. controller
  2. CONTROLLER-1954

Lower akka-segmented-journal memory footprint

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • High
    • Resolution: Done
    • None
    • 4.0.0, 3.0.8
    • clustering

    Description

      Heap analysis shows that io.atomix.storage.journal.FileChannelJournalSegmentWriter ends up allocating HeapByteBuffers with twice the size of maximum entry size. In our default full install, this means ODL ends up eating 306MiB of heap off the bat.

      We also have a problem where the maximum entry size is limited, whereas we can have rather huge entries stored in the journal.

      Introduce a revised journal version, which will seamlessly migrate when attached, so that we perform entry chunking – i.e. lower the maximum entry to something around 128KiB and split larger Akka journal entries into multiple file entries.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            rovarga Robert Varga
            rovarga Robert Varga
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: