Uploaded image for project: 'controller'
  1. controller
  2. CONTROLLER-1954

Lower akka-segmented-journal memory footprint

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Done
    • Icon: High High
    • 4.0.0, 3.0.8
    • None
    • clustering

      Heap analysis shows that io.atomix.storage.journal.FileChannelJournalSegmentWriter ends up allocating HeapByteBuffers with twice the size of maximum entry size. In our default full install, this means ODL ends up eating 306MiB of heap off the bat.

      We also have a problem where the maximum entry size is limited, whereas we can have rather huge entries stored in the journal.

      Introduce a revised journal version, which will seamlessly migrate when attached, so that we perform entry chunking – i.e. lower the maximum entry to something around 128KiB and split larger Akka journal entries into multiple file entries.

            rovarga Robert Varga
            rovarga Robert Varga
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: