[YANGTOOLS-779] OOM expection while parsing 27.1 MB of YANG with 2GO RAM Created: 30/May/17  Updated: 10/Apr/22  Resolved: 05/Jun/17

Status: Resolved
Project: yangtools
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug
Reporter: Alexis de Talhouët Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All

Attachments: Text File deadlock.txt    
Issue Links:
Duplicate
duplicates YANGTOOLS-694 Eliminate duplicate DescriptionEffect... Resolved
External issue ID: 8569

 Description   

Mount a vMX with Junos version 17.3 ends up with OOM expection.
Attached a deadlock revealed by Java Yourkit Profiler.

Link to the thread dump: https://drive.google.com/open?id=0B6yJWkVd2RfUdW4xZTJfR3hOUkk
Link to the schema being parsed: https://drive.google.com/open?id=0B6yJWkVd2RfUdW4xZTJfR3hOUkk
Link to the logs at TRACE level (but for NETCONF): https://drive.google.com/open?id=0B6yJWkVd2RfUdW4xZTJfR3hOUkk

Increasing the memory of ODL to 8GO fixes this issues.

Opening this ticket in case it worth being looked at this improve Yangtools parsing mechanism so it handles better heavy load.

 Comments   
Comment by Alexis de Talhouët [ 30/May/17 ]

Attachment deadlock.txt has been added with description: deadlock

Comment by Peter Kajsa [ 31/May/17 ]

Some issues have been resolved in scope of YANGTOOLS-660. We need to perform further analysis and optimization.

Comment by Alexis de Talhouët [ 31/May/17 ]

This is occurring in stable/carbon code (of NETCONF: commit 3521a2de8699c36ea4d92402a622b28d25e4a8a5

Peter, I believe the code I run is incorporating the fixes of YANGTOOLS-660 as this was a fresh build from yesterday.

Comment by Robert Varga [ 05/Jun/17 ]

Looking at the allocation failure path (in attachment) and the memory dumps provided we are failing to allocate more SubstatementContexts.

YANGTOOLS-694 already describes the problem and has a very rough outline of the fix.

In the mean time https://git.opendaylight.org/gerrit/58067 should help a tiny bit, but not nearly enough.

Generated at Wed Feb 07 20:54:17 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.