https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/OPNFLWPLUG-802 OpenFlowPlugin <p>ODL version: Beryllium-SR2<br/> Benchmarking Tool: Cbench</p> <p>I conducted a throughput test using cbench on ODL and ONOS. I noticed there's a huge gap between the numbers that I get from these two controllers. (ONOS throughout is almost x10 and latency is almost x2 better than ODL overall)</p> <p>When scaling up the number of switches from 1 to 8 throughout gets better (the maximum observed throughput is with 8 switches). However, throughput drops when increasing the number of switches more than 8.</p> <p>Following above observation I figured ONOS and ODL using the same I/O plugin library (Netty) and even ODL uses a newer version. Using more CPU threads, assign more memory, and tweaking Java heap size does not change the numbers that much (Less than 5%)</p> <p>Considering the fact these two controllers using the same I/O plugin (which is being tested in cbench throughput test), and allocating more resources to ODL does not help to improve the performance, I'm suspecting maybe there's a bug in ODL code.</p> <p>Cheers,<br/> Mohamad</p> <p>Operating System: All<br/> Platform: All</p> OPNFLWPLUG-802

Cbench test - ODL throughput drops by increasing the number of switches

Bug Resolved Done Luis Gomez Mohamad Darianian Tue, 18 Oct 2016 18:09:49 +0000 Mon, 27 Sep 2021 09:01:56 +0000 Mon, 16 Oct 2017 18:10:15 +0000 General 0 2 <p>Attachment Yourkit Java Profiler Error (When Profiling ODL).txt has been added with description: Java profiler error in TP test</p> <p>Attachment Installed features of TP test.txt has been added with description: ODL installed features for the throughput test</p> <p>Attachment Cbench Used Commands.txt has been added with description: Cbench commands</p> <p>Thanks Mohamad, I will take a deeper look at cbench test next week when I am done with longevity and scalability test refactor.</p> <p>This was never updated in the bug but there was a mail thread:</p> <p>--------------------------------------------------------------------------------------</p> <p>I recently did some cbench test with 16 switches in my laptop and ONOS Goldeneye was ~50% faster (60K vs 40K) than ODL Beryllium, however ODL Boron was ~50% faster (~90K) than ONOS.</p> <p>I used this command: cbench -c 192.168.0.1 -t -m 12000 -M 100 -l 5 -s 16 -D 5000</p> <p>Of course other cbench options (more switches, etc..) could throw other numbers, that is why I am asking Mohamad to post the cbench commands.</p> <p>BR/Luis</p> <p>See More from Abhijit Kumbhare</p> <p>​</p> <p>See More from Abhijit Kumbhare</p> <p>I was wondering to ask is there any conclusion and/or report to explain the cbench limitation(s) for ODL performance evaluation? In essence I'm trying to understand regardless of limitation(s) of stress testing tools (cbench, MT-cbench, etc) why ODL throughput is not that good (comparing to other controllers) and it drops drastically with increasing the number of switches?<br/> I would be grateful if you could shed some light on these ambiguities.<br/> ​</p> <p>Cheers,<br/> Mohamad​</p> <p>On Fri, Sep 30, 2016 at 3:00 PM, Luis Gomez &lt;ecelgp@gmail.com&gt; wrote:<br/> Hi Mohamad,</p> <p>We use cbench test in ODL just to detect perf regression, but not to get controller numbers because of cbench multiple limitations. Please check this report using other tools like MT-Cbench and Multinet:</p> <p><a href="https://raw.githubusercontent.com/wiki/intracom-telecom-sdn/nstat/files/ODL_performance_report_v1.2.pdf" class="external-link" target="_blank" rel="nofollow noopener">https://raw.githubusercontent.com/wiki/intracom-telecom-sdn/nstat/files/ODL_performance_report_v1.2.pdf</a></p> <p>Also please let me know if the results of this report match your observation.</p> <p>BR/Luis</p> <p>On Sep 30, 2016, at 9:57 AM, Mohamad Darianian &lt;mohamad.drnn@gmail.com&gt; wrote:</p> <p>Hi Luis,</p> <p>Hope all is well. We (me and my colleague) posted in ODL mailing lists regarding ODL performance issue (more specifically its throughput) a while ago, but, didn't get any helpful feedback. Here (<a href="https://lists.opendaylight.org/pipermail/opendaylight-users/2016-September/000656.html" class="external-link" target="_blank" rel="nofollow noopener">https://lists.opendaylight.org/pipermail/opendaylight-users/2016-September/000656.html</a>)</p> <p>I saw you're very active in the mailing lists and also bugs.opendaylight. Hence, I thought to drop you a line and see if you know the solution to fix this issue or the reason behind ODL's poor performance when increasing number of switches. Also this issue has been highlighted in a few studies before. The version that we are using is Beryllium-SR2.</p> <p>I would greatly appreciate your help. Thank you!</p> <p>Cheers,</p> <p>Mohamad Darianian<br/> Sr. Network/Security Engineer</p> <p>--------------------------------------------------------------------------------------</p> <p>I think we can close this as Boron release showed good numbers.</p> Development External issue ID 6983 External issue URL Rank 0|i033ef: