https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/CONTROLLER-1840 controller <p>Sometimes it's seen that the python script to add the cars has trouble<br/> communicating and fails with some python exceptions. Other times the <br/> failures are manifested in the robot rest clients but we notice that the<br/> python script runs to a clean completion.</p> <p>We want to know if the python script ever shows a failure when using<br/> the tell-based protocol.</p> CONTROLLER-1840

check if python script fails in tell based

Sub-task CONTROLLER-1838 Medium Open Unresolved Unassigned Jamo Luhrsen pick-next pt Fri, 22 Jun 2018 17:15:13 +0000 Mon, 22 Jan 2024 10:04:15 +0000 7.0.12 8.0.5 9.0.1 clustering 0 3 <p>yes, the python script does fail in tell based config. The failure is because /restconf (what it being used to add<br/> cars) stops responding for some period of time.</p> <p> </p> <p>script output looks like:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> 2018-06-25 23:47:00,983 INFO: Add 10000 car(s) to 10.30.170.10:8181 (1 per request) 2018-06-25 23:47:22,807 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,810 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,813 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,823 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,831 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,836 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,837 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,843 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,845 ERROR: No response from 10.30.170.10 2018-06-25 23:47:22,847 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,828 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,828 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,829 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,837 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,847 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,857 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,863 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,864 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,864 ERROR: No response from 10.30.170.10 2018-06-25 23:47:37,865 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,853 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,858 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,859 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,863 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,866 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,875 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,888 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,889 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,891 ERROR: No response from 10.30.170.10 2018-06-25 23:47:52,891 ERROR: No response from 10.30.170.10 2018-06-25 23:48:49,774 INFO: Response code(s) got per number of requests: {99: 3, 204: 998} 2018-06-25 23:48:49,783 INFO: Response code(s) got per number of requests: {99: 3, 204: 998} 2018-06-25 23:48:49,793 INFO: Response code(s) got per number of requests: {99: 3, 204: 994} 2018-06-25 23:48:49,816 INFO: Response code(s) got per number of requests: {99: 3, 204: 998} 2018-06-25 23:48:49,817 INFO: Response code(s) got per number of requests: {99: 3, 204: 998} 2018-06-25 23:48:49,818 INFO: Response code(s) got per number of requests: {99: 3, 204: 998} 2018-06-25 23:48:49,821 INFO: Response code(s) got per number of requests: {99: 3, 204: 996} 2018-06-25 23:48:49,821 INFO: Response code(s) got per number of requests: {99: 3, 204: 1012} 2018-06-25 23:48:49,822 INFO: Response code(s) got per number of requests: {99: 3, 204: 982} 2018-06-25 23:48:49,822 INFO: Response code(s) got per number of requests: {99: 3, 204: 996} 2018-06-25 23:48:49,826 ERROR: Problems during cars' configuration appeared: {99: 30, 204: 9970} Traceback (most recent call last): File <span class="code-quote">"cluster_rest_script.py"</span>, line 750, in &lt;module&gt; args.itemcount, auth, args.ipr) File <span class="code-quote">"cluster_rest_script.py"</span>, line 601, in add_car_with_retries raise Exception(<span class="code-quote">"Problems during cars' configuration appeared: "</span> + repr(res)) Exception: Problems during cars' configuration appeared: {99: 30, 204: 9970} </pre> </div></div> <p>so, it seems like maybe there was a ~30s period without a response</p> <p>btw, here are the few log lines that appear in the node being used as the endpoint<br/> during this period:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> 2018-06-25T23:47:20,057 | INFO | pipe-log:log <span class="code-quote">"ROBOT MESSAGE: Starting test controller-<span class="code-keyword">rest</span>-clust-cars-perf.txt.Puts During Isolation.Isolate_Current_Car_Leader"</span> | core | 112 - org.apache.karaf.log.core - 4.1.5 | ROBOT MESSAGE: Starting test controller-<span class="code-keyword">rest</span>-clust-cars-perf.txt.Puts During Isolation.Verify_Cars_Configured 2018-06-25T23:47:32,146 | INFO | opendaylight-cluster-data-akka.actor.<span class="code-keyword">default</span>-dispatcher-20 | Cluster(akka:<span class="code-comment">//opendaylight-cluster-data) | 41 - com.typesafe.akka.slf4j - 2.5.11 | Cluster Node [akka.tcp://opendaylight-cluster-data@10.30.170.10:2550] - Leader can currently not perform its duties, reachability status: [akka.tcp://opendaylight-cluster-data@10.30.170.10:2550 -&gt; akka.tcp://opendaylight-cluster-data@10.30.170.5:2550: Unreachable [Unreachable] (1), akka.tcp://opendaylight-cluster-data@10.30.170.17:2550 -&gt; akka.tcp://opendaylight-cluster-data@10.30.170.5:2550: Unreachable [Unreachable] (1)], member status: [akka.tcp://opendaylight-cluster-data@10.30.170.10:2550 Up seen=<span class="code-keyword">true</span>, akka.tcp://opendaylight-cluster-data@10.30.170.17:2550 Up seen=<span class="code-keyword">true</span>, akka.tcp://opendaylight-cluster-data@10.30.170.5:2550 Up seen=<span class="code-keyword">false</span>] </span>2018-06-25T23:48:00,207 | INFO | opendaylight-cluster-data-akka.actor.<span class="code-keyword">default</span>-dispatcher-38 | ClientActorBehavior | 196 - org.opendaylight.controller.cds-access-client - 1.4.0.SNAPSHOT | member-2-frontend-datastore-config: connection ConnectedClientConnection{client=ClientIdentifier{frontend=member-2-frontend-datastore-config, generation=0}, cookie=0, backend=ShardBackendInfo{actor=Actor[akka.tcp:<span class="code-comment">//opendaylight-cluster-data@10.30.170.5:2550/user/shardmanager-config/member-1-shard-<span class="code-keyword">default</span>-config#14171797], sessionId=0, version=BORON, maxMessages=1000, cookie=0, shard=<span class="code-keyword">default</span>, dataTree=absent}} reconnecting as </span> </pre> </div></div> <p><a href="https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/builder-copy-sandbox-logs/138/jamo-controller-csit-3node-rest-clust-cars-perf-only-fluorine/3/" class="external-link" target="_blank" rel="nofollow noopener">example job</a></p> Development Rank 0|i03fvr: