<!-- 
RSS generated by JIRA (8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d) at Wed Feb 07 20:48:05 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>OpenDaylight JIRA</title>
    <link>https://jira.opendaylight.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>8.20.10</version>
        <build-number>820010</build-number>
        <build-date>22-06-2022</build-date>
    </build-info>


<item>
            <title>[VTN-120] CSIT for VTN Manager failed to verify data flow</title>
                <link>https://jira.opendaylight.org/browse/VTN-120</link>
                <project id="10185" key="VTN">vtn</project>
                    <description>&lt;p&gt;The following CSIT for Beryllium VTN Manager failed to verify data flows.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/148/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/148/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;At the failed test case, the CSIT verified if data flows were created.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/148/robot/report/log.html#s1-s2-s3-t11&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/148/robot/report/log.html#s1-s2-s3-t11&lt;/a&gt;&lt;br/&gt;
However, CSIT could not find data flows, it marked the test case as failed.&lt;/p&gt;

&lt;p&gt;Considering that the CSIT passes this test case almost every time, the failure on that job (build #148) could be a kind of timming issue.&lt;/p&gt;</description>
                <environment>&lt;p&gt;Operating System: All&lt;br/&gt;
Platform: All&lt;/p&gt;</environment>
        <key id="26500">VTN-120</key>
            <summary>CSIT for VTN Manager failed to verify data flow</summary>
                <type id="10104" iconUrl="https://jira.opendaylight.org/secure/viewavatar?size=xsmall&amp;avatarId=10303&amp;avatarType=issuetype">Bug</type>
                                                <status id="5" iconUrl="https://jira.opendaylight.org/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="green"/>
                                    <resolution id="10000">Done</resolution>
                                        <assignee username="siva-karthik@hcl.com">Karthik Sivasamy</assignee>
                                    <reporter username="Hideyuki1985">Hideyuki Tai</reporter>
                        <labels>
                    </labels>
                <created>Fri, 12 Feb 2016 18:45:04 +0000</created>
                <updated>Mon, 21 Mar 2016 13:47:06 +0000</updated>
                            <resolved>Mon, 21 Mar 2016 13:47:06 +0000</resolved>
                                    <version>unspecified</version>
                                                    <component>VTN Manager</component>
                        <due></due>
                            <votes>0</votes>
                                    <watches>1</watches>
                                                                                                                <comments>
                            <comment id="53074" author="hideyuki.tai@necam.com" created="Fri, 12 Feb 2016 18:57:29 +0000"  >&lt;p&gt;I guess this is a bug of the CSIT.&lt;br/&gt;
Therefore I think the CSIT needs to be modified.&lt;/p&gt;

&lt;p&gt;I&apos;ve found out that the CSIT uses the following data store to get data flows from VTN Manager in the failed test case.&lt;/p&gt;

&lt;p&gt;    restconf/operational/vtn-flow-impl:vtn-flows/&lt;/p&gt;

&lt;p&gt;However, this data model (vtn-flow-impl) should not be used in the CSIT, since this data model is an internal model in VTN Manager and not assumed to be used by applications.&lt;br/&gt;
This is explicitly mentioned in vtn-flow-impl.yang file.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://git.opendaylight.org/gerrit/gitweb?p=vtn.git;a=blob;f=manager/implementation/src/main/yang/vtn-flow-impl.yang;h=aeb318fd209a843f6106a515352dfe88d3c2179c;hb=refs/heads/stable/beryllium&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://git.opendaylight.org/gerrit/gitweb?p=vtn.git;a=blob;f=manager/implementation/src/main/yang/vtn-flow-impl.yang;h=aeb318fd209a843f6106a515352dfe88d3c2179c;hb=refs/heads/stable/beryllium&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;  66     description&lt;br/&gt;
  67       &quot;The internal module for entities implementing the VTN data flow.&lt;br/&gt;
  68        Application other than VTN Manager must not use models defined in&lt;br/&gt;
  69        this module.&quot;;&lt;/p&gt;

&lt;p&gt;Instead of that, please use public data stores and RPCs provided by VTN Manager.&lt;br/&gt;
The explanation for all public models are available at the Jenkins server.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="53075" author="hideyuki.tai@necam.com" created="Fri, 12 Feb 2016 19:29:30 +0000"  >&lt;p&gt;First, I think the failed test case should use the get-data-flow RPC provided by VTN Manager to verify if target data flows exist.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/vtn-flow.html#get-data-flow&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/vtn-flow.html#get-data-flow&lt;/a&gt;&lt;/p&gt;


&lt;p&gt;Second, since anyway VTN Manager needs some time to be ready to return the target data flow information, I think the CSIT needs to add some sleep time before the verification or needs to repeat the verification a few times.&lt;/p&gt;


&lt;p&gt;Third, I&apos;m not sure but specifying the &quot;UPDATESTATS&quot; into the &quot;mode&quot; parameter of the get-data-flow RPC might solve the timing issue, since the get-data-flow PRC in the &quot;UPDATESTATS&quot; mode makes requests to OpenFlow switch to get up-to-date information.&lt;/p&gt;</comment>
                            <comment id="53076" author="hideyuki.tai@necam.com" created="Sun, 14 Feb 2016 22:33:22 +0000"  >&lt;p&gt;I&apos;ve found out that the same issue (&lt;a href=&quot;https://jira.opendaylight.org/browse/VTN-120&quot; title=&quot;CSIT for VTN Manager failed to verify data flow&quot; class=&quot;issue-link&quot; data-issue-key=&quot;VTN-120&quot;&gt;&lt;del&gt;VTN-120&lt;/del&gt;&lt;/a&gt;) happened in the build #129 of the vtn-csit-1node-manager-only-beryllium job.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/129/robot/report/log.html#s1-s1-s2-t18&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/129/robot/report/log.html#s1-s1-s2-t18&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="53077" author="siva-karthik@hcl.com" created="Thu, 18 Feb 2016 07:10:33 +0000"  >&lt;p&gt;Modifed VTN Manager CSIT Keyword file. To use get-data-flow RPC provided by VTN manager.&lt;/p&gt;

&lt;p&gt;Pushed patch and merged in to integration/test,&lt;br/&gt;
&lt;a href=&quot;https://git.opendaylight.org/gerrit/#/c/34735&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://git.opendaylight.org/gerrit/#/c/34735&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Tested in Sandbox now verify dataflow which uses get-data-flow RPC works fine.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/sandbox/job/vtn-csit-1node-manager-only-beryllium/19/console&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/sandbox/job/vtn-csit-1node-manager-only-beryllium/19/console&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="53078" author="siva-karthik@hcl.com" created="Thu, 25 Feb 2016 12:40:35 +0000"  >&lt;p&gt;After the patch is merged to git, the below job failed once in the below &lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/88/robot/report/log.html#s1-s2-s3-t11&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/88/robot/report/log.html#s1-s2-s3-t11&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Before pushing the patch to git, i have tested 5 times in sandbox but i didn&apos;t see this error. &lt;br/&gt;
The failure see only once in all-beryllium job. Other jobs are working fine without any issue.&lt;/p&gt;

&lt;p&gt;I think, vtn manager need some time to return dataflow information. We can add some &quot;Wait Until Keyword&quot;(sleep) for Verify dataflow test cases.&lt;/p&gt;</comment>
                            <comment id="53079" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:05:10 +0000"  >&lt;p&gt;CSIT for Beryllium VTN Manager failed to verify data flows.&lt;/p&gt;

&lt;p&gt;Topology used&lt;br/&gt;
h1,h2 &amp;lt;--&lt;del&gt;&amp;gt; s2 &amp;lt;&lt;/del&gt;-&lt;del&gt;&amp;gt; s1 &amp;lt;&lt;/del&gt;-&lt;del&gt;&amp;gt; s3 &amp;lt;&lt;/del&gt;--&amp;gt; h3,h4&lt;/p&gt;

&lt;p&gt;Following are the steps followed in the CSIT test script.&lt;/p&gt;

&lt;p&gt;1)	Create Tenant1&lt;br/&gt;
2)	Create vBridge1&lt;br/&gt;
3)	Create interfaces if1 and if2&lt;br/&gt;
4)	Create Portmapping for interfaces if1 and if2&lt;br/&gt;
5)	Ping h1 and h3. &#61664; Ping success&lt;br/&gt;
6)	Verify Dataflows. &#61664; Success.  Here verifying dataflow output for &#8220;Tenant1, vBridge1 , if1 and PORTMAPPED&#8221; &lt;br/&gt;
7)	Create vBridge2&lt;br/&gt;
8)	Create interfaces if3 and if4&lt;br/&gt;
9)	Create Portmapping for interfaces if3 and if4&lt;br/&gt;
10)	Ping h2 and h4. &#61664; Ping success&lt;br/&gt;
11)	Verify Dataflows. &#61664; failure.  Here verifying dataflow output for &#8220;Tenant1, vBridge2 , if3 and PORTMAPPED&#8221;&lt;/p&gt;

&lt;p&gt;From the Karaf Logs it is observed that when the get vtn data flow request is made for&lt;br/&gt;
&#8226;	vbridge 1 - The relevant stats request are seen.&lt;br/&gt;
&#8226;	vBridge 2 &#8211; The relevant stats request are not seen.&lt;/p&gt;

&lt;p&gt;One more observation - Sometimes Verify dataflow for vbridge2 is successful after some retries. In such a case the status requests are seen in the logs.&lt;/p&gt;

&lt;p&gt;Request VTN Manager teams support to analyze the logs and inform if there is any issue in the CSIT test procedure.&lt;/p&gt;

&lt;p&gt;Log files are attached&lt;br/&gt;
vtndf_karaf.log&lt;br/&gt;
vtndf_karaf.log.1&lt;/p&gt;</comment>
                            <comment id="53088" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:07:16 +0000"  >&lt;p&gt;Attachment vtndf_karaf.log has been added with description: Karaf log enabled TRACE&lt;/p&gt;</comment>
                            <comment id="53089" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:11:10 +0000"  >&lt;p&gt;Attachment vtndf_karaf_log.zip has been added with description: Karaf log enabled TRACE&lt;/p&gt;</comment>
                            <comment id="53080" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:12:32 +0000"  >&lt;p&gt;(In reply to Karthik Sivasamy from comment #6)&lt;br/&gt;
&amp;gt; CSIT for Beryllium VTN Manager failed to verify data flows.&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; Topology used&lt;br/&gt;
&amp;gt; h1,h2 &amp;lt;--&lt;del&gt;&amp;gt; s2 &amp;lt;&lt;/del&gt;-&lt;del&gt;&amp;gt; s1 &amp;lt;&lt;/del&gt;-&lt;del&gt;&amp;gt; s3 &amp;lt;&lt;/del&gt;--&amp;gt; h3,h4&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; Following are the steps followed in the CSIT test script.&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; 1)	Create Tenant1&lt;br/&gt;
&amp;gt; 2)	Create vBridge1&lt;br/&gt;
&amp;gt; 3)	Create interfaces if1 and if2&lt;br/&gt;
&amp;gt; 4)	Create Portmapping for interfaces if1 and if2&lt;br/&gt;
&amp;gt; 5)	Ping h1 and h3. &#61664; Ping success&lt;br/&gt;
&amp;gt; 6)	Verify Dataflows. &#61664; Success.  Here verifying dataflow output for&lt;br/&gt;
&amp;gt; &#8220;Tenant1, vBridge1 , if1 and PORTMAPPED&#8221; &lt;br/&gt;
&amp;gt; 7)	Create vBridge2&lt;br/&gt;
&amp;gt; 8)	Create interfaces if3 and if4&lt;br/&gt;
&amp;gt; 9)	Create Portmapping for interfaces if3 and if4&lt;br/&gt;
&amp;gt; 10)	Ping h2 and h4. &#61664; Ping success&lt;br/&gt;
&amp;gt; 11)	Verify Dataflows. &#61664; failure.  Here verifying dataflow output for&lt;br/&gt;
&amp;gt; &#8220;Tenant1, vBridge2 , if3 and PORTMAPPED&#8221;&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; From the Karaf Logs it is observed that when the get vtn data flow request&lt;br/&gt;
&amp;gt; is made for&lt;br/&gt;
&amp;gt; &#8226;	vbridge 1 - The relevant stats request are seen.&lt;br/&gt;
&amp;gt; &#8226;	vBridge 2 &#8211; The relevant stats request are not seen.&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; One more observation - Sometimes Verify dataflow for vbridge2 is successful&lt;br/&gt;
&amp;gt; after some retries. In such a case the status requests are seen in the logs.&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; Request VTN Manager teams support to analyze the logs and inform if there is&lt;br/&gt;
&amp;gt; any issue in the CSIT test procedure.&lt;br/&gt;
&amp;gt; &lt;br/&gt;
&amp;gt; Log files are attached&lt;br/&gt;
&amp;gt; vtndf_karaf.log&lt;br/&gt;
&amp;gt; vtndf_karaf.log.1&lt;/p&gt;

&lt;p&gt;Ignore the above log files. attached the zip file vtndf_karaf_log.zip with includes both the files&lt;/p&gt;</comment>
                            <comment id="53081" author="gvrangan" created="Mon, 7 Mar 2016 23:55:30 +0000"  >&lt;p&gt;Exceptions in karaf.log&lt;br/&gt;
016-03-07 06:53:27,969 | ERROR | er Task Thread-0 | StatsReaderService               | 188 - org.opendaylight.vtn.manager.implementation - 0.4.0.Beryllium | get-flow-stats: Caught an exception: canceled=false, input=GetFlowStatisticsFromFlowTableInput [_cookie=FlowCookie &lt;span class=&quot;error&quot;&gt;&amp;#91;_value=9175521290813964288&amp;#93;&lt;/span&gt;, _cookieMask=FlowCookie &lt;span class=&quot;error&quot;&gt;&amp;#91;_value=18446462598732840960&amp;#93;&lt;/span&gt;, _node=NodeRef [_value=KeyedInstanceIdentifier&lt;/p&gt;
{targetType=interface org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node, path=[org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.Nodes, org.opendaylight.yang.gen.v1.urn.opendaylight.inventory.rev130819.nodes.Node[key=NodeKey [_id=Uri [_value=openflow:1]]]]}
&lt;p&gt;], _tableId=0, augmentation=[]]&lt;br/&gt;
java.util.concurrent.ExecutionException: org.opendaylight.controller.md.sal.dom.api.DOMRpcImplementationNotAvailableException: No local or remote implementation available for rpc AbsoluteSchemaPath&lt;/p&gt;
{path=[(urn:opendaylight:flow:statistics?revision=2013-08-19)get-flow-statistics-from-flow-table]}
&lt;p&gt;	at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)&lt;span class=&quot;error&quot;&gt;&amp;#91;64:com.google.guava:18.0.0&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:272)&lt;span class=&quot;error&quot;&gt;&amp;#91;64:com.google.guava:18.0.0&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96)&lt;span class=&quot;error&quot;&gt;&amp;#91;64:com.google.guava:18.0.0&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.rpc.RpcInvocation.getResult(RpcInvocation.java:82)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.flow.GetFlowStatsRpc.getTransactionId(GetFlowStatsRpc.java:56)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService.startTransaction(StatsReaderService.java:546)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService.access$400(StatsReaderService.java:61)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService$RpcTask.run(StatsReaderService.java:234)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.concurrent.VTNThreadPool$WorkerThread.run(VTNThreadPool.java:400)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
Caused by: org.opendaylight.controller.md.sal.dom.api.DOMRpcImplementationNotAvailableException: No local or remote implementation available for rpc AbsoluteSchemaPath&lt;/p&gt;
{path=[(urn:opendaylight:flow:statistics?revision=2013-08-19)get-flow-statistics-from-flow-table]}
&lt;p&gt;	at org.opendaylight.controller.remote.rpc.RemoteRpcImplementation$1.onComplete(RemoteRpcImplementation.java:65)&lt;span class=&quot;error&quot;&gt;&amp;#91;163:org.opendaylight.controller.sal-remoterpc-connector:1.3.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.controller.remote.rpc.RemoteRpcImplementation$1.onComplete(RemoteRpcImplementation.java:56)&lt;span class=&quot;error&quot;&gt;&amp;#91;163:org.opendaylight.controller.sal-remoterpc-connector:1.3.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.OnComplete.internal(Future.scala:248)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.OnComplete.internal(Future.scala:245)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:175)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:172)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
2016-03-07 06:53:27,975 | ERROR | er Task Thread-0 | StatsReaderService               | 188 - org.opendaylight.vtn.manager.implementation - 0.4.0.Beryllium | Failed to issue flow stats RPC: get-flow-stats&lt;br/&gt;
org.opendaylight.vtn.manager.VTNException: No local or remote implementation available for rpc AbsoluteSchemaPath&lt;/p&gt;
{path=[(urn:opendaylight:flow:statistics?revision=2013-08-19)get-flow-statistics-from-flow-table]}
&lt;p&gt;	at org.opendaylight.vtn.manager.internal.util.concurrent.AbstractVTNFuture.getException(AbstractVTNFuture.java:75)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.rpc.RpcInvocation.getResult(RpcInvocation.java:89)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.flow.GetFlowStatsRpc.getTransactionId(GetFlowStatsRpc.java:56)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService.startTransaction(StatsReaderService.java:546)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService.access$400(StatsReaderService.java:61)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.flow.stats.StatsReaderService$RpcTask.run(StatsReaderService.java:234)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.vtn.manager.internal.util.concurrent.VTNThreadPool$WorkerThread.run(VTNThreadPool.java:400)&lt;span class=&quot;error&quot;&gt;&amp;#91;188:org.opendaylight.vtn.manager.implementation:0.4.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
Caused by: org.opendaylight.controller.md.sal.dom.api.DOMRpcImplementationNotAvailableException: No local or remote implementation available for rpc AbsoluteSchemaPath&lt;/p&gt;
{path=[(urn:opendaylight:flow:statistics?revision=2013-08-19)get-flow-statistics-from-flow-table]}
&lt;p&gt;	at org.opendaylight.controller.remote.rpc.RemoteRpcImplementation$1.onComplete(RemoteRpcImplementation.java:65)&lt;span class=&quot;error&quot;&gt;&amp;#91;163:org.opendaylight.controller.sal-remoterpc-connector:1.3.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at org.opendaylight.controller.remote.rpc.RemoteRpcImplementation$1.onComplete(RemoteRpcImplementation.java:56)&lt;span class=&quot;error&quot;&gt;&amp;#91;163:org.opendaylight.controller.sal-remoterpc-connector:1.3.0.Beryllium&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.OnComplete.internal(Future.scala:248)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.OnComplete.internal(Future.scala:245)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:175)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:172)&lt;span class=&quot;error&quot;&gt;&amp;#91;149:com.typesafe.akka.actor:2.3.14&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)&lt;span class=&quot;error&quot;&gt;&amp;#91;146:org.scala-lang.scala-library:2.11.7.v20150622-112736-1fbce4612c&amp;#93;&lt;/span&gt;&lt;br/&gt;
2016-03-07 06:53:27,976 | WARN  | er Task Thread-0 | ClearNodeFlows&lt;/p&gt;</comment>
                            <comment id="53082" author="hideyuki.tai@necam.com" created="Tue, 8 Mar 2016 00:08:13 +0000"  >&lt;p&gt;(In reply to Venkatrangan Govindarajan from comment #10)&lt;br/&gt;
&amp;gt; Exceptions in karaf.log&lt;br/&gt;
&amp;gt; 016-03-07 06:53:27,969 | ERROR | er Task Thread-0 | StatsReaderService      &lt;br/&gt;
&amp;gt; | 188 - org.opendaylight.vtn.manager.implementation - 0.4.0.Beryllium |&lt;br/&gt;
&amp;gt; get-flow-stats: Caught an exception: canceled=false,&lt;/p&gt;


&lt;p&gt;I&apos;ve filed that ERROR message as &lt;a href=&quot;https://jira.opendaylight.org/browse/OPNFLWPLUG-605&quot; title=&quot;He: Failed to issue flow stats; get-flow-statistics-from-flow-table&quot; class=&quot;issue-link&quot; data-issue-key=&quot;OPNFLWPLUG-605&quot;&gt;&lt;del&gt;OPNFLWPLUG-605&lt;/del&gt;&lt;/a&gt;.&lt;br/&gt;
&lt;a href=&quot;https://bugs.opendaylight.org/show_bug.cgi?id=5090&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://bugs.opendaylight.org/show_bug.cgi?id=5090&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;And, I don&apos;t think that ERROR message is related to the problem of the &lt;a href=&quot;https://jira.opendaylight.org/browse/VTN-120&quot; title=&quot;CSIT for VTN Manager failed to verify data flow&quot; class=&quot;issue-link&quot; data-issue-key=&quot;VTN-120&quot;&gt;&lt;del&gt;VTN-120&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="53083" author="gvrangan" created="Tue, 8 Mar 2016 00:12:10 +0000"  >&lt;p&gt;Thanks for clarifying, Just looking at the exception, felt like the stats for some switch is failing hence added it here. Will look further and update&lt;/p&gt;</comment>
                            <comment id="53084" author="hideyuki.tai@necam.com" created="Tue, 8 Mar 2016 01:03:20 +0000"  >&lt;p&gt;Since VTN Manager needs some time to be ready to return data flow information after it receives new packets, I think the CSIT needs to add some sleep time before the verification or needs to repeat the verification a few times.&lt;/p&gt;</comment>
                            <comment id="53085" author="hideyuki.tai@necam.com" created="Fri, 11 Mar 2016 19:01:14 +0000"  >&lt;p&gt;I think the patch for &lt;a href=&quot;https://jira.opendaylight.org/browse/VTN-121&quot; title=&quot;CSIT for VTN Manager failed to test flow filter&quot; class=&quot;issue-link&quot; data-issue-key=&quot;VTN-121&quot;&gt;&lt;del&gt;VTN-121&lt;/del&gt;&lt;/a&gt; also fixes the &lt;a href=&quot;https://jira.opendaylight.org/browse/VTN-120&quot; title=&quot;CSIT for VTN Manager failed to verify data flow&quot; class=&quot;issue-link&quot; data-issue-key=&quot;VTN-120&quot;&gt;&lt;del&gt;VTN-120&lt;/del&gt;&lt;/a&gt; since the root cause of these issues could be the same.&lt;br/&gt;
&lt;a href=&quot;https://git.opendaylight.org/gerrit/#/c/36039/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://git.opendaylight.org/gerrit/#/c/36039/&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="53086" author="siva-karthik@hcl.com" created="Mon, 21 Mar 2016 07:09:58 +0000"  >&lt;p&gt;The following CSIT for Beryllium to verify Dataflows are working fine.&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Since after the following patch was merged,&lt;br/&gt;
&lt;a href=&quot;https://git.opendaylight.org/gerrit/#/c/36039/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://git.opendaylight.org/gerrit/#/c/36039/&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="53087" author="siva-karthik@hcl.com" created="Mon, 21 Mar 2016 13:47:06 +0000"  >&lt;p&gt;To fix the CSIT test failure, we have used the get-data-flow RPC provided by VTN Manager to verify if target data flows exist.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/vtn-flow.html#get-data-flow&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-merge-beryllium/lastSuccessfulBuild/artifact/manager/model/target/site/models/vtn-flow.html#get-data-flow&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;After fixing the CSIT we got some other issue, that is verify dataflow fails and the issue is fixed with the following patch.&lt;br/&gt;
&lt;a href=&quot;https://git.opendaylight.org/gerrit/#/c/36039/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://git.opendaylight.org/gerrit/#/c/36039/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;From 11/03/2016, since after the above patch was merged, we dont see any issue related to Verify Dataflow tests in the follwing CSIT Beryllium jobs.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-only-beryllium/&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://jenkins.opendaylight.org/releng/view/vtn/job/vtn-csit-1node-manager-all-beryllium/&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="13709" name="vtndf_karaf.log" size="157165" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:07:16 +0000"/>
                            <attachment id="13710" name="vtndf_karaf_log.zip" size="24077" author="siva-karthik@hcl.com" created="Mon, 7 Mar 2016 18:11:10 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                            <customfield id="customfield_11400" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10208" key="com.atlassian.jira.plugin.system.customfieldtypes:textfield">
                        <customfieldname>External issue ID</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5343</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10201" key="com.atlassian.jira.plugin.system.customfieldtypes:url">
                        <customfieldname>External issue URL</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[https://bugs.opendaylight.org/show_bug.cgi?id=5343]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10000" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>0|i02tpj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>