[GENIUS-99] IfmUtil: Cannot read identifier java.util.concurrent.ExecutionException: ReadFailedException... dpn-to-interface-list/dpn-to-interface/dpn-to-interface... Created: 13/Nov/17  Updated: 15/Aug/18  Resolved: 15/Aug/18

Status: Resolved
Project: genius
Component/s: General
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Medium
Reporter: Sam Hague Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: csit:3node, ds
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File karaf1.1.log.tar.xz     File karaf1.2.log.tar.xz     File karaf2.log.tar.xz     File karaf3.log.tar.xz    
Issue Links:
Relates
relates to CONTROLLER-1787 java.lang.Exception: Error creating R... Resolved
relates to CONTROLLER-1788 Failed to execute RPC (urn:opendaylig... Resolved
relates to OPNFLWPLUG-956 No queue present, failing request Resolved
relates to OPNFLWPLUG-957 TransactionChainManager... Exception ... Resolved

 Description   

 

2017-11-08 04:21:00,275 | ERROR | Pool-1-worker-42 | IfmUtil | 352 - org.opendaylight.genius.interfacemanager-impl - 0.2.2.Carbon-redhat-2 | Cannot read identifier
 java.util.concurrent.ExecutionException: ReadFailedException{message=Error checking ReadData for path /(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpn-to-interface-list/dpn-to-interface/dpn-to-interface[
{(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpid=192905537585}
], errorList=[RpcError [message=Error checking ReadData for path /(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpn-to-interface-list/dpn-to-interface/dpn-to-interface[
{(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpid=192905537585}
], severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=akka.pattern.AskTimeoutException: Ask timed out on [ActorSelection[Anchor(akka.tcp://opendaylight-cluster-data@172.16.0.27:2550/), Path(/user/shardmanager-operational/member-1-shard-default-operational/shard-default-member-0:datastore-operational@0:14390_232127#1248264751)]] after [5000 ms]. Sender[null] sent message of type "org.opendaylight.controller.cluster.datastore.messages.ReadData".]]}
 at org.opendaylight.yangtools.util.concurrent.MappingCheckedFuture.wrapInExecutionException(MappingCheckedFuture.java:64)[69:org.opendaylight.yangtools.util:1.1.2.Carbon-redhat-2]
 at org.opendaylight.yangtools.util.concurrent.MappingCheckedFuture.get(MappingCheckedFuture.java:77)[69:org.opendaylight.yangtools.util:1.1.2.Carbon-redhat-2]
 at org.opendaylight.genius.interfacemanager.IfmUtil.read(IfmUtil.java:201)[352:org.opendaylight.genius.interfacemanager-impl:0.2.2.Carbon-redhat-2]
 at org.opendaylight.genius.interfacemanager.commons.InterfaceManagerCommonUtils.deleteDpnToInterface(InterfaceManagerCommonUtils.java:663)[352:org.opendaylight.genius.interfacemanager-impl:0.2.2.Carbon-redhat-2]
 at org.opendaylight.genius.interfacemanager.renderer.ovs.statehelpers.OvsInterfaceStateRemoveHelper.removeInterfaceStateConfiguration(OvsInterfaceStateRemoveHelper.java:78)[352:org.opendaylight.genius.interfacemanager-impl:0.2.2.Carbon-redhat-2]
 at org.opendaylight.genius.interfacemanager.listeners.InterfaceInventoryStateListener$InterfaceStateRemoveWorker.call(InterfaceInventoryStateListener.java:270)[352:org.opendaylight.genius.interfacemanager-impl:0.2.2.Carbon-redhat-2]
 at org.opendaylight.genius.datastoreutils.DataStoreJobCoordinator$MainTask.run(DataStoreJobCoordinator.java:285)[319:org.opendaylight.genius.mdsalutil-api:0.2.2.Carbon-redhat-2]
 at java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1402)[:1.8.0_151]
 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)[:1.8.0_151]
 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)[:1.8.0_151]
 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)[:1.8.0_151]
 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)[:1.8.0_151]
 Caused by: ReadFailedException{message=Error checking ReadData for path /(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpn-to-interface-list/dpn-to-interface/dpn-to-interface[
{(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpid=192905537585}
], errorList=[RpcError [message=Error checking ReadData for path /(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpn-to-interface-list/dpn-to-interface/dpn-to-interface[
{(urn:opendaylight:genius:interfacemanager:meta?revision=2016-04-06)dpid=192905537585}
], severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=akka.pattern.AskTimeoutException: Ask timed out on [ActorSelection[Anchor(akka.tcp://opendaylight-cluster-data@172.16.0.27:2550/), Path(/user/shardmanager-operational/member-1-shard-default-operational/shard-default-member-0:datastore-operational@0:14390_232127#1248264751)]] after [5000 ms]. Sender[null] sent message of type "org.opendaylight.controller.cluster.datastore.messages.ReadData".]]}
 at org.opendaylight.controller.cluster.datastore.RemoteTransactionContext$1.onComplete(RemoteTransactionContext.java:184)[211:org.opendaylight.controller.sal-distributed-datastore:1.5.2.Carbon-redhat-2]
 at akka.dispatch.OnComplete.internal(Future.scala:258)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.OnComplete.internal(Future.scala:256)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.japi$CallbackBridge.apply(Future.scala:186)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.japi$CallbackBridge.apply(Future.scala:183)[185:com.typesafe.akka.actor:2.4.18]
 at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)[185:com.typesafe.akka.actor:2.4.18]
 at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:90)[185:com.typesafe.akka.actor:2.4.18]
 at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)[185:com.typesafe.akka.actor:2.4.18]
 at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 Caused by: akka.pattern.AskTimeoutException: Ask timed out on [ActorSelection[Anchor(akka.tcp://opendaylight-cluster-data@172.16.0.27:2550/), Path(/user/shardmanager-operational/member-1-shard-default-operational/shard-default-member-0:datastore-operational@0:14390_232127#1248264751)]] after [5000 ms]. Sender[null] sent message of type "org.opendaylight.controller.cluster.datastore.messages.ReadData".
 at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604)[185:com.typesafe.akka.actor:2.4.18]
 at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126)[185:com.typesafe.akka.actor:2.4.18]
 at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)[181:org.scala-lang.scala-library:2.11.11.v20170413-090219-8a413ba7cc]
 at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:329)[185:com.typesafe.akka.actor:2.4.18]
 at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:280)[185:com.typesafe.akka.actor:2.4.18]
 at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:284)[185:com.typesafe.akka.actor:2.4.18]
 at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)[185:com.typesafe.akka.actor:2.4.18]
 at java.lang.Thread.run(Thread.java:748)[:1.8.0_151]

 



 Comments   
Comment by Faseela K [ 14/Nov/17 ]

Are you doing a cluster testing? Is this scale testing?

Comment by Faseela K [ 23/Nov/17 ]

Sam, the error says Ask Timed out. Probably the cluster is not in good shape, and probably all reads are failing at that time. Also, dpn to interface-list is being read by netvirt when ports are getting created, will be better to analyze how efficiently it is being done.

Comment by Faseela K [ 10/May/18 ]

Want to know whether this bug is still valid, and let me know of any help i can do..

Comment by Jamo Luhrsen [ 15/Aug/18 ]

reopen if we see it again. original problem was reported 9 months ago.

Generated at Wed Feb 07 19:59:54 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.