[#CONTROLLER-1133] Clustering : does not support GBP

[CONTROLLER-1133] Clustering : does not support GBP Created: 03/Feb/15 Updated: 10/Feb/15 Resolved: 10/Feb/15
Status:	Resolved
Project:	controller
Component/s:	mdsal
Affects Version/s:	Post-Helium
Fix Version/s:	None

Type:

Bug

Reporter:

Keith Burns

Assignee:

Moiz Raja

Resolution:

Done

Votes:

Labels:

None

Remaining Estimate:

Not Specified

Time Spent:

Not Specified

Original Estimate:

Not Specified

Environment:

Operating System: All
Platform: All

Attachments:

karaf.log

karaf.logs.tar.gz

Issue Links:

Duplicate
is duplicated by	~~CONTROLLER-1131~~	Exception while runing Group Based Po...	Resolved
is duplicated by	~~CONTROLLER-1132~~	Clustering does not support GBP	Resolved

External issue ID:

2667

Description

Get AKKA errors (timeout) when trying to write DestinationMapper (table2) to OVS. This is on a single node running latest MASTER GBP using the single-node instructions here https://wiki.opendaylight.org/view/Running_and_testing_an_OpenDaylight_Cluster

Logs attached

This is with:

no clustering
turn on clustering
start POC (doesn't work)
stop controller
start controller
(as per Moiz instructions)

Comments

Comment by Keith Burns [ 03/Feb/15 ]

Attachment karaf.logs.tar.gz has been added with description: Karaf Logs

Comment by Thomas Bachman [ 03/Feb/15 ]

Here's the link to run the POC: https://wiki.opendaylight.org/view/Group_Policy:Building_and_Running_Docker

Comment by Thomas Bachman [ 03/Feb/15 ]

This is the exception that we get:

{message=commit encountered an unexpected failure, errorList=[RpcError [message=commit encountered an unexpected failure, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=akka.pattern.AskTimeoutException: Ask timed out on [ActorSelection[Anchor(akka://opendaylight-cluster-data/), Path(/user/shardmanager-config/member-1-shard-inventory-config#-1462442986)]] after [5000 ms]]]}

at org.opendaylight.yangtools.util.concurrent.MappingCheckedFuture.wrapInExecutionException(MappingCheckedFuture.java:64)[78:org.opendaylight.yangtools.util:0.6.4.Helium-SR2]
at org.opendaylight.yangtools.util.concurrent.MappingCheckedFuture.get(MappingCheckedFuture.java:77)[78:org.opendaylight.yangtools.util:0.6.4.Helium-SR2]
at org.opendaylight.groupbasedpolicy.renderer.ofoverlay.flow.FlowTable.update(FlowTable.java:79)[226:org.opendaylight.groupbasedpolicy:0.1.2.Helium-SR2]
at org.opendaylight.groupbasedpolicy.renderer.ofoverlay.PolicyManager$SwitchFlowUpdateTask.call(PolicyManager.java:322)[226:org.opendaylight.groupbasedpolicy:0.1.2.Helium-SR2]
at org.opendaylight.groupbasedpolicy.renderer.ofoverlay.PolicyManager$SwitchFlowUpdateTask.call(PolicyManager.java:305)[226:org.opendaylight.groupbasedpolicy:0.1.2.Helium-SR2]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)[:1.7.0_71]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_71]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)[:1.7.0_71]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_71]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)[:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)[:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)[:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7.0_71]
at java.lang.Thread.run(Thread.java:745)[:1.7.0_71]
Caused by: TransactionCommitFailedException

at org.opendaylight.controller.md.sal.dom.broker.impl.TransactionCommitFailedExceptionMapper.newWithCause(TransactionCommitFailedExceptionMapper.java:37)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at org.opendaylight.controller.md.sal.dom.broker.impl.TransactionCommitFailedExceptionMapper.newWithCause(TransactionCommitFailedExceptionMapper.java:18)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at org.opendaylight.yangtools.util.concurrent.ExceptionMapper.apply(ExceptionMapper.java:96)[78:org.opendaylight.yangtools.util:0.6.4.Helium-SR2]
at org.opendaylight.controller.md.sal.dom.broker.impl.DOMConcurrentDataCommitCoordinator.handleException(DOMConcurrentDataCommitCoordinator.java:199)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at org.opendaylight.controller.md.sal.dom.broker.impl.DOMConcurrentDataCommitCoordinator.access$100(DOMConcurrentDataCommitCoordinator.java:38)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at org.opendaylight.controller.md.sal.dom.broker.impl.DOMConcurrentDataCommitCoordinator$3.onFailure(DOMConcurrentDataCommitCoordinator.java:169)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)[75:com.google.guava:14.0.1]
at org.opendaylight.controller.md.sal.dom.broker.impl.DOMConcurrentDataCommitCoordinator$SimpleSameThreadExecutor.execute(DOMConcurrentDataCommitCoordinator.java:321)[157:org.opendaylight.controller.sal-broker-impl:1.1.2.Helium-SR2]
at com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)[75:com.google.guava:14.0.1]
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)[75:com.google.guava:14.0.1]
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:203)[75:com.google.guava:14.0.1]
at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:68)[75:com.google.guava:14.0.1]
at org.opendaylight.controller.cluster.datastore.ThreePhaseCommitCohortProxy$5.onComplete(ThreePhaseCommitCohortProxy.java:257)[182:org.opendaylight.controller.sal-distributed-datastore:1.1.2.Helium-SR2]
at org.opendaylight.controller.cluster.datastore.ThreePhaseCommitCohortProxy$5.onComplete(ThreePhaseCommitCohortProxy.java:233)[182:org.opendaylight.controller.sal-distributed-datastore:1.1.2.Helium-SR2]
at akka.dispatch.OnComplete.internal(Future.scala:246)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.OnComplete.internal(Future.scala:244)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.japi$CallbackBridge.apply(Future.scala:174)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.japi$CallbackBridge.apply(Future.scala:171)[167:com.typesafe.akka.actor:2.3.4]
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.processBatch$1(BatchingExecutor.scala:67)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:82)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.BatchingExecutor$Batch$$anonfun$run$1.apply(BatchingExecutor.scala:59)[167:com.typesafe.akka.actor:2.3.4]
at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:58)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)[167:com.typesafe.akka.actor:2.3.4]
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:393)[167:com.typesafe.akka.actor:2.3.4]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
Caused by: akka.pattern.AskTimeoutException: Ask timed out on ActorSelection[Anchor(akka://opendaylight-cluster-data/), Path(/user/shardmanager-config/member-1-shard-inventory-config#-1462442986)] after [5000 ms]
at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:333)[167:com.typesafe.akka.actor:2.3.4]
at akka.actor.Scheduler$$anon$7.run(Scheduler.scala:117)[167:com.typesafe.akka.actor:2.3.4]
at scala.concurrent.Future$InternalCallbackExecutor$.scala$concurrent$Future$InternalCallbackExecutor$$unbatchedExecute(Future.scala:694)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:691)[164:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(Scheduler.scala:467)[167:com.typesafe.akka.actor:2.3.4]
at akka.actor.LightArrayRevolverScheduler$$anon$8.executeBucket$1(Scheduler.scala:419)[167:com.typesafe.akka.actor:2.3.4]
at akka.actor.LightArrayRevolverScheduler$$anon$8.nextTick(Scheduler.scala:423)[167:com.typesafe.akka.actor:2.3.4]
at akka.actor.LightArrayRevolverScheduler$$anon$8.run(Scheduler.scala:375)[167:com.typesafe.akka.actor:2.3.4]
at java.lang.Thread.run(Thread.java:745)[:1.7.0_71]

Comment by Thomas Bachman [ 03/Feb/15 ]

I haven't looked through the log yet, but will do so in parallel.

Comment by Thomas Bachman [ 03/Feb/15 ]

Attachment karaf.log has been added with description: Latest log file with exception in it

Comment by Moiz Raja [ 03/Feb/15 ]

https://git.opendaylight.org/gerrit/#/c/14789/

Generated at Wed Feb 07 21:52:33 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.

[CONTROLLER-1133] Clustering : does not support GBP Created: 03/Feb/15 Updated: 10/Feb/15 Resolved: 10/Feb/15