[YANGTOOLS-554] java.lang.IllegalArgumentException: Unsupported modification APPEARED (Again) Created: 20/Nov/15  Updated: 10/Apr/22  Resolved: 09/Jan/16

Status: Resolved
Project: yangtools
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug
Reporter: Anil Vishnoi Assignee: Tony Tkacik
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All


Attachments: Text File karaf-c1.log     Text File karaf-c2.log     Text File karaf-c3.log    
Issue Links:
Blocks
blocks OVSDB-248 cannot create a bridge using northbou... Resolved
External issue ID: 4657
Priority: High

 Description   

I see following exception when i start my 3 node ovsdb cluster

2015-11-20 20:49:15,894 | WARN | ult-dispatcher-4 | ShardManager | 150 - org.opendaylight.controller.sal-distributed-datastore - 1.3.0.SNAPSHOT | Supervisor Strategy caught unexpected exception - resuming
java.lang.IllegalArgumentException: Unsupported modification APPEARED
at org.opendaylight.yangtools.yang.data.api.schema.tree.DataTreeCandidateNodes$AbstractNodeIterator.next(DataTreeCandidateNodes.java:98)[66:org.opendaylight.yangtools.yang-data-api:0.8.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.api.schema.tree.DataTreeCandidateNodes.applyRootToCursor(DataTreeCandidateNodes.java:59)[66:org.opendaylight.yangtools.yang-data-api:0.8.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.api.schema.tree.DataTreeCandidates.applyToCursorAwareModification(DataTreeCandidates.java:81)[66:org.opendaylight.yangtools.yang-data-api:0.8.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.api.schema.tree.DataTreeCandidates.applyToModification(DataTreeCandidates.java:44)[66:org.opendaylight.yangtools.yang-data-api:0.8.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.ShardDataTree.applyForeignCandidate(ShardDataTree.java:180)[150:org.opendaylight.controller.sal-distributed-datastore:1.3.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.Shard.applyState(Shard.java:628)[150:org.opendaylight.controller.sal-distributed-datastore:1.3.0.SNAPSHOT]
at org.opendaylight.controller.cluster.raft.RaftActor.handleCommand(RaftActor.java:221)[147:org.opendaylight.controller.sal-akka-raft:1.3.0.SNAPSHOT]
at org.opendaylight.controller.cluster.common.actor.AbstractUntypedPersistentActor.onReceiveCommand(AbstractUntypedPersistentActor.java:36)[146:org.opendaylight.controller.sal-clustering-commons:1.3.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.Shard.onReceiveCommand(Shard.java:269)[150:org.opendaylight.controller.sal-distributed-datastore:1.3.0.SNAPSHOT]
at akka.persistence.UntypedPersistentActor.onReceive(Eventsourced.scala:430)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:97)[146:org.opendaylight.controller.sal-clustering-commons:1.3.0.SNAPSHOT]
at akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:534)[135:com.typesafe.akka.actor:2.3.14]
at akka.persistence.Recovery$State$class.process(Recovery.scala:30)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.ProcessorImpl$$anon$2.process(Processor.scala:103)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.ProcessorImpl$$anon$2.aroundReceive(Processor.scala:114)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.Recovery$class.aroundReceive(Recovery.scala:265)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.UntypedPersistentActor.akka$persistence$Eventsourced$$super$aroundReceive(Eventsourced.scala:428)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.Eventsourced$$anon$2.doAroundReceive(Eventsourced.scala:82)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.Eventsourced$$anon$2.aroundReceive(Eventsourced.scala:78)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.Eventsourced$class.aroundReceive(Eventsourced.scala:369)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.persistence.UntypedPersistentActor.aroundReceive(Eventsourced.scala:428)[140:com.typesafe.akka.persistence.experimental:2.3.14]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)[135:com.typesafe.akka.actor:2.3.14]
at akka.actor.ActorCell.invoke(ActorCell.scala:487)[135:com.typesafe.akka.actor:2.3.14]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)[135:com.typesafe.akka.actor:2.3.14]
at akka.dispatch.Mailbox.run(Mailbox.scala:220)[135:com.typesafe.akka.actor:2.3.14]
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)[135:com.typesafe.akka.actor:2.3.14]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[132:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[132:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[132:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[132:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
2015-11-20 20:49:15,895 | WARN | lt-dispatcher-38 | OneForOneStrategy | 136 - com.typesafe.akka.slf4j - 2.3.14 | Unsupported modification APPEARED



 Comments   
Comment by Robert Varga [ 24/Nov/15 ]

Are there steps to reproduce? Can you describe what operations ovsdb has executed on the data store and what their results were?

Full karaf logs from all nodes are also required, as it seems that the cluster underwent a leadership change while active operations were being executed.

Comment by Anil Vishnoi [ 05/Jan/16 ]

Karaf log from controller-1 in 3-node cluster setup of ovsdb.

Comment by Anil Vishnoi [ 05/Jan/16 ]

Attachment karaf-c1.log has been added with description: Karaf-Log-Controller-1

Comment by Anil Vishnoi [ 05/Jan/16 ]

Karaf log from controller-1 in 3-node cluster setup of ovsdb.

Comment by Anil Vishnoi [ 05/Jan/16 ]

Attachment karaf-c2.log has been added with description: Karaf-Log-Controller-2

Comment by Anil Vishnoi [ 05/Jan/16 ]

Karaf log from controller-3 in 3-node cluster setup of ovsdb.

Comment by Anil Vishnoi [ 05/Jan/16 ]

Attachment karaf-c3.log has been added with description: Karaf-Log-Controller-3

Comment by Anil Vishnoi [ 05/Jan/16 ]

Following are the steps to re-create the issue

1) configure 3-node cluster using the ovsdb project ( standard setting)
2) start all 3 karaf containers from ovsdb project ( ./karaf/target/assembly/bin) – no need to install any specific feature, boot features will install required feature

wait for cluster to come up and you will see this exception.

The only operation ovsdb does before this exception is writing "netvirt:1" node on /topology/ but that's around 700ms before.

2016-01-05 01:12:58,056 | INFO | lt-dispatcher-15 | SouthboundProvider | 233 - org.opendaylight.ovsdb.southbound-impl - 1.2.1.SNAPSHOT | Initialize OVSDB topology Uri [_value=ovsdb:1] in operational and config data store if not already present
2016-01-05 01:12:58,116 | INFO | lt-dispatcher-15 | OvsdbConnectionService | 230 - org.opendaylight.ovsdb.library - 1.2.1.SNAPSHOT | registerConnectionListener: registering OvsdbConnectionManager
2016-01-05 01:12:58,116 | INFO | lt-dispatcher-15 | OvsdbConnectionService | 230 - org.opendaylight.ovsdb.library - 1.2.1.SNAPSHOT | startOvsdbManager: Starting
2016-01-05 01:12:58,118 | INFO | ntLoopGroup-10-1 | LoggingHandler | 110 - io.netty.common - 4.0.33.Final | [id: 0xbd1c6c68] REGISTERED
2016-01-05 01:12:58,119 | INFO | ntLoopGroup-10-1 | LoggingHandler | 110 - io.netty.common - 4.0.33.Final | [id: 0xbd1c6c68] BIND(0.0.0.0/0.0.0.0:6640)
2016-01-05 01:12:58,119 | INFO | ntLoopGroup-10-1 | LoggingHandler | 110 - io.netty.common - 4.0.33.Final | [id: 0xbd1c6c68, /0:0:0:0:0:0:0:0:6640] ACTIVE
2016-01-05 01:12:58,783 | WARN | ult-dispatcher-2 | ShardManager | 151 - org.opendaylight.controller.sal-distributed-datastore - 1.3.0.SNAPSHOT | Supervisor Strategy caught unexpected exception - resuming
java.lang.IllegalArgumentException: Unsupported modification APPEARED

Comment by Anil Vishnoi [ 05/Jan/16 ]

please let me know if you need more details.

Thanks
Anil

Comment by Tony Tkacik [ 08/Jan/16 ]

https://git.opendaylight.org/gerrit/32260

Generated at Wed Feb 07 20:53:35 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.