[SXP-9] Clustering : Read from datastore failing with Exception: Metadata not available for modification

Thu, 3 May 2018 15:53:33 +0000

In SXP project, a simple read from datastore failed with ReadFailedException due to:
java.lang.IllegalArgumentException: Metadata not available for modification

Sumbitting this bug under clustering, since this was not seen with a regular datastore. Could somebody from clustering confirm this ?

Logged error:

2015-04-14 11:17:40,864 | ERROR | lt-dispatcher-17 | InMemoryDataTreeModification | 104 - org.opendaylight.yangtools.yang-data-impl - 0.7.0.SNAPSHOT | Could not create snapshot for /(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)network-topology/topology/topology[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)topology-id=sxp}

]/node:NodeModification [identifier=(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node, modificationType=TOUCH, childModification={(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=0.17.34.53}

]=NodeModification [identifier=(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=0.17.34.53}

], modificationType=TOUCH, childModification={AugmentationIdentifier

{childNames=[(urn:opendaylight:sxp:node?revision=2014-10-02)source-ip, (urn:opendaylight:sxp:node?revision=2014-10-02)security, (urn:opendaylight:sxp:node?revision=2014-10-02)mapping-expanded, (urn:opendaylight:sxp:node?revision=2014-10-02)enabled, (urn:opendaylight:sxp:node?revision=2014-10-02)master-database, (urn:opendaylight:sxp:node?revision=2014-10-02)version, (urn:opendaylight:sxp:node?revision=2014-10-02)name, (urn:opendaylight:sxp:node?revision=2014-10-02)sxp-database, (urn:opendaylight:sxp:node?revision=2014-10-02)timers, (urn:opendaylight:sxp:node?revision=2014-10-02)tcp-port, (urn:opendaylight:sxp:node?revision=2014-10-02)connections, (urn:opendaylight:sxp:node?revision=2014-10-02)capabilities, (urn:opendaylight:sxp:node?revision=2014-10-02)description]}

=NodeModification [identifier=AugmentationIdentifier

, modificationType=TOUCH, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)master-database=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)master-database, modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)source=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)source, modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)source[

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)source[

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

], modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group, modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group[

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group[

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

], modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)sgt, modificationType=MERGE, childModification={}], (urn:opendaylight:sxp:node?revision=2014-10-02)binding=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding, modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)binding[

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding[

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=0.17.34.53}

], modificationType=TOUCH, childModification={AugmentationIdentifier

=NodeModification [identifier=AugmentationIdentifier

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)source[

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group[

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding[

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

], modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix, modificationType=MERGE, childModification={}]}]}]}]}], (urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source, modificationType=MERGE, childModification={}]}]}]}]}]}]]
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145)[64:com.google.guava:18.0.0]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.apply(SchemaAwareApplyOperation.java:192)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.mutateChildren(AbstractNodeContainerModificationStrategy.java:113)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.applyTouch(AbstractNodeContainerModificationStrategy.java:155)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.apply(SchemaAwareApplyOperation.java:194)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.InMemoryDataTreeModification.resolveSnapshot(InMemoryDataTreeModification.java:111)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.InMemoryDataTreeModification.readNode(InMemoryDataTreeModification.java:95)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.controller.md.sal.dom.store.impl.SnapshotBackedReadTransaction.read(SnapshotBackedReadTransaction.java:61)[174:org.opendaylight.controller.sal-inmemory-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.ShardTransaction.readData(ShardTransaction.java:122)[193:org.opendaylight.controller.sal-distributed-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.ShardReadTransaction.handleReceive(ShardReadTransaction.java:48)[193:org.opendaylight.controller.sal-distributed-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.common.actor.AbstractUntypedActor.onReceive(AbstractUntypedActor.java:34)[185:org.opendaylight.controller.sal-clustering-commons:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:97)[185:org.opendaylight.controller.sal-clustering-commons:1.2.0.SNAPSHOT]
at akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:534)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.ActorCell.invoke(ActorCell.scala:487)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.run(Mailbox.scala:221)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.exec(Mailbox.scala:231)[178:com.typesafe.akka.actor:2.3.9]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
2015-04-14 11:17:40,864 | ERROR | lt-dispatcher-17 | SnapshotBackedReadTransaction | 174 - org.opendaylight.controller.sal-inmemory-datastore - 1.2.0.SNAPSHOT | Tx: member-1-shard-topology-operational-341 Failed Read of /(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)network-topology/topology/topology[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)topology-id=sxp}

]/node/node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=127.0.0.1}

]/AugmentationIdentifier

/(urn:opendaylight:sxp:node?revision=2014-10-02)master-database
java.lang.IllegalArgumentException: Metadata not available for modification [NodeModification [identifier=(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=0.17.34.53}

], modificationType=TOUCH, childModification={AugmentationIdentifier

=NodeModification [identifier=AugmentationIdentifier

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)source[

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group[

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding[

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

], modificationType=MERGE, childModification={(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix, modificationType=MERGE, childModification={}]}]}]}]}], (urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source, modificationType=MERGE, childModification={}]}]}]}]}]}]]
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145)[64:com.google.guava:18.0.0]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.apply(SchemaAwareApplyOperation.java:192)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.mutateChildren(AbstractNodeContainerModificationStrategy.java:113)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.AbstractNodeContainerModificationStrategy.applyTouch(AbstractNodeContainerModificationStrategy.java:155)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.SchemaAwareApplyOperation.apply(SchemaAwareApplyOperation.java:194)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.InMemoryDataTreeModification.resolveSnapshot(InMemoryDataTreeModification.java:111)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.yangtools.yang.data.impl.schema.tree.InMemoryDataTreeModification.readNode(InMemoryDataTreeModification.java:95)[104:org.opendaylight.yangtools.yang-data-impl:0.7.0.SNAPSHOT]
at org.opendaylight.controller.md.sal.dom.store.impl.SnapshotBackedReadTransaction.read(SnapshotBackedReadTransaction.java:61)[174:org.opendaylight.controller.sal-inmemory-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.ShardTransaction.readData(ShardTransaction.java:122)[193:org.opendaylight.controller.sal-distributed-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.datastore.ShardReadTransaction.handleReceive(ShardReadTransaction.java:48)[193:org.opendaylight.controller.sal-distributed-datastore:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.common.actor.AbstractUntypedActor.onReceive(AbstractUntypedActor.java:34)[185:org.opendaylight.controller.sal-clustering-commons:1.2.0.SNAPSHOT]
at org.opendaylight.controller.cluster.common.actor.MeteringBehavior.apply(MeteringBehavior.java:97)[185:org.opendaylight.controller.sal-clustering-commons:1.2.0.SNAPSHOT]
at akka.actor.ActorCell$$anonfun$become$1.applyOrElse(ActorCell.scala:534)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)[178:com.typesafe.akka.actor:2.3.9]
at akka.actor.ActorCell.invoke(ActorCell.scala:487)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.run(Mailbox.scala:221)[178:com.typesafe.akka.actor:2.3.9]
at akka.dispatch.Mailbox.exec(Mailbox.scala:231)[178:com.typesafe.akka.actor:2.3.9]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[175:org.scala-lang.scala-library:2.10.4.v20140209-180020-VFINAL-b66a39653b]
2015-04-14 11:17:40,865 | WARN | pool-56-thread-1 | BindingDispatcher | 95 - org.opendaylight.sxp.core - 1.1.0.SNAPSHOT | [127.0.0.1] Processing export DatabaseAccessException | [127.0.0.1] MasterDatabaseAccessImpl reading | ExecutionException | ReadFailedException{message=Error reading data for path /(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)network-topology/topology/topology[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)topology-id=sxp}

]/node/node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=127.0.0.1}

]/AugmentationIdentifier

/(urn:opendaylight:sxp:node?revision=2014-10-02)master-database, errorList=[RpcError [message=Error reading data for path /(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)network-topology/topology/topology[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)topology-id=sxp}

]/node/node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=127.0.0.1}

]/AugmentationIdentifier

/(urn:opendaylight:sxp:node?revision=2014-10-02)master-database, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=ReadFailedException{message=Read failed, errorList=[RpcError [message=Read failed, severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=java.lang.IllegalArgumentException: Metadata not available for modification [NodeModification [identifier=(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node[

{(urn:TBD:params:xml:ns:yang:network-topology?revision=2013-10-21)node-id=0.17.34.53}

], modificationType=TOUCH, childModification={AugmentationIdentifier

=NodeModification [identifier=AugmentationIdentifier

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)source[

{(urn:opendaylight:sxp:node?revision=2014-10-02)binding-source=local}

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)prefix-group[

{(urn:opendaylight:sxp:node?revision=2014-10-02)sgt=10}

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

]=NodeModification [identifier=(urn:opendaylight:sxp:node?revision=2014-10-02)binding[

{(urn:opendaylight:sxp:node?revision=2014-10-02)ip-prefix=99.2.2.2/32}

OpenDaylight JIRA

[SXP-9] Clustering : Read from datastore failing with Exception: Metadata not available for modification