https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/NETCONF-327 netconf <p>In clustered setting mount point's transactions are delegated to one node in cluster and that node actually configures the device.</p> <p>The implementation however depends only on one write transaction at a time. So the delegated calls can interleave together, for example one node can submit transaction of the other node, etc.</p> <p>Operating System: All<br/> Platform: All</p> NETCONF-327

Incorrect handling of device transactions in clustered setting

Bug Resolved Done Jakub Morvay Jakub Morvay Mon, 5 Dec 2016 08:33:34 +0000 Fri, 15 Mar 2019 22:22:34 +0000 Fri, 17 Feb 2017 15:24:04 +0000 netconf 0 3 <p>The log error looks like re-usage of closed transaction. </p> <p>Example:<br/> 2016-11-30 16:26:42,824 | ERROR | on-dispatcher-44 | DataTreeChangeListenerActor | 205 - org.opendaylight.controller.sal-clustering-commons - 1.5.0.SNAPSHOT | Error notifying listener org.opendaylight.controller.md.sal.binding.impl.BindingClusteredDOMDataTreeChangeListenerAdapter@1bc842c8<br/> java.lang.IllegalStateException: RemoteDevice</p> {overcloud-controller-0.opnfvapex.com} <p>: Transaction org.opendaylight.netconf.sal.connect.netconf.sal.tx.WriteCandidateTx@395c290c already finished</p> <p>Cannot reliably reproduce, appears randomly when transaction.put/read/delete/submit etc. us used.</p> <p>Possible workaround is to close existing transaction and create a new one when this error is caught - this helps in most cases. Also ensure that only one netconf transaction is opened at a time.</p> <p>Tested with netconf-clustered-topology</p> <p>I think, the one reliable workaround is to have just one transaction open at once.<br/> You shouldn't see any problem with reused transactions than.</p> <p>Please report full exception stack.</p> <p>Without the stack trace, it is quite hard to track down what exactly is happening and what triggered the ISE.</p> <p>Full exception stack:</p> <p>2016-11-30 16:35:16,896 | ERROR | on-dispatcher-78 | DataTreeChangeListenerActor | 205 - org.opendaylight.controller.sal-clustering-commons - 1.5.0.SNAPSHOT | Error notifying listener org.opendaylight.controller.md.sal.binding.impl.BindingClusteredDOMDataTreeChangeListenerAdapter@8aec786<br/> java.lang.IllegalStateException: RemoteDevice</p> {overcloud-controller-0.opnfvapex.com} <p>: Transaction org.opendaylight.netconf.sal.connect.netconf.sal.tx.WriteCandidateTx@4dac5057 already finished<br/> at com.google.common.base.Preconditions.checkState(Preconditions.java:197)<span class="error">&#91;65:com.google.guava:18.0.0&#93;</span><br/> at org.opendaylight.netconf.sal.connect.netconf.sal.tx.AbstractWriteTx.checkNotFinished(AbstractWriteTx.java:66)<span class="error">&#91;310:org.opendaylight.netconf.sal-netconf-connector:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.netconf.sal.connect.netconf.sal.tx.AbstractWriteTx.commit(AbstractWriteTx.java:140)<span class="error">&#91;310:org.opendaylight.netconf.sal-netconf-connector:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.netconf.sal.connect.netconf.sal.tx.WriteCandidateTx.submit(WriteCandidateTx.java:97)<span class="error">&#91;310:org.opendaylight.netconf.sal-netconf-connector:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.netconf.topology.singleton.impl.tx.NetconfMasterDOMTransaction.submit(NetconfMasterDOMTransaction.java:154)<span class="error">&#91;313:org.opendaylight.netconf.topology-singleton:1.2.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.netconf.topology.singleton.impl.tx.NetconfWriteOnlyTransaction.submit(NetconfWriteOnlyTransaction.java:84)<span class="error">&#91;313:org.opendaylight.netconf.topology-singleton:1.2.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.netconf.sal.connect.netconf.sal.tx.ReadWriteTx.submit(ReadWriteTx.java:59)<span class="error">&#91;310:org.opendaylight.netconf.sal-netconf-connector:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.md.sal.binding.impl.AbstractWriteTransaction.doSubmit(AbstractWriteTransaction.java:134)<span class="error">&#91;173:org.opendaylight.controller.sal-binding-broker-impl:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.md.sal.binding.impl.BindingDOMWriteTransactionAdapter.submit(BindingDOMWriteTransactionAdapter.java:83)<span class="error">&#91;173:org.opendaylight.controller.sal-binding-broker-impl:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.vbd.impl.VppModifier.createVirtualInterfaceOnVpp(VppModifier.java:432)<span class="error">&#91;317:org.opendaylight.honeycomb.vbd.impl:1.1.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.vbd.impl.VbdBridgeDomain.addVxlanTunnel(VbdBridgeDomain.java:700)<span class="error">&#91;317:org.opendaylight.honeycomb.vbd.impl:1.1.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.vbd.impl.VbdBridgeDomain.modifyNode(VbdBridgeDomain.java:511)<span class="error">&#91;317:org.opendaylight.honeycomb.vbd.impl:1.1.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.vbd.impl.VbdBridgeDomain.handleModifiedChildren(VbdBridgeDomain.java:459)<span class="error">&#91;317:org.opendaylight.honeycomb.vbd.impl:1.1.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.vbd.impl.VbdBridgeDomain.onDataTreeChanged(VbdBridgeDomain.java:428)<span class="error">&#91;317:org.opendaylight.honeycomb.vbd.impl:1.1.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.md.sal.binding.impl.BindingDOMDataTreeChangeListenerAdapter.onDataTreeChanged(BindingDOMDataTreeChangeListenerAdapter.java:41)<span class="error">&#91;173:org.opendaylight.controller.sal-binding-broker-impl:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.cluster.datastore.DataTreeChangeListenerActor.dataChanged(DataTreeChangeListenerActor.java:54)<span class="error">&#91;211:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.cluster.datastore.DataTreeChangeListenerActor.handleReceive(DataTreeChangeListenerActor.java:35)<span class="error">&#91;211:org.opendaylight.controller.sal-distributed-datastore:1.5.0.SNAPSHOT&#93;</span><br/> at org.opendaylight.controller.cluster.common.actor.AbstractUntypedActor.onReceive(AbstractUntypedActor.java:28)<span class="error">&#91;205:org.opendaylight.controller.sal-clustering-commons:1.5.0.SNAPSHOT&#93;</span><br/> at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.actor.Actor$class.aroundReceive(Actor.scala:484)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.actor.ActorCell.invoke(ActorCell.scala:495)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.dispatch.Mailbox.run(Mailbox.scala:224)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at akka.dispatch.Mailbox.exec(Mailbox.scala:234)<span class="error">&#91;186:com.typesafe.akka.actor:2.4.11&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)<span class="error">&#91;181:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)<span class="error">&#91;181:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)<span class="error">&#91;181:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span><br/> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)<span class="error">&#91;181:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8&#93;</span></p> <p><a href="https://jira.opendaylight.org/browse/NETCONF-327" title="Incorrect handling of device transactions in clustered setting" class="issue-link" data-issue-key="NETCONF-327"><del>NETCONF-327</del></a> - Incorrect handling of device transactions in clustered setting</p> <p>(In reply to Jakub Morvay from comment #6)<br/> &gt; <a href="https://jira.opendaylight.org/browse/NETCONF-327" title="Incorrect handling of device transactions in clustered setting" class="issue-link" data-issue-key="NETCONF-327"><del>NETCONF-327</del></a> - Incorrect handling of device transactions in clustered setting</p> <p>Sorry for invalid comment..</p> <p><a href="https://git.opendaylight.org/gerrit/51875" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/51875</a></p> Development External issue ID 7295 External issue URL Issue Type ODL SR Target Milestone Rank 0|i01xuv: