[NETCONF-418] Failed to process scaled data response from the netconf enabled device

Tue, 6 Aug 2019 19:30:42 +0000

Version: Boron

Controller is not able to process scaled data .
It got stuck for more than 10 minutes and not processing any other RESTCONF queries in this duration.

Xml output is about 145000 lines

POST /restconf/operations/network-topology:network-topology/topology/topology-netconf/node/bag2r/yang-ext:mount/show-route:get-route-information HTTP/1.1
Host: 10.209.1.8:8181
Accept: application/xml
Authorization: Basic
Content-Type: application/xml

Body:
<input>
</input>

Karaf Log:

{bag2r}: Rpc failure detected. Reconnecting netconf session
java.util.concurrent.CancellationException: Task was cancelled.
at com.google.common.util.concurrent.AbstractFuture.cancellationExceptionWithCause(AbstractFuture.java:392)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:137)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1308)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:457)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.cancel(AbstractFuture.java:134)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Futures$ChainingListenableFuture.cancel(Futures.java:871)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ForwardingFuture.cancel(ForwardingFuture.java:48)[38:com.google.guava:18.0.0]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade$RequestTimeoutTask.run(KeepaliveSalFacade.java:254)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)[:1.8.0_121]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_121]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_121]
Caused by: java.util.concurrent.CancellationException: Future.cancel() was called.
at com.google.common.util.concurrent.AbstractFuture$Sync.complete(AbstractFuture.java:378)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.cancel(AbstractFuture.java:355)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.cancel(AbstractFuture.java:131)[38:com.google.guava:18.0.0]
... 10 more
2017-05-10 14:14:04,468 | ERROR | ssing-executor-8 | ExecutionList | 38 - com.google.guava - 18.0.0 | RuntimeException while executing runnable com.google.common.util.concurrent.Futures$6@5523530d with executor INSTANCE
java.lang.IllegalStateException: RemoteDevice{bag2r}

: Unable to reconnect, session listener is missing
at com.google.common.base.Preconditions.checkState(Preconditions.java:197)[38:com.google.guava:18.0.0]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade.reconnect(KeepaliveSalFacade.java:117)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade.access$700(KeepaliveSalFacade.java:47)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade$ResetKeepalive.onFailure(KeepaliveSalFacade.java:234)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1313)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:457)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.cancel(AbstractFuture.java:134)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Futures$ChainingListenableFuture.cancel(Futures.java:871)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ForwardingFuture.cancel(ForwardingFuture.java:48)[38:com.google.guava:18.0.0]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade$RequestTimeoutTask.run(KeepaliveSalFacade.java:254)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)[:1.8.0_121]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_121]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_121]
2017-05-10 14:14:12,671 | WARN | oupCloseable-3-7 | NetconfXMLToMessageDecoder | 98 - org.opendaylight.netconf.netty-util - 1.1.1.Boron-SR1 | XML message with unwanted leading bytes detected. Discarded the 1 leading byte(s): '0a'
2017-05-10 14:16:12,682 | WARN | oupCloseable-3-7 | NetconfXMLToMessageDecoder | 98 - org.opendaylight.netconf.netty-util - 1.1.1.Boron-SR1 | XML message with unwanted leading bytes detected. Discarded the 1 leading byte(s): '0a'
2017-05-10 14:18:12,711 | WARN | oupCloseable-3-7 | NetconfXMLToMessageDecoder | 98 - org.opendaylight.netconf.netty-util - 1.1.1.Boron-SR1 | XML message with unwanted leading bytes detected. Discarded the 1 leading byte(s): '0a'
2017-05-10 14:18:34,274 | WARN | ssionScavenger-3 | teInvalidatingHashSessionManager | 209 - org.ops4j.pax.web.pax-web-jetty - 3.2.9 | Timing out for 1 session(s) with id 1xowhlhw1fa981o0a60d277q04
2017-05-10 14:20:12,722 | WARN | oupCloseable-3-7 | NetconfXMLToMessageDecoder | 98 - org.opendaylight.netconf.netty-util - 1.1.1.Boron-SR1 | XML message with unwanted leading bytes detected. Discarded the 1 leading byte(s): '0a'
2017-05-10 14:22:12,752 | WARN | oupCloseable-3-7 | NetconfXMLToMessageDecoder | 98 - org.opendaylight.netconf.netty-util - 1.1.1.Boron-SR1 | XML message with unwanted leading bytes detected. Discarded the 1 leading byte(s): '0a'
2017-05-10 14:23:27,707 | WARN | ssing-executor-4 | KeepaliveSalFacade | 263 - org.opendaylight.netconf.sal-netconf-connector - 1.4.1.Boron-SR1 | RemoteDevice

{bag2r}: Rpc failure detected. Reconnecting netconf session
java.util.concurrent.CancellationException: Task was cancelled.
at com.google.common.util.concurrent.AbstractFuture.cancellationExceptionWithCause(AbstractFuture.java:392)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:137)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1308)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:457)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.cancel(AbstractFuture.java:134)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.Futures$ChainingListenableFuture.cancel(Futures.java:871)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.ForwardingFuture.cancel(ForwardingFuture.java:48)[38:com.google.guava:18.0.0]
at org.opendaylight.netconf.sal.connect.netconf.sal.KeepaliveSalFacade$RequestTimeoutTask.run(KeepaliveSalFacade.java:254)[263:org.opendaylight.netconf.sal-netconf-connector:1.4.1.Boron-SR1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)[:1.8.0_121]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)[:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_121]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_121]
Caused by: java.util.concurrent.CancellationException: Future.cancel() was called.
at com.google.common.util.concurrent.AbstractFuture$Sync.complete(AbstractFuture.java:378)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture$Sync.cancel(AbstractFuture.java:355)[38:com.google.guava:18.0.0]
at com.google.common.util.concurrent.AbstractFuture.cancel(AbstractFuture.java:131)[38:com.google.guava:18.0.0]
... 10 more
2017-05-10 14:23:27,708 | ERROR | ssing-executor-4 | ExecutionList | 38 - com.google.guava - 18.0.0 | RuntimeException while executing runnable com.google.common.util.concurrent.Futures$6@19b1fcfc with executor INSTANCE
java.lang.IllegalStateException: RemoteDevice{bag2r}

OpenDaylight JIRA

[NETCONF-418] Failed to process scaled data response from the netconf enabled device