[CONTROLLER-1673] Leader failed to add shard replica: Error loading snapshot file

Tue, 25 Jul 2023 08:24:37 +0000

This has happened [0] in a suite for prefix-based shards when adding previously removed shard replica.

Looking at karaf.log [1] the test started at 06:13:58,161 and there are two errors (aside of the one in the response):

2017-05-14 06:14:33,442 | ERROR | am-dispatcher-69 | LocalSnapshotStore | 192 - org.opendaylight.controller.sal-clustering-commons - 1.5.0.Carbon | Error loading snapshot file snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781, remaining attempts: 0
java.io.FileNotFoundException: snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781 (No such file or directory)
at java.io.FileInputStream.open0(Native Method)[:1.8.0_121]
at java.io.FileInputStream.open(FileInputStream.java:195)[:1.8.0_121]
at java.io.FileInputStream.<init>(FileInputStream.java:138)[:1.8.0_121]
at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.tryDeserializeAkkaSnapshot(LocalSnapshotStore.java:156)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.deserialize(LocalSnapshotStore.java:143)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.doLoad(LocalSnapshotStore.java:119)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.lambda$doLoadAsync$0(LocalSnapshotStore.java:109)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97)[173:com.typesafe.akka.actor:2.4.17]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)[173:com.typesafe.akka.actor:2.4.17]
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)[173:com.typesafe.akka.actor:2.4.17]
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]

017-05-14 06:14:33,448 | ERROR | lt-dispatcher-32 | Shard | 174 - com.typesafe.akka.slf4j - 2.4.17 | Persistence failure when replaying events for persistenceId [member-3-shard-id-ints!-config]. Last known sequence number [0]
java.io.FileNotFoundException: snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781 (No such file or directory)

[0] https://logs.opendaylight.org/releng/jenkins092/controller-csit-3node-clustering-only-carbon/684/archives/log.html.gz#s1-s27-t2-k2-k11-k2-k3-k1-k4-k7-k1
[1] https://logs.opendaylight.org/releng/jenkins092/controller-csit-3node-clustering-only-carbon/684/archives/odl3_karaf.log.gz

OpenDaylight JIRA

[CONTROLLER-1673] Leader failed to add shard replica: Error loading snapshot file