Uploaded image for project: 'controller'
  1. controller
  2. CONTROLLER-1673

Leader failed to add shard replica: Error loading snapshot file

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Resolution: Done
    • None
    • None
    • clustering
    • None
    • Operating System: All
      Platform: All

    • 8444

    Description

      This has happened [0] in a suite for prefix-based shards when adding previously removed shard replica.

      Looking at karaf.log [1] the test started at 06:13:58,161 and there are two errors (aside of the one in the response):

      2017-05-14 06:14:33,442 | ERROR | am-dispatcher-69 | LocalSnapshotStore | 192 - org.opendaylight.controller.sal-clustering-commons - 1.5.0.Carbon | Error loading snapshot file snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781, remaining attempts: 0
      java.io.FileNotFoundException: snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781 (No such file or directory)
      at java.io.FileInputStream.open0(Native Method)[:1.8.0_121]
      at java.io.FileInputStream.open(FileInputStream.java:195)[:1.8.0_121]
      at java.io.FileInputStream.<init>(FileInputStream.java:138)[:1.8.0_121]
      at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.tryDeserializeAkkaSnapshot(LocalSnapshotStore.java:156)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
      at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.deserialize(LocalSnapshotStore.java:143)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
      at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.doLoad(LocalSnapshotStore.java:119)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
      at org.opendaylight.controller.cluster.persistence.LocalSnapshotStore.lambda$doLoadAsync$0(LocalSnapshotStore.java:109)[192:org.opendaylight.controller.sal-clustering-commons:1.5.0.Carbon]
      at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:97)[173:com.typesafe.akka.actor:2.4.17]
      at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
      at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
      at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)[173:com.typesafe.akka.actor:2.4.17]
      at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)[173:com.typesafe.akka.actor:2.4.17]
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)[169:org.scala-lang.scala-library:2.11.8.v20160304-115712-1706a37eb8]

      017-05-14 06:14:33,448 | ERROR | lt-dispatcher-32 | Shard | 174 - com.typesafe.akka.slf4j - 2.4.17 | Persistence failure when replaying events for persistenceId [member-3-shard-id-ints!-config]. Last known sequence number [0]
      java.io.FileNotFoundException: snapshots/snapshot-member-3-shard-id-ints%2521-config-31717-1494742432781 (No such file or directory)

      [0] https://logs.opendaylight.org/releng/jenkins092/controller-csit-3node-clustering-only-carbon/684/archives/log.html.gz#s1-s27-t2-k2-k11-k2-k3-k1-k4-k7-k1
      [1] https://logs.opendaylight.org/releng/jenkins092/controller-csit-3node-clustering-only-carbon/684/archives/odl3_karaf.log.gz

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            jmorvay@cisco.com Jakub Morvay
            vrpolak Vratko Polak
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: