[CONTROLLER-1901] cluster node quarantined, but the node did not auto restart when restore the network connection

Relates — Wed, 2 Jun 2021 09:31:35 +0000

In a three-node cluster environment, a cluster member is isolated by manual network isolation, and then the network is restored. It is found that the cluster members are not restarted.

Environment:

3 cluster nodes

member-01：172.20.14.162
member-02：172.20.14.163
member-03：172.20.14.164

odl-version: Oxygen-sr4(0.8.4)

Steps to reproduce:

config cluster
cluster nodes start
install feature:odl-mdsal-all
add reject route on node01 as:
route add -host 172.20.14.163 reject
route add -host 172.20.14.164 reject
few minutes later delete reject route as :
route del -host 172.20.14.163 reject
route del -host 172.20.14.164 reject
log always print "is still unreachable or has not been restarted. Keeping it quarantined."
node did not restart

cluster config use default settings, such as node01:

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = off
        canonical.hostname = "172.20.14.162"
        canonical.port = 2550
      }

      netty.tcp {
        hostname = "172.20.14.162"
        port = 2550
      }

      # when under load we might trip a false positive on the failure detector
      transport-failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s #
      }
    }

    cluster {
      # Remove ".tcp" when using artery.
      seed-nodes = ["akka.tcp://opendaylight-cluster-data@172.20.14.162:2550", "akka.tcp://opendaylight-cluster-data@172.20.14.163:2550", "akka.tcp://opendaylight-cluster-data@172.20.14.164:2550"] roles = ["member-1"]
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path.
      # The relative path is always relative to KARAF_HOME.
      snapshot-store.local.dir = "target/snapshots"
      journal.leveldb.dir = "target/journal"
      journal {
        leveldb {
          # Set native = off to use a Java-only implementation of leveldb.
          # Note that the Java-only version is not currently considered by Akka to be production quality.
          # native = off
        }
      }
    }
  }
}

OpenDaylight JIRA

[CONTROLLER-1901] cluster node quarantined, but the node did not auto restart when restore the network connection

Environment:

Steps to reproduce: