[CONTROLLER-1481] Singleton Cluster is not happened

Thu, 19 Oct 2017 21:26:57 +0000

Cluster instances are 10.106.138.107, 10.106.138.111, 10.106.138.251

Observation-1 :

In 3 node cluster, If all nodes goes down and then restarted node (10.106.138.107) which node act as a leader when nodes are up. now achieved singleton cluster. the leader will be selected and this node act as singleton cluster

http://10.106.138.107:8181/jolokia/read/akka:type=Cluster

{"timestamp":1452166117,"status":200,"request":

{"mbean":"akka:type=Cluster","type":"read"}

,"value":{"Available":true,"ClusterStatus":"{\n \"self-address\": \"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.107:2550\",\n \"members\": [\n

{\n \"address\": \"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.107:2550\",\n \"status\": \"Up\"\n }

\n ],\n \"unreachable\": [\n \n ]\n}\n","Unreachable":"","Members":"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.107:2550","Leader":"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.107:2550","MemberStatus":"Up","Singleton":true}}

Observation-2 :

All 3 nodes goes down and then restarted any one of the non-leader node (10.106.138.251 and 10.106.138.111), leader will not be elected and not achieved singleton cluster.

http://10.106.138.251:8181/jolokia/read/akka:type=Cluster

{"timestamp":1452182366,"status":200,"request":

{"mbean":"akka:type=Cluster","type":"read"}

,"value":{"Available":false,"ClusterStatus":"

{\n \"self-address\": \"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.251:2550\",\n \"members\": [\n \n ],\n \"unreachable\": [\n \n ]\n}

\n","Unreachable":"","Members":"","Leader":"","MemberStatus":"Removed","Singleton":false}}

http://10.106.138.111:8181/jolokia/read/akka:type=Cluster

{"timestamp":1452165274,"status":200,"request":

{"mbean":"akka:type=Cluster","type":"read"}

,"value":{"Available":false,"ClusterStatus":"

{\n \"self-address\": \"akka.tcp:\/\/opendaylight-cluster-data@10.106.138.111:2550\",\n \"members\": [\n \n ],\n \"unreachable\": [\n \n ]\n}

\n","Unreachable":"","Members":"","Leader":"","MemberStatus":"Removed","Singleton":false}}

Many times I have tried but got above observations only.

Reproduce this issue, following below steps
1) 3-node is up
2) After election one node elected as a leader, then down all 3 nodes
3) Restart any one down node which is not act as a leader.

OpenDaylight JIRA

[CONTROLLER-1481] Singleton Cluster is not happened