https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/CONTROLLER-1439 controller <p>Recently Gary Wu was intermittently seeing a cluster island formed when the first seed node was re-started with the other members up. I also recently saw this in a production environment.</p> <p>According to akka's docs, on startup the first seed node tries every sec to contact the other seed nodes up to the seed-node-timeout. If none connect then it joins itself and declares itself a leader. The default seed-node-timeut is 5 sec. However this may not be enough in some cases. Akka has a mechanism to gate a node for 5 sec before allowing re-connect (it logs info messages about this). I think if the timing is right, the 5 sec gate could result in the seed node timeout. </p> <p>Gary increased the seed-node-timeout and that alleviated the island issue. I think we should increase it by default to 15 sec to be safe.</p> <p>Operating System: All<br/> Platform: All</p> CONTROLLER-1439

Increase seed-node-timeout to avoid cluster island

Bug Resolved Done Tom Pantelis Tom Pantelis Fri, 30 Oct 2015 21:42:32 +0000 Tue, 10 Nov 2015 03:04:37 +0000 Tue, 10 Nov 2015 03:04:37 +0000 Lithium clustering 0 2 <p>In my environment, increasing the seed-node-timeout to 10s seems to completely eliminate the issue.</p> <p>Also see <a href="https://github.com/akka/akka/issues/18757" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/akka/akka/issues/18757</a> for reference.</p> <p>I've seen similar intermittent failure in various test cases in LeaderTest. It always happens when the leader sends the first AppendEntries to the follower however the message goes to dead letters, which normally occurs and/or is supposed to occur when an actor is killed. This seems to be a timing issue/bug in akka, possibly with ActorSelection - maybe the actor isn't in a state to receive messages yet. </p> <p>I came up with a solution in <a href="https://git.opendaylight.org/gerrit/#/c/29027" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/29027</a> that appears to alleviate the issue as the LeaderTest ran successfully over 1000 times.</p> <p>Oops - I commented and closed the wrong bug. Re-opening.</p> <p>Master patch <a href="https://git.opendaylight.org/gerrit/#/c/29075" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/29075</a></p> Development External issue ID 4563 External issue URL Issue Type ODL SR Target Milestone Rank 0|i02qkv: