[CONTROLLER-1478] Switch reconciliation is not happening after leader node restart in 3 node cluster

Thu, 19 Oct 2017 22:33:47 +0000

Build used :
===================
Karaf distro from ODL Beryllium master code

Test Type :
===================
Switch reconciliation is not happening after leader node restart in 3 node cluster.

Objective of test :
===================
verify Switch reconciliation when leader node is restarted.

Test Steps :
============
1. Bring up healthy 3 node cluster.
2. c1, c2 and c3 nodes are up. c1 is leader for config and operational inventory shard.
3. push 1000 flows from leader node c1 to 3 switchs (s1,s2 and s3).
4. connect 1 switch per node to c1, c2 and c3 node. (switch s1 connected to c1, switch s2 connected to c2 and switch s3 connected to c3)
5. total flows in 3 switchs is 3000
6. disconnect switch s1 from c1 node.
7. stop c1 node
8. push 200 more flows from leader node c1 to 3 switchs.
9. start c1 node
10. now c3 node is leader for config inventory shard and c2 is leader for operational inventory shard.
11. checked total flows in config data store is 3000 but expected is 3600
12. reconnect switchs s1 to c1 node.
13. total flows in reconnected switch s1 is 0 but expected number of flows is 1200 after resync.

Note:
1. there is AskTimeOutException in c3 node after step 7 (refer logs in folder jan29_till_step7).
2. after step 12, there is AskTimeOutException exception in node c1 (refer logs in folder jan29_till_step12).

Controllers (to cross-check logs):
===================================
c1 - Controller 1 with IP 10.183.181.41
c2 - Controller 2 with IP 10.183.181.42
c3 - Controller 3 with IP 10.183.181.43

Enclosed Logs:
==============
c1.log for controller c1
c2.log for controller c2
c3.log for controller c3

OpenDaylight JIRA

[CONTROLLER-1478] Switch reconciliation is not happening after leader node restart in 3 node cluster