https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/OVSDB-213 ovsdb <p>The Inter-network East West traffic is not workingm after a compute node is unstacked and restacked. The static Arp and L3 forwarding rules for inter-network east west traffic were not programmed after a unstack/restack for the compute node. This was the reason for failure. </p> <p>Sample static Arp and L3 forwarding flows:</p> <p>cookie=0x0, duration=14333.017s, table=20, n_packets=1, n_bytes=42, priority=1024,arp,tun_id=0x413,arp_tpa=1.0.0.3 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:2f:11:a8</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163e2f11a8-&gt;NXM_NX_ARP_SHA[],load:0x1000003-&gt;NXM_OF_ARP_SPA[],IN_PORT</p> <p>cookie=0x0, duration=14333.049s, table=70, n_packets=15, n_bytes=1910, priority=1024,ip,tun_id=0x413,nw_dst=1.0.0.3 actions=set_field:fa:16:3e:2f:11:a8-&gt;eth_dst,goto_table:80</p> <p>Operating System: All<br/> Platform: All</p> OVSDB-213

Inter-network East-west traffic does not work after a compute node is unstacked and re-stacked

Bug Resolved Done Josh Hershberg Ravi Shankar S Sun, 4 Oct 2015 16:10:22 +0000 Tue, 29 May 2018 14:57:24 +0000 Tue, 15 Mar 2016 13:41:43 +0000 unspecified openstack.net-virt 0 4 <p>can you give a little more info? My assumption is that when the node re-stacks<br/> it will have all the mdsal flows re-programmed, so the cache in the ovsdb L3 netvirt is unaffected.</p> <p>Clearing the cache doe not do anything about the programmed flows, thus I think I may be missing something here and gerrit <span class="error">&#91;1&#93;</span> is not addressing the bug.</p> <p><span class="error">&#91;1&#93;</span>: <a href="https://git.opendaylight.org/gerrit/#/c/27946/3/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/27946/3/</a></p> <p>Tested on: Bery-RC1,openstack(kilo)</p> <p>Steps to Reproduce:<br/> ===================<br/> 1.Stacked the Openstack Controller &amp; compute node1,node2<br/> 2.Created 2 networks and spawn vm's on each compute node(s)/networks.<br/> 3.Associated the one Floating IP address on atleast one VM/networks (across compute node1,node2<br/> 4.East-West traffic(across compute node),North-South traffic(across compute node) working fine.<br/> 5.Unstack the compute node-2 and restack<br/> 6.Spawn VM-x on compute node-2 and associated floating IP address.<br/> 7.VM-x unable to reach VM on compute node-1(i.e created on step 3) using local ip address (i.e east-west traffic not reachable).However its reachable via Floating IP of VM-x to VM on compute node-1.</p> <p>Workaround:<br/> =============<br/> If we reboot VM's (on compute node-1),then VM-x (on restacked compute node-2) manage to reach both local IP address (east-west) as well as floating ip address (north-south).</p> <p>Openflow table entries captures on both compute node before &amp; after reboot of VM.</p> <p>Here: 3.3.3.5 (compute node-1 VM's local IP),201.1.1.5 is floating IP address.</p> <p>Before reboot:<br/> ============<br/> openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "3.3.3.5"<br/> cookie=0x0, duration=546.107s, table=20, n_packets=0, n_bytes=0, priority=1024,arp,tun_id=0x446,arp_tpa=3.3.3.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:c9:60:51</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163ec96051-&gt;NXM_NX_ARP_SHA[],load:0x3030305-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=529.757s, table=30, n_packets=105, n_bytes=11706, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:3.3.3.5-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=546.107s, table=40, n_packets=132, n_bytes=14900, priority=36001,ip,in_port=1,dl_src=fa:16:3e:c9:60:51,nw_src=3.3.3.5 actions=goto_table:50<br/> cookie=0x0, duration=551.677s, table=70, n_packets=110, n_bytes=12728, priority=1024,ip,tun_id=0x446,nw_dst=3.3.3.5 actions=set_field:fa:16:3e:c9:60:51-&gt;eth_dst,goto_table:80<br/> cookie=0x0, duration=529.718s, table=100, n_packets=109, n_bytes=12698, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.5 actions=set_field:fa:16:3e:79:94:9d-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.5-&gt;ip_src,output:2</p> <p>openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "201.1.1.5"<br/> cookie=0x0, duration=613.934s, table=20, n_packets=1, n_bytes=60, priority=1024,arp,in_port=2,arp_tpa=201.1.1.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:79:94:9d</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163e79949d-&gt;NXM_NX_ARP_SHA[],load:0xc9010105-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=613.903s, table=30, n_packets=105, n_bytes=11706, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:3.3.3.5-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=613.864s, table=100, n_packets=109, n_bytes=12698, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.5 actions=set_field:fa:16:3e:79:94:9d-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.5-&gt;ip_src,output:2</p> <p>==========================</p> <p>openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "3.3.3.5"<br/> cookie=0x0, duration=564.976s, table=20, n_packets=2, n_bytes=84, priority=1024,arp,tun_id=0x446,arp_tpa=3.3.3.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:c9:60:51</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163ec96051-&gt;NXM_NX_ARP_SHA[],load:0x3030305-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=565.007s, table=70, n_packets=5, n_bytes=1022, priority=1024,ip,tun_id=0x446,nw_dst=3.3.3.5 actions=set_field:fa:16:3e:c9:60:51-&gt;eth_dst,goto_table:80</p> <p>openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "201.1.1.3" <br/> cookie=0x0, duration=3999.766s, table=20, n_packets=1, n_bytes=60, priority=1024,arp,in_port=2,arp_tpa=201.1.1.3,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:55:14:9a</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163e55149a-&gt;NXM_NX_ARP_SHA[],load:0xc9010103-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=3999.684s, table=30, n_packets=113, n_bytes=13062, priority=1024,ip,in_port=2,nw_dst=201.1.1.3 actions=set_field:3.3.3.4-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=3999.679s, table=100, n_packets=108, n_bytes=12000, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.4 actions=set_field:fa:16:3e:55:14:9a-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.3-&gt;ip_src,output:2<br/> openflow@os-controller:~/kilo/devstack$ </p> <p>================================================================================</p> <p>After reboot<br/> =============</p> <p>openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "201.1.1.5"<br/> cookie=0x0, duration=694.066s, table=20, n_packets=1, n_bytes=60, priority=1024,arp,in_port=2,arp_tpa=201.1.1.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:79:94:9d</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163e79949d-&gt;NXM_NX_ARP_SHA[],load:0xc9010105-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=694.035s, table=30, n_packets=105, n_bytes=11706, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:3.3.3.5-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=693.996s, table=100, n_packets=109, n_bytes=12698, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.5 actions=set_field:fa:16:3e:79:94:9d-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.5-&gt;ip_src,output:2</p> <p>openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "3.3.3.5"<br/> cookie=0x0, duration=711.907s, table=20, n_packets=0, n_bytes=0, priority=1024,arp,tun_id=0x446,arp_tpa=3.3.3.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:c9:60:51</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163ec96051-&gt;NXM_NX_ARP_SHA[],load:0x3030305-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=695.557s, table=30, n_packets=105, n_bytes=11706, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:3.3.3.5-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=711.907s, table=40, n_packets=132, n_bytes=14900, priority=36001,ip,in_port=1,dl_src=fa:16:3e:c9:60:51,nw_src=3.3.3.5 actions=goto_table:50<br/> cookie=0x0, duration=717.477s, table=70, n_packets=110, n_bytes=12728, priority=1024,ip,tun_id=0x446,nw_dst=3.3.3.5 actions=set_field:fa:16:3e:c9:60:51-&gt;eth_dst,goto_table:80<br/> cookie=0x0, duration=695.518s, table=100, n_packets=109, n_bytes=12698, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.5 actions=set_field:fa:16:3e:79:94:9d-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.5-&gt;ip_src,output:2</p> <p>==================<br/> openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl <del>O openflow13 dump-flows br-int | grep "201.1.1.3" cookie=0x0, duration=4078.356s, table=20, n_packets=1, n_bytes=60, priority=1024,arp,in_port=2,arp_tpa=201.1.1.3,arp_op=1 actions=move:NXM_OF_ETH_SRC[]</del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:55:14:9a-&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163e55149a-&gt;NXM_NX_ARP_SHA[],load:0xc9010103-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=4078.274s, table=30, n_packets=113, n_bytes=13062, priority=1024,ip,in_port=2,nw_dst=201.1.1.3 actions=set_field:3.3.3.4-&gt;ip_dst,load:0x446-&gt;NXM_NX_REG3[],goto_table:40<br/> cookie=0x0, duration=4078.269s, table=100, n_packets=108, n_bytes=12000, priority=512,ip,tun_id=0x446,dl_dst=fa:16:3e:05:a1:e8,nw_src=3.3.3.4 actions=set_field:fa:16:3e:55:14:9a-&gt;eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee-&gt;eth_dst,set_field:201.1.1.3-&gt;ip_src,output:2<br/> openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "3.3.3.5"<br/> cookie=0x0, duration=688.149s, table=20, n_packets=2, n_bytes=84, priority=1024,arp,tun_id=0x446,arp_tpa=3.3.3.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]<del>&gt;NXM_OF_ETH_DST[],set_field:fa:16:3e:c9:60:51</del>&gt;eth_src,load:0x2-&gt;NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]<del>&gt;NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]</del>&gt;NXM_OF_ARP_TPA[],load:0xfa163ec96051-&gt;NXM_NX_ARP_SHA[],load:0x3030305-&gt;NXM_OF_ARP_SPA[],IN_PORT<br/> cookie=0x0, duration=688.180s, table=70, n_packets=5, n_bytes=1022, priority=1024,ip,tun_id=0x446,nw_dst=3.3.3.5 actions=set_field:fa:16:3e:c9:60:51-&gt;eth_dst,goto_table:80</p> <p>master: <a href="https://git.opendaylight.org/gerrit/#/c/36067/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/36067/</a><br/> be: <a href="https://git.opendaylight.org/gerrit/#/c/36164/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/36164/</a></p> Duplicate OVSDB-215 Development External issue ID 4408 External issue URL ODL SR Target Milestone Priority Rank 0|i021cf: