[OVSDB-281] Delete VM's Floating IP address,Stale Openflow Entries exist on Compute node.

Tue, 16 Feb 2016 16:34:31 +0000

Build#: Bery-RC1 Build
Openstack: stable/kilo
ODL config (on etc/custom.properties)
===========
ovsdb.of.version=1.3
ovsdb.l3.fwd.enabled=yes

local.conf snip
=======
enable_plugin networking-odl https://github.com/stackforge/networking-odl stable/kilo
Q_PLUGIN=ml2
ENABLE_TENANT_TUNNELS=True
Q_ML2_TENANT_NETWORK_TYPE=vxlan

Openstack setup
=================
eth0 => Mgmt Network eth1=> Data Network eth3 => External Network

Problem:
============
1.Have created VM-X(Compute-1: VM 33.1.1.3 <=> Floating ip 201.1.1.5) and verified the North-South is reachable.Respective br-int flow as below
**********************************************************************
openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "201.1.1.5"
cookie=0x0, duration=116.623s, table=20, n_packets=1, n_bytes=60, priority=1024,arp,in_port=2,arp_tpa=201.1.1.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]~~>NXM_OF_ETH_DST[],set_field:fa:16:3e:fd:90:97~~>eth_src,load:0x2->NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]~~>NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]~~>NXM_OF_ARP_TPA[],load:0xfa163efd9097->NXM_NX_ARP_SHA[],load:0xc9010105->NXM_OF_ARP_SPA[],IN_PORT
cookie=0x0, duration=116.591s, table=30, n_packets=68, n_bytes=6346, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:33.1.1.3->ip_dst,load:0x41b->NXM_NX_REG3[],goto_table:40
cookie=0x0, duration=116.573s, table=100, n_packets=52, n_bytes=6974, priority=512,ip,tun_id=0x41b,dl_dst=fa:16:3e:7f:fa:41,nw_src=33.1.1.3 actions=set_field:fa:16:3e:fd:90:97->eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee->eth_dst,set_field:201.1.1.5->ip_src,output:2

openflow@os-controller:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "33.1.1.3"
cookie=0x0, duration=973.838s, table=30, n_packets=68, n_bytes=6346, priority=1024,ip,in_port=2,nw_dst=201.1.1.5 actions=set_field:33.1.1.3->ip_dst,load:0x41b->NXM_NX_REG3[],goto_table:40
cookie=0x0, duration=973.820s, table=100, n_packets=52, n_bytes=6974, priority=512,ip,tun_id=0x41b,dl_dst=fa:16:3e:7f:fa:41,nw_src=33.1.1.3 actions=set_field:fa:16:3e:fd:90:97->eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee->eth_dst,set_field:201.1.1.5->ip_src,output:2

**********************************************

2.Deleted the VM-X (without releasing Floating IP's) and respective br-int OF flows doesnot removed from Compute-1.

3.Re-assiged the released Floating IP to another VM-Y on compute node 2 (Compute-2: VM 31.1.1.4 <=> Floating IP 201.1.1.5) and verified the North-South is reachable.

*********************************************************
openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "201.1.1.5"
cookie=0x0, duration=188.010s, table=20, n_packets=4, n_bytes=240, priority=1024,arp,in_port=3,arp_tpa=201.1.1.5,arp_op=1 actions=move:NXM_OF_ETH_SRC[]~~>NXM_OF_ETH_DST[],set_field:fa:16:3e:fd:90:97~~>eth_src,load:0x2->NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]~~>NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]~~>NXM_OF_ARP_TPA[],load:0xfa163efd9097->NXM_NX_ARP_SHA[],load:0xc9010105->NXM_OF_ARP_SPA[],IN_PORT
cookie=0x0, duration=187.988s, table=30, n_packets=83, n_bytes=9118, priority=1024,ip,in_port=3,nw_dst=201.1.1.5 actions=set_field:31.1.1.4->ip_dst,load:0x43b->NXM_NX_REG3[],goto_table:40
cookie=0x0, duration=187.955s, table=100, n_packets=73, n_bytes=11094, priority=512,ip,tun_id=0x43b,dl_dst=fa:16:3e:f1:b0:d0,nw_src=31.1.1.4 actions=set_field:fa:16:3e:fd:90:97->eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee->eth_dst,set_field:201.1.1.5->ip_src,output:3

openflow@os-compute1:~/kilo/devstack$ sudo ovs-ofctl -O openflow13 dump-flows br-int | grep "31.1.1.4"
cookie=0x0, duration=2094.057s, table=20, n_packets=0, n_bytes=0, priority=1024,arp,tun_id=0x43b,arp_tpa=31.1.1.4,arp_op=1 actions=move:NXM_OF_ETH_SRC[]~~>NXM_OF_ETH_DST[],set_field:fa:16:3e:68:21:3c~~>eth_src,load:0x2->NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]~~>NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]~~>NXM_OF_ARP_TPA[],load:0xfa163e68213c->NXM_NX_ARP_SHA[],load:0x1f010104->NXM_OF_ARP_SPA[],IN_PORT
cookie=0x0, duration=856.651s, table=30, n_packets=83, n_bytes=9118, priority=1024,ip,in_port=3,nw_dst=201.1.1.5 actions=set_field:31.1.1.4->ip_dst,load:0x43b->NXM_NX_REG3[],goto_table:40
cookie=0x0, duration=2078.355s, table=40, n_packets=0, n_bytes=0, priority=36001,ip,in_port=4,dl_src=fa:16:3e:68:21:3c,nw_src=31.1.1.4 actions=goto_table:50
cookie=0x0, duration=2095.689s, table=70, n_packets=105, n_bytes=11730, priority=1024,ip,tun_id=0x43b,nw_dst31.1.1.4 actions=set_field:fa:16:3e:68:21:3c->eth_dst,goto_table:80
cookie=0x0, duration=856.618s, table=100, n_packets=73, n_bytes=11094, priority=512,ip,tun_id=0x43b,dl_dst=fa:16:3e:f1:b0:d0,nw_src=31.1.1.4 actions=set_field:fa:16:3e:fd:90:97->eth_src,dec_ttl,set_field:00:01:e8:00:ee:ee->eth_dst,set_field:201.1.1.5->ip_src,output:3
*****************************************************************

4.As functionalities-wise,Its working.However the Stale Flow entries exist on deleted VM(i.e unreleased Floating IP deleted VM on Compute node-1).

OpenDaylight JIRA

[OVSDB-281] Delete VM's Floating IP address,Stale Openflow Entries exist on Compute node.