[NETVIRT-820] DualStack: L3 forwarding broken, absence of appropriate OF rules Created: 04/Aug/17  Updated: 08/Nov/19  Resolved: 08/Nov/19

Status: Resolved
Project: netvirt
Component/s: General
Affects Version/s: Nitrogen
Fix Version/s: None

Type: Bug Priority: Medium
Reporter: Valentina Krasnobaeva Assignee: Valentina Krasnobaeva
Resolution: Cannot Reproduce Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All


External issue ID: 8928

 Description   

If we apply DualStack patch set:

git fetch https://git.opendaylight.org/gerrit/netvirt refs/changes/46/60246/37 && git checkout FETCH_HEAD

to current HEAD [0], we noticed a problem with L3 forwarding.

Steps to reproduce:

0. checkout patch set above and apply it to Nitrogen HEAD [1], compile a build

1. launch compiled build with following options in etc/custom.properties:

ovsdb.of.version=1.3
ovsdb.l3.fwd.enabled=yes
vpnservice.bgpspeaker.host.name = 127.0.0.1

install DevStack stable/newton

2. create following neutron network infrastructure:

2.1 neutron net-create A

2.2 neutron subnet-create --name SUB1 A 10.0.0.0/24

2.3 neutron subnet-create --name SUB2 --ip-version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --allocation-pool start=2001:db8:0:2::2,end=2001:db8:0:2:ffff:ffff:ffff:fffe A 2001:db8:0:2::/64

2.4 neutron router-create RT

2.5
root@controller-deray:/opt/stack/devstack# neutron subnet-list
----------------------------------------------------------------------------------------------------------------------------------+

id name cidr allocation_pools

----------------------------------------------------------------------------------------------------------------------------------+

44fd58bd-97d6-4c5f-8a6d-7c012e326155 SUB1 10.0.0.0/24 {"start": "10.0.0.2", "end": "10.0.0.254"}
75e6f5b8-9cf7-411e-a440-fdfedd995779 SUB2 2001:db8:0:2::/64 {"start": "2001:db8:0:2::2", "end": "2001:db8:0:2:ffff:ffff:ffff:fffe"}

----------------------------------------------------------------------------------------------------------------------------------+

2.6 # neutron router-interface-add RT 44fd58bd-97d6-4c5f-8a6d-7c012e326155
Added interface 703b9a7d-8de9-4089-8716-84c1789e359e to router RT.

2.7 # neutron router-interface-add RT 75e6f5b8-9cf7-411e-a440-fdfedd995779
Added interface 3820373a-4d9e-4af3-8506-571d73a25895 to router RT.

2.8 # neutron net-create B

2.9 # neutron subnet-create --name SUB4_B B 20.0.0.0/24

2.10 # neutron subnet-create --name SUB6_B --ip-version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --allocation-pool start=2001:db5:0:5::2,end=2001:db5:0:5:ffff:ffff:ffff:fffe B 2001
:db5:0:5::/64

2.11 # neutron router-interface-add RT SUB4_B.

2.12 # neutron router-interface-add RT SUB6_B.

2.13 # neutron security-group-create X

2.14

openstack security group rule create X --ingress --dst-port 1:65535 --protocol tcp
openstack security group rule create X --egress --dst-port 1:65535 --protocol tcp
openstack security group rule create X --egress --dst-port 1:65535 --protocol udp
openstack security group rule create X --ingress --dst-port 1:65535 --protocol udp
openstack security group rule create X --ingress --protocol icmp
openstack security group rule create X --egress --protocol icmp

openstack security group rule create X --ingress --ethertype IPv6 --dst-port 1:65535 --protocol tcp
openstack security group rule create X --ingress --ethertype IPv6 --dst-port 1:65535 --protocol udp
openstack security group rule create X --egress --ethertype IPv6 --dst-port 1:65535 --protocol udp
openstack security group rule create X --egress --ethertype IPv6 --dst-port 1:65535 --protocol tcp
openstack security group rule create X --ingress --ethertype IPv6 --protocol icmp
openstack security group rule create X --egress --ethertype IPv6 --protocol icmp

2.15

neutron port-create --name PORT1 --security-group X A

  1. neutron port-list | grep PORT1
    ea93a757-84af-4b0a-a43c-01d1f9b5e85f PORT1 fa:16:3e:84:3b:a1 {"subnet_id": "44fd58bd-97d6-4c5f-8a6d-7c012e326155", "ip_address": "10.0.0.5"}

2.16

openstack server create --image cirros-0.3.4-x86_64-uec --flavor m1.tiny --nic port-id=ea93a757-84af-4b0a-a43c-01d1f9b5e85f --security-group X VM1

2.17

neutron port-create --name PORT2 --security-group X B

2.18

openstack server create --image cirros-0.3.4-x86_64-uec --flavor m1.tiny --nic port-id=<PORT2_id> --security-group X VM2

3. Try to ping VM2 from network B from dhcp-namespace for network A, en vice-versa

root@controller-deray:/opt/stack/devstack# ip netns exec qdhcp-93bfb7f2-527d-47ed-a88b-eed291186c51 ping 20.0.0.5
PING 20.0.0.5 (20.0.0.5) 56(84) bytes of data.
64 bytes from 20.0.0.5: icmp_seq=1 ttl=64 time=1.58 ms
64 bytes from 20.0.0.5: icmp_seq=2 ttl=64 time=1.09 ms
64 bytes from 20.0.0.5: icmp_seq=3 ttl=64 time=1.21 ms
64 bytes from 20.0.0.5: icmp_seq=4 ttl=64 time=0.635 ms
64 bytes from 20.0.0.5: icmp_seq=5 ttl=64 time=0.792 ms
64 bytes from 20.0.0.5: icmp_seq=6 ttl=64 time=1.01 ms
64 bytes from 20.0.0.5: icmp_seq=7 ttl=64 time=0.801 ms
64 bytes from 20.0.0.5: icmp_seq=8 ttl=64 time=1.54 ms
64 bytes from 20.0.0.5: icmp_seq=9 ttl=64 time=0.720 ms
64 bytes from 20.0.0.5: icmp_seq=10 ttl=64 time=0.784 ms
64 bytes from 20.0.0.5: icmp_seq=11 ttl=64 time=0.990 ms
64 bytes from 20.0.0.5: icmp_seq=12 ttl=64 time=0.704 ms
64 bytes from 20.0.0.5: icmp_seq=13 ttl=64 time=1.22 ms
^C
— 20.0.0.5 ping statistics —
13 packets transmitted, 13 received, 0% packet loss, time 12003ms
rtt min/avg/max/mdev = 0.635/1.008/1.588/0.301 ms
root@controller-deray:/opt/stack/devstack# ip netns exec qdhcp-93bfb7f2-527d-47ed-a88b-eed291186c51 ping 10.0.0.8
PING 10.0.0.8 (10.0.0.8) 56(84) bytes of data.
From 20.0.0.2 icmp_seq=1 Destination Host Unreachable
From 20.0.0.2 icmp_seq=2 Destination Host Unreachable
From 20.0.0.2 icmp_seq=3 Destination Host Unreachable
From 20.0.0.2 icmp_seq=4 Destination Host Unreachable
From 20.0.0.2 icmp_seq=5 Destination Host Unreachable
From 20.0.0.2 icmp_seq=6 Destination Host Unreachable



 Comments   
Comment by Vivekanandan Narasimhan [ 04/Aug/17 ]

When you use custome security-groups, you have to configure the rules correctly. I donot see any rule to allow remote-ip-prefixes in your security group rules in section 2.14.

I would request you to use 'default' security group available in Neutron after making sure it has the ingress rules present in it.

neutron security-group-rule-list default

If the ingress rules are absent in above output please add them as below first:

neutron security-group-rule-create --direction ingress --ethertype ip --port_range_min 1 --port_range_max 65535 --remote_group_id default default

neutron security-group-rule-create default --direction ingress --ethertype ipv6 --port_range_min 1 --port_range_max 65535 --remote_group_id default default

After that boot VMs without giving any security-groups as it would automatically take the above 'default' security gorup.

After that initate both same-subnet(L2) and across-subnet(L3) pings and see if there is still a problem.

If there is still a problem, please attach the following flow dumps:
PortUUUID Of the 2 communicating VMs
IP Address of the 2 communicating VMs
"sudo ovs-vsctl show" output of both hypervisors
"sudo ovs-ofctl show br-int -O OpenFlow13 " output of both hypervisors.
"sudo ovs-ofctl dump-flows br-int -O OpenFlow13" output of both hypervisors.
"sudo ovs-ofctl dump-groups br-int -O OpenFlow13" output of both hypervisors.

Comment by Valentina Krasnobaeva [ 09/Aug/17 ]

Vivek, thanks a lot for your help.

When I apply a commit list from l3vpn-dual-stack-internet branch [0] to current Nitrogen HEAD [1]

[0] https://git.opendaylight.org/gerrit/#/c/57439/24
[1] https://git.opendaylight.org/gerrit/#/c/61251/

With default security group, which includes ingress rule, any traffic can not pass from dhcp-namespace to VM.

1. # neutron security-group-rule-list | grep ingress

0abd1732-7a6c-45cf-a884-7ace0b0beb4f default ingress IPv4 1-65535/udp default (group)
25f49a3b-f1bb-4122-8b88-8086e0d8e2b4 default ingress IPv6 1-65535/udp default (group)
31fe8cc1-b143-428e-a62f-988f73ed44fd default ingress IPv6 any default (group)
4bd88d5e-9a7b-4694-a90f-070a1a6dea36 default ingress IPv6 1-65535/tcp default (group)
4ea22f6a-f4f3-42bc-b3a6-336e25b470ff default ingress IPv4 any default (group)
56f40555-65d1-4bab-bf53-cc55526da2fa default ingress IPv4 1-65535/tcp default (group)
574b80d1-e068-4969-be90-c6c06404741f default ingress IPv4 1-65535/udp default (group)
6ab208b7-973d-4f0c-9dc8-4db6fc5225ce default ingress IPv6 1-65535/udp default (group)
817cfd12-9172-4c10-9396-dc0df8dc477c default ingress IPv6 any default (group)
a882c8a9-bd31-4632-9a3b-79e6e0c2a058 default ingress IPv4 icmp default (group)
a9d246b2-3e74-4f6d-9fe7-70c92d458f10 default ingress IPv6 icmp default (group)
d2c8adc7-7b97-4df9-b812-dd1b314665a6 default ingress IPv6 1-65535/tcp default (group)
d585e006-4166-46e5-ac66-a38125cce8fe default ingress IPv4 any default (group)
fa0e3dee-1eda-41b5-a33c-21e300552ecb default ingress IPv4 1-65535/tcp default (group)

root@controller-deray:/opt/stack/devstack#

2. Two VMs were started with following addresses:

root@controller-deray:/opt/stack/devstack# nova list
------------------------------------------------------------------------------------------------------------------+

ID Name Status Task State Power State Networks

------------------------------------------------------------------------------------------------------------------+

1153ad2a-f968-46be-9d0e-9df926280380 VM1 ACTIVE
Running B=2001:db3:0:3:f816:3eff:fe21:3743, 20.0.0.7
d9e83dd9-0616-48d5-8788-6d02491092a1 VM2 ACTIVE
Running A=2001:db2:0:2:f816:3eff:fe8c:641a, 10.0.0.10

------------------------------------------------------------------------------------------------------------------+
root@controller-deray:/opt/stack/devstack#

3. # neutron port-list | grep PORT

07fc7166-7111-4412-87f3-a5ee0e7e95f9 PORT2 fa:16:3e:21:37:43 {"subnet_id": "4b7e1395-5e19-4607-b7d2-5c19df5ae03e", "ip_address": "20.0.0.7"}
7bc7a1ec-f524-4c65-99b8-d48cbce148d3 PORT1 fa:16:3e:8c:64:1a {"subnet_id": "a3a6a7b2-afa8-4b72-bc0f-bc8bdbf33dea", "ip_address": "10.0.0.10"}

4. VXLAN tunnels were created:

root@controller-deray:/opt/stack/devstack# ovs-vsctl show
d7a55c6f-4e65-4785-bb5f-bdd693e4aab0
Manager "tcp:10.100.0.51:6640"
is_connected: true
Bridge br-int
Controller "tcp:10.100.0.51:6653"
is_connected: true
fail_mode: secure
Port "tapde157c2b-7f"
Interface "tapde157c2b-7f"
Port br-int
Interface br-int
type: internal
Port "tun1ed2941bbf0"
Interface "tun1ed2941bbf0"
type: vxlan
options:

{key=flow, local_ip="192.168.0.1", remote_ip="192.168.0.2"}

Port "tap577e4b01-d6"
Interface "tap577e4b01-d6"
Port "tun8345153c668"
Interface "tun8345153c668"
type: vxlan
options:

{key=flow, local_ip="192.168.0.1", remote_ip="192.168.0.3"}

ovs_version: "2.6.1"
root@controller-deray:/opt/stack/devstack#

  1. ovs-ofctl -O OpenFlow13 dump-ports-desc br-int
    OFPST_PORT_DESC reply (OF1.3) (xid=0x2):
    1(tapde157c2b-7f): addr:1e:be:bb:20:d8:2f
    config: 0
    state: 0
    current: 10GB-FD COPPER
    speed: 10000 Mbps now, 0 Mbps max
    2(tap577e4b01-d6): addr:8e:ef:c3:7d:5c:0b
    config: 0
    state: 0
    current: 10GB-FD COPPER
    speed: 10000 Mbps now, 0 Mbps max
    3(tun8345153c668): addr:ae:8a:65:ec:d7:c2
    config: 0
    state: 0
    speed: 0 Mbps now, 0 Mbps max
    4(tun1ed2941bbf0): addr:0a:1a:d5:20:c0:63
    config: 0
    state: 0
    speed: 0 Mbps now, 0 Mbps max
    LOCAL(br-int): addr:0c:ce:0c:5b:c7:9a
    config: PORT_DOWN
    state: LINK_DOWN
    speed: 0 Mbps now, 0 Mbps max
    root@controller-deray:/opt/stack/devstack#

root@controller-deray:/opt/stack/devstack# ip netns exec qdhcp-a513f912-4080-47af-8ed6-f34eb4188dd2 ping 20.0.0.7
PING 20.0.0.7 (20.0.0.7) 56(84) bytes of data.

root@controller-deray:/opt/stack/devstack# ip netns exec qdhcp-a513f912-4080-47af-8ed6-f34eb4188dd2 ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ns-577e4b01-d6@if48: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default qlen 1000
link/ether fa:16:3e:84:8e:bc brd ff:ff:ff:ff:ff:ff
inet 169.254.169.254/16 brd 169.254.255.255 scope global ns-577e4b01-d6
valid_lft forever preferred_lft forever
inet 20.0.0.2/24 brd 20.0.0.255 scope global ns-577e4b01-d6
valid_lft forever preferred_lft forever
inet6 2001:db3:0:3:f816:3eff:fe84:8ebc/64 scope global

5. root@controller-deray:/opt/stack/devstack# ovs-ofctl -O OpenFlow13 dump-flows br-int | grep -v n_packets=0
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x8000001, duration=67995.031s, table=0, n_packets=91834, n_bytes=6712663, priority=5,in_port=3 actions=write_metadata:0x50000000001/0xfffff0000000001,goto_table:36
cookie=0x8000001, duration=67978.544s, table=0, n_packets=91747, n_bytes=6680881, priority=5,in_port=4 actions=write_metadata:0x70000000001/0xfffff0000000001,goto_table:36
cookie=0x8000000, duration=68595.277s, table=0, n_packets=361, n_bytes=35434, priority=4,in_port=1,vlan_tci=0x0000/0x1fff actions=write_metadata:0x10000000000/0xffffff0000000001,goto_table:17
cookie=0x8000000, duration=68317.861s, table=0, n_packets=2043, n_bytes=197289, priority=4,in_port=2,vlan_tci=0x0000/0x1fff actions=write_metadata:0x20000000000/0xffffff0000000001,goto_table:17
cookie=0x8040000, duration=68594.085s, table=17, n_packets=358, n_bytes=35176, priority=10,metadata=0x10000000000/0xffffff0000000000 actions=load:0x1->NXM_NX_REG1[0..19],load:0x1389->NXM_NX_REG7[0..15],write_metadata:0xa000011389000000/0xfffffffffffffffe,goto_table:48
cookie=0x4000000, duration=68316.927s, table=17, n_packets=2043, n_bytes=197289, priority=10,metadata=0x20000000000/0xffffff0000000000 actions=write_metadata:0x900002138a000000/0xfffffffffffffffe,goto_table:45
cookie=0x8040000, duration=68316.927s, table=17, n_packets=2038, n_bytes=196851, priority=10,metadata=0x9000020000000000/0xffffff0000000000 actions=load:0x2->NXM_NX_REG1[0..19],load:0x138a->NXM_NX_REG7[0..15],write_metadata:0xa00002138a000000/0xfffffffffffffffe,goto_table:48
cookie=0x8000000, duration=68825.029s, table=17, n_packets=5, n_bytes=438, priority=0,metadata=0x8000000000000000/0xf000000000000000 actions=write_metadata:0x9000000000000000/0xf000000000000000,goto_table:80
cookie=0x9001389, duration=68594.090s, table=36, n_packets=465, n_bytes=44404, priority=5,tun_id=0x51 actions=write_metadata:0x1389000000/0xfffffffff000000,goto_table:51
cookie=0x900138a, duration=68316.939s, table=36, n_packets=517, n_bytes=46588, priority=5,tun_id=0x49 actions=write_metadata:0x138a000000/0xfffffffff000000,goto_table:51
cookie=0x4000000, duration=68825.029s, table=45, n_packets=2043, n_bytes=197289, priority=0 actions=resubmit(,17)
cookie=0x8500000, duration=68825.029s, table=48, n_packets=2396, n_bytes=232027, priority=0 actions=resubmit(,49),resubmit(,50)
cookie=0x8051389, duration=68594.090s, table=50, n_packets=358, n_bytes=35176, priority=20,metadata=0x11389000000/0xfffffffff000000,dl_src=fa:16:3e:75:61:74 actions=goto_table:51
cookie=0x805138a, duration=68316.939s, table=50, n_packets=2038, n_bytes=196851, priority=20,metadata=0x2138a000000/0xfffffffff000000,dl_src=fa:16:3e:84:8e:bc actions=goto_table:51
cookie=0x8031389, duration=68594.090s, table=51, n_packets=404, n_bytes=38994, priority=20,metadata=0x1389000000/0xffff000000,dl_dst=fa:16:3e:75:61:74 actions=load:0x100->NXM_NX_REG6[],resubmit(,220)
cookie=0x803138a, duration=68316.939s, table=51, n_packets=456, n_bytes=41178, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:84:8e:bc actions=load:0x200->NXM_NX_REG6[],resubmit(,220)
cookie=0x803138a, duration=2191.970s, table=51, n_packets=1735, n_bytes=167952, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:21:37:43 actions=set_field:0x49->tun_id,load:0x500->NXM_NX_REG6[],resubmit(,220)
cookie=0x8031389, duration=2174.198s, table=51, n_packets=69, n_bytes=7374, priority=20,metadata=0x1389000000/0xffff000000,dl_dst=fa:16:3e:8c:64:1a actions=set_field:0x51->tun_id,load:0x700->NXM_NX_REG6[],resubmit(,220)
cookie=0x8030000, duration=68825.029s, table=51, n_packets=228, n_bytes=15720, priority=0 actions=goto_table:52
cookie=0x8701389, duration=68594.090s, table=52, n_packets=54, n_bytes=2540, priority=5,metadata=0x1389000000/0xffff000001 actions=write_actions(group:210002)
cookie=0x8701389, duration=68594.090s, table=52, n_packets=61, n_bytes=5410, priority=5,metadata=0x1389000001/0xffff000001 actions=write_actions(group:210001)
cookie=0x870138a, duration=68316.939s, table=52, n_packets=52, n_bytes=2360, priority=5,metadata=0x138a000000/0xffff000001 actions=write_actions(group:210004)
cookie=0x870138a, duration=68316.939s, table=52, n_packets=61, n_bytes=5410, priority=5,metadata=0x138a000001/0xffff000001 actions=write_actions(group:210003)
cookie=0x8800001, duration=68594.090s, table=55, n_packets=54, n_bytes=2540, priority=10,tun_id=0x1,metadata=0x10000000000/0xfffff0000000000 actions=drop
cookie=0x8800002, duration=68316.939s, table=55, n_packets=52, n_bytes=2360, priority=10,tun_id=0x2,metadata=0x20000000000/0xfffff0000000000 actions=drop
cookie=0x8800001, duration=68594.090s, table=55, n_packets=61, n_bytes=5410, priority=9,tun_id=0x1 actions=load:0x100->NXM_NX_REG6[],resubmit(,220)
cookie=0x8800002, duration=68316.939s, table=55, n_packets=61, n_bytes=5410, priority=9,tun_id=0x2 actions=load:0x200->NXM_NX_REG6[],resubmit(,220)
cookie=0x1030000, duration=68824.754s, table=80, n_packets=5, n_bytes=438, priority=0 actions=resubmit(,17)
cookie=0x8000007, duration=68595.157s, table=220, n_packets=465, n_bytes=44404, priority=9,reg6=0x100 actions=output:1
cookie=0x8000007, duration=68317.838s, table=220, n_packets=517, n_bytes=46588, priority=9,reg6=0x200 actions=output:2
cookie=0x8000230, duration=67994.995s, table=220, n_packets=2037, n_bytes=196851, priority=6,reg6=0x500 actions=load:0x90000500->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=67994.995s, table=220, n_packets=2037, n_bytes=196851, priority=9,reg6=0x90000500 actions=output:3
cookie=0x8000230, duration=67978.488s, table=220, n_packets=351, n_bytes=34480, priority=6,reg6=0x700 actions=load:0x90000700->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=67978.488s, table=220, n_packets=351, n_bytes=34480, priority=9,reg6=0x90000700 actions=output:4
cookie=0x8000230, duration=68825.030s, table=230, n_packets=2388, n_bytes=231331, priority=0 actions=resubmit(,220)

Comment by Valentina Krasnobaeva [ 09/Aug/17 ]

root@controller-deray:/opt/stack/devstack# ovs-ofctl dump-groups br-int -O OpenFlow13
OFPST_GROUP_DESC reply (OF1.3) (xid=0x2):
group_id=210002,type=all,bucket=actions=group:210001,bucket=actions=resubmit(,220),load:0x700->NXM_NX_REG6[],set_field:0x51->tun_id
group_id=5000,type=all,bucket=actions=CONTROLLER:65535,bucket=actions=resubmit(,17),bucket=actions=resubmit(,81)
group_id=210001,type=all,bucket=actions=resubmit(,55),set_field:0x1->tun_id
group_id=210003,type=all,bucket=actions=resubmit(,55),set_field:0x2->tun_id
group_id=210004,type=all,bucket=actions=group:210003,bucket=actions=resubmit(,220),load:0x500->NXM_NX_REG6[],set_field:0x49->tun_id

Comment by Valentina Krasnobaeva [ 09/Aug/17 ]

icmp packets due to empty tcpdump at VXLAN iface do not go to the tunnel. They are losted in OVS at controller node and they pass by following pipeline:

cookie=0x8000000, duration=75988.185s, table=0, n_packets=2241, n_bytes=216413, priority=4,in_port=2,vlan_tci=0x0000/0x1fff actions=write_metadata:0x20000000000/0xffffff0000000001,goto_table:17

cookie=0x4000000, duration=75987.251s, table=17, n_packets=2241, n_bytes=216413, priority=10,metadata=0x20000000000/0xffffff0000000000 actions=write_metadata:0x900002138a000000/0xfffffffffffffffe,goto_table:45

cookie=0x8040000, duration=75987.251s, table=17, n_packets=2236, n_bytes=215975, priority=10,metadata=0x9000020000000000/0xffffff0000000000 actions=load:0x2->NXM_NX_REG1[0..19],load:0x138a->NXM_NX_REG7[0..15],write_metadata:0xa00002138a000000/0xfffffffffffffffe,goto_table:48

cookie=0x4000000, duration=76495.353s, table=45, n_packets=2241, n_bytes=216413, priority=0 actions=resubmit(,17)

cookie=0x8500000, duration=76495.353s, table=48, n_packets=2594, n_bytes=251151, priority=0 actions=resubmit(,49),resubmit(,50)

cookie=0x805138a, duration=75987.263s, table=50, n_packets=2236, n_bytes=215975, priority=20,metadata=0x2138a000000/0xfffffffff000000,dl_src=fa:16:3e:84:8e:bc actions=goto_table:51

cookie=0x803138a, duration=75987.263s, table=51, n_packets=461, n_bytes=41388, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:84:8e:bc actions=load:0x200->NXM_NX_REG6[],resubmit(,220)

cookie=0x803138a, duration=9862.294s, table=51, n_packets=1933, n_bytes=187076, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:21:37:43 actions=set_field:0x49->tun_id,load:0x500->NXM_NX_REG6[],resubmit(,220)

cookie=0x8000230, duration=75665.319s, table=220, n_packets=2235, n_bytes=215975, priority=6,reg6=0x500 actions=load:0x90000500->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230

cookie=0x8000230, duration=76495.353s, table=230, n_packets=2586, n_bytes=250455, priority=0 actions=resubmit(,220) ---> here we can see that packets are going to the loop

Comment by Valentina Krasnobaeva [ 09/Aug/17 ]

as queried ovs details from compute-2 node, where VM was actually spawned:

root@compute2-deray:~# ovs-vsctl show
de7f671e-c3c3-4709-9dc2-1145f0999ca3
Manager "tcp:10.100.0.51:6640"
is_connected: true
Bridge br-int
Controller "tcp:10.100.0.51:6653"
is_connected: true
fail_mode: secure
Port "tun78d03448a8a"
Interface "tun78d03448a8a"
type: vxlan
options:

{key=flow, local_ip="192.168.0.3", remote_ip="192.168.0.1"}

Port "tun3760c2d6ae0"
Interface "tun3760c2d6ae0"
type: vxlan
options:

{key=flow, local_ip="192.168.0.3", remote_ip="192.168.0.2"}

Port br-int
Interface br-int
type: internal
Port "tap07fc7166-71"
Interface "tap07fc7166-71"
ovs_version: "2.6.1"
root@compute2-deray:~#

root@compute2-deray:~# ovs-ofctl -O OpenFlow13 dump-ports-desc br-int
OFPST_PORT_DESC reply (OF1.3) (xid=0x2):
2(tun78d03448a8a): addr:2e:95:86:6c:9d:0d
config: 0
state: 0
speed: 0 Mbps now, 0 Mbps max
4(tun3760c2d6ae0): addr:ba:4f:16:47:e9:31
config: 0
state: 0
speed: 0 Mbps now, 0 Mbps max
6(tap07fc7166-71): addr:fe:16:3e:21:37:43
config: 0
state: 0
current: 10MB-FD COPPER
speed: 10 Mbps now, 0 Mbps max
LOCAL(br-int): addr:c8:9c:76:70:3b:7f
config: PORT_DOWN
state: LINK_DOWN
speed: 0 Mbps now, 0 Mbps max
root@compute2-deray:~#

root@compute2-deray:~# ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x8000001, duration=76683.902s, table=0, n_packets=106296, n_bytes=7805974, priority=5,in_port=2 actions=write_metadata:0x40000000001/0xfffff0000000001,goto_table:36
cookie=0x8000001, duration=76067.496s, table=0, n_packets=102156, n_bytes=7426881, priority=5,in_port=4 actions=write_metadata:0xa0000000001/0xfffff0000000001,goto_table:36
cookie=0x8000000, duration=10881.260s, table=0, n_packets=202, n_bytes=14664, priority=4,in_port=6,vlan_tci=0x0000/0x1fff actions=write_metadata:0x30000000000/0xffffff0000000001,goto_table
:17
cookie=0x8040000, duration=75914.340s, table=17, n_packets=0, n_bytes=0, priority=10,metadata=0x60000000000/0xffffff0000000000 actions=load:0x6->NXM_NX_REG1[0..19],load:0x138a->NXM_NX_REG7
[0..15],write_metadata:0xa00006138a000000/0xfffffffffffffffe,goto_table:48
cookie=0x4000000, duration=10881.217s, table=17, n_packets=201, n_bytes=14574, priority=10,metadata=0x7000030000000000/0xffffff0000000000 actions=write_metadata:0x900003138a000000/0xffffff
fffffffffe,goto_table:45
cookie=0x8040000, duration=10881.217s, table=17, n_packets=200, n_bytes=14504, priority=10,metadata=0x9000030000000000/0xffffff0000000000 actions=load:0x3->NXM_NX_REG1[0..19],load:0x138a->
NXM_NX_REG7[0..15],write_metadata:0xa00003138a000000/0xfffffffffffffffe,goto_table:48
cookie=0x6900000, duration=10881.217s, table=17, n_packets=202, n_bytes=14664, priority=10,metadata=0x30000000000/0xffffff0000000000 actions=write_metadata:0x7000030000fffffe/0xfffffffffff
ffffe,goto_table:211
cookie=0x8000000, duration=77723.309s, table=17, n_packets=0, n_bytes=0, priority=0,metadata=0x8000000000000000/0xf000000000000000 actions=write_metadata:0x9000000000000000/0xf000000000000
000,goto_table:80
cookie=0x6800000, duration=77723.309s, table=18, n_packets=0, n_bytes=0, priority=0 actions=goto_table:38
cookie=0x1080000, duration=77723.029s, table=19, n_packets=0, n_bytes=0, priority=100,arp,arp_op=2 actions=CONTROLLER:65535,resubmit(,17)
cookie=0x1080000, duration=77723.029s, table=19, n_packets=0, n_bytes=0, priority=100,arp,arp_op=1 actions=group:5000
cookie=0x1080000, duration=77723.029s, table=19, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x1030000, duration=77723.029s, table=20, n_packets=0, n_bytes=0, priority=0 actions=goto_table:80
cookie=0x8000004, duration=77723.029s, table=22, n_packets=0, n_bytes=0, priority=0 actions=CONTROLLER:65535
cookie=0x1080000, duration=77723.029s, table=23, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x900138a, duration=10880.294s, table=36, n_packets=2995, n_bytes=288688, priority=5,tun_id=0x49 actions=write_metadata:0x138a000000/0xfffffffff000000,goto_table:51
cookie=0x905138a, duration=10881.252s, table=38, n_packets=0, n_bytes=0, priority=5,tun_id=0x49 actions=write_metadata:0x138a000000/0xfffffffff000000,goto_table:51
cookie=0x4000000, duration=76684.911s, table=45, n_packets=1, n_bytes=70, priority=50,icmp6,metadata=0x1389000000/0xffff000000,icmp_type=133,icmp_code=0 actions=CONTROLLER:65535
cookie=0x4000000, duration=76068.928s, table=45, n_packets=3, n_bytes=210, priority=50,icmp6,metadata=0x138a000000/0xffff000000,icmp_type=133,icmp_code=0 actions=CONTROLLER:65535
cookie=0x4000000, duration=76684.911s, table=45, n_packets=0, n_bytes=0, priority=50,icmp6,metadata=0x1389000000/0xffff000000,icmp_type=135,icmp_code=0,nd_target=2001:db2:0:2::1 actions=CO
NTROLLER:65535
cookie=0x4000000, duration=76684.911s, table=45, n_packets=0, n_bytes=0, priority=50,icmp6,metadata=0x1389000000/0xffff000000,icmp_type=135,icmp_code=0,nd_target=fe80::f816:3eff:fef8:969d
actions=CONTROLLER:65535
cookie=0x4000000, duration=76068.928s, table=45, n_packets=0, n_bytes=0, priority=50,icmp6,metadata=0x138a000000/0xffff000000,icmp_type=135,icmp_code=0,nd_target=2001:db3:0:3::1 actions=CO
NTROLLER:65535
cookie=0x4000000, duration=76068.928s, table=45, n_packets=0, n_bytes=0, priority=50,icmp6,metadata=0x138a000000/0xffff000000,icmp_type=135,icmp_code=0,nd_target=fe80::f816:3eff:feae:3b20
actions=CONTROLLER:65535
cookie=0x4000000, duration=77723.309s, table=45, n_packets=554, n_bytes=48142, priority=0 actions=resubmit(,17)
cookie=0x8500000, duration=77723.309s, table=48, n_packets=554, n_bytes=48142, priority=0 actions=resubmit(,49),resubmit(,50)
cookie=0x805138a, duration=10880.294s, table=50, n_packets=200, n_bytes=14504, priority=20,metadata=0x3138a000000/0xfffffffff000000,dl_src=fa:16:3e:21:37:43 actions=goto_table:51
cookie=0x8050001, duration=77723.309s, table=50, n_packets=0, n_bytes=0, priority=10,reg4=0x1 actions=goto_table:51
cookie=0x8050000, duration=77723.309s, table=50, n_packets=0, n_bytes=0, priority=0 actions=CONTROLLER:65535,learn(table=49,hard_timeout=10,priority=0,cookie=0x8600000,NXM_OF_ETH_SRC[],NXM
_NX_REG1[0..19],load:0x1->NXM_NX_REG4[0..7]),goto_table:51
cookie=0x803138a, duration=10880.294s, table=51, n_packets=2983, n_bytes=288184, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:21:37:43 actions=load:0x300->NXM_NX_REG6[],r
esubmit(,220)
cookie=0x803138a, duration=10880.294s, table=51, n_packets=185, n_bytes=13162, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:84:8e:bc actions=set_field:0x49->tun_id,load:0x400->NXM_NX_REG6[],resubmit(,220)
cookie=0x8030000, duration=77723.309s, table=51, n_packets=0, n_bytes=0, priority=15,dl_dst=01:80:c2:00:00:00/ff:ff:ff:ff:ff:f0 actions=drop
cookie=0x8030000, duration=77723.309s, table=51, n_packets=110, n_bytes=7512, priority=0 actions=goto_table:52
cookie=0x870138a, duration=10880.294s, table=52, n_packets=15, n_bytes=1342, priority=5,metadata=0x138a000000/0xffff000001 actions=write_actions(group:210004)
cookie=0x870138a, duration=10880.294s, table=52, n_packets=12, n_bytes=504, priority=5,metadata=0x138a000001/0xffff000001 actions=write_actions(group:210003)
cookie=0x8800003, duration=10880.294s, table=55, n_packets=15, n_bytes=1342, priority=10,tun_id=0x3,metadata=0x30000000000/0xfffff0000000000 actions=drop
cookie=0x8800003, duration=10880.294s, table=55, n_packets=12, n_bytes=504, priority=9,tun_id=0x3 actions=load:0x300->NXM_NX_REG6[],resubmit(,220)
cookie=0x6800000, duration=77723.309s, table=60, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x1030000, duration=77723.029s, table=80, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x8220000, duration=77723.029s, table=81, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x4000001, duration=77723.309s, table=90, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x6900000, duration=10881.071s, table=211, n_packets=2, n_bytes=676, priority=63010,udp,metadata=0x30000000000/0xfffff0000000000,tp_src=68,tp_dst=67 actions=resubmit(,17)
cookie=0x6900000, duration=10881.069s, table=211, n_packets=0, n_bytes=0, priority=63010,udp6,metadata=0x30000000000/0xfffff0000000000,tp_src=546,tp_dst=547 actions=resubmit(,17)
cookie=0x6900000, duration=10881.066s, table=211, n_packets=0, n_bytes=0, priority=63010,udp,metadata=0x30000000000/0xfffff0000000000,tp_src=67,tp_dst=68 actions=drop
cookie=0x6900000, duration=10881.065s, table=211, n_packets=0, n_bytes=0, priority=63010,udp6,metadata=0x30000000000/0xfffff0000000000,tp_src=547,tp_dst=546 actions=drop
cookie=0x6900000, duration=10881.063s, table=211, n_packets=0, n_bytes=0, priority=63020,icmp6,metadata=0x30000000000/0xfffff0000000000,icmp_type=134,icmp_code=0 actions=drop
cookie=0x6900000, duration=10881.061s, table=211, n_packets=1, n_bytes=70, priority=63010,icmp6,metadata=0x30000000000/0xfffff0000000000,icmp_type=133,icmp_code=0 actions=resubmit(,17)
cookie=0x6900000, duration=10881.060s, table=211, n_packets=2, n_bytes=156, priority=63010,icmp6,metadata=0x30000000000/0xfffff0000000000,icmp_type=135,icmp_code=0 actions=resubmit(,17)
cookie=0x6900000, duration=10881.058s, table=211, n_packets=0, n_bytes=0, priority=63010,icmp6,metadata=0x30000000000/0xfffff0000000000,icmp_type=136,icmp_code=0 actions=resubmit(,17)
cookie=0x6900000, duration=10880.930s, table=211, n_packets=96, n_bytes=4032, priority=63010,arp,metadata=0x30000000000/0xfffff0000000000,arp_sha=fa:16:3e:21:37:43 actions=resubmit(,17)
cookie=0x6900000, duration=10881.054s, table=211, n_packets=1, n_bytes=90, priority=61010,ipv6,dl_src=fa:16:3e:21:37:43,ipv6_src=fe80::f816:3eff:fe21:3743 actions=ct(table=212,zone=5002)
cookie=0x6900000, duration=10881.051s, table=211, n_packets=0, n_bytes=0, priority=61010,ipv6,dl_src=fa:16:3e:21:37:43,ipv6_src=2001:db3:0:3:f816:3eff:fe21:3743 actions=ct(table=212,zone=5002)
cookie=0x6900000, duration=10881.053s, table=211, n_packets=99, n_bytes=9550, priority=61010,ip,dl_src=fa:16:3e:21:37:43,nw_src=20.0.0.7 actions=ct(table=212,zone=5002)
cookie=0x6900000, duration=77723.309s, table=211, n_packets=4, n_bytes=360, priority=0 actions=drop
cookie=0x6900000, duration=10880.882s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_dst=fe80::f816:3eff:fe21:3743 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=10880.879s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_dst=2001:db3:0:3:f816:3eff:fe21:3743 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=10863.371s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_dst=fe80::f816:3eff:fe8c:641a actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=10863.365s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_dst=2001:db2:0:2:f816:3eff:fe8c:641a actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=10880.881s, table=212, n_packets=0, n_bytes=0, priority=50,ip,metadata=0xfffffe/0xfffffe,nw_dst=20.0.0.7 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=10863.374s, table=212, n_packets=0, n_bytes=0, priority=50,ip,metadata=0xfffffe/0xfffffe,nw_dst=10.0.0.10 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=77723.309s, table=212, n_packets=400, n_bytes=38560, priority=0 actions=goto_table:213
cookie=0x6900000, duration=77723.309s, table=213, n_packets=316, n_bytes=32008, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,17)
cookie=0x6900000, duration=77723.309s, table=213, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,17)
cookie=0x6900001, duration=10881.043s, table=213, n_packets=0, n_bytes=0, priority=62015,ct_state=+inv+trk,metadata=0x30000000000/0xfffff0000000000 actions=drop
cookie=0x6900000, duration=10880.894s, table=213, n_packets=20, n_bytes=1548, priority=1002,ct_state=+new+trk,ip,metadata=0x30000000000/0xfffff0000000000 actions=ct(commit,zone=5002),resubmit(,17)
cookie=0x6900000, duration=10880.884s, table=213, n_packets=1, n_bytes=90, priority=1003,ct_state=+new+trk,ipv6,metadata=0x30000000000/0xfffff0000000000 actions=ct(commit,zone=5002),resubmit(,17)
cookie=0x6900001, duration=10881.049s, table=213, n_packets=0, n_bytes=0, priority=50,ct_state=+new+trk,metadata=0x30000000000/0xfffff0000000000 actions=drop
cookie=0x6900000, duration=77723.309s, table=213, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x8000007, duration=76683.842s, table=220, n_packets=554, n_bytes=48142, priority=9,reg6=0x90000400 actions=output:2
cookie=0x8000230, duration=76683.833s, table=220, n_packets=554, n_bytes=48142, priority=6,reg6=0x400 actions=load:0x90000400->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000230, duration=76067.418s, table=220, n_packets=0, n_bytes=0, priority=6,reg6=0xa00 actions=load:0x90000a00->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=76067.416s, table=220, n_packets=0, n_bytes=0, priority=9,reg6=0x90000a00 actions=output:4
cookie=0x8000007, duration=10881.207s, table=220, n_packets=166, n_bytes=11446, priority=9,reg6=0x90000300 actions=output:6
cookie=0x6900000, duration=10881.207s, table=220, n_packets=2995, n_bytes=288688, priority=6,reg6=0x300 actions=load:0x90000300->NXM_NX_REG6[],write_metadata:0xfffffe/0xfffffffffe,goto_table:241
cookie=0x8000230, duration=77723.309s, table=230, n_packets=554, n_bytes=48142, priority=0 actions=resubmit(,220)
cookie=0x8000231, duration=77723.309s, table=231, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,220)
cookie=0x6900000, duration=10881.252s, table=241, n_packets=2, n_bytes=755, priority=63010,udp,reg6=0x300/0xfffff00,tp_src=67,tp_dst=68 actions=resubmit(,220)
cookie=0x6900000, duration=10881.236s, table=241, n_packets=0, n_bytes=0, priority=63010,udp6,reg6=0x300/0xfffff00,tp_src=547,tp_dst=546 actions=resubmit(,220)
cookie=0x6900000, duration=10881.223s, table=241, n_packets=0, n_bytes=0, priority=63010,icmp6,reg6=0x300/0xfffff00,icmp_type=130,icmp_code=0 actions=resubmit(,220)
cookie=0x6900000, duration=10881.212s, table=241, n_packets=0, n_bytes=0, priority=63010,icmp6,reg6=0x300/0xfffff00,icmp_type=135,icmp_code=0 actions=resubmit(,220)
cookie=0x6900000, duration=10881.195s, table=241, n_packets=0, n_bytes=0, priority=63010,icmp6,reg6=0x300/0xfffff00,icmp_type=136,icmp_code=0 actions=resubmit(,220)
cookie=0x6900000, duration=10881.186s, table=241, n_packets=99, n_bytes=4158, priority=63010,arp,reg6=0x300/0xfffff00 actions=resubmit(,220)
cookie=0x6900000, duration=10881.179s, table=241, n_packets=0, n_bytes=0, priority=61010,ipv6,dl_dst=fa:16:3e:21:37:43,ipv6_dst=fe80::f816:3eff:fe21:3743 actions=ct(table=242,zone=5002)
cookie=0x6900000, duration=10881.170s, table=241, n_packets=0, n_bytes=0, priority=61010,ipv6,dl_dst=fa:16:3e:21:37:43,ipv6_dst=2001:db3:0:3:f816:3eff:fe21:3743 actions=ct(table=242,zone=5002)
cookie=0x6900000, duration=10881.175s, table=241, n_packets=2894, n_bytes=283775, priority=61010,ip,dl_dst=fa:16:3e:21:37:43,nw_dst=20.0.0.7 actions=ct(table=242,zone=5002)
cookie=0x6900000, duration=77723.309s, table=241, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x6900000, duration=10880.958s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_src=fe80::f816:3eff:fe21:3743 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=10880.946s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_src=2001:db3:0:3:f816:3eff:fe21:3743 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=10863.421s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_src=fe80::f816:3eff:fe8c:641a actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=10863.417s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0xfffffe/0xfffffe,ipv6_src=2001:db2:0:2:f816:3eff:fe8c:641a actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=10880.952s, table=242, n_packets=0, n_bytes=0, priority=50,ip,metadata=0xfffffe/0xfffffe,nw_src=20.0.0.7 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=10863.424s, table=242, n_packets=0, n_bytes=0, priority=50,ip,metadata=0xfffffe/0xfffffe,nw_src=10.0.0.10 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=77723.309s, table=242, n_packets=3127, n_bytes=307259, priority=0 actions=goto_table:243
cookie=0x6900000, duration=77723.309s, table=243, n_packets=260, n_bytes=26133, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,220)
cookie=0x6900000, duration=77723.309s, table=243, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,220)
cookie=0x6900001, duration=10881.153s, table=243, n_packets=0, n_bytes=0, priority=62015,ct_state=+inv+trk,reg6=0x300/0xfffff00 actions=drop
cookie=0x6900000, duration=10880.980s, table=243, n_packets=0, n_bytes=0, priority=1009,ct_state=+new+trk,udp,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10880.967s, table=243, n_packets=0, n_bytes=0, priority=1010,ct_state=+new+trk,tcp,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10880.967s, table=243, n_packets=0, n_bytes=0, priority=1011,ct_state=+new+trk,tcp6,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10880.958s, table=243, n_packets=0, n_bytes=0, priority=1012,ct_state=+new+trk,udp6,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10880.958s, table=243, n_packets=0, n_bytes=0, priority=1013,ct_state=+new+trk,icmp,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10881.007s, table=243, n_packets=0, n_bytes=0, priority=1007,ct_state=+new+trk,ip,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900000, duration=10880.997s, table=243, n_packets=0, n_bytes=0, priority=1008,ct_state=+new+trk,ipv6,reg6=0x300/0xfffff00,metadata=0x2/0xfffffe actions=ct(commit,zone=5002),resubmit(,220)
cookie=0x6900001, duration=10881.161s, table=243, n_packets=2829, n_bytes=277242, priority=50,ct_state=+new+trk,reg6=0x300/0xfffff00 actions=drop
cookie=0x6900000, duration=77723.309s, table=243, n_packets=0, n_bytes=0, priority=0 actions=drop

root@compute2-deray:~# ovs-ofctl dump-groups br-int -O OpenFlow13
OFPST_GROUP_DESC reply (OF1.3) (xid=0x2):
group_id=210003,type=all,bucket=actions=resubmit(,55),set_field:0x3->tun_id
group_id=210004,type=all,bucket=actions=group:210003,bucket=actions=resubmit(,220),load:0x400->NXM_NX_REG6[],set_field:0x49->tun_id
group_id=5000,type=all,bucket=actions=CONTROLLER:65535,bucket=actions=resubmit(,17),bucket=actions=resubmit(,81)

Comment by Valentina Krasnobaeva [ 09/Aug/17 ]

With following security group rule set:

  1. neutron security-group-rule-list | grep X
    0684b730-debd-41b9-84c1-14a9b67e891d X ingress IPv4 1-65535/tcp 0.0.0.0/0 (CIDR)
    0cbcbcad-965c-44a1-b0e9-55b7487cea8d X ingress IPv4 1-65535/udp 0.0.0.0/0 (CIDR)
    10a2de0f-2f98-4856-af89-c4637a4eeceb X egress IPv6 any any
    3653ee42-4cdf-4ee7-b3df-4b3ee13eaf87 X ingress IPv6 icmp any
    39617115-12aa-4c9e-97cb-9b5e0a1c8183 X ingress IPv4 icmp 0.0.0.0/0 (CIDR)
    4ab9fcd7-b8df-45d7-991e-62cb3efee0b4 X ingress IPv6 1-65535/udp any
    4b3753d9-347a-430e-ad90-c188a69edd96 X egress IPv4 icmp 0.0.0.0/0 (CIDR)
    927f1e26-3ad9-4710-b21f-47f882a81b92 X egress IPv4 1-65535/udp 0.0.0.0/0 (CIDR)
    9ba4d753-d8ea-485a-bd54-a1179e48cea5 X egress IPv4 1-65535/tcp 0.0.0.0/0 (CIDR)
    d29e0e5e-e226-48d7-b406-e57e88240d44 X egress IPv6 1-65535/udp any
    d38ef550-4bb7-49ac-896d-1ef4cc575099 X egress IPv6 icmp any
    d656f00f-0662-4f51-8a2a-9e2400e7c796 X egress IPv6 1-65535/tcp any
    e93d7558-1e4d-46ab-bec8-8aadbb1bf6fd X ingress IPv6 1-65535/tcp any
    f42f8eaf-98ef-43c6-8d91-c40e8371c7cc X egress IPv4 any any

    root@controller-deray:/opt/stack/devstack#

We have at least L2 traffic passed, but still not L3

ovs flows at controller node:

cookie=0x8031389, duration=294.576s, table=51, n_packets=68, n_bytes=7330, priority=20,metadata=0x1389000000/0xffff000000,dl_dst=fa:16:3e:5e:3e:6b actions=set_field:0x51->tun_id,load:0x500->NXM_NX_REG6[],resubmit(,220)
cookie=0x803138a, duration=275.665s, table=51, n_packets=76, n_bytes=8058, priority=20,metadata=0x138a000000/0xffff000000,dl_dst=fa:16:3e:3c:23:74 actions=set_field:0x49->tun_id,load:0x700->NXM_NX_REG6[],resubmit(,220)
cookie=0x8030000, duration=79369.821s, table=51, n_packets=0, n_bytes=0, priority=15,dl_dst=01:80:c2:00:00:00/ff:ff:ff:ff:ff:f0 actions=drop
cookie=0x8030000, duration=79369.821s, table=51, n_packets=288, n_bytes=19664, priority=0 actions=goto_table:52
cookie=0x8701389, duration=79138.882s, table=52, n_packets=66, n_bytes=3044, priority=5,metadata=0x1389000000/0xffff000001 actions=write_actions(group:210002)
cookie=0x8701389, duration=79138.882s, table=52, n_packets=76, n_bytes=6752, priority=5,metadata=0x1389000001/0xffff000001 actions=write_actions(group:210001)
cookie=0x870138a, duration=78861.731s, table=52, n_packets=70, n_bytes=3116, priority=5,metadata=0x138a000000/0xffff000001 actions=write_actions(group:210004)
cookie=0x870138a, duration=78861.731s, table=52, n_packets=76, n_bytes=6752, priority=5,metadata=0x138a000001/0xffff000001 actions=write_actions(group:210003)
cookie=0x8800001, duration=79138.882s, table=55, n_packets=66, n_bytes=3044, priority=10,tun_id=0x1,metadata=0x10000000000/0xfffff0000000000 actions=drop
cookie=0x8800002, duration=78861.731s, table=55, n_packets=70, n_bytes=3116, priority=10,tun_id=0x2,metadata=0x20000000000/0xfffff0000000000 actions=drop
cookie=0x8800001, duration=79138.882s, table=55, n_packets=76, n_bytes=6752, priority=9,tun_id=0x1 actions=load:0x100->NXM_NX_REG6[],resubmit(,220)
cookie=0x8800002, duration=78861.731s, table=55, n_packets=76, n_bytes=6752, priority=9,tun_id=0x2 actions=load:0x200->NXM_NX_REG6[],resubmit(,220)
cookie=0x6800000, duration=79369.821s, table=60, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x1030000, duration=79369.546s, table=80, n_packets=5, n_bytes=438, priority=0 actions=resubmit(,17)
cookie=0x8220000, duration=79369.546s, table=81, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x4000001, duration=79369.821s, table=90, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x6900000, duration=79369.821s, table=211, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x6900000, duration=79369.821s, table=212, n_packets=0, n_bytes=0, priority=0 actions=goto_table:213
cookie=0x6900000, duration=79369.821s, table=213, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,17)
cookie=0x6900000, duration=79369.821s, table=213, n_packets=0, n_bytes=0, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,17)
cookie=0x6900000, duration=79369.821s, table=213, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x8000007, duration=79139.949s, table=220, n_packets=579, n_bytes=55296, priority=9,reg6=0x100 actions=output:1
cookie=0x8000007, duration=78862.630s, table=220, n_packets=681, n_bytes=59972, priority=9,reg6=0x200 actions=output:2
cookie=0x8000230, duration=78539.787s, table=220, n_packets=3556, n_bytes=343355, priority=6,reg6=0x500 actions=load:0x90000500->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=78539.787s, table=220, n_packets=3556, n_bytes=343355, priority=9,reg6=0x90000500 actions=output:3
cookie=0x8000230, duration=78523.280s, table=220, n_packets=445, n_bytes=43294, priority=6,reg6=0x700 actions=load:0x90000700->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=78523.280s, table=220, n_packets=445, n_bytes=43294, priority=9,reg6=0x90000700 actions=output:4
cookie=0x8000230, duration=79369.821s, table=230, n_packets=4001, n_bytes=386649, priority=0 actions=resubmit(,220)
cookie=0x8000231, duration=79369.821s, table=231, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,220)
cookie=0x6900000, duration=79369.821s, table=241, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x6900000, duration=79369.821s, table=242, n_packets=0, n_bytes=0, priority=0 actions=goto_table:243
cookie=0x6900000, duration=79369.821s, table=243, n_packets=0, n_bytes=0, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,220)
cookie=0x6900000, duration=79369.821s, table=243, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,220)
cookie=0x6900000, duration=79369.821s, table=243, n_packets=0, n_bytes=0, priority=0 actions=drop
root@controller-deray:/opt/stack/devstack#

root@controller-deray:/opt/stack/devstack# ovs-ofctl -O OpenFlow13 dump-groups br-int
OFPST_GROUP_DESC reply (OF1.3) (xid=0x2):
group_id=210002,type=all,bucket=actions=group:210001,bucket=actions=resubmit(,220),load:0x500->NXM_NX_REG6[],set_field:0x51->tun_id
group_id=5000,type=all,bucket=actions=CONTROLLER:65535,bucket=actions=resubmit(,17),bucket=actions=resubmit(,81)
group_id=210001,type=all,bucket=actions=resubmit(,55),set_field:0x1->tun_id
group_id=210003,type=all,bucket=actions=resubmit(,55),set_field:0x2->tun_id
group_id=210004,type=all,bucket=actions=group:210003,bucket=actions=resubmit(,220),load:0x700->NXM_NX_REG6[],set_field:0x49->tun_id

Comment by Sam Hague [ 06/Apr/18 ]

valentina.krasnobaeva is this still an issue?

Comment by Valentina Krasnobaeva [ 06/Apr/18 ]

No I can't reproduce it now with current OXYGEN and master

Comment by Abhinav Gupta [ 08/Nov/19 ]

Thanks, I'll mark the bug closed in that case

Generated at Wed Feb 07 20:22:33 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.