[NETVIRT-1423] Stale flows in table 20, 21,19 after neutron router delete Created: 30/Aug/18  Updated: 17/Sep/18  Resolved: 17/Sep/18

Status: Resolved
Project: netvirt
Component/s: ipv6service
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Medium
Reporter: Sindhuri B Assignee: Karthikeyan Krishnan
Resolution: Cannot Reproduce Votes: 0
Labels: VPNV6
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

3 node cluster with 2 computes

Attachments: Text File Stale_flows_issue.txt     Text File Test_steps.txt    

 Description   

Stale flows in table 20, 21,19  after neutron router delete

Test Steps:

========

Initial configuration:

->Configure 8 dualstack networks and 16 VMs and 2 routers. Two computes have one VM for each of the 8 networks. Attach 4 dualstack networks to each router

->Configure BGP, 2 VPN instances .

->Attach routers to VPN instances.

->Configure extra routes with four VMs as nexthops for both the routers.

->Verify reachability between DCGW and extraroute.

Delete configuration:

->Dissociate routers from VPN

-> router update no routes on both routes

-> delete subnets from the router

->delete VPN instances

->Delete routers

 

Stale flows are seen in table 20 21 and 19. Stale flows file is attached.

 

 Comments   
Comment by Karthikeyan Krishnan [ 17/Sep/18 ]

Invalid stale flows are appearing on both the compute nodes: (Including Local/Remote VM flows, Extra Route flows and BGP Learnt flows)
 **  
Compute-1: (Table 19, 20, 21)
   cookie=0x8000009, duration=1226100.209s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x32514/0xfffffe,dl_dst=fa:16:3e:c9:c0:55 actions=goto_table:21
   cookie=0x8000009, duration=1226100.209s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x32514/0xfffffe,dl_dst=fa:16:3e:94:d0:a2 actions=goto_table:21
   cookie=0x8000009, duration=687781.833s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x33e08/0xfffffe,dl_dst=fa:16:3e:f7:53:9c actions=goto_table:21
  **   cookie=0x8000002, duration=1226100.211s, table=20, n_packets=0, n_bytes=0, priority=10,mpls,mpls_label=103053 actions=pop_mpls:0x86dd,write_metadata:0x157d032514/0xfffffffffe,goto_table:22
  cookie=0x8000003, duration=1226100.211s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x32514/0xfffffe,ipv6_dst=23bc:fe2:41::/64  actions=push_mpls:0x8847,set_field:20001->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x500->NXM_NX_REG6[],resubmit(,220)
 cookie=0x8000003, duration=687781.468s, table=21, n_packets=0, n_bytes=0, priority=138,icmp6,metadata=0x33e08/0xfffffe,ipv6_dst=2001:db8:abcd:11::1,icmp_type=128,icmp_code=0 actions=move:NXM_OF_ETH_SRC[]>NXM_OF_ETH_DST[],set_field:fa:16:3e:f7:53:9c>eth_src,move:NXM_NX_IPV6_SRC[]>NXM_NX_IPV6_DST[],set_field:2001:db8:abcd:11::1>ipv6_src,
set_field:129->icmpv6_type,load:0->NXM_OF_IN_PORT[],resubmit(,21)

Compute-2: (table 19, 21)
   **    cookie=0x8000009, duration=1226085.275s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x32556/0xfffffe,dl_dst=fa:16:3e:c0:c6:72 actions=goto_table:21
   cookie=0x8000009, duration=1226085.192s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x32556/0xfffffe,dl_dst=fa:16:3e:65:4b:cc actions=goto_table:21
  cookie=0x8000009, duration=698595.676s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x33c84/0xfffffe,dl_dst=fa:16:3e:07:5f:36 actions=goto_table:21
  cookie=0x8000003, duration=1226084.432s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x32556/0xfffffe,ipv6_dst=2441:c2b1:1024::/64 actions=push_mpls:0x8847,set_field:20002->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x200->NXM_NX_REG6[],resubmit(,220)

1226085.275s = 14 days (approximately)
687781.833s = 8 days (approximately)

Correct flows for yesterday testing:

Compute-1: (VPN1 0x30d64 and VPN2 0x30d66)
  cookie=0x8000009, duration=6329.325s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d64/0xfffffe,dl_dst=fa:16:3e:8b:3f:33 actions=goto_table:21
  cookie=0x8000009, duration=6329.302s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d64/0xfffffe,dl_dst=fa:16:3e:95:b1:b9 actions=goto_table:21
  cookie=0x8000009, duration=6317.281s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d66/0xfffffe,dl_dst=fa:16:3e:de:a2:30 actions=goto_table:21
  cookie=0x8000009, duration=6317.206s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d66/0xfffffe,dl_dst=fa:16:3e:c6:e4:2a actions=goto_table:21
 cookie=0x8000003, duration=6329.327s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x30d64/0xfffffe,ipv6_dst=2982:632:537::/64 actions=push_mpls:0x8847,set_field:20001->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x100->NXM_NX_REG6[],resubmit(,220)
cookie=0x8000003, duration=6317.305s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x30d66/0xfffffe,ipv6_dst=2183:baa:123d::/64 actions=push_mpls:0x8847,set_field:20002->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x100->NXM_NX_REG6[],resubmit(,220)

Compute-2: (VPN1 0x30d64 and VPN2 0x30d66)
  cookie=0x8000009, duration=6330.157s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d64/0xfffffe,dl_dst=fa:16:3e:8b:3f:33 actions=goto_table:21
 cookie=0x8000009, duration=6330.137s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d64/0xfffffe,dl_dst=fa:16:3e:95:b1:b9 actions=goto_table:21
 cookie=0x8000009, duration=6318.117s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d66/0xfffffe,dl_dst=fa:16:3e:de:a2:30 actions=goto_table:21
 cookie=0x8000009, duration=6318.047s, table=19, n_packets=0, n_bytes=0, priority=20,metadata=0x30d66/0xfffffe,dl_dst=fa:16:3e:c6:e4:2a actions=goto_table:21
cookie=0x8000003, duration=6330.226s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x30d64/0xfffffe,ipv6_dst=2004:ae12::/64 actions=push_mpls:0x8847,set_field:20001->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x300->NXM_NX_REG6[],resubmit(,220)
 cookie=0x8000003, duration=6318.492s, table=21, n_packets=0, n_bytes=0, priority=74,ipv6,metadata=0x30d66/0xfffffe,ipv6_dst=2183:baa:123d::/64 actions=push_mpls:0x8847,set_field:20002->mpls_label,load:0->NXM_OF_IN_PORT[],load:0x300->NXM_NX_REG6[],resubmit(,220)

6330.157s = 1.7 hours approximately. Since as you confirmed yesterday, you did configured required network topology before start out joint debug session.

After the VPN and router deleted all the L3/VPN related flows got cleaned properly from both the compute nodes (As per the shared logs).

Conclusion:

Issue is not able to re-produce in latest oxygen build. Please feel free to re-open the TR if you seen this issue in future.

 

Generated at Wed Feb 07 20:24:02 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.