[NETVIRT-520] CSIT Sporadic failures - Flow(s) missing in VPNService suite on compute node Created: 08/Mar/17  Updated: 19/Nov/19  Resolved: 05/Sep/17

Status: Resolved
Project: netvirt
Component/s: General
Affects Version/s: Carbon
Fix Version/s: None

Type: Bug
Reporter: Jamo Luhrsen Assignee: Kiran N Upadhyaya
Resolution: Cannot Reproduce Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All


External issue ID: 7939

 Description   

VMs are created and they do receive ip addresses, but one compute node
did not have a flow containing the ip address of one of the VMs, as
expected by the test.

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-carbon/182/archives/log.html.gz#s1-s4-t9



 Comments   
Comment by Abhinav Gupta [ 21/Mar/17 ]

Tentative fix at https://git.opendaylight.org/gerrit/#/c/53355/

Comment by Vivekanandan Narasimhan [ 21/Mar/17 ]

Added one more fix:

https://git.opendaylight.org/gerrit/#/c/53628/

Comment by Jamo Luhrsen [ 24/Mar/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-carbon/250/archives/log.html.gz#s1-s4-t9

Comment by Jamo Luhrsen [ 27/Mar/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-carbon/262/archives/log.html.gz

Comment by Sam Hague [ 03/Apr/17 ]

https://git.opendaylight.org/gerrit/53355

Comment by Vivekanandan Narasimhan [ 04/Apr/17 ]

Addressed via this one too:
https://git.opendaylight.org/gerrit/53628

Comment by Jamo Luhrsen [ 05/Apr/17 ]

still seeing similar failures:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-boron/339/archives/log.html.gz#s1-s4-t9

we can open a new bug if needed.

Comment by Jamo Luhrsen [ 07/Apr/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-stateful-carbon/315/archives/log.html.gz

Comment by Jamo Luhrsen [ 11/Apr/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-carbon/242/archives/log.html.gz#s1-s4-t9

Comment by Vivekanandan Narasimhan [ 13/Apr/17 ]

It has been observed from the attached link that
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-mitaka-upstream-learn-carbon/242/archives/log.html.gz#s1-s4-t6

Table 19 is being populated even when no VPNInstance is available.

This is being further analyzed.

Comment by Sam Hague [ 25/Apr/17 ]

Hi Sam,

7939 was kind of an umbrella bug that covered all failures restricted to the VPN Service suite side. It included fixes in the ID Manager, VPN Manager etc.

There is still one pending problem where Table 19 rows are not getting populated consistently. Once/Twice every week the upstream job fails in VPNService suite with Table 19 flow absent error.

That is the only problem that makes me keep this bug open, (as otherwise this bug can be closed).

Vivek

Comment by Jamo Luhrsen [ 26/Apr/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-snat-conntrack-carbon/7/archives/log.html.gz

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-transparent-carbon/482/archives/log.html.gz

Comment by A H [ 17/May/17 ]

We are looking to build RC2 tomorrow 5/18 at 23:59 UTC time assuming there are no blocker bugs. Is there an ETA for when a fix can be merged and this bug resolved?

Comment by A H [ 18/May/17 ]

Patch has merge conflict: https://git.opendaylight.org/gerrit/#/c/57255/

Comment by Vivekanandan Narasimhan [ 19/May/17 ]

The following fixes eventually nails down this problem:

https://git.opendaylight.org/gerrit/57361

https://git.opendaylight.org/gerrit/57145\

Vivek

Comment by Vivekanandan Narasimhan [ 19/May/17 ]

The following are the equivalent stable/carbon fixes:

https://git.opendaylight.org/gerrit/57255

https://git.opendaylight.org/gerrit/57363

Vivek

Comment by Jamo Luhrsen [ 25/May/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-carbon/621/archives/log.html.gz#s1-s4-t9

Comment by Vivekanandan Narasimhan [ 13/Jun/17 ]

We fixed Flow issues with VPN Service suite in general.

If flow missing issues appear again in VPN Service CSIT suite, please re-open this one.

Comment by Jamo Luhrsen [ 23/Jun/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-snat-conntrack-carbon/82/log.html.gz#s1-s4-t9

Comment by Kiran N Upadhyaya [ 28/Jun/17 ]

https://git.opendaylight.org/gerrit/#/c/59613/

Comment by Jamo Luhrsen [ 10/Jul/17 ]

this is in a v6 suite:

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-stateful-snat-conntrack-carbon/101/log.html.gz#s1-s5-t15

Comment by Jamo Luhrsen [ 19/Jul/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-carbon/464/log.html.gz

Comment by Kiran N Upadhyaya [ 21/Jul/17 ]

This issue is due to populateFIBonNewDpn() and createRemoteFibEntry() trying to install a flow at the same time.
Working on a fix.

Comment by Kiran N Upadhyaya [ 01/Aug/17 ]

https://git.opendaylight.org/gerrit/#/c/60971

Comment by Jamo Luhrsen [ 18/Aug/17 ]

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-ocata-upstream-transparent-nitrogen/97/log.html.gz#s1-s4-t9

Comment by Jamo Luhrsen [ 05/Sep/17 ]

This has not shown up in several weeks now. I will close it as resolved and
we can re-open if we see it again.

Generated at Wed Feb 07 20:21:46 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.