[NETVIRT-743] CSIT Sporadic failures - ipv6 tests failing in learn sg mode Created: 22/Jun/17  Updated: 03/May/18  Resolved: 27/Sep/17

Status: Resolved
Project: netvirt
Component/s: General
Affects Version/s: Carbon
Fix Version/s: None

Type: Bug
Reporter: Jamo Luhrsen Assignee: Aswin Suryanarayanan
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All

External issue ID: 8729

 Description   

four tempest.scenario.v6 tests have been added to CSIT recently. They are passing
when running in stateful and transparent sg modes, but fail in learn mode.

example log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-learn-carbon/303/log.html.gz

debugging the tempest failures is not easy in this environment. We do have
non-tempest robot csit coming soon around v6 so maybe those will also hit
this same issue and we can debug more easily there.

 Comments   
Comment by Jamo Luhrsen [ 22/Jun/17 ]

some limited discussion in this email thread:
https://lists.opendaylight.org/pipermail/netvirt-dev/2017-June/004855.html

Comment by Jamo Luhrsen [ 23/Jun/17 ]

this is happening (failures) in our newly added v6 robot suite as
well, so it's not just tempest failing. These failures may be easier
to debug as there are flow dumps and other debug output interspersed
in the test cases. see example here:

https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-learn-carbon/305/log.html.gz#s1-s5

Comment by Aswin Suryanarayanan [ 07/Jul/17 ]

The tests are failing since the learn rules (for tcp ,udp and icmp) are not programmed in table 214 and 244 [1] . The flow mods are rejected by Ovs with an error OFPET_BAD_ACTION.

For Ipv6 support in learn mode we may need to modify the LearnCodec in OpenFlowplugin and corresponding changes will be required in netvirt as well. Until the support is added we can think of skipping these Ipv6 tests.

[1]https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-nodl-v2-upstream-learn-carbon/305/log.html.gz#s1-s5-t8-k3-k1-k2-k1-k15-k4

Comment by Jamo Luhrsen [ 10/Jul/17 ]

(In reply to Aswin Suryanarayanan from comment #3)
> The tests are failing since the learn rules (for tcp ,udp and icmp) are not
> programmed in table 214 and 244 [1] . The flow mods are rejected by Ovs
> with an error OFPET_BAD_ACTION.
>
> For Ipv6 support in learn mode we may need to modify the LearnCodec in
> OpenFlowplugin and corresponding changes will be required in netvirt as
> well. Until the support is added we can think of skipping these Ipv6 tests.
>
> [1]https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-
> openstack-newton-nodl-v2-upstream-learn-carbon/305/log.html.gz#s1-s5-t8-k3-
> k1-k2-k1-k15-k4

Aswin, would you characterize this as an OVS bug with the OFP codec changes
being a workaround we can do on our side?

do you know happen to have the exact flow that's trying to be programmed
that is producing the BAD_ACTION?

I'm worried that skipping these tests in learn mode will just make us ignore
and forget that we have an issue somewhere.

Comment by Kiran N Upadhyaya [ 21/Jul/17 ]

This issue seems to be due to populateFibOnNewDpn() and createRemoteFibEntry() trying to add the same flow at the same time.
Working on a fix...

Comment by Kiran N Upadhyaya [ 21/Jul/17 ]

Please ignore my previous comment (Comment 5). It was directed at NETVIRT-520

Comment by Jamo Luhrsen [ 27/Sep/17 ]

no longer seen in CSIT, and learn sg mode is deprecated now

Generated at Wed Feb 07 20:22:21 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.