[NETVIRT-1360] L3VPN creation issue in fluorine build. Created: 04/Jul/18  Updated: 13/Jun/19  Resolved: 13/Jun/19

Status: Verified
Project: netvirt
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: High
Reporter: Madhusmita Pany Assignee: Jaya Priyadarshini
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Zip Archive VPN_creation_fluorine_log.zip    

 Description   

Hi ,

I am facing the issue while creating L3VPN,though VPN is getting deleted in previous step.

Steps followed :

  1. Creating L3VPN - Successful
  2. Deleting L3VPN - Successful
  3. Create L3VPN -issue :   {"errors":
    Unknown macro: {"error"}

    }

Even though VPN is deleted successfully, it is not allowing to create VPN in the next step.

Build used : https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.9.0-SNAPSHOT/karaf-0.9.0-20180703.111534-1424.zip

Sanbox job link:

https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-hwvtep-1node-openstack-queens-madhuupstream-stateful-fluorine/8

If you will open this link, it will redirect you to all the required logs,i.e,console log,ODL log,script log.

Script log link : 

https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-hwvtep-1node-openstack-queens-madhuupstream-stateful-fluorine/8/robot-plugin/log_full.html.gz

ODL/KARAF LOG:

https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-hwvtep-1node-openstack-queens-madhuupstream-stateful-fluorine/8/odl_1/

 Attaching the complete report and log of this issue with this mail.

Please resolve this ASAP as we are blocked.

Thanks,

Madhusmita

 



 Comments   
Comment by Sam Hague [ 05/Jul/18 ]

mpany this isn't a hwvtep test case is it? If not, could you push a standard upstream job netvirt-csit-1node- job that is not related to hwvtep and then post results? The hwvtep jobs are configured a little different so I want to rule out any issues there.

Comment by Madhusmita Pany [ 06/Jul/18 ]

Hi Sam,

This suite is covers BGP establishment scenario using DCGW and in hwvtep job "tools_system_count" parameter is present which brings up DCGW VM.

But in netvirt-csit-1node- job, this parameter is not present.So, executing the suite using hwvtep job.

Please suggest me if i can use "netvirt-csit-1node- job" for DCGW related testcases.

Thanks,

Madhusmita

Comment by Sam Hague [ 07/Jul/18 ]

We can add the parameter if it makes sense. If these are not hwvtep specific tests, then we should add the parameter to the yaml and update the integration template. These would be dcgw deployments so also break them out in the project yaml so that the non-dcgw jobs don't spin up an unused tools vm. What you would do is add the param at the top under the openstack_system2_flavor, with value 0 as the default. Then add the same parameter under the functionality->gate-tdd-wip with the value set to how many tools vms you need. Update the integration template to use the vm_3_* stuff. That should work assuming the heat templates take the 0 count and don't do anything.

Comment by Ariel Adam [ 08/Jul/18 ]

Are we sure this is a blocking bug (highest)?

If so what is it blocking? 

Comment by Madhusmita Pany [ 10/Jul/18 ]

Hi Sam,

I followed the below steps to create dcgw job in non-hwvtep job :

-  In netvirt-csit-multi-openstack.yaml ,added the param at the top under the openstack_system2_flavor as :

openstack_system2_flavor: odl-standard-4
tools_system_count: 0
tools_system_image: ZZCI - Ubuntu 16.04 - mininet-ovs-26 - 20171208-1847

 Then added the same parameter under the functionality>gate-tdd-wip with the value set to 1 tools vms as 1 dcgw vm is needed as :

  • anujgate-tdd-wip:
    testplan: '{project}-{topology}-tdd-wip-openstack.txt'
    schedule: ''
    tools_system_count: 1

-  Then, updated the integration template to use the vm_3_* stuff in integration-templates.yaml  :

Under job template : inttest-csit-openstack -> builder, added the below params :

vm_3_count: '{tools_system_count}'
vm_3_flavor: '{tools_system_flavor}'
vm_3_image: '{tools_system_image}'

Then created job : netvirt-csit-1node-openstack-pike-anujgate-tdd-wip-oxygen and started executing the job in sandbox.

But job is failing as it is not able to create tool system VM.

In environment variables 

NUM_TOOLS_SYSTEM 0

Log : https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-1node-openstack-pike-anujgate-tdd-wip-oxygen/2/_build-enviroment-variables.log.gz

 https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-1node-openstack-pike-anujgate-tdd-wip-oxygen/5

Thanks,

Madhusmita

 

Comment by Madhusmita Pany [ 10/Jul/18 ]

Hi,

VPN is not getting created after VPN deletion in fluorine build.

Thanks,

Madhusmita

Comment by Karthikeyan Krishnan [ 12/Jul/18 ]

Hi Madhu,
 
   I have analysed your attached logs (VPN_creation_fluorine_log) in the JIRA and observed JSON response[0] & [1] for L3VPN Creation and Deletion via ODL REST API after first time L3VPN was created and deleted successfully. Looks like you need to check your existing L3VPN instance having the RD 2200:2 as same as second time L3VPN creation request.
 
Please check whether if any existing L3VPN instance is having the RD as 2200:2 using ODL REST API get call [2]. Since i have validated the L3VPN creation and deletion of multiple times again and again with same ID in latest fluorine build (karaf-0.9.0-20180711.125024-1566) and i didn't observed any issues.
 
 
[0]
Creation of L3VPN log:
==================
{"errors":{"error":[

{"error-type":"application","error-tag":"operation-failed","error-message":"Creation of L3VPN failed for VPN 4ae8cd92-48ca-49b5-94e1-b2921a261441 as another VPN 4ae8cd92-48ca-49b5-94e1-b2921a261441 with the same RD 2200:2 is still available. Please retry creation of a new vpn with the same RD after a couple of minutes.","error-info":"<severity>error</severity>"}

]}}
 
[1]:
Deletion of L3VPN log:
==================
{"errors":{"error":[

{"error-type":"protocol","error-tag":"invalid-value","error-message":"VPN with vpnid: 4ae8cd92-48ca-49b5-94e1-b2921a261441 does not exist","error-info":"<severity>warning</severity>"}

]}}
 
 
[2]:  
Get existing L3VPN:
==================
<POST> http://<ODL-IP>:8181/restconf/operations/neutronvpn:getL3VPN
 
 
Thanks and Regards,
Karthikeyan.

Comment by Karthikeyan Krishnan [ 12/Jul/18 ]

Hi Madhu, 
  I want to share one more point to check your setup before trying to create the same L3VPN instance again and again. Once you POST the JSON request for L3VPN instance delete, please check the L3VPN DS [0] to see the current VPN state. If it is marked as "pending_delete" then wait for few seconds to delete L3VPN instance completely. Hope this will solve your script issue.
 
 
[0]:
http://<ODL-IP>:8181/restconf/operational/odl-l3vpn:vpn-instance-op-data{ "vpn-instance-op-data": { "vpn-instance-op-data-entry": [ { "vrf-id": "2200:2", "vpnTargets": { "vpnTarget": [ { "vrfRTValue": "2200:2", "vrfRTType": "both" } ] }, "vpn-id": 100004, "vpn-instance-name": "4ae8cd92-48ca-49b5-94e1-b2921a261441", "bgpvpn-type": "BGPVPNExternal", "rd": [ "2200:2" ], "l3vni": 0, "ipv6-configured": false, "vpn-state": "pending_delete", "ipv4-configured": false } ] } }
Thanks & Regards,
Karthikeyan.

Comment by Faseela K [ 13/Jun/19 ]

JayaPr : Could you please check if this is just a script issue as pointed out by Karthiikeyan above, and if so, close the Jira ?

Comment by Jaya Priyadarshini [ 13/Jun/19 ]

Hi Faseela/Karthikeyan,

 

Script has been fixed some time back and is passing consistently.

Logs as below:

https://logs.opendaylight.org/sandbox/vex-yul-odl-jenkins-2/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-gate-tdd-wip-sodium/7/robot-plugin/log_full.html

 

Comment by Faseela K [ 13/Jun/19 ]

Not an issue in the code, CSIT script adjusted to fix the issue

Generated at Wed Feb 07 20:23:52 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.