[NETVIRT-226] VM can’t access neutron services Created: 31/Oct/16  Updated: 19/Oct/17  Resolved: 01/Nov/16

Status: Resolved
Project: netvirt
Component/s: General
Affects Version/s: Boron
Fix Version/s: None

Type: Bug
Reporter: zan cohen Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All


Attachments: Zip Archive q-svc.zip     Zip Archive q-svc_defetc7070.zip     Zip Archive screen-karaf.zip     File screen-karaf_defect7070.zipx    
Issue Links:
Duplicate
duplicates GENIUS-17 Packet IN handler thread in deadlock ... Resolved
External issue ID: 7070

 Comments   
Comment by zan cohen [ 31/Oct/16 ]

After creating new VM with fixed ip 10.0.126.62 the following DS models are missing:
elan-interface
ietf-interface (config/operational)
as a result, T0 flow is not installed for this port.
Neutron port for this ip exist 44902cd3-d25c-43c6-9013-f266aa26726c and the associated tap interface tap44902cd3-d2 exist in the oper DS.

No error log found
2016-10-31 10:21:11,682 | INFO | nPool-1-worker-2 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | Of-port-interface creation for port 44902cd3-d25c-43c6-9013-f266aa26726c
2016-10-31 10:21:11,691 | INFO | nPool-1-worker-2 | NeutronvpnManager | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | Creating vpn interface VpnInterface [_key=VpnInterfaceKey [_name=44902cd3-d25c-43c6-9013-f266aa26726c], _name=44902cd3-d25c-43c6-9013-f266aa26726c, _vpnInstanceName=e4bcb54d-15d3-4943-8a92-f0d96e67a7cd, augmentation=[Adjacencies [_adjacency=[Adjacency [_ipAddress=10.0.123.62/32, _key=AdjacencyKey [_ipAddress=10.0.123.62/32], _macAddress=fa:16:3e:0b:76:23, _primaryAdjacency=true, augmentation=[]]]]]]
2016-10-31 10:21:11,694 | INFO | nPool-1-worker-2 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | publish notification called

Comment by zan cohen [ 31/Oct/16 ]

Attachment q-svc.zip has been added with description: ignore this logs!!

Comment by zan cohen [ 31/Oct/16 ]

Attachment screen-karaf.zip has been added with description: ignore this logs!!

Comment by zan cohen [ 01/Nov/16 ]

please refer to zipped logs file:
1.q-svc_defetc7070.zip
2.screen-karaf_defect7070.zipx

Comment by zan cohen [ 01/Nov/16 ]

Attachment q-svc_defetc7070.zip has been added with description: q-svc logs

Comment by zan cohen [ 01/Nov/16 ]

Attachment screen-karaf_defect7070.zipx has been added with description: karaf logs

Comment by Tali Ben-Meir [ 01/Nov/16 ]

dup of GENIUS-17 (high ARP rate)
Between 2016-10-31 08:30:21,460-08:30:22,749 there was an arp burst and the notification handling got into some deadlock.

After that each thread attempting to send blocking notification gets stuck.
The next four threads blocked on putNotification are triggered by NeutronPortChangeListener when new VM ports are created

2016-10-31 10:13:43,829 | INFO | nPool-1-worker-3 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | publish notification called
2016-10-31 10:14:12,521 | INFO | nPool-1-worker-0 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | publish notification called
2016-10-31 10:20:39,059 | INFO | nPool-1-worker-1 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | publish notification called
2016-10-31 10:21:11,694 | INFO | nPool-1-worker-2 | NeutronPortChangeListener | 344 - org.opendaylight.netvirt.neutronvpn-impl - 0.3.1.SNAPSHOT | publish notification called

These notifications are called from the thread pool. Once all the worker threads are blocked on notifications the DjC is not able to serve any new requests.

Generated at Wed Feb 07 20:21:01 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.