[NEUTRON-15] Neutron Tempest Test Failure: tempest.api.network.test_allowed_address_pair

Mon, 29 Jun 2015 20:47:13 +0000

The OpenStack tempest test tempest.api.network.test_allowed_address_pair fails when running Neutron with the OpenDaylight ML2 driver. Tempest failures are below.

From testr:
[vagrant@localhost tempest]$ testr failing
======================================================================
FAIL: setUpClass (tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON)
tags: worker-0
----------------------------------------------------------------------
Traceback (most recent call last):
File "tempest/test.py", line 273, in setUpClass
cls.resource_setup()
File "tempest/api/network/test_allowed_address_pair.py", line 52, in resource_setup
port = cls.create_port(cls.network)
File "tempest/api/network/base.py", line 241, in create_port
**kwargs)
File "tempest/services/network/json/network_client.py", line 145, in _create
resp, body = self.post(uri, post_data)
File "tempest/common/rest_client.py", line 236, in post
return self.request('POST', url, extra_headers, headers, body)
File "tempest/common/rest_client.py", line 450, in request
resp, resp_body)
File "tempest/common/rest_client.py", line 547, in _error_checker
raise exceptions.ServerFault(message)
ServerFault: Got server fault
Details: create_port_postcommit failed.
Ran 1 tests
FAILED (id=2, failures=1)
[vagrant@localhost tempest]$

Neutron logs from the failure:

2014-12-31 15:48:27.680 24407 ERROR neutron.plugins.ml2.managers [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] Mechanism driver 'opendaylight' failed in create_port_postcommit
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 292, in _call_on_drivers
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 163, in create_port_postcommit
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers self.synchronize('create', ODL_PORTS, context)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 176, in synchronize
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers self.sync_single_resource(operation, object_type, context)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 279, in sync_single_resource
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers self.out_of_sync = True
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/oslo/utils/excutils.py", line 82, in _exit_
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers six.reraise(self.type_, self.value, self.tb)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 276, in sync_single_resource
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers self.sendjson(method, urlpath,

{object_type[:-1]: resource}

)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 299, in sendjson
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers r.raise_for_status()
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/requests/models.py", line 683, in raise_for_status
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers HTTPError: 400 Client Error: Bad Request
2014-12-31 15:48:27.680 24407 TRACE neutron.plugins.ml2.managers
2014-12-31 15:48:27.685 24407 ERROR neutron.plugins.ml2.plugin [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] mechanism_manager.create_port_postcommit failed, deleting port '1b19006e-1a2d-4164-a5b8-25870f1bbd57'
2014-12-31 15:48:27.685 24407 DEBUG neutron.plugins.ml2.plugin [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] Deleting port 1b19006e-1a2d-4164-a5b8-25870f1bbd57 delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:984
2014-12-31 15:48:27.702 24407 DEBUG neutron.openstack.common.lockutils [req-bc0c3708-7cfd-46f6-8b48-89baff856339 ] Created new semaphore "db-access" internal_lock /opt/stack/neutron/neutron/openstack/common/lockutils.py:206
2014-12-31 15:48:27.703 24407 DEBUG neutron.openstack.common.lockutils [req-bc0c3708-7cfd-46f6-8b48-89baff856339 ] Acquired semaphore "db-access" lock /opt/stack/neutron/neutron/openstack/common/lockutils.py:229

2014-12-31 15:48:27.798 24407 DEBUG neutron.plugins.ml2.drivers.mechanism_odl [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] Sending METHOD (post) URL (http://19
2.168.56.10:8080/controller/nb/v2/neutron/subnets) JSON (

{'subnets': []}

) sendjson /opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py:295
2014-12-31 15:48:27.817 24407 DEBUG neutron.plugins.ml2.drivers.mechanism_odl [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] Sending METHOD (post) URL (http://19
2.168.56.10:8080/controller/nb/v2/neutron/ports) JSON (

{'ports': []}

) sendjson /opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py:295
2014-12-31 15:48:27.824 24407 DEBUG neutron.openstack.common.lockutils [req-bc0c3708-7cfd-46f6-8b48-89baff856339 ] Releasing semaphore "odl-sync-full" lock /opt/s
tack/neutron/neutron/openstack/common/lockutils.py:238
2014-12-31 15:48:27.826 24407 DEBUG neutron.openstack.common.lockutils [req-bc0c3708-7cfd-46f6-8b48-89baff856339 ] Semaphore / lock released "sync_full" inner /op
t/stack/neutron/neutron/openstack/common/lockutils.py:275
2014-12-31 15:48:27.834 24407 ERROR neutron.api.v2.resource [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] create failed
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource Traceback (most recent call last):
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/resource.py", line 83, in resource
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource result = method(request=request, **args)
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/api/v2/base.py", line 451, in create
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource obj = obj_creator(request.context, **kwargs)
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 819, in create_port
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource self.delete_port(context, result['id'])
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo/utils/excutils.py", line 82, in _exit_
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 814, in create_port
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource self.mechanism_manager.create_port_postcommit(mech_context)
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 501, in create_port_postcommit
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource self._call_on_drivers("create_port_postcommit", context)
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 303, in _call_on_drivers
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource method=method_name
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource MechanismDriverError: create_port_postcommit failed.
2014-12-31 15:48:27.834 24407 TRACE neutron.api.v2.resource
2014-12-31 15:48:27.836 24407 INFO neutron.wsgi [req-bc0c3708-7cfd-46f6-8b48-89baff856339 None] 192.168.56.10 - - [31/Dec/2014 15:48:27] "POST /v2.0/ports HTTP/1.1" 500 337 0.287899
2014-12-31 15:48:27.840 24407 INFO neutron.wsgi [-] (24407) accepted ('192.168.56.10', 50325)
2014-12-31 15:48:27.874 24407 DEBUG neutron.plugins.ml2.plugin [req-49095da9-e2aa-47d8-9795-e4180f39edee None] Deleting subnet fbbe0ae5-931c-4f77-b08e-2cad2d05ea46 delete_subnet /opt/stack/neutron/neutron/plugins/ml2/plugin.py:709

2014-12-31 15:48:31.892 24407 INFO neutron.tests.unit.ml2.drivers.mechanism_logger [req-dfa854e9-dc17-4ce3-8aad-36b122bb8052 None] delete_subnet_postcommit called
with subnet settings {'ipv6_ra_mode': None, 'allocation_pools': [

{'start': u'10.100.0.2', 'end': u'10.100.0.14'}

], 'host_routes': [], 'ipv6_address_mode': None,
'cidr': u'10.100.0.0/28', 'id': u'97c1a470-1235-4ce2-8566-a0ca4ef842b5', 'name': u'', 'enable_dhcp': True, 'network_id': u'aa024c5c-eda1-45d0-b414-60a7a9039535',
'tenant_id': u'1834b08d87bf4a5b96b7ead6d2a92ad0', 'dns_nameservers': [], 'gateway_ip': u'10.100.0.1', 'ip_version': 4L, 'shared': False} (original settings None)
2014-12-31 15:48:31.892 24407 DEBUG neutron.plugins.ml2.drivers.mechanism_odl [req-dfa854e9-dc17-4ce3-8aad-36b122bb8052 None] Sending METHOD (delete) URL (http://
192.168.56.10:8080/controller/nb/v2/neutron/subnets/97c1a470-1235-4ce2-8566-a0ca4ef842b5) JSON (None) sendjson /opt/stack/neutron/neutron/plugins/ml2/drivers/mech
anism_odl.py:295
2014-12-31 15:48:31.900 24407 ERROR neutron.plugins.ml2.managers [req-dfa854e9-dc17-4ce3-8aad-36b122bb8052 None] Mechanism driver 'opendaylight' failed in delete_subnet_postcommit
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 292, in _call_on_drivers
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 160, in delete_subnet_postcommit
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers self.synchronize('delete', ODL_SUBNETS, context)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 176, in synchronize
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers self.sync_single_resource(operation, object_type, context)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 279, in sync_single_resource
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers self.out_of_sync = True
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/oslo/utils/excutils.py", line 82, in _exit_
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers six.reraise(self.type_, self.value, self.tb)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 264, in sync_single_resource
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers self.sendjson('delete', object_type + '/' + obj_id, None)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 299, in sendjson
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers r.raise_for_status()
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/requests/models.py", line 683, in raise_for_status
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers HTTPError: 409 Client Error: Conflict
2014-12-31 15:48:31.900 24407 TRACE neutron.plugins.ml2.managers
2014-12-31 15:48:31.901 24407 ERROR neutron.plugins.ml2.plugin [req-dfa854e9-dc17-4ce3-8aad-36b122bb8052 None] mechanism_manager.delete_subnet_postcommit failed
2014-12-31 15:48:31.932 24407 INFO neutron.wsgi [req-dfa854e9-dc17-4ce3-8aad-36b122bb8052 None] 192.168.56.10 - - [31/Dec/2014 15:48:31] "DELETE /v2.0/subnets/97c1a470-1235-4ce2-8566-a0ca4ef842b5 HTTP/1.1" 204 168 0.162958
2014-12-31 15:48:31.935 24407 INFO neutron.wsgi [-] (24407) accepted ('192.168.56.10', 50386)
2014-12-31 15:48:31.952 24407 DEBUG neutron.plugins.ml2.plugin [req-4398af71-54b4-4726-8583-765688f88a9b None] Deleting network aa024c5c-eda1-45d0-b414-60a7a9039535 delete_network /opt/stack/neutron/neutron/plugins/ml2/plugin.py:575

2014-12-31 15:48:32.161 24407 DEBUG neutron.plugins.ml2.drivers.mechanism_odl [req-4398af71-54b4-4726-8583-765688f88a9b None] Sending METHOD (delete) URL (http://
192.168.56.10:8080/controller/nb/v2/neutron/networks/aa024c5c-eda1-45d0-b414-60a7a9039535) JSON (None) sendjson /opt/stack/neutron/neutron/plugins/ml2/drivers/mec
hanism_odl.py:295
2014-12-31 15:48:32.166 24407 ERROR neutron.plugins.ml2.managers [req-4398af71-54b4-4726-8583-765688f88a9b None] Mechanism driver 'opendaylight' failed in delete_network_postcommit
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/managers.py", line 292, in _call_on_drivers
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 151, in delete_network_postcommit
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers self.synchronize('delete', ODL_NETWORKS, context)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 176, in synchronize
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers self.sync_single_resource(operation, object_type, context)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 279, in sync_single_resource
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers self.out_of_sync = True
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/oslo/utils/excutils.py", line 82, in _exit_
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers six.reraise(self.type_, self.value, self.tb)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 264, in sync_single_resource
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers self.sendjson('delete', object_type + '/' + obj_id, None)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/opt/stack/neutron/neutron/plugins/ml2/drivers/mechanism_odl.py", line 299, in sendjson
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers r.raise_for_status()
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers File "/usr/lib/python2.7/site-packages/requests/models.py", line 683, in raise_for_status
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers raise HTTPError(http_error_msg, response=self)
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers HTTPError: 409 Client Error: Conflict
2014-12-31 15:48:32.166 24407 TRACE neutron.plugins.ml2.managers
2014-12-31 15:48:32.167 24407 ERROR neutron.plugins.ml2.plugin [req-4398af71-54b4-4726-8583-765688f88a9b None] mechanism_manager.delete_network_postcommit failed
2014-12-31 15:48:32.176 24407 DEBUG neutron.policy [req-4398af71-54b4-4726-8583-765688f88a9b None] Enforcing rules: ['get_network:provider:physical_network'] log_rule_list /opt/stack/neutron/neutron/policy.py:369

OpenDaylight JIRA

[NEUTRON-15] Neutron Tempest Test Failure: tempest.api.network.test_allowed_address_pair