https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/NETVIRT-77 netvirt <p>distribution used for testing: <a href="https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/distribution-karaf/0.5.0-SNAPSHOT/distribution-karaf-0.5.0-20160817.134922-4396.zip" class="external-link" target="_blank" rel="nofollow noopener">https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/distribution-karaf/0.5.0-SNAPSHOT/distribution-karaf-0.5.0-20160817.134922-4396.zip</a></p> <p> Steps Tried out</p> <p> 1. Deploy 3 node as Cluster</p> <p> 2. Installed odl-ovsdb-openstack, odl-jolokia in 3nodes</p> <p> 3. Ensured the clustering is fine by checking sync status</p> <p> 4. Added the 3 node as Managers to OVS</p> <p> Observation1: br-int not getting created</p> <p> Observation2: Manually created br-int and then checked dump-fl;ows, the pipeline initial flows are nnot geting added.</p> <p> Observation 3: saw this is ODL2 log<br/> --------------------------------------------------------<br/> 2016-08-17 20:10:47,707 | WARN | rint Extender: 3 | NetvirtProvidersProvider | 314 - org.opendaylight.netvirt.openstack.net-virt-providers - 1.3.0.SNAPSHOT | Failed to start Netvirt:<br/> java.lang.NullPointerException<br/> at org.opendaylight.netvirt.openstack.netvirt.impl.ProviderNetworkManagerImpl.providerAdded(ProviderNetworkManagerImpl.java:74)<br/> at org.opendaylight.netvirt.openstack.netvirt.providers.openflow13.OF13Provider.setDependencies(OF13Provider.java:2017)<br/> at org.opendaylight.netvirt.openstack.netvirt.providers.ConfigActivator$1.addingService(ConfigActivator.java:186)<br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:932)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:864)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:256)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:183)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:317)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:261)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.opendaylight.netvirt.openstack.netvirt.providers.ConfigActivator.start(ConfigActivator.java:191)<br/> at org.opendaylight.netvirt.openstack.netvirt.providers.NetvirtProvidersProvider.start(NetvirtProvidersProvider.java:97)<br/> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.lang.reflect.Method.invoke(Method.java:498)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:299)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BeanRecipe.invoke(BeanRecipe.java:956)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BeanRecipe.runBeanProcInit(BeanRecipe.java:712)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BeanRecipe.internalCreate2(BeanRecipe.java:824)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BeanRecipe.internalCreate(BeanRecipe.java:787)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.di.AbstractRecipe$1.call(AbstractRecipe.java:79)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at java.util.concurrent.FutureTask.run(FutureTask.java:266)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:88)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:247)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:183)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:682)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:377)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:269)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.util.concurrent.FutureTask.run(FutureTask.java:266)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at org.apache.aries.blueprint.container.ExecutorServiceWrapper.run(ExecutorServiceWrapper.java:106)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at org.apache.aries.blueprint.utils.threading.impl.DiscardableRunnable.run(DiscardableRunnable.java:48)<span class="error">&#91;15:org.apache.aries.blueprint.core:1.4.4&#93;</span><br/> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.util.concurrent.FutureTask.run(FutureTask.java:266)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)<span class="error">&#91;:1.8.0_101&#93;</span><br/> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)<span class="error">&#91;:1.8.0_101&#93;</span></p> <p>------------------------------------------------</p> <p> 5. Checked the entity owners , ODL2 was the owner of netvirt-provider entity</p> <p> 6. Killed karaf in ODL2 and restarted</p> <p> 7. ODL1 became owner of netvirt-provider<br/> Observation: br-int got created and pipeline flows got added</p> <p>Operating System: All<br/> Platform: All</p> NETVIRT-77

[Legacy] br-int not getting created when Netvirt used as 3node

Bug Resolved Done Bertrand Low Venkatrangan Govindarajan Thu, 18 Aug 2016 00:31:22 +0000 Fri, 9 Mar 2018 18:21:30 +0000 Wed, 24 Aug 2016 19:13:29 +0000 Boron 0 5 <p>Attachment odl1_bug_6455_log.tgz has been added with description: ODL1 logs</p> <p>Attachment odl2_bug_6455_log.tgz has been added with description: ODL2 logs</p> <p>Attachment odl3_bug_6455_log.tgz has been added with description: ODL3 logs</p> <p>The issue occurs in releng also now</p> <p><a href="https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-3node-openstack-mitaka-openstack-boron/118/" class="external-link" target="_blank" rel="nofollow noopener">https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-3node-openstack-mitaka-openstack-boron/118/</a></p> <p>The error appears to be happening because of a timing issue between O13Provider and ProviderNetworkManagerImpl<br/> 1) An O13Provider calls setDependency when ProviderNetworkManagerImpl service registers<br/> 2) O13Provider::setDependency calls ProviderNetworkManagerImpl::providerAdd<br/> 3) ProviderNetworkManagerImpl::providerAdd calls ovsdbInventoryService.providersReady().<br/> This statement causes the NullPointerException because ovsdbInventoryService is null. OvsdbInventoryService is a dependency for ProviderNetworkManagerImpl but when this exception occurs, it has not yet been added as such.</p> <p>The effect of this error is that Netvirt will fail to start properly. In this particular case, because ovsdbInventoryService is null, OvsdbInventoryServiceImpl will never get notified that its providers are ready, and hence the following will be true: the ovsdbDataChangeListener will not start, and both the NeutronModelsDataChangeListeners and the NetvirtTopology will not be initialized. In general though, seeing the "Failed to start Netvirt" log does not tell us which component of Netvirt has failed; it only tells us that Netvirt will not behave in an expected way.</p> <p>Likely, fixing the NullPointerException will allow Netvirt to start up properly and hence the successfully creation of br-int.</p> <p>Sam pointed out that blueprint migration may have contributed to this behaviour because blueprint causes the order of ConfigActivator.start() in Netvirt and in Netvirt-Providers to be random (see <a href="https://lists.opendaylight.org/pipermail/netvirt-dev/2016-August/001274.html" class="external-link" target="_blank" rel="nofollow noopener">https://lists.opendaylight.org/pipermail/netvirt-dev/2016-August/001274.html</a>). That is, sometimes, Netvirt-Providers will start up before Netvirt starts up.</p> <p>This random order is in itself not the cause of the problem, as we have observed successful starts independent of whether Netvirt-Providers starts up before Netvirt or vice versa. However, in the instances where the timing issue described above occurs, Netvirt-Providers has been observed to start up before Netvirt.</p> <p>We will confirm if adding the OvsdbInventoryService dependency to netvirt-provider.xml works to properly set all dependencies before startup, thus avoiding the NullPointerException.</p> <p>Patch submitted.</p> <p>Inject dependency of OvsdbInventoryService to blueprint for NetvirtProvidersProvider</p> <p><a href="https://git.opendaylight.org/gerrit/#/c/44562/4" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/44562/4</a></p> <p>The patch has been tested and the bug has not been observed after applying the patch</p> <p>master branch:<br/> <a href="https://git.opendaylight.org/gerrit/#/c/44572/1" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/44572/1</a><br/> <a href="https://git.opendaylight.org/gerrit/44623" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/44623</a></p> Development External issue ID 6455 External issue URL Rank 0|i01pkn: