https://jira.opendaylight.org This file is an XML representation of an issue en-us 8.20.10 820010 22-06-2022 https://jira.opendaylight.org/browse/AAA-37 aaa <p>Even after more than 5 mins after ODL is started, rest calls fail<br/> due to aaa service not being ready</p> <p>Ref: <a href="https://lists.opendaylight.org/pipermail/controller-dev/2015-June/009628.html" class="external-link" target="_blank" rel="nofollow noopener">https://lists.opendaylight.org/pipermail/controller-dev/2015-June/009628.html</a></p> <p>2015-06-11 10:28:08,791 | ERROR | qtp335420420-194 | ContainerResponse | 212 - com.sun.jersey.jersey-server - 1.17.0 | Mapped exception to response: 503 (Service Unavailable)<br/> javax.ws.rs.WebApplicationException<br/> at org.opendaylight.aaa.sts.TokenAuthFilter.&lt;clinit&gt;(TokenAuthFilter.java:40)<br/> at java.lang.Class.forName0(Native Method)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.lang.Class.forName(Class.java:191)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at com.sun.jersey.core.reflection.ReflectionHelper.classForNameWithException(ReflectionHelper.java:242)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.core.reflection.ReflectionHelper.classForNameWithException(ReflectionHelper.java:222)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.core.spi.component.ProviderServices.getInstances(ProviderServices.java:216)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.container.filter.FilterFactory.getFilters(FilterFactory.java:146)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.container.filter.FilterFactory.init(FilterFactory.java:75)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1283)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:168)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:774)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:770)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:770)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:765)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.initiate(ServletContainer.java:489)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:319)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:605)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:210)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:374)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:557)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at javax.servlet.GenericServlet.init(GenericServlet.java:161)<span class="error">&#91;178:org.apache.geronimo.specs.geronimo-servlet_3.0_spec:1.0.0&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:532)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:344)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doStart(HttpServiceContext.java:222)<span class="error">&#91;193:org.ops4j.pax.web.pax-web-jetty:3.1.4&#93;</span><br/> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.ops4j.pax.web.service.jetty.internal.JettyServerImpl$1.start(JettyServerImpl.java:202)<span class="error">&#91;193:org.ops4j.pax.web.pax-web-jetty:3.1.4&#93;</span><br/> at org.ops4j.pax.web.service.internal.HttpServiceStarted.end(HttpServiceStarted.java:1032)<span class="error">&#91;192:org.ops4j.pax.web.pax-web-runtime:3.1.4&#93;</span><br/> at org.ops4j.pax.web.service.internal.HttpServiceProxy.end(HttpServiceProxy.java:422)<span class="error">&#91;192:org.ops4j.pax.web.pax-web-runtime:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.RegisterWebAppVisitorWC.end(RegisterWebAppVisitorWC.java:341)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.model.WebApp.accept(WebApp.java:678)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.register(WebAppPublisher.java:237)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.addingService(WebAppPublisher.java:182)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.addingService(WebAppPublisher.java:135)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:932)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:864)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:256)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:183)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:317)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:261)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher.publish(WebAppPublisher.java:101)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebObserver.deploy(WebObserver.java:213)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebObserver$1.doStart(WebObserver.java:175)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.extender.SimpleExtension.start(SimpleExtension.java:58)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.extender.AbstractExtender$1.run(AbstractExtender.java:266)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.FutureTask.run(FutureTask.java:262)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.lang.Thread.run(Thread.java:745)<span class="error">&#91;:1.7.0_79&#93;</span><br/> 2015-06-11 10:28:08,877 | ERROR | qtp335420420-194 | ContainerResponse | 212 - com.sun.jersey.jersey-server - 1.17.0 | Mapped exception to response: 503 (Service Unavailable)<br/> javax.ws.rs.WebApplicationException<br/> at org.opendaylight.aaa.sts.TokenAuthFilter.&lt;clinit&gt;(TokenAuthFilter.java:40)<br/> at java.lang.Class.forName0(Native Method)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.lang.Class.forName(Class.java:191)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at com.sun.jersey.core.reflection.ReflectionHelper.classForNameWithException(ReflectionHelper.java:242)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.core.reflection.ReflectionHelper.classForNameWithException(ReflectionHelper.java:222)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.core.spi.component.ProviderServices.getInstances(ProviderServices.java:216)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.container.filter.FilterFactory.getFilters(FilterFactory.java:146)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.container.filter.FilterFactory.init(FilterFactory.java:75)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1283)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:168)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:774)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:770)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)<span class="error">&#91;211:com.sun.jersey.core:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:770)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:765)<span class="error">&#91;212:com.sun.jersey.jersey-server:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.initiate(ServletContainer.java:489)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:319)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:605)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:210)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:374)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:557)<span class="error">&#91;210:com.sun.jersey.servlet:1.17.0&#93;</span><br/> at javax.servlet.GenericServlet.init(GenericServlet.java:161)<span class="error">&#91;178:org.apache.geronimo.specs.geronimo-servlet_3.0_spec:1.0.0&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:532)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:344)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doStart(HttpServiceContext.java:222)<span class="error">&#91;193:org.ops4j.pax.web.pax-web-jetty:3.1.4&#93;</span><br/> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)<span class="error">&#91;184:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411&#93;</span><br/> at org.ops4j.pax.web.service.jetty.internal.JettyServerImpl$1.start(JettyServerImpl.java:202)<span class="error">&#91;193:org.ops4j.pax.web.pax-web-jetty:3.1.4&#93;</span><br/> at org.ops4j.pax.web.service.internal.HttpServiceStarted.end(HttpServiceStarted.java:1032)<span class="error">&#91;192:org.ops4j.pax.web.pax-web-runtime:3.1.4&#93;</span><br/> at org.ops4j.pax.web.service.internal.HttpServiceProxy.end(HttpServiceProxy.java:422)<span class="error">&#91;192:org.ops4j.pax.web.pax-web-runtime:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.RegisterWebAppVisitorWC.end(RegisterWebAppVisitorWC.java:341)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.model.WebApp.accept(WebApp.java:678)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.register(WebAppPublisher.java:237)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.addingService(WebAppPublisher.java:182)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher$WebAppDependencyListener.addingService(WebAppPublisher.java:135)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:932)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker$Tracked.customizerAdding(ServiceTracker.java:864)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackAdding(AbstractTracked.java:256)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.AbstractTracked.trackInitial(AbstractTracked.java:183)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:317)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.osgi.util.tracker.ServiceTracker.open(ServiceTracker.java:261)<span class="error">&#91;karaf-org.osgi.core.jar:&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebAppPublisher.publish(WebAppPublisher.java:101)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebObserver.deploy(WebObserver.java:213)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.WebObserver$1.doStart(WebObserver.java:175)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.extender.SimpleExtension.start(SimpleExtension.java:58)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at org.ops4j.pax.web.extender.war.internal.extender.AbstractExtender$1.run(AbstractExtender.java:266)<span class="error">&#91;198:org.ops4j.pax.web.pax-web-extender-war:3.1.4&#93;</span><br/> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.FutureTask.run(FutureTask.java:262)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)<span class="error">&#91;:1.7.0_79&#93;</span><br/> at java.lang.Thread.run(Thread.java:745)<span class="error">&#91;:1.7.0_79&#93;</span></p> <p>Operating System: All<br/> Platform: All</p> AAA-37

javax.ws.rs.WebApplicationException: org.opendaylight.aaa.sts.TokenAuthFilter.<clinit>(TokenAuthFilter.java:40)

Bug Resolved Done Unassigned Flavio Fernandes Thu, 11 Jun 2015 21:06:37 +0000 Thu, 21 Mar 2019 11:56:41 +0000 Thu, 2 Jul 2015 15:23:43 +0000 General 0 6 <p>Ref irc excerpt:</p> <p><a href="https://gist.github.com/b6a92d04494ca1a0dd9d" class="external-link" target="_blank" rel="nofollow noopener">https://gist.github.com/b6a92d04494ca1a0dd9d</a></p> <p><span class="error">&#91;16:47:13&#93;</span> &lt;edwarnicke&gt; Is this helium or lithium ?<br/> <span class="error">&#91;16:47:26&#93;</span> &lt;flaviof&gt; edwarnicke: you will like this: its Lithium!<br/> <span class="error">&#91;16:47:49&#93;</span> &lt;edwarnicke&gt; flaviof: I do like that <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:47:52&#93;</span> &lt;mestery&gt; lothium<br/> <span class="error">&#91;16:47:54&#93;</span> &lt;mestery&gt; yeah<br/> <span class="error">&#91;16:47:56&#93;</span> &lt;flaviof&gt; lol<br/> <span class="error">&#91;16:47:57&#93;</span> &lt;edwarnicke&gt; flaviof: Needed to know so I could look at the right code<br/> <span class="error">&#91;16:48:07&#93;</span> &lt;flaviof&gt; edwarnicke: ack.<br/> <span class="error">&#91;16:48:24&#93;</span> &lt;edwarnicke&gt; flaviof: mestery So question: is it the RC0 build? (note: there are no wrong answers here, just trying to figure out where to look <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/> )<br/> <span class="error">&#91;16:49:01&#93;</span> &lt;flaviof&gt; edwarnicke: it is last night build. the logic to grab what build to use is here:<br/> <span class="error">&#91;16:49:05&#93;</span> flaviof digging<br/> <span class="error">&#91;16:49:24&#93;</span> &lt;mestery&gt; yes, it's a snapshot build<br/> <span class="error">&#91;16:49:25&#93;</span> &lt;mestery&gt; the very latest<br/> <span class="error">&#91;16:49:32&#93;</span> &lt;mestery&gt; as of something like 30 minutes ago<br/> <span class="error">&#91;16:49:40&#93;</span> &lt;edwarnicke&gt; mestery: Cool <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:49:46&#93;</span> &lt;edwarnicke&gt; mestery: flaviof Now I know where to look <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:49:47&#93;</span> &lt;flaviof&gt; edwarnicke: <a href="https://github.com/stackforge/networking-odl/blob/master/devstack/release.lithium-snapshot-0.3.0" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/stackforge/networking-odl/blob/master/devstack/release.lithium-snapshot-0.3.0</a><br/> <span class="error">&#91;16:53:12&#93;</span> &lt;edwarnicke&gt; mestery: flaviof OK... I know a little more<br/> <span class="error">&#91;16:53:41&#93;</span> &lt;edwarnicke&gt; mestery: flaviof Basically, the Exception is because the aaa system has not authentication service at the time it was asked to authenticate something<br/> <span class="error">&#91;16:53:54&#93;</span> &lt;edwarnicke&gt; mestery: You said that you had REST calls that went through before the failure?<br/> <span class="error">&#91;16:53:59&#93;</span> mestery shakes his fist at the ^@#$!@# aaa system<br/> <span class="error">&#91;16:54:33&#93;</span> &lt;mestery&gt; edwarnicke: I <b>thought</b> that, but on closer look, it wasn't the case.<br/> <span class="error">&#91;16:54:46&#93;</span> &lt;flaviof&gt; edwarnicke: is this an issue in the realm of.... if you waited longer it would have worked; or this is borked and aaa is gone fishing for good?<br/> <span class="error">&#91;16:54:48&#93;</span> &lt;edwarnicke&gt; mestery: Good to know, because that would be less mysterious <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:55:03&#93;</span> &lt;edwarnicke&gt; flaviof: So given what mestery just said, yes, if you waited longer it should work<br/> <span class="error">&#91;16:55:08&#93;</span> &lt;mestery&gt; <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/sad.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:55:11&#93;</span> &lt;edwarnicke&gt; flaviof: mestery Not to imply its not a bug<br/> <span class="error">&#91;16:55:23&#93;</span> &lt;mestery&gt; We're already waiting 6 minutes I guess I can increase the timeout more<br/> <span class="error">&#91;16:55:25&#93;</span> &lt;edwarnicke&gt; flaviof: mestery Because you shouldn't <b>have</b> to wait<br/> <span class="error">&#91;16:55:27&#93;</span> &lt;flaviof&gt; <b>sigh</b><br/> <span class="error">&#91;16:55:40&#93;</span> &lt;edwarnicke&gt; mestery: I figured out something that should make a lot of this better in general<br/> <span class="error">&#91;16:55:51&#93;</span> &lt;flaviof&gt; Kyle it is already waithing 5 mins?<br/> <span class="error">&#91;16:55:59&#93;</span> &lt;edwarnicke&gt; mestery: Basically... ODL should be building in a way that it doesn't need to fetch bundles via mvn at startup<br/> <span class="error">&#91;16:56:03&#93;</span> &lt;mestery&gt; flaviof: 6 minutes<br/> <span class="error">&#91;16:56:03&#93;</span> &lt;mestery&gt; <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/sad.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> <span class="error">&#91;16:56:05&#93;</span> &lt;edwarnicke&gt; mestery: But that is broken</p> <p>Ed, are you working on this issue? Let me know if you need a second set of eyes, as I have encountered this as well <img class="emoticon" src="https://jira.opendaylight.org/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/>.</p> <p>A solution may be in moving AAA to use the config sub system and it's ordered dependencies.</p> <p>That being said, issues with the fetching of mvn artefacts will likely not be solved by that.</p> <p>I believe this to be a classic 'random bundle load order' bug caused by aaa using Activators instead of the config subsystem... switching to using the config-subsystem should fix it.</p> <p>Same symptoms could be given if MD-SAL fails to come up:</p> <p><a href="https://bugs.opendaylight.org/show_bug.cgi?id=3878" class="external-link" target="_blank" rel="nofollow noopener">https://bugs.opendaylight.org/show_bug.cgi?id=3878</a></p> <p>see <a href="https://git.opendaylight.org/gerrit/#/c/23608/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/23608/</a> for the revert patch that should address this...</p> <p>@rmoats : Thanks, but that commit is likely not the cause of the breakage covered by this bug, as it was merged after this bug was filed.</p> <p>General request: Could anyone experiencing this issue attach their karaf.log?</p> <p>(In reply to Wojciech Dec from comment #8)<br/> &gt; General request: Could anyone experiencing this issue attach their karaf.log?</p> <p>as requested, I will attach the log.<br/> For ref, this is where it is located:</p> <p><a href="http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/screen-karaf.log.2015-06-30-205206" class="external-link" target="_blank" rel="nofollow noopener">http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/screen-karaf.log.2015-06-30-205206</a></p> <p><a href="http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/" class="external-link" target="_blank" rel="nofollow noopener">http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/</a></p> <p><a href="http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/" class="external-link" target="_blank" rel="nofollow noopener">http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/</a></p> <p><a href="http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/screen-karaf.log.2015-06-30-205206" class="external-link" target="_blank" rel="nofollow noopener">http://logs.openstack.org/79/197179/3/check/check-tempest-dsvm-networking-odl/b322a4a/logs/screen-karaf.log.2015-06-30-205206</a></p> <p>renamed to karaf.log</p> <p>Attachment karaf.log has been added with description: karaf.log</p> <p>The following is one immediate fix:</p> <p><a href="https://git.opendaylight.org/gerrit/#/c/23683/" class="external-link" target="_blank" rel="nofollow noopener">https://git.opendaylight.org/gerrit/#/c/23683/</a></p> <p>It likely resolves the most pressing problem.</p> <p>fixed on master.</p> <p><span class="error">&#91;11:22:48&#93;</span> &lt;regXboi&gt; flaviof: I think we can also mark 3680 as resolved for now<br/> <span class="error">&#91;11:22:54&#93;</span> &lt;regXboi&gt; because we aren't seeing it in master</p> Development External issue ID 3680 External issue URL ODL SR Target Milestone Priority Rank 0|i023pj: