[NETCONF-518] SFT failure in netconf/features/netconf-connector/odl-netconf-topology/ Created: 27/Feb/18  Updated: 27/Feb/18  Resolved: 27/Feb/18

Status: Resolved
Project: netconf
Component/s: netconf
Affects Version/s: Oxygen
Fix Version/s: Oxygen

Type: Bug Priority: High
Reporter: Michael Vorburger Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File diff.txt     Text File org.opendaylight.odlparent.featuretest.SingleFeatureTest-output_FAILED-ON-JENKINS.txt     Text File org.opendaylight.odlparent.featuretest.SingleFeatureTest-output_PASSED-LOCALLY.txt    
Issue Links:
Duplicate
duplicates NETCONF-510 Fix netconf-tcp and netconf-ssh activ... Resolved

 Description   

https://git.opendaylight.org/gerrit/#/c/68199/ has the following SFT failure in netconf/features/netconf-connector/odl-netconf-topology/ which I have reason to believe is not actually an impact of that change (because the same SFT passes locally even with the change in that bundle mvn install'd), but seems to be another random heisenbug related to something unpredictable related to Karaf's feature installation PITA?

Running org.opendaylight.odlparent.featuretest.SingleFeatureTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 49.823 sec <<< FAILURE! - in org.opendaylight.odlparent.featuretest.SingleFeatureTest
installFeatureCatchAndLog(org.opendaylight.odlparent.featuretest.SingleFeatureTest)[repoUrl: file:/w/workspace/netconf-maven-verify-fluorine-mvn33-openjdk8/features/netconf-connector/odl-netconf-topology/target/feature/feature.xml, Feature: odl-netconf-topology 1.5.0.SNAPSHOT]  Time elapsed: 48.794 sec  <<< ERROR!
org.apache.karaf.features.internal.util.MultiException: Error restarting bundles:
	Exception in org.opendaylight.netconf.tcp.osgi.NetconfTCPActivator.start() of bundle org.opendaylight.netconf.tcp.
	Exception in org.opendaylight.netconf.ssh.osgi.NetconfSSHActivator.start() of bundle org.opendaylight.netconf.ssh.
	at org.apache.karaf.features.internal.service.Deployer.deploy(Deployer.java:896)
	at org.apache.karaf.features.internal.service.FeaturesServiceImpl.doProvision(FeaturesServiceImpl.java:1248)
	at org.apache.karaf.features.internal.service.FeaturesServiceImpl.lambda$doProvisionInThread$1(FeaturesServiceImpl.java:1147)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: org.osgi.framework.BundleException: Exception in org.opendaylight.netconf.tcp.osgi.NetconfTCPActivator.start() of bundle org.opendaylight.netconf.tcp.
		at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:795)
		at org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932)
		at org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309)
		at org.eclipse.osgi.container.Module.doStart(Module.java:581)
		at org.eclipse.osgi.container.Module.start(Module.java:449)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402)
		at org.apache.karaf.features.internal.service.FeaturesServiceImpl.startBundle(FeaturesServiceImpl.java:1361)
		at org.apache.karaf.features.internal.service.Deployer.deploy(Deployer.java:888)
		... 6 more
	Caused by: java.lang.IllegalStateException: Netconf configuration service not found
		at org.opendaylight.netconf.util.osgi.NetconfConfigUtil.getNetconfConfigurationService(NetconfConfigUtil.java:39)
		at org.opendaylight.netconf.tcp.osgi.NetconfTCPActivator.start(NetconfTCPActivator.java:30)
		at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:774)
		at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:1)
		at java.security.AccessController.doPrivileged(Native Method)
		at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:767)
		... 15 more
	Suppressed: org.osgi.framework.BundleException: Exception in org.opendaylight.netconf.ssh.osgi.NetconfSSHActivator.start() of bundle org.opendaylight.netconf.ssh.
		at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:795)
		at org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932)
		at org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309)
		at org.eclipse.osgi.container.Module.doStart(Module.java:581)
		at org.eclipse.osgi.container.Module.start(Module.java:449)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383)
		at org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402)
		at org.apache.karaf.features.internal.service.FeaturesServiceImpl.startBundle(FeaturesServiceImpl.java:1361)
		at org.apache.karaf.features.internal.service.Deployer.deploy(Deployer.java:888)
		... 6 more
	Caused by: java.lang.IllegalStateException: Netconf configuration service not found
		at org.opendaylight.netconf.util.osgi.NetconfConfigUtil.getNetconfConfigurationService(NetconfConfigUtil.java:39)
		at org.opendaylight.netconf.ssh.osgi.NetconfSSHActivator.startSSHServer(NetconfSSHActivator.java:81)
		at org.opendaylight.netconf.ssh.osgi.NetconfSSHActivator.start(NetconfSSHActivator.java:52)
		at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:774)
		at org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:1)
		at java.security.AccessController.doPrivileged(Native Method)
		at org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:767)
		... 15 more


Results :

Tests in error: 
  Error restarting bundles:
	Exception in org.opendaylight.netconf.tcp.osgi.NetconfTCPActivator.start() of bundle org.opendaylight.netconf.tcp.
	Exception in org.opendaylight.netconf.ssh.osgi.NetconfSSHActivator.start() of bundle org.opendaylight.netconf.ssh.

I'm hoping the subtle differences in the attached log from when it worked (locally) and failed (retrieved from https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netconf-maven-verify-fluorine-mvn33-openjdk8/14/features/netconf-connector/odl-netconf-topology/target/surefire-reports/org.opendaylight.odlparent.featuretest.SingleFeatureTest-output.txt.gz) can help someone fix this.



 Comments   
Comment by Michael Vorburger [ 27/Feb/18 ]

Confirming this as a "heisenbug" - as I suspected, a simple "recheck" on https://git.opendaylight.org/gerrit/#/c/68199/ actually passed the build now on the second run.

Comment by Michael Vorburger [ 27/Feb/18 ]

This actually happens quite frequently; like on every 2nd build... lemme raise Criticality just to see what happens next (nothing, probably).

Generated at Wed Feb 07 20:15:14 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.