[GENIUS-82] Karaf4 specific problems seen on both boot and during manual testing of genius distribution Created: 12/Jun/17  Updated: 08/Aug/17  Resolved: 08/Aug/17

Status: Resolved
Project: genius
Component/s: General
Affects Version/s: Nitrogen
Fix Version/s: None

Type: Bug
Reporter: Michael Vorburger Assignee: Faseela K
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Operating System: All
Platform: All


Attachments: Text File karaf.log    
Issue Links:
Blocks
blocks ODLPARENT-23 Milestone: Upgrade karaf to 4.0.1 or ... Resolved
blocks NETVIRT-719 Karaf4 specific problems seen on boot... Resolved
is blocked by CONTROLLER-1716 NullPointerException at org.opendayli... Resolved
is blocked by GENIUS-83 genius CSIT Issue_Command_On_Karaf_Co... Resolved
is blocked by MDSAL-270 Karaf 4 diag missing Missing dependen... Resolved
is blocked by ODLPARENT-99 Karaf 4 deadlock in Equinox on shutdown Resolved
is blocked by ODLPARENT-101 Karaf 4 distribution local build fail... Resolved
is blocked by OPNFLWPLUG-908 Karaf 4 openflowplugin "not working" ... Resolved
External issue ID: 8661

 Description   

This is an "umrella" bug to track all Karaf4 specific exceptions seen on boot of a genius/karaf4 distribution based on Karaf 4 instead of Karaf 3 built with https://git.opendaylight.org/gerrit/#/c/58726/ after installation of odl-genius* feature/s and (some) manual testing of that distribution.

Smaller specific issues should be created for each individual problem, and linked to this bug as Depends on.

Only Karaf 4 specific exceptions should be treated and linked here; any exceptions already seen on Karaf 3 before the migration should be treated separately.

This bug should be closed where are no more exception on boot of a Karaf 4 genius Nitrogen dist (or if those exceptions already occurred on a Carbon Karaf 3 one as well), and no more blocking Karaf 4 specific "functional" issues.

FYI: NETVIRT-719 is a similar umbrella bug for netvirt (and SFC-196 for SFC). Thus, some, but not all, issues linked as Depends on this may be listed on that bug as well.



 Comments   
Comment by Michael Vorburger [ 12/Jun/17 ]

Attachment karaf.log has been added with description: Karaf 4 LOG on start-up of genius distribution, without any feature:install yet

Comment by Michael Vorburger [ 13/Jun/17 ]

> and (some) manual testing of that distribution

feature:install odl-genius-ui

GET http://localhost:8181/restconf/config/ietf-interfaces:interfaces/

Comment by Robert Varga [ 20/Jun/17 ]

2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | Refreshing bundles:
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | com.fasterxml.jackson.datatype.jackson-datatype-json-org/2.3.2 (Wired to org.opendaylight.netconf.sal-rest-docgen/1.6.0.SNAPSHOT which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.apache.oltu.oauth2.authzserver/1.0.0 (Wired to org.apache.oltu.oauth2.common/1.0.0 which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.apache.oltu.oauth2.common/1.0.0 (Wired to org.opendaylight.netconf.sal-rest-docgen/1.6.0.SNAPSHOT which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.apache.oltu.oauth2.resourceserver/1.0.0 (Wired to org.apache.oltu.oauth2.common/1.0.0 which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.apache.shiro.core/1.3.2 (Should be wired to: org.apache.servicemix.bundles.commons-beanutils/1.8.3.2 (through [org.apache.shiro.core/1.3.2] osgi.wiring.package; filter:="(&(osgi.wiring.package=org.apache.commons.beanutils)(version>=1.8.0))"; resolution:=optional))
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.apache.shiro.web/1.3.2 (Wired to org.apache.shiro.core/1.3.2 which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.opendaylight.aaa.idmlight/0.6.0.SNAPSHOT (Wired to org.apache.shiro.web/1.3.2 which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.opendaylight.aaa.shiro/0.6.0.SNAPSHOT (Wired to org.apache.shiro.core/1.3.2 which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.opendaylight.aaa.shiro-act/0.6.0.SNAPSHOT (Wired to org.opendaylight.aaa.shiro/0.6.0.SNAPSHOT which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.opendaylight.netconf.sal-rest-connector/1.6.0.SNAPSHOT (Wired to org.opendaylight.aaa.shiro/0.6.0.SNAPSHOT which is being refreshed)
2017-06-12 12:35:24,138 | INFO | pool-12-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | org.opendaylight.netconf.sal-rest-docgen/1.6.0.SNAPSHOT (Wired to org.opendaylight.aaa.shiro/0.6.0.SNAPSHOT which is being refreshed)

Looks like a problem. More specifically:

2017-06-12 12:35:16,268 | INFO | pool-2-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | mvn:commons-beanutils/commons-beanutils/1.8.3

2017-06-12 12:35:16,673 | INFO | pool-2-thread-1 | FeaturesServiceImpl | 7 - org.apache.karaf.features.core - 4.0.9 | mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.commons-beanutils/1.8.3_2

I guess this circles back to AAA:

nite@nitebug : ~/odl/aaa on master $ fgrep -rn commons-beanutils .
./aaa-shiro/impl/pom.xml:94: <groupId>commons-beanutils</groupId>
./aaa-shiro/impl/pom.xml:95: <artifactId>commons-beanutils</artifactId>
./aaa-shiro/impl/pom.xml:98: <!-- commons-beanutils' dependency on commons-collections is supposed to be optional... -->
./features/authn/odl-aaa-authn-mdsal-cluster/target/classes/META-INF/maven/dependencies.properties:143:commons-beanutils/commons-beanutils/version = 1.8.3
./features/authn/odl-aaa-authn-mdsal-cluster/target/classes/META-INF/maven/dependencies.properties:144:commons-beanutils/commons-beanutils/type = jar
./features/authn/odl-aaa-authn-mdsal-cluster/target/classes/META-INF/maven/dependencies.properties:145:commons-beanutils/commons-beanutils/scope = compile
./features/authn/odl-aaa-authn-mdsal-cluster/target/feature/feature.xml:33: <bundle>mvn:commons-beanutils/commons-beanutils/1.8.3</bundle>
./features/shiro/features-aaa-shiro/src/main/features/features.xml:36: <bundle>mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.commons-beanutils/VERSION</bundle>
./features/shiro/features-aaa-shiro/pom.xml:108: <artifactId>org.apache.servicemix.bundles.commons-beanutils</artifactId>
./features/shiro/odl-aaa-shiro/pom.xml:114: <artifactId>org.apache.servicemix.bundles.commons-beanutils</artifactId>

Comment by Robert Varga [ 20/Jun/17 ]

Snippet of dependency:tree:

[INFO] | +- org.opendaylight.aaa:features-aaa-shiro:xml:features:0.6.0-SNAPSHOT:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-shiro-act:jar:0.6.0-SNAPSHOT:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-shiro:cfg:configuration:0.6.0-SNAPSHOT:runtime
[INFO] | | | +- commons-beanutils:commons-beanutils:jar:1.8.3:runtime
[INFO] | | | - commons-collections:commons-collections:jar:3.2.2:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-shiro:jar:0.6.0-SNAPSHOT:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-shiro-api:jar:0.6.0-SNAPSHOT:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-authn-api:jar:0.6.0-SNAPSHOT:runtime
[INFO] | | +- org.opendaylight.aaa:aaa-filterchain:cfg:config:0.6.0-SNAPSHOT:runtime
[INFO] | | +- com.sun.jersey:jersey-servlet:jar:1.17:runtime
[INFO] | | +- com.sun.jersey:jersey-core:jar:1.17:runtime
[INFO] | | +- javax.servlet:javax.servlet-api:jar:3.0.1:runtime
[INFO] | | +- org.apache.felix:org.apache.felix.dependencymanager:jar:4.3.0:runtime
[INFO] | | +- org.apache.felix:org.apache.felix.metatype:jar:1.1.2:runtime
[INFO] | | | - net.sf.kxml:kxml2:jar:2.2.2:runtime
[INFO] | | +- org.apache.shiro:shiro-web:jar:1.3.2:runtime
[INFO] | | +- org.apache.shiro:shiro-core:jar:1.3.2:runtime
[INFO] | | +- org.apache.servicemix.bundles:org.apache.servicemix.bundles.commons-beanutils:jar:1.8.3_2:runtime
[INFO] | | +- org.apache.oltu.oauth2:org.apache.oltu.oauth2.resourceserver:jar:1.0.2:runtime
[INFO] | | +- org.apache.oltu.oauth2:org.apache.oltu.oauth2.authzserver:jar:1.0.2:runtime
[INFO] | | +- org.apache.oltu.oauth2:org.apache.oltu.oauth2.common:jar:1.0.2:runtime
[INFO] | | - javax.ws.rs:javax.ws.rs-api:jar:2.0.1:runtime

i.e. features-aaa-shiro is pulling in both those bundles.

Comment by Ryan Goulding [ 20/Jun/17 ]

What seems to be the issue? beanutils is required by apache shiro. Are you saying we should upgrade it? Let me know and I can give it a go...

Comment by Ryan Goulding [ 20/Jun/17 ]

https://git.opendaylight.org/gerrit/#/c/59248/

Comment by Ryan Goulding [ 20/Jun/17 ]

merged the above to remove the servicemix version; my apologies I must have added that in Lithium 2.5 years ago when I was not as familiar with dependency management. I am going to open a bug against AAA to clean up the dependencies and re-evaluate how we use the current framework (Shiro) as there are some gnarly third parties required.
It would appear this is supposed to be an umbrella, and ended up being quite specific. I will leave it open as I do not want to disrupt the work being done as part of this bug.

Generated at Wed Feb 07 19:59:52 UTC 2024 using Jira 8.20.10#820010-sha1:ace47f9899e9ee25d7157d59aa17ab06aee30d3d.