Operating System: All
Platform: All

Hi Jan and all,

Thanks for filling in this entry.
I have raised the question originally on ODL forum.
I have access to several ARM 64bit server platforms, from various vendors including AppliedMicro (APM), Freescale, Cavium.

Since then I have been able to build leveldb and corresponding JNI library on aarch64 target. It has been successfully tested in the last couple of months, running ODL Lithium on an APM server as part of a basic ARM 64bit OPNFV test lab (OpenStack controller including ODL + 3 compute nodes).

I would gladly help to upstream this support, however I need some guidance on the release procedure (releasing leveldjni to Maven Central and integration with ODL).
I would like to prioritize this feature request as next release of OPNFV will depend on it.

Looking forward to sync with you on this.

Also, please add me to the CC list (in case Bugzilla will not do it).

Best Regards,
Florin

@Florin:

See https://git.opendaylight.org/gerrit/#/c/25693/

The infra is there, ping the RELENG/IT to make it happen.

I've also added a commit that shows how to turn on the Java-only
implementation of leveldb, for those platforms where the native version
is unavailable.

https://git.opendaylight.org/gerrit/#/c/29217/

(In reply to Jan-Simon Moeller from comment #2)
> @Florin:
>
> See https://git.opendaylight.org/gerrit/#/c/25693/
>
> The infra is there, ping the RELENG/IT to make it happen.

Many thanks Jan,

I'll have a look at the Solaris example for reference.

Gary,

To get leveldb java to work in karaf don't we need to also have the leveldb java bundle installed? Were you able to verify that leveldb java was used when we change the configuration?

Hi Moiz,

Yes, I did verify (via stack traces) that the Java-only leveldb was being used when the option is set.

It looks like the Java-only leveldb (https://github.com/dain/leveldb) is already included by the Akka Persistence default plugin for leveldb. So, we don't need to package any additional bundles ourselves.

Thanks for confirming that Gary.

@Florin: just provide the instructions on how to build leveldbjni for arm here. IT can pick it up here and create the package.

@Moiz/Gary:
There is still the dependency to leveldbjni left which fails during feature:install. So there is no way to successfully install something e.g. on arm currently. Even if the java-only version would just pick-up, the installation procedure would fail currently.
So we'd need a weaker dependency or an architecture-dependent dependency on leveldbjni then ?

FWIW leveldbjni upstream project recently accepted our Solaris patch [1] which tells me they aren't completely dead. Just really slow. I think it'd be worth providing patches to them in hopes that they'll merge it and release a version we can consume in the future.

To not block our own development though IT can rebuild and publish a custom version on nexus.opendaylight.org we just need instructions on how to build it as well as the source since we have to release source.jars with anything we push to Nexus, please provide that detail here. Once that's done I'd recommend opening a helpdesk ticket by sending email to helpdesk@opendaylight.org with a link back to this bug so that we can see the build instructions and history.

[1] https://github.com/fusesource/leveldbjni/pull/64

We discussed this today at the Clustering Hackers Meeting. The consensus is that the right way to deal with the karaf feature dependency issue is with karaf 4.0 version which has the necessary features to address this type of dependency requirements.

There is a pre-existing bug logged for the karaf upgrade here:
https://bugs.opendaylight.org/show_bug.cgi?id=4219

Due to the time constraint and the potential impact, the karaf upgrade will likely be done in the Boron release.

Whats the status of this bug ?

I see there is movement on the karaf front.

Do we have a leveldbjni with arm meantime ?

Hi Jan,

Unfortunately I did not have the bandwidth to follow up on pushing leveldbjni for ARM (same as it was done for Solaris). In the meantime OPNFV for ARM builds it locally.
Let me see if I can free up some time in the next couple of weeks.

CONTROLLER-1591 may help in this regard (if I ever manage to make progress with it).

> I would gladly help to upstream this support, however I need some
> guidance on the release procedure (releasing leveldjni to
> Maven Central and integration with ODL).

Any such work would have to at least initially start via a Pull Request over on https://github.com/fusesource/leveldbjni, not here... You could jump on https://github.com/fusesource/leveldbjni/issues/76. But see also CONTROLLER-1591.

> how to turn on the Java-only implementation of leveldb,
> for those platforms where the native version is unavailable.
> https://git.opendaylight.org/gerrit/#/c/29217/
> the Java-only leveldb (https://github.com/dain/leveldb)

Do any of you actually use this alternative implemementation? To me, both the comment you put in c/29217 and looking myself at "dain/leveldb" doesn't look very serious... "currently the code base is basically functional, but only trivially tested" - if any of you have tested ODL with this, do let us know here please.

I agree, there are a bunch of architectures supported upstream. ariel.adam, is there interest to support ARM on RH? If so, we really need an update to upstream and then we can pull the arches we need.

For Red Hat products we rebuild from source anyway, so our downstream support doesn’t depend on the availability of binaries upstream. Currently we ship leveldbjni on ppc64le and x86_64.