SymbolLookup.libraryLookup() is quite slow on MacOS with M-series chips

[刘希晨]

Sorry guys, fall asleep last night, cause it's late in my country.

I have run some more tests, and now I am 100% percent sure that the problem
is not about System.load() or SymbolLookup.librarylookup() and I am pretty
sure it should be reproducible.

here is the minimal version of the reproducible code:

```

private static final String s =
"/Users/liuxichen/workspace/demo/src/main/resources/lib/libcrypto.3.dylib";
public static void main(String[] args) throws IOException {
    long start = System.currentTimeMillis();
    FileInputStream fileInputStream = new FileInputStream(s);
    File f = File.createTempFile("test", ".dylib");
    Path p = f.toPath();
    Files.copy(fileInputStream, p, StandardCopyOption.REPLACE_EXISTING);
    f.deleteOnExit();
    System.out.println("File operation cost : " +
(System.currentTimeMillis() - start));
    SymbolLookup symbolLookup = SymbolLookup.libraryLookup(p,
SegmentScope.global());
    System.out.println("all cost : " + (System.currentTimeMillis() - start));
    fileInputStream.close();
}

```

here is my test results :
1. Just running System.load() or SymbolLookup.librarylookup() will have no
problem and that should cost just about 3ms, no matter it's in the normal
folder or in the tmp folder.
2. If using mechanism in the above codes, which is directly call
SymbolLookup.librarylookup() right after copying file to tmp folder, the
operation is quite slow, it takes about 300ms each time on my M1-pro chips
3. The performance drop using above code is not that obvious on Windows or
Linux, cost about 20ms

I think my OpenSSL library is right in arm architecture, since I install it
using homebrew:
❯ openssl version -a
OpenSSL 3.1.0 14 Mar 2023 (Library: OpenSSL 3.1.0 14 Mar 2023)
built on: Tue Mar 14 12:59:07 2023 UTC
platform: darwin64-arm64-cc
options:  bn(64,64)
compiler: clang -fPIC -arch arm64 -O3 -Wall -DL_ENDIAN -DOPENSSL_PIC
-D_REENTRANT -DOPENSSL_BUILDING_OPENSSL -DNDEBUG
OPENSSLDIR: "/opt/homebrew/etc/openssl at 3"
ENGINESDIR: "/opt/homebrew/Cellar/openssl at 3/3.1.0/lib/engines-3"
MODULESDIR: "/opt/homebrew/Cellar/openssl at 3/3.1.0/lib/ossl-modules"
Seeding source: os-specific
CPUINFO: OPENSSL_armcap=0x187d



Sebastian Stenzel <sebastian.stenzel at gmail.com> 于2023年5月27日周六 02:22写道：

> Is it reproducible? Maybe your openssl .dylib is x86_64 and Rosetta kicked
> in on first use?
>
> > Am 26.05.2023 um 18:21 schrieb Maurizio Cimadamore <
> maurizio.cimadamore at oracle.com>:
> >
> > 
> >> On 26/05/2023 16:51, 刘希晨 wrote:
> >> I noticed a weird problem about SymbolLookup.libraryLookup() with
> SegmentScope.global when I was testing on my M1-pro macbook using JDK20,
> the method took about 700ms to finish when loading OpenSSL's dynamic
> library, this result is quite slow. I tested on Windows and Linux(using WSL
> on Windows) with older hardware (AMD Ryzen 3700x) and it takes around
> 100ms. Please run some tests about this situation and correct me if I am
> wrong. Thanks for your help!
> > Hi,
> >
> > this seems very odd, we will look into it.
> >
> > Note that SymbolLookup::libraryLookup just ends up straight into a
> dlopen call. There are not many strings attached, really. 700ms (but even
> 100ms) seems quite a lot to me.
> >
> > Can you also try with System::loadLibrary - is it faster that way (I
> very much doubt it, since the underlying code is the same?)
> >
> > Cheers
> > Maurizio
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.openjdk.org/pipermail/panama-dev/attachments/20230527/6151f63b/attachment.htm>