[External] : Re: JEP-412 & OpenGL

Maurizio Cimadamore maurizio.cimadamore at oracle.com
Mon Nov 22 12:23:25 UTC 2021 

I see what you mean.

Unfortunately, having too strict of a behavior at runtime (e.g. fail 
early when a non-existing function is detected) might also be overly 
strict. There are many cases where the library is 99% there, except for 
one or two problematic functions (which might be delivered as macros on 
some platforms, but not in others). If these functions are never called, 
failing eagerly might seem overly harsh.

Possible options are to use some kind of SPI to allow clients to 
override function lookup - but honestly, it seems a very complex 
solution. E.g. in your case you can probably tweak RuntimeHelper sources 
to fail early if a native symbol is not found.

Maurizio

On 22/11/2021 12:08, Martin Pernollet wrote:
> Hi Maurizio,
>
> Maybe this would be more handy to run this from the program using the binding : providing the libs to JExtract has the drawback to tidying the generated library to the developer lib path. In the future I woule like not use the -l option to prevent JExtract from generating the System.load and System.loadLibrary, and write this lib loading code on the user side.
>
> Example use case that I got working : I generated bindings from a Mac 11.4 computer which has the lib at a given path /a/b/c. I ran from a Mac 10.15 and noticed it works perfectly by just modifying the path to the GL libs at /d/e/f.
>
> If I was wrong entering /d/e/g at runtime, I would like to detect unmapped functions.
>
> Cheers
>
>
> Sent with ProtonMail Secure Email.
>
> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
>
> Le lundi 22 novembre 2021 à 11:41, Maurizio Cimadamore <maurizio.cimadamore at oracle.com> a écrit :
>
>> Hi Martin,
>>
>> we used to have a check similar to the one you describe in an earlier
>>
>> version of jextract (e.g. when `-l` was specified, we would check that
>>
>> functions/global vars were emitted in said libs). We can probably re-add
>>
>> such a check.
>>
>> Maurizio
>>
>> On 21/11/2021 17:39, Martin Pernollet wrote:
>>
>>> Hi,
>>>
>>> The UnsatisfiedLinkError was triggered while invoking a method relying on a null method handle.
>>>
>>> When invoking jextract, I provided an include dir with multiple header files (usr/include/GL) but an incomplete list of libraries. The code is generated correctly and the user of this generated code don't see any problem at compile time. However, when running the program, glut_h will only map a subset of the generated method handles to the native libs.
>>>
>>> It would be convenient to get warnings about it when the program starts. Would you recommend a way to iterate over all generated method handles to check those that are null?
>>>
>>> /usr/lib/jvm/jdk-17-panama/bin/jextract -d ./src/main/java/ --source -t opengl.ubuntu.v20 \
>>>
>>> -lGL \
>>>
>>> -l/usr/lib/x86_64-linux-gnu/libglut.so.3.9.0 \
>>>
>>> -l/usr/lib/x86_64-linux-gnu/libGLU.so.1.3.1 \ << that one was missing
>>>
>>> -I /usr/include/GL \
>>>
>>> -C-F/usr/include/GL \
>>>
>>> /usr/include/GL/glut.h
>>>
>>> public class glut_h extends glut_h_6 {
>>>
>>>       static {
>>>           System.loadLibrary("GL");
>>>           System.load("/usr/lib/x86_64-linux-gnu/libglut.so.3.9.0");
>>>           System.load("/usr/lib/x86_64-linux-gnu/libGLU.so.1.3.1"); // fixing jextract lib list let glut_h map the metod handle to the native libs
>>>       }
>>>
>>>
>>> Cheers,
>>>
>>> Martin
>>>
>>> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
>>>
>>> Le lundi 15 novembre 2021 à 11:43, Maurizio Cimadamore maurizio.cimadamore at oracle.com a écrit :
>>>
>>>> Hi,
>>>>
>>>> from the top of my head, this looks like an exception thrown while you
>>>>
>>>> are executing an upcall. And it also looks like you are missing some of
>>>>
>>>> the latest patches which will generate a "normal" stack trace. So you
>>>>
>>>> only see the exception name (UnsatisfiedLink).
>>>>
>>>> As a general rule, if an exception occurs when an upcall is executing,
>>>>
>>>> only option is to exit the Java program, so that we don't leave the
>>>>
>>>> native code in a potentially bad state.
>>>>
>>>> But more recent releases of the linker API do a better job at presenting
>>>>
>>>> this as an "exception" (although one that cannot be caught) rather than
>>>>
>>>> a blunt crash.
>>>>
>>>> If you can't update to a newer build, I'd look into all upcall code,
>>>>
>>>> looking for all pieces of code which might do System.load/loadLibrary.
>>>>
>>>> Maurizio
>>>>
>>>> On 15/11/2021 07:33, Martin Pernollet wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am now on Ubuntu. The original teapot sample is working (just
>>>>>
>>>>> required to change glutDisplayFunc$func to glutDisplayFunc$callback).
>>>>>
>>>>> I got an UnstasfiedLinkException with other programs. I wonder if you
>>>>>
>>>>> have a suggestion to help me understand my mistake? LDD command does
>>>>>
>>>>> not help. Like for the NPE, we lack a bit of info for debugging.
>>>>>
>>>>> Console says
>>>>>
>>>>> Uncaught exception:
>>>>>
>>>>> java.lang.UnsatisfiedLinkError
>>>>>
>>>>> {0x0000000091ac9b58} - klass: 'java/lang/UnsatisfiedLinkError'
>>>>>
>>>>> A fatal error has been detected by the Java Runtime Environment:
>>>>> ================================================================
>>>>>
>>>>> #  Internal Error (universalUpcallHandler.cpp:113), pid=33668, tid=33677
>>>>>
>>>>> #  Error: ShouldNotReachHere()
>>>>>
>>>>> Core dump says (see attached the complete core dump file)
>>>>>
>>>>> Current thread (0x00007f5d580268c0):  JavaThread "main"
>>>>>
>>>>> [_thread_in_Java, id=35593, stack(0x00007f5d5f59e000,0x00007f5d5f69f000)]
>>>>>
>>>>> Stack: [0x00007f5d5f59e000,0x00007f5d5f69f000],
>>>>>
>>>>> sp=0x00007f5d5f69c8b0,  free space=1018k
>>>>>
>>>>> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
>>>>>
>>>>> C=native code)
>>>>>
>>>>> V  [libjvm.so+0xd993a3]
>>>>>
>>>>> ProgrammableUpcallHandler::handle_uncaught_exception(oopDesc*)+0x43
>>>>>
>>>>> v  ~BufferBlob::panama_upcall_stub
>>>>>
>>>>> C  [libglut.so.3.9.0+0x20895]  glutMainLoopEvent+0x2a5
>>>>>
>>>>> Register to memory mapping:
>>>>>
>>>>> RAX=0x00007f5d60cc4000 points into unknown readable memory:
>>>>>
>>>>> 0x0000000000000058 | 58 00 00 00 00 00 00 00
>>>>>
>>>>> RBX=0x00007f5d4184556a is at code_begin+842 in
>>>>>
>>>>> [CodeBlob (0x00007f5d41845190)]
>>>>>
>>>>> Framesize: 0
>>>>>
>>>>> BufferBlob (0x00007f5d41845190) used for panama_upcall_stub
>>>>>
>>>>> RCX=0x000000000000000a is an unknown value
>>>>>
>>>>> RDX=0x0 is NULL
>>>>>
>>>>> RSP=0x00007f5d5f69c8b0 is pointing into the stack for thread:
>>>>>
>>>>> 0x00007f5d580268c0
>>>>>
>>>>> RBP=0x00007f5d5f69c8c0 is pointing into the stack for thread:
>>>>>
>>>>> 0x00007f5d580268c0
>>>>>
>>>>> RSI=0x0000000000000071 is an unknown value
>>>>>
>>>>> RDI=0x00007f5d606f6108: <offset 0x0000000000efd108> in
>>>>>
>>>>> /usr/lib/jvm/jdk-17-panama/lib/server/libjvm.so at 0x00007f5d5f7f9000
>>>>>
>>>>> R8 =0x0 is NULL
>>>>>
>>>>> R9 =0x00007f5d5f69c8a0 is pointing into the stack for thread:
>>>>>
>>>>> 0x00007f5d580268c0
>>>>>
>>>>> R10=0x0 is NULL
>>>>>
>>>>> R11=0x0 is NULL
>>>>>
>>>>> R12=0x0000000091d82828 is an oop: java.lang.UnsatisfiedLinkError
>>>>>
>>>>> {0x0000000091d82828} - klass: 'java/lang/UnsatisfiedLinkError'
>>>>>
>>>>> R13=0x00007f5d1c42fbdc is pointing into metadata
>>>>>
>>>>> R14=0x00007f5d5f69c8c8 is pointing into the stack for thread:
>>>>>
>>>>> 0x00007f5d580268c0
>>>>>
>>>>> R15=0x00007f5d580268c0 is a thread
>>>>>
>>>>> I verified with LDD if the lib I am linking to has dependencies
>>>>>
>>>>> problem but it seams to be ok.
>>>>>
>>>>> ldd --verbose /usr/lib/x86_64-linux-gnu/libglut.so.3.9.0
>>>>>
>>>>> linux-vdso.so.1 (0x00007ffc37dcd000)
>>>>>
>>>>> libGL.so.1 => /lib/x86_64-linux-gnu/libGL.so.1 (0x00007effdf322000)
>>>>>
>>>>> libX11.so.6 => /lib/x86_64-linux-gnu/libX11.so.6 (0x00007effdf1e5000)
>>>>>
>>>>> libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007effdf096000)
>>>>>
>>>>> libXi.so.6 => /lib/x86_64-linux-gnu/libXi.so.6 (0x00007effdf084000)
>>>>>
>>>>> libXxf86vm.so.1 => /lib/x86_64-linux-gnu/libXxf86vm.so.1
>>>>>
>>>>> (0x00007effdf07d000)
>>>>>
>>>>> libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007effdee8b000)
>>>>>
>>>>> libGLdispatch.so.0 => /lib/x86_64-linux-gnu/libGLdispatch.so.0
>>>>>
>>>>> (0x00007effdedd1000)
>>>>>
>>>>> libGLX.so.0 => /lib/x86_64-linux-gnu/libGLX.so.0 (0x00007effded9d000)
>>>>>
>>>>> libxcb.so.1 => /lib/x86_64-linux-gnu/libxcb.so.1 (0x00007effded73000)
>>>>>
>>>>> libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007effded6d000)
>>>>>
>>>>> /lib64/ld-linux-x86-64.so.2 (0x00007effdf608000)
>>>>>
>>>>> libXext.so.6 => /lib/x86_64-linux-gnu/libXext.so.6 (0x00007effded58000)
>>>>>
>>>>> libXau.so.6 => /lib/x86_64-linux-gnu/libXau.so.6 (0x00007effded50000)
>>>>>
>>>>> libXdmcp.so.6 => /lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007effded48000)
>>>>>
>>>>> libbsd.so.0 => /lib/x86_64-linux-gnu/libbsd.so.0 (0x00007effded2e000)
>>>>>
>>>>> Version information:
>>>>>
>>>>> /usr/lib/x86_64-linux-gnu/libglut.so.3.9.0:
>>>>>
>>>>> libm.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libm.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.7) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.15) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.17) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libGL.so.1:
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libX11.so.6:
>>>>>
>>>>> libdl.so.2 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libdl.so.2
>>>>>
>>>>> libc.so.6 (GLIBC_2.7) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.15) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.26) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.2) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libm.so.6:
>>>>>
>>>>> ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_PRIVATE) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libXi.so.6:
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libXxf86vm.so.1:
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libc.so.6:
>>>>>
>>>>> ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2
>>>>>
>>>>> ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2
>>>>>
>>>>> /lib/x86_64-linux-gnu/libGLdispatch.so.0:
>>>>>
>>>>> libdl.so.2 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libdl.so.2
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libGLX.so.0:
>>>>>
>>>>> libdl.so.2 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libdl.so.2
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.7) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libxcb.so.1:
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.2) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libdl.so.2:
>>>>>
>>>>> ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2
>>>>>
>>>>> libc.so.6 (GLIBC_PRIVATE) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libXext.so.6:
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libXau.so.6:
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libXdmcp.so.6:
>>>>>
>>>>> libbsd.so.0 (LIBBSD_0.2) => /lib/x86_64-linux-gnu/libbsd.so.0
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> /lib/x86_64-linux-gnu/libbsd.so.0:
>>>>>
>>>>> libc.so.6 (GLIBC_2.25) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.16) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.14) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.8) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.2) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.17) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3.4) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.2.5) => /lib/x86_64-linux-gnu/libc.so.6
>>>>>
>>>>> libc.so.6 (GLIBC_2.3) => /lib/x86_64-linux-gnu/libc.so.6

More information about the panama-dev mailing list