Lots of crashes on 13.0.1+9

David Holmes david.holmes at oracle.com
Tue Feb 4 04:38:49 UTC 2020


Hi Sundar,

In this case the si_code 4 means BUS_MCEERR_AR which is a hardware 
memory error.

I'm suspecting a hardware memory problem on your machine. Are these 
crashes all on the same machine?

David

On 4/02/2020 1:33 pm, Sundara Mohan M wrote:
> Also here is another crash which doesn't have si_code: 128 (SI_KERNEL),
> ks -Djavax.net.ssl.trustStorePassword=changeit 
> -Djdk.tls.client.protocols=TLSv1.2 -XX:+HeapDumpOnOutOfMemoryError 
> -XX:HeapDumpPath=/home/y/logs/jedi_j#
> # A fatal error has been detected by the Java Runtime Environment:
> #
> #  SIGBUS (0x7) at pc=0x00007fe2c531e2d1, pid=56844, tid=57523
> #
> # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build 13.0.1+9)
> # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode, tiered, 
> parallel gc, linux-amd64)
> # Problematic frame:
> # V  [libjvm.so+0x64d2d1] 
>   CompiledMethod::cleanup_inline_caches_impl(bool, bool)+0xe1
> #
> # No core dump will be written. Core dumps have been disabled. To enable 
> core dumping, try "ulimit -c unlimited" before starting Java again
> #
> # If you would like to submit a bug report, please visit:
> # https://github.com/AdoptOpenJDK/openjdk-build/issues
> #
> ...
> 
> ---------------  T H R E A D  ---------------
> 
> Current thread (0x00007fe2c0148000):  JavaThread "Sweeper thread" daemon 
> [_thread_in_vm, id=57523, stack(0x00007fd1ccc64000,0x00007fd1ccd65000)]
> 
> Stack: [0x00007fd1ccc64000,0x00007fd1ccd65000],  sp=0x00007fd1ccd63940, 
>   free space=1022k
> Native frames: (J=compiled Java code, A=aot compiled Java code, 
> j=interpreted, Vv=VM code, C=native code)
> V  [libjvm.so+0x64d2d1] 
>   CompiledMethod::cleanup_inline_caches_impl(bool, bool)+0xe1
> V  [libjvm.so+0x64d702]  CompiledMethod::cleanup_inline_caches(bool)+0x42
> V  [libjvm.so+0xf07c52] 
>   NMethodSweeper::process_compiled_method(CompiledMethod*)+0x122
> V  [libjvm.so+0xf08243]  NMethodSweeper::sweep_code_cache()+0x243
> V  [libjvm.so+0xf088e3]  NMethodSweeper::possibly_sweep()+0x93
> V  [libjvm.so+0xf08c65]  NMethodSweeper::sweeper_loop()+0xe5
> V  [libjvm.so+0xf6b9fe]  JavaThread::thread_main_inner()+0x1be
> V  [libjvm.so+0xf707fd]  Thread::call_run()+0x10d
> V  [libjvm.so+0xc875b7]  thread_native_entry(Thread*)+0xe7
> 
> 
> siginfo: si_signo: 7 (SIGBUS), si_code: 4 (unknown), si_addr: 
> 0x00007fe2a9aaa000
> 
> Register to memory mapping:
> 
> RAX=
> [error occurred during error reporting (printing register info), id 0x7, 
> SIGBUS (0x7) at pc=0x00007fe2c5511f49]
> 
> ...
> 
> 
> Thanks
> Sundar
> 
> On Mon, Feb 3, 2020 at 10:00 PM Sundara Mohan M <m.sundar85 at gmail.com 
> <mailto:m.sundar85 at gmail.com>> wrote:
> 
>     Hi David,
>        Thanks for the bug reference, if i understand correctly it says
>     happens on 32bit system but i am running 64bit (linux-amd64).
>     Let me dig further if i can find reference for other crashes.
> 
>     Thanks
>     Sundar
> 
>     On Mon, Feb 3, 2020 at 6:03 PM David Holmes <david.holmes at oracle.com
>     <mailto:david.holmes at oracle.com>> wrote:
> 
>         Hi Sundar,
> 
>           > siginfo: si_signo: 11 (SIGSEGV), si_code: 128 (SI_KERNEL),
>         si_addr:
>         0x0000000000000000
> 
>         This seems it may be related to:
> 
>         https://bugs.openjdk.java.net/browse/JDK-8004124
> 
>         which is basically an OS issue. Though why this suddenly appears
>         for
>         13.0.1+9 is something I can't explain.
> 
>         David
> 
> 
> 
>         On 4/02/2020 5:27 am, Sundara Mohan M wrote:
>          > Hi,
>          >   I am seeing lots of crashes on 13.0.1+9 build
>          > For example
>          >
>          > #
>          > # A fatal error has been detected by the Java Runtime
>         Environment:
>          > #
>          > #  SIGSEGV (0xb) at pc=0x00007ff4a8295311, pid=79770, tid=85679
>          > #
>          > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
>         13.0.1+9)
>          > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
>         tiered, parallel
>          > gc, linux-amd64)
>          > # Problematic frame:
>          > # V  [libjvm.so+0xcd3311] 
>         PCMarkAndPushClosure::do_oop(oopDesc**)+0x51
>          > #
>          > # No core dump will be written. Core dumps have been
>         disabled. To enable
>          > core dumping, try "ulimit -c unlimited" before starting Java
>         again
>          > #
>          > # If you would like to submit a bug report, please visit:
>          > # https://github.com/AdoptOpenJDK/openjdk-build/issues
>          > #
>          >
>          >
>          > Host: Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz, 72 cores,
>         187G, Red Hat
>          > Enterprise Linux Server release 6.10 (Santiago)
>          > Time: Wed Jan 22 02:23:24 2020 UTC elapsed time: 366551
>         seconds (4d 5h 49m
>          > 11s)
>          >
>          > ---------------  T H R E A D  ---------------
>          >
>          > Current thread (0x00007ff4a0048000):  GCTaskThread "ParGC
>         Thread#3" [stack:
>          > 0x00007ff4a61f4000,0x00007ff4a62f4000] [id=85679]
>          >
>          > Stack: [0x00007ff4a61f4000,0x00007ff4a62f4000], 
>         sp=0x00007ff4a62f1890,
>          >   free space=1014k
>          > Native frames: (J=compiled Java code, A=aot compiled Java code,
>          > j=interpreted, Vv=VM code, C=native code)
>          > V  [libjvm.so+0xcd3311] 
>         PCMarkAndPushClosure::do_oop(oopDesc**)+0x51
>          > V  [libjvm.so+0xc6bf0b]  OopMapSet::oops_do(frame const*,
>         RegisterMap
>          > const*, OopClosure*)+0x2eb
>          > V  [libjvm.so+0x765489]  frame::oops_do_internal(OopClosure*,
>          > CodeBlobClosure*, RegisterMap*, bool)+0x99
>          > V  [libjvm.so+0xf68b17]  JavaThread::oops_do(OopClosure*,
>          > CodeBlobClosure*)+0x187
>          > V  [libjvm.so+0xcce2f0] 
>         ThreadRootsMarkingTask::do_it(GCTaskManager*,
>          > unsigned int)+0xb0
>          > V  [libjvm.so+0x7f422b]  GCTaskThread::run()+0x1eb
>          > V  [libjvm.so+0xf707fd]  Thread::call_run()+0x10d
>          > V  [libjvm.so+0xc875b7]  thread_native_entry(Thread*)+0xe7
>          >
>          > JavaThread 0x00007fe2c001c000 (nid = 71850) was being processed
>          > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
>          > v  ~RuntimeStub::_new_array_Java
>          > J 198197 c2
>          >
>         ch.qos.logback.classic.spi.ThrowableProxy.<init>(Ljava/lang/Throwable;)V
>          > (207 bytes) @ 0x00007ff495f7c328
>         [0x00007ff495f7a300+0x0000000000002028]
>          > J 444945 c2
>          >
>         ch.qos.logback.classic.Logger.log(Lorg/slf4j/Marker;Ljava/lang/String;ILjava/lang/String;[Ljava/lang/Object;Ljava/lang/Throwable;)V
>          > (21 bytes) @ 0x00007ff49252f234
>         [0x00007ff49252ef80+0x00000000000002b4]
>          > J 447089 c2
>          >
>         org.eclipse.jetty.util.log.JettyAwareLogger.log(Lorg/slf4j/Marker;ILjava/lang/String;[Ljava/lang/Object;Ljava/lang/Throwable;)V
>          > (134 bytes) @ 0x00007ff494212c2c
>         [0x00007ff494212a00+0x000000000000022c]
>          > j
>          > 
>           org.eclipse.jetty.util.log.JettyAwareLogger.warn(Ljava/lang/String;Ljava/lang/Throwable;)V+7
>          > j
>          > 
>           org.eclipse.jetty.util.log.Slf4jLog.warn(Ljava/lang/String;Ljava/lang/Throwable;)V+6
>          > j
>          > 
>           org.eclipse.jetty.server.HttpChannel.handleException(Ljava/lang/Throwable;)V+181
>          > j
>          > 
>           org.eclipse.jetty.server.HttpChannelOverHttp.handleException(Ljava/lang/Throwable;)V+13
>          > j  org.eclipse.jetty.server.HttpChannel.handle()Z+927
>          > J 65088 c2
>         org.eclipse.jetty.server.HttpConnection.onFillable()V (334
>          > bytes) @ 0x00007ff4917ceb74
>         [0x00007ff4917ce5c0+0x00000000000005b4]
>          > J 59048 c2 org.eclipse.jetty.io
>         <http://org.eclipse.jetty.io>.ChannelEndPoint$2.run()V (12 bytes) @
>          > 0x00007ff494767a84 [0x00007ff494767960+0x0000000000000124]
>          > J 62234 c2
>         org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run()V
>          > (565 bytes) @ 0x00007ff494ce396c
>         [0x00007ff494ce3800+0x000000000000016c]
>          > J 74903 c2 java.lang.Thread.run()V java.base at 13.0.1 (17 bytes) @
>          > 0x00007ff493fc55d8 [0x00007ff493fc55a0+0x0000000000000038]
>          > v  ~StubRoutines::call_stub
>          >
>          > siginfo: si_signo: 11 (SIGSEGV), si_code: 128 (SI_KERNEL),
>         si_addr:
>          > 0x0000000000000000
>          >
>          > ===========
>          >
>          >
>          > #
>          > # A fatal error has been detected by the Java Runtime
>         Environment:
>          > #
>          > #  SIGBUS (0x7) at pc=0x00007fa6d02d5570, pid=93432, tid=94111
>          > #
>          > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
>         13.0.1+9)
>          > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
>         tiered, parallel
>          > gc, linux-amd64)
>          > # Problematic frame:
>          > # V  [libjvm.so+0x582570] 
>         PhaseChaitin::gather_lrg_masks(bool)+0x730
>          > #
>          > # No core dump will be written. Core dumps have been
>         disabled. To enable
>          > core dumping, try "ulimit -c unlimited" before starting Java
>         again
>          > #
>          > # If you would like to submit a bug report, please visit:
>          > # https://github.com/AdoptOpenJDK/openjdk-build/issues
>          > #
>          >
>          > ================
>          >
>          > #
>          > # A fatal error has been detected by the Java Runtime
>         Environment:
>          > #
>          > #  SIGBUS (0x7) at pc=0x00007fe2c531e2d1, pid=56844, tid=57523
>          > #
>          > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
>         13.0.1+9)
>          > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
>         tiered, parallel
>          > gc, linux-amd64)
>          > # Problematic frame:
>          > # V  [libjvm.so+0x64d2d1] 
>         CompiledMethod::cleanup_inline_caches_impl(bool,
>          > bool)+0xe1
>          > #
>          > # No core dump will be written. Core dumps have been
>         disabled. To enable
>          > core dumping, try "ulimit -c unlimited" before starting Java
>         again
>          > #
>          > # If you would like to submit a bug report, please visit:
>          > # https://github.com/AdoptOpenJDK/openjdk-build/issues
>          > #
>          >
>          >
>          > I have following flags
>          > -XX:+AlwaysPreTouch -Xms64000m -Xmx64000m -XX:NewSize=40000m
>          > -XX:+DisableExplicitGC -Xnoclassgc -XX:+UseParallelGC
>          > -XX:ParallelGCThreads=40 -XX:ConcGCThreads=5
>          >
>         -Xlog:gc,gc+init,gc+start,gc+phases,gc+heap,gc+cpu,gc+reloc,gc+ref,gc+marking,gc+metaspace=info:file=gc.log:time,uptime,level,tags:filecount=3,filesize=100M
>          > -DenablePureJava=true -XX:-OmitStackTraceInFastThrow
>          >
>         -Dorg.xml.sax.driver=com.sun.org.apache.xerces.internal.parsers.SAXParser
>          > -Dsun.reflect.inflationThreshold=0
>         -Dsun.rmi.dgc.client.gcInterval=43200000
>          > -Dsun.rmi.dgc.server.gcInterval=43200000
>          > -Dremote.ip.filter.enable_https_scheme_from_ypath=false
>          > -Djava.security.egd=file:///dev/urandom
>          >
>          > and running jetty server.
>          >
>          > Can someone help to debug what is happening here?
>          >
>          > Note: I am trying to move to 13.0.2 but want to check if that
>         will solve my
>          > issues.
>          >
>          > Thanks
>          > Sundar
>          >
> 


More information about the hotspot-runtime-dev mailing list