Lots of crashes on 13.0.1+9
Sundara Mohan M
m.sundar85 at gmail.com
Tue Feb 4 13:50:04 UTC 2020
Hi David,
It was happening in multiple machines. Let me check if all of them
have same memory issue or si_code 128.
Thanks
Sundar
On Mon, Feb 3, 2020 at 11:38 PM David Holmes <david.holmes at oracle.com>
wrote:
> Hi Sundar,
>
> In this case the si_code 4 means BUS_MCEERR_AR which is a hardware
> memory error.
>
> I'm suspecting a hardware memory problem on your machine. Are these
> crashes all on the same machine?
>
> David
>
> On 4/02/2020 1:33 pm, Sundara Mohan M wrote:
> > Also here is another crash which doesn't have si_code: 128 (SI_KERNEL),
> > ks -Djavax.net.ssl.trustStorePassword=changeit
> > -Djdk.tls.client.protocols=TLSv1.2 -XX:+HeapDumpOnOutOfMemoryError
> > -XX:HeapDumpPath=/home/y/logs/jedi_j#
> > # A fatal error has been detected by the Java Runtime Environment:
> > #
> > # SIGBUS (0x7) at pc=0x00007fe2c531e2d1, pid=56844, tid=57523
> > #
> > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build 13.0.1+9)
> > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode, tiered,
> > parallel gc, linux-amd64)
> > # Problematic frame:
> > # V [libjvm.so+0x64d2d1]
> > CompiledMethod::cleanup_inline_caches_impl(bool, bool)+0xe1
> > #
> > # No core dump will be written. Core dumps have been disabled. To enable
> > core dumping, try "ulimit -c unlimited" before starting Java again
> > #
> > # If you would like to submit a bug report, please visit:
> > # https://github.com/AdoptOpenJDK/openjdk-build/issues
> > #
> > ...
> >
> > --------------- T H R E A D ---------------
> >
> > Current thread (0x00007fe2c0148000): JavaThread "Sweeper thread" daemon
> > [_thread_in_vm, id=57523, stack(0x00007fd1ccc64000,0x00007fd1ccd65000)]
> >
> > Stack: [0x00007fd1ccc64000,0x00007fd1ccd65000], sp=0x00007fd1ccd63940,
> > free space=1022k
> > Native frames: (J=compiled Java code, A=aot compiled Java code,
> > j=interpreted, Vv=VM code, C=native code)
> > V [libjvm.so+0x64d2d1]
> > CompiledMethod::cleanup_inline_caches_impl(bool, bool)+0xe1
> > V [libjvm.so+0x64d702] CompiledMethod::cleanup_inline_caches(bool)+0x42
> > V [libjvm.so+0xf07c52]
> > NMethodSweeper::process_compiled_method(CompiledMethod*)+0x122
> > V [libjvm.so+0xf08243] NMethodSweeper::sweep_code_cache()+0x243
> > V [libjvm.so+0xf088e3] NMethodSweeper::possibly_sweep()+0x93
> > V [libjvm.so+0xf08c65] NMethodSweeper::sweeper_loop()+0xe5
> > V [libjvm.so+0xf6b9fe] JavaThread::thread_main_inner()+0x1be
> > V [libjvm.so+0xf707fd] Thread::call_run()+0x10d
> > V [libjvm.so+0xc875b7] thread_native_entry(Thread*)+0xe7
> >
> >
> > siginfo: si_signo: 7 (SIGBUS), si_code: 4 (unknown), si_addr:
> > 0x00007fe2a9aaa000
> >
> > Register to memory mapping:
> >
> > RAX=
> > [error occurred during error reporting (printing register info), id 0x7,
> > SIGBUS (0x7) at pc=0x00007fe2c5511f49]
> >
> > ...
> >
> >
> > Thanks
> > Sundar
> >
> > On Mon, Feb 3, 2020 at 10:00 PM Sundara Mohan M <m.sundar85 at gmail.com
> > <mailto:m.sundar85 at gmail.com>> wrote:
> >
> > Hi David,
> > Thanks for the bug reference, if i understand correctly it says
> > happens on 32bit system but i am running 64bit (linux-amd64).
> > Let me dig further if i can find reference for other crashes.
> >
> > Thanks
> > Sundar
> >
> > On Mon, Feb 3, 2020 at 6:03 PM David Holmes <david.holmes at oracle.com
> > <mailto:david.holmes at oracle.com>> wrote:
> >
> > Hi Sundar,
> >
> > > siginfo: si_signo: 11 (SIGSEGV), si_code: 128 (SI_KERNEL),
> > si_addr:
> > 0x0000000000000000
> >
> > This seems it may be related to:
> >
> > https://bugs.openjdk.java.net/browse/JDK-8004124
> >
> > which is basically an OS issue. Though why this suddenly appears
> > for
> > 13.0.1+9 is something I can't explain.
> >
> > David
> >
> >
> >
> > On 4/02/2020 5:27 am, Sundara Mohan M wrote:
> > > Hi,
> > > I am seeing lots of crashes on 13.0.1+9 build
> > > For example
> > >
> > > #
> > > # A fatal error has been detected by the Java Runtime
> > Environment:
> > > #
> > > # SIGSEGV (0xb) at pc=0x00007ff4a8295311, pid=79770,
> tid=85679
> > > #
> > > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
> > 13.0.1+9)
> > > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
> > tiered, parallel
> > > gc, linux-amd64)
> > > # Problematic frame:
> > > # V [libjvm.so+0xcd3311]
> > PCMarkAndPushClosure::do_oop(oopDesc**)+0x51
> > > #
> > > # No core dump will be written. Core dumps have been
> > disabled. To enable
> > > core dumping, try "ulimit -c unlimited" before starting Java
> > again
> > > #
> > > # If you would like to submit a bug report, please visit:
> > > # https://github.com/AdoptOpenJDK/openjdk-build/issues
> > > #
> > >
> > >
> > > Host: Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz, 72 cores,
> > 187G, Red Hat
> > > Enterprise Linux Server release 6.10 (Santiago)
> > > Time: Wed Jan 22 02:23:24 2020 UTC elapsed time: 366551
> > seconds (4d 5h 49m
> > > 11s)
> > >
> > > --------------- T H R E A D ---------------
> > >
> > > Current thread (0x00007ff4a0048000): GCTaskThread "ParGC
> > Thread#3" [stack:
> > > 0x00007ff4a61f4000,0x00007ff4a62f4000] [id=85679]
> > >
> > > Stack: [0x00007ff4a61f4000,0x00007ff4a62f4000],
> > sp=0x00007ff4a62f1890,
> > > free space=1014k
> > > Native frames: (J=compiled Java code, A=aot compiled Java
> code,
> > > j=interpreted, Vv=VM code, C=native code)
> > > V [libjvm.so+0xcd3311]
> > PCMarkAndPushClosure::do_oop(oopDesc**)+0x51
> > > V [libjvm.so+0xc6bf0b] OopMapSet::oops_do(frame const*,
> > RegisterMap
> > > const*, OopClosure*)+0x2eb
> > > V [libjvm.so+0x765489] frame::oops_do_internal(OopClosure*,
> > > CodeBlobClosure*, RegisterMap*, bool)+0x99
> > > V [libjvm.so+0xf68b17] JavaThread::oops_do(OopClosure*,
> > > CodeBlobClosure*)+0x187
> > > V [libjvm.so+0xcce2f0]
> > ThreadRootsMarkingTask::do_it(GCTaskManager*,
> > > unsigned int)+0xb0
> > > V [libjvm.so+0x7f422b] GCTaskThread::run()+0x1eb
> > > V [libjvm.so+0xf707fd] Thread::call_run()+0x10d
> > > V [libjvm.so+0xc875b7] thread_native_entry(Thread*)+0xe7
> > >
> > > JavaThread 0x00007fe2c001c000 (nid = 71850) was being
> processed
> > > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> > > v ~RuntimeStub::_new_array_Java
> > > J 198197 c2
> > >
> >
> ch.qos.logback.classic.spi.ThrowableProxy.<init>(Ljava/lang/Throwable;)V
> > > (207 bytes) @ 0x00007ff495f7c328
> > [0x00007ff495f7a300+0x0000000000002028]
> > > J 444945 c2
> > >
> >
> ch.qos.logback.classic.Logger.log(Lorg/slf4j/Marker;Ljava/lang/String;ILjava/lang/String;[Ljava/lang/Object;Ljava/lang/Throwable;)V
> > > (21 bytes) @ 0x00007ff49252f234
> > [0x00007ff49252ef80+0x00000000000002b4]
> > > J 447089 c2
> > >
> >
> org.eclipse.jetty.util.log.JettyAwareLogger.log(Lorg/slf4j/Marker;ILjava/lang/String;[Ljava/lang/Object;Ljava/lang/Throwable;)V
> > > (134 bytes) @ 0x00007ff494212c2c
> > [0x00007ff494212a00+0x000000000000022c]
> > > j
> > >
> >
> org.eclipse.jetty.util.log.JettyAwareLogger.warn(Ljava/lang/String;Ljava/lang/Throwable;)V+7
> > > j
> > >
> >
> org.eclipse.jetty.util.log.Slf4jLog.warn(Ljava/lang/String;Ljava/lang/Throwable;)V+6
> > > j
> > >
> >
> org.eclipse.jetty.server.HttpChannel.handleException(Ljava/lang/Throwable;)V+181
> > > j
> > >
> >
> org.eclipse.jetty.server.HttpChannelOverHttp.handleException(Ljava/lang/Throwable;)V+13
> > > j org.eclipse.jetty.server.HttpChannel.handle()Z+927
> > > J 65088 c2
> > org.eclipse.jetty.server.HttpConnection.onFillable()V (334
> > > bytes) @ 0x00007ff4917ceb74
> > [0x00007ff4917ce5c0+0x00000000000005b4]
> > > J 59048 c2 org.eclipse.jetty.io
> > <http://org.eclipse.jetty.io>.ChannelEndPoint$2.run()V (12
> bytes) @
> > > 0x00007ff494767a84 [0x00007ff494767960+0x0000000000000124]
> > > J 62234 c2
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run()V
> > > (565 bytes) @ 0x00007ff494ce396c
> > [0x00007ff494ce3800+0x000000000000016c]
> > > J 74903 c2 java.lang.Thread.run()V java.base at 13.0.1 (17
> bytes) @
> > > 0x00007ff493fc55d8 [0x00007ff493fc55a0+0x0000000000000038]
> > > v ~StubRoutines::call_stub
> > >
> > > siginfo: si_signo: 11 (SIGSEGV), si_code: 128 (SI_KERNEL),
> > si_addr:
> > > 0x0000000000000000
> > >
> > > ===========
> > >
> > >
> > > #
> > > # A fatal error has been detected by the Java Runtime
> > Environment:
> > > #
> > > # SIGBUS (0x7) at pc=0x00007fa6d02d5570, pid=93432, tid=94111
> > > #
> > > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
> > 13.0.1+9)
> > > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
> > tiered, parallel
> > > gc, linux-amd64)
> > > # Problematic frame:
> > > # V [libjvm.so+0x582570]
> > PhaseChaitin::gather_lrg_masks(bool)+0x730
> > > #
> > > # No core dump will be written. Core dumps have been
> > disabled. To enable
> > > core dumping, try "ulimit -c unlimited" before starting Java
> > again
> > > #
> > > # If you would like to submit a bug report, please visit:
> > > # https://github.com/AdoptOpenJDK/openjdk-build/issues
> > > #
> > >
> > > ================
> > >
> > > #
> > > # A fatal error has been detected by the Java Runtime
> > Environment:
> > > #
> > > # SIGBUS (0x7) at pc=0x00007fe2c531e2d1, pid=56844, tid=57523
> > > #
> > > # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build
> > 13.0.1+9)
> > > # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode,
> > tiered, parallel
> > > gc, linux-amd64)
> > > # Problematic frame:
> > > # V [libjvm.so+0x64d2d1]
> > CompiledMethod::cleanup_inline_caches_impl(bool,
> > > bool)+0xe1
> > > #
> > > # No core dump will be written. Core dumps have been
> > disabled. To enable
> > > core dumping, try "ulimit -c unlimited" before starting Java
> > again
> > > #
> > > # If you would like to submit a bug report, please visit:
> > > # https://github.com/AdoptOpenJDK/openjdk-build/issues
> > > #
> > >
> > >
> > > I have following flags
> > > -XX:+AlwaysPreTouch -Xms64000m -Xmx64000m -XX:NewSize=40000m
> > > -XX:+DisableExplicitGC -Xnoclassgc -XX:+UseParallelGC
> > > -XX:ParallelGCThreads=40 -XX:ConcGCThreads=5
> > >
> >
> -Xlog:gc,gc+init,gc+start,gc+phases,gc+heap,gc+cpu,gc+reloc,gc+ref,gc+marking,gc+metaspace=info:file=gc.log:time,uptime,level,tags:filecount=3,filesize=100M
> > > -DenablePureJava=true -XX:-OmitStackTraceInFastThrow
> > >
> >
> -Dorg.xml.sax.driver=com.sun.org.apache.xerces.internal.parsers.SAXParser
> > > -Dsun.reflect.inflationThreshold=0
> > -Dsun.rmi.dgc.client.gcInterval=43200000
> > > -Dsun.rmi.dgc.server.gcInterval=43200000
> > > -Dremote.ip.filter.enable_https_scheme_from_ypath=false
> > > -Djava.security.egd=file:///dev/urandom
> > >
> > > and running jetty server.
> > >
> > > Can someone help to debug what is happening here?
> > >
> > > Note: I am trying to move to 13.0.2 but want to check if that
> > will solve my
> > > issues.
> > >
> > > Thanks
> > > Sundar
> > >
> >
>
More information about the hotspot-runtime-dev
mailing list