<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:DengXian;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"\@DengXian";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
code
{mso-style-priority:99;
font-family:"Courier New";}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">I guess this should also go to jdk-updates.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Best regards,<o:p></o:p></p>
<p class="MsoNormal">Goetz.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Lindenmaier, Goetz <br>
<b>Sent:</b> Thursday, August 4, 2022 10:29 PM<br>
<b>To:</b> Carter Kozak <ckozak@ckozak.net>; hotspot-compiler-dev@openjdk.org<br>
<b>Subject:</b> RE: C2 exhausts system memory compiling SSLEngineInputRecord::decodeInputRecord<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We ran into the presumable same issue. <o:p></o:p></p>
<p class="MsoNormal">We already narrowed it down to the same change.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I had opened <a href="https://bugs.openjdk.org/browse/JDK-8291919">
[JDK-8291919] [11u] High compiler native memory consumption after 8280799 - Java Bug System (openjdk.org)</a><o:p></o:p></p>
<p class="MsoNormal">For this.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Best regards,<o:p></o:p></p>
<p class="MsoNormal"> Goetz.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> hotspot-compiler-dev <<a href="mailto:hotspot-compiler-dev-retn@openjdk.org">hotspot-compiler-dev-retn@openjdk.org</a>>
<b>On Behalf Of </b>Carter Kozak<br>
<b>Sent:</b> Thursday, August 4, 2022 9:57 PM<br>
<b>To:</b> <a href="mailto:hotspot-compiler-dev@openjdk.org">hotspot-compiler-dev@openjdk.org</a><br>
<b>Subject:</b> C2 exhausts system memory compiling SSLEngineInputRecord::decodeInputRecord<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I filed <a href="https://bugs.openjdk.org/browse/JDK-8291665">
JDK-8291665</a> [1] which was originally closed as “This is not a java bug, the crash is on zulu build”; however, I've since been able to reproduce the issue on standard OpenJDK builds consistently with a
<a href="https://gist.github.com/carterkozak/4aff21e72e74d42320b4427953a56385">compiler replay log [2]</a>. Unfortunately I lack the permissions to update the ticket myself, so I'd like to share my findings here, and hopefully work toward a solution.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">This impacts OpenJDK <a href="https://github.com/openjdk/jdk11u/releases/tag/jdk-11.0.16-ga">
jdk-11.0.16-ga</a> [3] (Latest OpenJDK 11 hotfix which resolves a cvss 9.8 vulnerability) observed using public builds as well as a build I created from source. The crash impacted dozens of applications repeatedly within the first day of rollout, as the pattern
which triggers the failure exists within the JDK itself, used within TLS. The failure presents as a jvm crash after the compiler consumes all physical memory. Some applications crash after 50-90 seconds around ~30% of launches, while others crash less frequently.
In all cases I've observed, the failure has been within C2 compilation of <code>
<span style="font-size:10.0pt">SSLEngineInputRecord::decodeInputRecord</span></code><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The failure is reproducible using the compiler replay log with a debug-enabled jdk-11.0.16-ga and produces an hs_err_pid log as seen below:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><code><span style="font-size:10.0pt">./linux-x86_64-normal-server-fastdebug-jdk-11.0.16-ga/bin/java -XX:+ReplayCompiles -XX:ReplayDataFile=replay.log</span></code><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I have verified that the failure is not reproducible using the previous release jdk-11.0.15-ga. The failure appears to be the result of commit
<a href="https://github.com/openjdk/jdk11u/commit/9ce8530c5d5f179fa42e1060447aead887570124">
9ce8530c</a> [4] (<a href="https://bugs.openjdk.org/browse/JDK-8279219">JDK-8279219</a> [REDO] C2 crash when allocating array of size too large [5]), reverting this commit allows the replay to complete successfully (not to imply the commit itself should be
reverted as I don't have context on what it resolves, but it should help narrow the search space).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Carter Kozak<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">[1] <a href="https://bugs.openjdk.org/browse/JDK-8291665">https://bugs.openjdk.org/browse/JDK-8291665</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">[2] Compiler replay log can be found here: <a href="https://gist.github.com/carterkozak/4aff21e72e74d42320b4427953a56385">
https://gist.github.com/carterkozak/4aff21e72e74d42320b4427953a56385</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">[3] <a href="https://github.com/openjdk/jdk11u/releases/tag/jdk-11.0.16-ga">
https://github.com/openjdk/jdk11u/releases/tag/jdk-11.0.16-ga</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">[4] <a href="https://github.com/openjdk/jdk11u/commit/9ce8530c5d5f179fa42e1060447aead887570124">
https://github.com/openjdk/jdk11u/commit/9ce8530c5d5f179fa42e1060447aead887570124</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">[5] <a href="https://bugs.openjdk.org/browse/JDK-8279219">https://bugs.openjdk.org/browse/JDK-8279219</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<pre># To suppress the following error report, specify this argument<o:p></o:p></pre>
</div>
<div>
<pre># after -XX: or in .hotspotrc: SuppressErrorAt=/split_if.cpp:131<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># A fatal error has been detected by the Java Runtime Environment:<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># Internal Error (/home/user/code/openjdk/jdk11u-dev/src/hotspot/share/opto/split_if.cpp:131), pid=165552, tid=165579<o:p></o:p></pre>
</div>
<div>
<pre># assert(use->is_If() || use->is_CMove() || use->Opcode() == Op_Opaque1 || use->is_AllocateArray()) failed: unexpected node type<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># JRE version: OpenJDK Runtime Environment (11.0.16) (fastdebug build 11.0.16-internal+0-adhoc.user.jdk11u-dev)<o:p></o:p></pre>
</div>
<div>
<pre># Java VM: OpenJDK 64-Bit Server VM (fastdebug 11.0.16-internal+0-adhoc.user.jdk11u-dev, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)<o:p></o:p></pre>
</div>
<div>
<pre># Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E" (or dumping to /home/user/jvm-debugging/core.165552)<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># An error report file with more information is saved as:<o:p></o:p></pre>
</div>
<div>
<pre># /home/user/jvm-debugging/hs_err_pid165552.log<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># If you would like to submit a bug report, please visit:<o:p></o:p></pre>
</div>
<div>
<pre># <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugreport.java.com%2Fbugreport%2Fcrash.jsp&data=05%7C01%7Cgoetz.lindenmaier%40sap.com%7C09db704ab96f4d51404608da7653bcf0%7C42f7676cf455423c82f6dc2d99791af7%7C0%7C0%7C637952399293438560%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Qqto8DWjUV6h4AKrlqzA%2FnT8fzJ0ddKekkHRCqPP30%3D&reserved=0">https://bugreport.java.com/bugreport/crash.jsp</a><o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre>Current thread is 165579<o:p></o:p></pre>
</div>
<div>
<pre>Dumping core ...<o:p></o:p></pre>
</div>
<div>
<pre>zsh: abort (core dumped) ./linux-x86_64-normal-server-fastdebug-jdk-11.0.16-ga/bin/jav<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># A fatal error has been detected by the Java Runtime Environment:<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># Internal Error (/home/user/code/openjdk/jdk11u-dev/src/hotspot/share/opto/split_if.cpp:131), pid=165552, tid=165579<o:p></o:p></pre>
</div>
<div>
<pre># assert(use->is_If() || use->is_CMove() || use->Opcode() == Op_Opaque1 || use->is_AllocateArray()) failed: unexpected node type<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># JRE version: OpenJDK Runtime Environment (11.0.16) (fastdebug build 11.0.16-internal+0-adhoc.user.jdk11u-dev)<o:p></o:p></pre>
</div>
<div>
<pre># Java VM: OpenJDK 64-Bit Server VM (fastdebug 11.0.16-internal+0-adhoc.user.jdk11u-dev, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)<o:p></o:p></pre>
</div>
<div>
<pre># Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E" (or dumping to /home/user/jvm-debugging/core.165552)<o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre># If you would like to submit a bug report, please visit:<o:p></o:p></pre>
</div>
<div>
<pre># <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugreport.java.com%2Fbugreport%2Fcrash.jsp&data=05%7C01%7Cgoetz.lindenmaier%40sap.com%7C09db704ab96f4d51404608da7653bcf0%7C42f7676cf455423c82f6dc2d99791af7%7C0%7C0%7C637952399293438560%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Qqto8DWjUV6h4AKrlqzA%2FnT8fzJ0ddKekkHRCqPP30%3D&reserved=0">https://bugreport.java.com/bugreport/crash.jsp</a><o:p></o:p></pre>
</div>
<div>
<pre>#<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>--------------- S U M M A R Y ------------<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Command Line: -XX:+ReplayCompiles -XX:ReplayDataFile=replay.log <o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Host: linux, Intel(R) Xeon(R) W-2175 CPU @ 2.50GHz, 28 cores, 62G, Ubuntu 20.04.4 LTS<o:p></o:p></pre>
</div>
<div>
<pre>Time: Thu Aug 4 08:27:42 2022 EDT elapsed time: 0.606943 seconds (0d 0h 0m 0s)<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>--------------- T H R E A D ---------------<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Current thread (0x00007f75003c8800): JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=165579, stack(0x00007f74b6434000,0x00007f74b6535000)]<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Current CompileTask:<o:p></o:p></pre>
</div>
<div>
<pre>C2: 606 27 !b 4 sun.security.ssl.SSLEngineInputRecord::decodeInputRecord (812 bytes)<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Stack: [0x00007f74b6434000,0x00007f74b6535000], sp=0x00007f74b652e030, free space=1000k<o:p></o:p></pre>
</div>
<div>
<pre>Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x1a6ea5a] VMError::report_and_die(int, char const*, char const*, __va_list_tag*, Thread*, unsigned char*, void*, void*, char const*, int, unsigned long)+0x1ca<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x1a6fbc5] VMError::report_and_die(Thread*, void*, char const*, int, char const*, char const*, __va_list_tag*)+0x35<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xc302aa] report_vm_error(char const*, int, char const*, char const*, ...)+0x10a<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x187b68d] PhaseIdealLoop::split_up(Node*, Node*, Node*) [clone .part.0]+0x173d<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x187f8e3] PhaseIdealLoop::do_split_if(Node*)+0x763<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x1442420] PhaseIdealLoop::split_if_with_blocks_post(Node*, bool)+0xf20<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x144267d] PhaseIdealLoop::split_if_with_blocks(VectorSet&, Node_Stack&, bool)+0x20d<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x14378a3] PhaseIdealLoop::build_and_optimize()+0x1133<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xb3f881] Compile::optimize_loops(int&, PhaseIterGVN&, LoopOptsMode) [clone .part.0]+0x311<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xb4418f] Compile::Optimize()+0xd1f<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xb46116] Compile::Compile(ciEnv*, C2Compiler*, ciMethod*, int, bool, bool, bool, bool, DirectiveSet*)+0x1ae6<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x915c24] C2Compiler::compile_method(ciEnv*, ciMethod*, int, DirectiveSet*)+0x334<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xb57250] CompileBroker::invoke_compiler_on_method(CompileTask*)+0x540<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0xb588f8] CompileBroker::compiler_thread_loop()+0x678<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x19a4c52] JavaThread::thread_main_inner()+0x252<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x199d62b] Thread::call_run()+0x7b<o:p></o:p></pre>
</div>
<div>
<pre>V [libjvm.so+0x1693926] thread_native_entry(Thread*)+0x106<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>--------------- P R O C E S S ---------------<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>uid : 1000 euid : 1000 gid : 1000 egid : 1000<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>umask: 0002 (-------w-)<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Threads class SMR info:<o:p></o:p></pre>
</div>
<div>
<pre>_java_thread_list=0x00007f7500885270, length=9, elements={<o:p></o:p></pre>
</div>
<div>
<pre>0x00007f7500032000, 0x00007f750039e000, 0x00007f75003a0800, 0x00007f75003c3800,<o:p></o:p></pre>
</div>
<div>
<pre>0x00007f75003c6000, 0x00007f75003c8800, 0x00007f75003cb000, 0x00007f75003cd800,<o:p></o:p></pre>
</div>
<div>
<pre>0x00007f7500886000<o:p></o:p></pre>
</div>
<div>
<pre>}<o:p></o:p></pre>
</div>
<div>
<pre>_java_thread_list_alloc_cnt=10, _java_thread_list_free_cnt=9, _java_thread_list_max=9, _nested_thread_list_max=0<o:p></o:p></pre>
</div>
<div>
<pre>_tlh_cnt=34, _tlh_times=0, avg_tlh_time=0.00, _tlh_time_max=0<o:p></o:p></pre>
</div>
<div>
<pre>_delete_lock_wait_cnt=0, _delete_lock_wait_max=0<o:p></o:p></pre>
</div>
<div>
<pre>_to_delete_list_cnt=0, _to_delete_list_max=1<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Java Threads: ( => current thread )<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500032000 JavaThread "main" [_thread_blocked, id=165553, stack(0x00007f7505585000,0x00007f7505686000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f750039e000 JavaThread "Reference Handler" daemon [_thread_blocked, id=165573, stack(0x00007f74b6da8000,0x00007f74b6ea9000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75003a0800 JavaThread "Finalizer" daemon [_thread_blocked, id=165574, stack(0x00007f74b6ca7000,0x00007f74b6da8000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75003c3800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=165577, stack(0x00007f74b6636000,0x00007f74b6737000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75003c6000 JavaThread "Service Thread" daemon [_thread_blocked, id=165578, stack(0x00007f74b6535000,0x00007f74b6636000)]<o:p></o:p></pre>
</div>
<div>
<pre>=>0x00007f75003c8800 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=165579, stack(0x00007f74b6434000,0x00007f74b6535000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75003cb000 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=165580, stack(0x00007f74b6333000,0x00007f74b6434000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75003cd800 JavaThread "Sweeper thread" daemon [_thread_blocked, id=165581, stack(0x00007f74b6232000,0x00007f74b6333000)]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500886000 JavaThread "Common-Cleaner" daemon [_thread_blocked, id=165612, stack(0x00007f74b59d1000,0x00007f74b5ad2000)]<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Other Threads:<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500388000 VMThread "VM Thread" [stack: 0x00007f74b6eab000,0x00007f74b6fab000] [id=165572]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f75004c1800 WatcherThread [stack: 0x00007f74b6132000,0x00007f74b6232000] [id=165586]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500052000 GCTaskThread "GC Thread#0" [stack: 0x00007f750521e000,0x00007f750531e000] [id=165558]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500091000 ConcurrentGCThread "G1 Main Marker" [stack: 0x00007f74e8218000,0x00007f74e8318000] [id=165563]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f7500093000 ConcurrentGCThread "G1 Conc#0" [stack: 0x00007f74e8116000,0x00007f74e8216000] [id=165564]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f750026b800 ConcurrentGCThread "G1 Refine#0" [stack: 0x00007f74b79fb000,0x00007f74b7afb000] [id=165566]<o:p></o:p></pre>
</div>
<div>
<pre> 0x00007f750026e000 ConcurrentGCThread "G1 Young RemSet Sampling" [stack: 0x00007f74b78f9000,0x00007f74b79f9000] [id=165567]<o:p></o:p></pre>
</div>
<div>
<pre><o:p> </o:p></pre>
</div>
<div>
<pre>Threads with active compile tasks:<o:p></o:p></pre>
</div>
<div>
<pre>C2 CompilerThread0 614 27 !b 4 sun.security.ssl.SSLEngineInputRecord::decodeInputRecord (812 bytes)<o:p></o:p></pre>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>