RFR: 8365442: [asan] runtime/ErrorHandling/CreateCoredumpOnCrash.java fails

[Johan Sjölen]

On Mon, 25 Aug 2025 12:55:13 GMT, Matthias Baesken <mbaesken at openjdk.org> wrote:

> When running with asan - enabled binaries, the test CreateCoredumpOnCrash.java fails with the output below. Seems asan does not work well with ulimit used in the test, so better avoid running it with asan enabled.
> 
> 
> [2025-08-09T09:25:35.801707203Z] Gathering output for process 4376
> [2025-08-09T09:25:41.863125073Z] Waiting for completion for process 4376
> [2025-08-09T09:25:41.863790182Z] Waiting for completion finished for process 4376
> [2025-08-09T09:25:41.876094199Z] Gathering output for process 5017
> [2025-08-09T09:25:41.883445027Z] Waiting for completion for process 5017
> [2025-08-09T09:25:41.883598661Z] Waiting for completion finished for process 5017
> ----------System.err:(10/570)----------
> java.lang.Exception: ulimit is not set correctly, try 'ulimit -c unlimited' and re-run.
> at CreateCoredumpOnCrash.main(CreateCoredumpOnCrash.java:82)
> at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
> at java.base/java.lang.reflect.Method.invoke(Method.java:565)
> at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:335)
> at java.base/java.lang.Thread.run(Thread.java:1474)

I guess it's because asan uses 20TiB of virtual address space? I'm OK with this being disabled on asan.

-------------

Marked as reviewed by jsjolen (Reviewer).

PR Review: https://git.openjdk.org/jdk/pull/26927#pullrequestreview-3152565896