RFR: 8366118: DontCompileHugeMethods is not respected with -XX:-TieredCompilation

[Tobias Hartmann]

On Mon, 25 Aug 2025 19:38:23 GMT, Man Cao <manc at openjdk.org> wrote:

> Hi,
> 
> Could anyone review this change that fixes https://bugs.openjdk.org/browse/JDK-8366118? When this bug happens, it is difficult or almost impossible to debug due to the lack of stack trace, hs-err log or core dump. Fortunately we are also experimenting with sigaltstack for https://bugs.openjdk.org/browse/JDK-8364654, and it helped immensely to identify the root cause.
> 
> I will also try adding a test case for DontCompileHugeMethod under -XX:-TieredCompilation.
> 
> -Man

But setting `-XX:-DontCompileHugeMethods` will still crash the VM, right? Do you have a regression test for triggering the crash?

I think we should fix the root cause of the stack overflow (separately).

-------------

PR Comment: https://git.openjdk.org/jdk/pull/26932#issuecomment-3222858620