RFR: 8324174: assert(m->is_entered(current)) failed: invariant [v2]

[Vladimir Kozlov]

On Wed, 31 Jan 2024 06:25:52 GMT, Tobias Hartmann <thartmann at openjdk.org> wrote:

>> Vladimir Kozlov has updated the pull request incrementally with one additional commit since the last revision:
>> 
>>   Fix spacing
>
> test/hotspot/jtreg/compiler/escapeAnalysis/TestNestedRelockAtDeopt.java line 46:
> 
>> 44:             }
>> 45:         } catch (OutOfMemoryError oom) {
>> 46:             arr = null; // Free memory
> 
> This isn't guaranteed to free any memory, right? Isn't there a high risk that we are hitting another OOME below at the `new ArrayList<>()`? Is that what [JDK-8325003](https://bugs.openjdk.org/browse/JDK-8325003) is about?

The failure [JDK-8325003](https://bugs.openjdk.org/browse/JDK-8325003) happens during `newarray` inside `test1()` if it is inlined. If `test1()` is not inlined everything works.

-------------

PR Review Comment: https://git.openjdk.org/jdk/pull/17600#discussion_r1473370197