RFR: 8321806: Shenandoah: each mutator must see FullGC or GC overhead limit is exceeded before throwing OOM [v3]

[Kelvin Nilsen]

On Fri, 8 Dec 2023 03:47:48 GMT, Kelvin Nilsen <kdnilsen at openjdk.org> wrote:

>> Require each thread to observe unproductive Full GC before it throws OOM exception.
>
> Kelvin Nilsen has updated the pull request incrementally with one additional commit since the last revision:
> 
>   Fix several bugs for GCU limit exceeded implementation

I got a timeout on compiler/uncommontrap/TestDeoptOOM.java#id0 when testing with:

make test TEST="tier1 tier2 tier3" TEST_VM_OPTS="-XX:+UseShenandoahGC" CONF=fastdebug

even though no timeouts on the same test when we ran 50 times with the following:

make test TEST="runtime/reflect/ReflectOutOfMemoryError.java gc/InfiniteList.java runtime/ClassInitErrors/TestOutOfMemoryDuringInit.java compiler/uncommontrap/TestDeoptOOM.java" TEST_VM_OPTS="-Xlog:gc*=info:file=/tmp/oome.log -XX:+UseShenandoahGC" JTREG="REPEAT_COUNT=50" CONF=fastdebug

Also, earthling-amzn reports some times running on aarch64.  I'm implementing gc_overhead_exceeds_limit and testing how that behaves.  Placing in draft mode until I resolve the open issues.

-------------

PR Comment: https://git.openjdk.org/jdk/pull/16985#issuecomment-1847992200