RFR: 8350621: Code cache stops scheduling GC [v6]

[Thomas Schatzl]

> Hi all,
> 
>   please review this change to avoid CodeCache triggered GCs temporarily being ignored.
> 
> In particular, G1 does not make sure when its `collect()` method is called during a concurrent cycle, that a `Remark` pause that does code unloading etc. actually occurs after that request. This makes it so that some internal flag is not reset appropriately (via some callback to the caller). After this event, there will never be another attempt by the compiler threads to issue a garbage collection. The compiler threads are stuck until the next code unloading (caused by e.g. a regular concurrent cycle being triggered).
> 
> The [original PR](https://github.com/openjdk/jdk/pull/23656) also stated a similar with Parallel GC - however due to recent changes (https://bugs.openjdk.org/browse/JDK-8192647 and others) I do not think it is possible any more that the `collect()`call can silently be ignored. (I.e. gclocker could abort a full gc that is the only reason why code cache unloading and that callback will not occur as expected).
> 
> So for G1, the change makes the caller of `collect()` (i.e. the compiler thread) wait until that situation passes and retry. With that the compiler thread is sure that the callback the compiler threads are waiting for occurs. This does have the disadvantage that that compiler thread may not be available for compilation any more for a bit.
> 
> Testing: tier1-5, test case passing, failing before
> 
> Thanks,
>   Thomas

Thomas Schatzl has updated the pull request incrementally with one additional commit since the last revision:

  * kbarret review, remove wb_breakpoint from possible cases where we can ignore the request if a concurrent mark is already running

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/26189/files
  - new: https://git.openjdk.org/jdk/pull/26189/files/ba85553b..16aa539c

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=26189&range=05
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=26189&range=04-05

  Stats: 2 lines in 1 file changed: 0 ins; 1 del; 1 mod
  Patch: https://git.openjdk.org/jdk/pull/26189.diff
  Fetch: git fetch https://git.openjdk.org/jdk.git pull/26189/head:pull/26189

PR: https://git.openjdk.org/jdk/pull/26189