RFR: 8322630: Remove ICStubs and related safepoints [v11]

[Erik Österlund]

> ICStubs solve an atomicity problem when setting both the destination and data of an inline cache. Unfortunately, it also leads to occasional safepoint carpets when multiple threads need to ICRefill the stubs at the same time, and spurious GuaranteedSafepointInterval "Cleanup" safepoints every second. This patch changes inline caches to not change the data part at all during the nmethod life cycle, hence removing the need for ICStubs.
> 
> The new scheme is less stateful. Instead of adding and removing callsite metadata back and forth when transitioning inline cache states, it installs all state any shape of call will ever need at resolution time in a struct that I call CompiledICData. This reduces inline cache state changes to simply changing the destination of the call, and it doesn't really matter what state transitions to what other state.
> 
> With this patch, we get rid of ICStub and ICBuffer classes and the related ICRefill and almost all Cleanup safepoints in practice. It also makes the inline cache code much simpler.
> 
> I have tested the changes from tier1-7, and run through full aurora performance tests.

Erik Österlund has updated the pull request with a new target base due to a merge or a rebase. The pull request now contains 19 commits:

 - Merge branch 'master' into 8310823_object_streaming
 - Some comments
 - Feedback from Dean and Thomas
 - Update src/hotspot/share/code/compiledIC.hpp
   
   Co-authored-by: Thomas Schatzl <59967451+tschatzl at users.noreply.github.com>
 - Update src/hotspot/share/runtime/sharedRuntime.cpp
   
   Co-authored-by: Thomas Schatzl <59967451+tschatzl at users.noreply.github.com>
 - ARM32 fixes
 - Add comment
 - Deal with short far branches on AArch64
 - Batch allocate and free CompiledICData
 - JVMCI support
 - ... and 9 more: https://git.openjdk.org/jdk/compare/62a4be03...29994286

-------------

Changes: https://git.openjdk.org/jdk/pull/17495/files
 Webrev: https://webrevs.openjdk.org/?repo=jdk&pr=17495&range=10
  Stats: 4253 lines in 142 files changed: 501 ins; 3226 del; 526 mod
  Patch: https://git.openjdk.org/jdk/pull/17495.diff
  Fetch: git fetch https://git.openjdk.org/jdk.git pull/17495/head:pull/17495

PR: https://git.openjdk.org/jdk/pull/17495