RFR: 8305670: Performance regression in LockSupport.unpark with lots of idle threads [v5]

[Daniel D. Daugherty]

> Address the performance regression in `LockSupport.unpark()` with the following changes:
> - Add a `quick_mode` parameter to `ThreadsListHandle::cv_internal_thread_to_JavaThread()` that tells the conversion function to skip searching the ThreadsList for the target `JavaThread*`.
> - Update `Unsafe_Unpark()` to verify that `java_lang_Thread::thread(thread_oop) != nullptr` both before and after the creation of the ThreadsListHandle; this verification that a `JavaThread*` is saved in the `java.lang.Thread` object allows us to know that the target `JavaThread*` is protected by the ThreadsListHandle without searching it.
> - Move the storing of the `JavaThread*` in the `java.lang.Thread` object until after the `JavaThread*` is added to the system ThreadsList.
> - This change in the order permits the check of `java_lang_Thread::thread(thread_oop) != nullptr` before the creation of the ThreadsListHandle to have the meaning that we need for a `JavaThread*` that is in the early stages of running.
> - The check `java_lang_Thread::thread(thread_oop) != nullptr` that happens after the creation of the ThreadsListHandle permits the meaning that we need for a `JavaThread*` that is in the end stages of running.
> - So the combination of the two `java_lang_Thread::thread(thread_oop) != nullptr` checks allows us to safely skip the ThreadsList search in `ThreadsListHandle::cv_internal_thread_to_JavaThread()`.
> 
> Additional changes:
> - Remove the `EnableThreadSMRExtraValidityChecks` option since that option implies that the ThreadsList search is optional in all situations which is not the case. Also remove comments that mention the option.
> - Update the comments in `ThreadsListHandle::cv_internal_thread_to_JavaThread()` to clarify what `java_lang_Thread::thread(thread_oop) != nullptr` means in the JavaThread's lifecycle and that function's attempts to convert a `jthread` into a `JavaThread*` that's known to be protected by the ThreadsListHandle.

Daniel D. Daugherty has updated the pull request with a new target base due to a merge or a rebase. The incremental webrev excludes the unrelated changes brought in by the merge/rebase. The pull request contains five additional commits since the last revision:

 - Merge branch 'jdk-21+20' into JDK-8305670
 - 8305670.with-rehn-quick-mode.cr3.patch
 - Use optimized logic in Unsafe_Unpark() instead of cv_internal_thread_to_JavaThread().
 - dholmes CR - add more comments.
 - 8305670.with-rehn-quick-mode.cr0.patch

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/13519/files
  - new: https://git.openjdk.org/jdk/pull/13519/files/fb37feb7..e6e9c50f

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=13519&range=04
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=13519&range=03-04

  Stats: 261318 lines in 2001 files changed: 237956 ins; 10392 del; 12970 mod
  Patch: https://git.openjdk.org/jdk/pull/13519.diff
  Fetch: git fetch https://git.openjdk.org/jdk.git pull/13519/head:pull/13519

PR: https://git.openjdk.org/jdk/pull/13519