RFR: 8344665: Refactor PartialArrayState allocation for reuse [v5]

[Kim Barrett]

> This change splits the existing PartialArrayStateAllocator class into an
> allocator class and a manager class.  The allocator class is per worker
> thread.  The manager class provides the memory management context for a
> group of allocators.
> 
> This change is in preparation for some other refactorings around partial array
> state handling.  That work is intended to make it easier for various
> collections to adopt the use of that mechanism for chunking the processing of
> large objArrays.
> 
> The new implementation for the memory management context is based on the
> existing one, with an Arena per worker, now controlled by the manager object.
> Potential improvements to that can be explored in the future.  Some ideas
> include improvements to the Arena API or a single thread-safe Arena variant
> (trading slower arena allocation (which is the slow path) for less memory
> usage).
> 
> G1 has a single manager, reused by each young/mixed GC. Associated state
> allocators are nested in the per-worker structures, so deleted at the end of
> the collection. The manager is reset at the end of the collection to allow the
> memory to be recycled. It is planned that the STW full collector will also use
> this manager when converted to use PartialArrayState. So it will be reused by
> all STW collections.
> 
> ParallelGC has a single manager, reused by each young collection. Because the
> per-worker promotion managers are never destroyed, their nested state
> allocators are never destroyed. So the manager is not reset, instead leaving
> previously allocated states in the allocator free lists for use by the next
> collection. This means the full collector won't be able to use the same
> manager object as the young collectors.
> 
> Testing: mach5 tier1-5

Kim Barrett has updated the pull request with a new target base due to a merge or a rebase. The incremental webrev excludes the unrelated changes brought in by the merge/rebase. The pull request contains 11 additional commits since the last revision:

 - rescue lost acquire
 - Merge branch 'master' into new-pas-alloc
 - fix ref to debug-only member
 - remove phase invariant checks
 - num_allocators => max_allocators
 - fix comment typo
 - use struct/union instead of constants
 - simplify pas allocator destruction and manager phase tracking
 - parallel youngen uses new PAS
 - g1 uses refactored PAS
 - ... and 1 more: https://git.openjdk.org/jdk/compare/b0801928...5716bb5a

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/22287/files
  - new: https://git.openjdk.org/jdk/pull/22287/files/2eb1814e..5716bb5a

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=22287&range=04
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=22287&range=03-04

  Stats: 116618 lines in 1650 files changed: 82592 ins; 25661 del; 8365 mod
  Patch: https://git.openjdk.org/jdk/pull/22287.diff
  Fetch: git fetch https://git.openjdk.org/jdk.git pull/22287/head:pull/22287

PR: https://git.openjdk.org/jdk/pull/22287