RFR: 8256265: G1: Improve parallelism in regions that failed evacuation [v3]

[Thomas Schatzl]

> Hi all,
> 
>   can I have reviews on this change that makes the evacuation failure remove forwards phase split the work across threads within regions?
> 
> This work is a continuation of PR#7047 from @Hamlin-Li and latest improvements from @albertnetymk in that thread. This is reflected in the first commit, I added a fair amount of changes to fix bugs and streamline the code.  
> 
> Testing: tier1-8 with G1EvacuationFailureALot enabled, tier1-5 as is

Thomas Schatzl has updated the pull request incrementally with one additional commit since the last revision:

  sjohanss, albert review

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/9980/files
  - new: https://git.openjdk.org/jdk/pull/9980/files/2628451d..a529f6d6

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=9980&range=02
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=9980&range=01-02

  Stats: 58 lines in 12 files changed: 10 ins; 12 del; 36 mod
  Patch: https://git.openjdk.org/jdk/pull/9980.diff
  Fetch: git fetch https://git.openjdk.org/jdk pull/9980/head:pull/9980

PR: https://git.openjdk.org/jdk/pull/9980