RFR: 8256265: G1: Improve parallelism in regions that failed evacuation [v5]

[Thomas Schatzl]

> Hi all,
> 
>   can I have reviews on this change that makes the evacuation failure remove forwards phase split the work across threads within regions?
> 
> This work is a continuation of PR#7047 from @Hamlin-Li and latest improvements from @albertnetymk in that thread. This is reflected in the first commit, I added a fair amount of changes to fix bugs and streamline the code.  
> 
> Testing: tier1-8 with G1EvacuationFailureALot enabled, tier1-5 as is

Thomas Schatzl has updated the pull request incrementally with two additional commits since the last revision:

 - clear_bitmap_for_region() -> clear_mark_data_for_region()
 - ayang review 3

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/9980/files
  - new: https://git.openjdk.org/jdk/pull/9980/files/1259cf15..3363fca0

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=9980&range=04
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=9980&range=03-04

  Stats: 34 lines in 9 files changed: 8 ins; 8 del; 18 mod
  Patch: https://git.openjdk.org/jdk/pull/9980.diff
  Fetch: git fetch https://git.openjdk.org/jdk pull/9980/head:pull/9980

PR: https://git.openjdk.org/jdk/pull/9980