RFR: 8276126: Dump time class transformation causes heap objects of non-boot classes to be archived

[Calvin Cheung]

During CDS static dump, if a class loaded by a boot class loader is transformed by a java agent. The transformed class is mistakenly archived as a class loaded by a custom loader and causing archiving of the heap objects to fail.

The proposed patch corrects the identification of the transformed class and will not include it in the archive.
Also, if a transformed class is detected during dump time, the archiving of the heap objects will be disabled.

Testing: Oracle CI tiers 1-3, tier4 in progress.

-------------

Commit messages:
 - 8276126: Dump time class transformation causes heap objects of non-boot classes to be archived

Changes: https://git.openjdk.java.net/jdk/pull/6484/files
 Webrev: https://webrevs.openjdk.java.net/?repo=jdk&pr=6484&range=00
  Issue: https://bugs.openjdk.java.net/browse/JDK-8276126
  Stats: 196 lines in 8 files changed: 192 ins; 0 del; 4 mod
  Patch: https://git.openjdk.java.net/jdk/pull/6484.diff
  Fetch: git fetch https://git.openjdk.java.net/jdk pull/6484/head:pull/6484

PR: https://git.openjdk.java.net/jdk/pull/6484