RFR: JDK-8292769: [JVMCI] OutOfMemoryError thrown when attaching the libgraal isolate causes HotSpot to crash. [v3]

[Tomáš Zezula]

> Fixes a virtual machine crash when the libgraal isolate does not have enough heap memory available and its memory is exhausted. The [crash](https://bugs.openjdk.org/secure/attachment/100520/hs_err_pid679001.log) is caused by an unhandled `OutOfMemoryError` thrown in the isolate's `AttachCurrentThread`.
> The isolate's `AttachCurrentThread` is [fixed](https://github.com/oracle/graal/commit/62ede96fd3ddc9e5ddb4804ed369f61cfa0c0a21#diff-9eedff7eb9fceec5f37c48cf089ff8e24103279e1384a2c0fa1fc9446b5dc438)  to report an `OutOfMemoryError` using a `JNI_ENOMEM` result. This pull request aborts a compilation when `AttachCurrentThread` fails with `JNI_ENOMEM`.

Tomáš Zezula has updated the pull request with a new target base due to a merge or a rebase. The pull request now contains one commit:

  JDK-8292769: CompileBroker aborts a compilation when the JVMCIRuntime::AttachCurrentThread fails with JNI_ENOMEM.

-------------

Changes: https://git.openjdk.org/jdk/pull/9978/files
 Webrev: https://webrevs.openjdk.org/?repo=jdk&pr=9978&range=02
  Stats: 43 lines in 3 files changed: 24 ins; 5 del; 14 mod
  Patch: https://git.openjdk.org/jdk/pull/9978.diff
  Fetch: git fetch https://git.openjdk.org/jdk pull/9978/head:pull/9978

PR: https://git.openjdk.org/jdk/pull/9978