[jdk17u-dev] RFR: 8320836: jtreg gtest runs should limit heap size

[Goetz Lindenmaier]

I backport this for parity with 17.0.18-oracle

-------------

Commit messages:
 - Backport ac9e51023fc34a82b795950a109af2397826adaa

Changes: https://git.openjdk.org/jdk17u-dev/pull/3965/files
  Webrev: https://webrevs.openjdk.org/?repo=jdk17u-dev&pr=3965&range=00
  Issue: https://bugs.openjdk.org/browse/JDK-8320836
  Stats: 2 lines in 1 file changed: 1 ins; 0 del; 1 mod
  Patch: https://git.openjdk.org/jdk17u-dev/pull/3965.diff
  Fetch: git fetch https://git.openjdk.org/jdk17u-dev.git pull/3965/head:pull/3965

PR: https://git.openjdk.org/jdk17u-dev/pull/3965