[jdk17u-dev] RFR: 8275037: Test vmTestbase/nsk/sysdict/vm/stress/btree/btree011/btree011.java crashes with memory exhaustion on Windows

[Goetz Lindenmaier]

I backport this for parity with 17.0.4-oracle.

-------------

Commit messages:
 - Backport 9f2f46ee4576d9cd0190530949e5e50f796a6bdc

Changes: https://git.openjdk.java.net/jdk17u-dev/pull/249/files
 Webrev: https://webrevs.openjdk.java.net/?repo=jdk17u-dev&pr=249&range=00
  Issue: https://bugs.openjdk.java.net/browse/JDK-8275037
  Stats: 4 lines in 2 files changed: 1 ins; 0 del; 3 mod
  Patch: https://git.openjdk.java.net/jdk17u-dev/pull/249.diff
  Fetch: git fetch https://git.openjdk.java.net/jdk17u-dev pull/249/head:pull/249

PR: https://git.openjdk.java.net/jdk17u-dev/pull/249