[jdk17u-dev] RFR: 8314831: NMT tests ignore vm flags

[Goetz Lindenmaier]

I backport this for parity with 17.0.14-oracle.

Clean except for one file omitted:
MallocLimitTest.java is not in 17, omitted. It was introduced by 
"8291878: NMT: Malloc limits" in jdk20, not a candidate for backport to 17

-------------

Commit messages:
 - Backport 9bf3dee2424bd8ccbc7ef0175c6e7165ff5cf1c6

Changes: https://git.openjdk.org/jdk17u-dev/pull/2874/files
  Webrev: https://webrevs.openjdk.org/?repo=jdk17u-dev&pr=2874&range=00
  Issue: https://bugs.openjdk.org/browse/JDK-8314831
  Stats: 22 lines in 10 files changed: 5 ins; 0 del; 17 mod
  Patch: https://git.openjdk.org/jdk17u-dev/pull/2874.diff
  Fetch: git fetch https://git.openjdk.org/jdk17u-dev.git pull/2874/head:pull/2874

PR: https://git.openjdk.org/jdk17u-dev/pull/2874