RFR: 8292083: Detected container memory limit may exceed physical machine memory [v4]

[Jonathan Dowland]

> We discovered some systems configured with cgroups v1 which report a bogus container memory limit value which is above the physical memory of the host. OpenJDK then calculates flags such as InitialHeapSize based on this invalid value; this can be larger than the available memory which can result in the OS terminating the process due to OOM.
> 
> hotspot's container awareness attempts to sanity check the limit value by ensuring it's below `_unlimited_memory = (LONG_MAX / os::vm_page_size()) * os::vm_page_size()`, but that still leaves a large range of potential invalid values between physical RAM and that ceiling value.
> 
> Cgroups V1 in particular returns an uninitialised value for the memory limit when one has not been explicitly set. Cgroups v2 does not suffer the same problem: however, it's possible for any value to be set for the max memory, including values exceeding the available physical memory, in either v1 or v2.
> 
> This fixes the problem in two places. Further work may be required in the area of Java metrics / MXBeans. I'd also look again at whether the existing ceiling value `_unlimited_memory` serves any useful purpose. I personally don't feel those improvements should hold up this fix.

Jonathan Dowland has updated the pull request incrementally with three additional commits since the last revision:

 - Remove set_physical_memory (unneeded)
   
   Cgroups code used this to override the real host RAM value with the
   container memory limit. We don't do this any more so this routine
   is not needed. Linux::physical_memory()/_physical_memory will now
   always correspond to the hosts physical RAM, unaffected by cgroups
   limits.
 - Don't sanity check mem limit in OSContainer::init
   
   Only do so in os::physical_memory()
 - Rename to more descriptive testContainerMemExceedsPhysical

-------------

Changes:
  - all: https://git.openjdk.org/jdk/pull/9880/files
  - new: https://git.openjdk.org/jdk/pull/9880/files/7f5307d6..98664643

Webrevs:
 - full: https://webrevs.openjdk.org/?repo=jdk&pr=9880&range=03
 - incr: https://webrevs.openjdk.org/?repo=jdk&pr=9880&range=02-03

  Stats: 23 lines in 4 files changed: 0 ins; 19 del; 4 mod
  Patch: https://git.openjdk.org/jdk/pull/9880.diff
  Fetch: git fetch https://git.openjdk.org/jdk pull/9880/head:pull/9880

PR: https://git.openjdk.org/jdk/pull/9880