RFR: JDK-8319382: com/sun/jdi/JdwpAllowTest.java shows failures on AIX if prefixLen of mask is larger than 32 in IPv6 case

[Matthias Baesken]

On Wed, 8 Nov 2023 14:37:29 GMT, Matthias Baesken <mbaesken at openjdk.org> wrote:

> In parseAllowedMask (file socketTransport.c) , prefixLen of mask is compared with a maxValue (32 for IPv4, 128 otherwise). This fails on AIX if it is larger than 32, because getaddrinfo seems to often (always ?) detect IPv4 family, even for IPv6 addresses, so we take the wrong maxValue.
> Probably we have to adjust the allowed maxValue on AIX, or adjust the IPv6 check.
> 
> Example:
> images/jdk/bin/java -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=*:0,allow=0:0:0:0:0:0:10:0/106
> Error in allow option: '106'
> ERROR: transport error 103: invalid netmask in allow option
> ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)

A  colleague contacted IBM about the different behavior of getaddrinfo on AIX (compared to Linux/macOS);  maybe we have to adjust the result of the getaddrinfo call on AIX.

-------------

PR Comment: https://git.openjdk.org/jdk/pull/16561#issuecomment-1808002445