RFR: 8373722: [TESTBUG] compiler/vectorapi/TestVectorOperationsWithPartialSize.java fails intermittently

[Jie Fu]

On Tue, 23 Dec 2025 09:28:00 GMT, Xiaohong Gong <xgong at openjdk.org> wrote:

> For example, if the float array is `[1.0f, -1.0f, 2.0f, -2.0f]`, we genuinely expect a result very close to `0.0f`, not something near `2.0f`.
> 
> Using `max_abs` to set the tolerance risks inflating the admissible error range (since `max_abs` here would be 2.0f), which I'm afraid might make the test much less effective.

FYI: the current sum based tolerance may be also bigger than max_abs based.
For example, if the float array is `[1.0f, 1.0f, 2.0f, 2.0f]`.  The sum would be `6.0f`, the max_abs would be `2.0`.
What do you think?

-------------

PR Comment: https://git.openjdk.org/jdk/pull/28960#issuecomment-3686438527