RFR: 8354242: VectorAPI: combine vector not operation with compare [v6]

erifan duke at openjdk.org
Thu Jun 5 09:27:03 UTC 2025


On Wed, 28 May 2025 12:18:15 GMT, Emanuel Peter <epeter at openjdk.org> wrote:

>> erifan has updated the pull request with a new target base due to a merge or a rebase. The incremental webrev excludes the unrelated changes brought in by the merge/rebase. The pull request contains 10 additional commits since the last revision:
>> 
>>  - Refactor the JTReg tests for compare.xor(maskAll)
>>    
>>    Also made a bit change to support pattern `VectorMask.fromLong()`.
>>  - Merge branch 'master' into JDK-8354242
>>  - Refactor code
>>    
>>    Add a new function XorVNode::Ideal_XorV_VectorMaskCmp to do this
>>    optimization, making the code more modular.
>>  - Merge branch 'master' into JDK-8354242
>>  - Update the jtreg test
>>  - Merge branch 'master' into JDK-8354242
>>  - Addressed some review comments
>>    
>>    1. Call VectorNode::Ideal() only once in XorVNode::Ideal.
>>    2. Improve code comments.
>>  - Merge branch 'master' into JDK-8354242
>>  - Merge branch 'master' into JDK-8354242
>>  - 8354242: VectorAPI: combine vector not operation with compare
>>    
>>    This patch optimizes the following patterns:
>>    For integer types:
>>    ```
>>    (XorV (VectorMaskCmp src1 src2 cond) (Replicate -1))
>>        => (VectorMaskCmp src1 src2 ncond)
>>    (XorVMask (VectorMaskCmp src1 src2 cond) (MaskAll m1))
>>        => (VectorMaskCmp src1 src2 ncond)
>>    ```
>>    cond can be eq, ne, le, ge, lt, gt, ule, uge, ult and ugt, ncond is the
>>    negative comparison of cond.
>>    
>>    For float and double types:
>>    ```
>>    (XorV (VectorMaskCast (VectorMaskCmp src1 src2 cond)) (Replicate -1))
>>        => (VectorMaskCast (VectorMaskCmp src1 src2 ncond))
>>    (XorVMask (VectorMaskCast (VectorMaskCmp src1 src2 cond)) (MaskAll m1))
>>        => (VectorMaskCast (VectorMaskCmp src1 src2 ncond))
>>    ```
>>    cond can be eq or ne.
>>    
>>    Benchmarks on Nvidia Grace machine with 128-bit SVE2:
>>    With option `-XX:UseSVE=2`:
>>    ```
>>    Benchmark			Unit	Before		Score Error	After		Score Error	Uplift
>>    testCompareEQMaskNotByte	ops/s	7912127.225	2677.289518	10266136.26	8955.008548	1.29
>>    testCompareEQMaskNotDouble	ops/s	884737.6799	446.963779	1179760.772	448.031844	1.33
>>    testCompareEQMaskNotFloat	ops/s	1765045.787	682.332214	2359520.803	896.305743	1.33
>>    testCompareEQMaskNotInt		ops/s	1787221.411	977.743935	2353952.519	960.069976	1.31
>>    testCompareEQMaskNotLong	ops/s	895297.1974	673.44808	1178449.02	323.804205	1.31
>>    testCompareEQMaskNotShort	ops/s	3339987.002	3415.2226	4712761.965	2110.862053	1.41
>>    testCompareGEMaskNotByte	ops/s	7907615.16	4...
>
> src/hotspot/share/opto/vectornode.cpp line 2251:
> 
>> 2249:                                       predicate_node, vt);
>> 2250:   if (vmcast_vt != nullptr) {
>> 2251:     // We optimized out an VectorMaskCast, and in order to ensure type
> 
> Suggestion:
> 
>     // We optimized out a VectorMaskCast, and in order to ensure type

Done.

> src/hotspot/share/opto/vectornode.cpp line 2253:
> 
>> 2251:     // We optimized out an VectorMaskCast, and in order to ensure type
>> 2252:     // correctness, we need to regenerate one. VectorMaskCast will be encoded as
>> 2253:     // empty for types with the same size.
> 
> Suggestion:
> 
>     // a no-op (identity function) for types with the same size.
> 
> Or what do you mean by "empty"? `TOP`? All zeros?

I mean `no-op`. Done, thanks.

> test/hotspot/jtreg/compiler/vectorapi/VectorMaskCompareNotTest.java line 96:
> 
>> 94:         Generator<Long> lGen = RD.uniformLongs(Long.MIN_VALUE, Long.MAX_VALUE);
>> 95:         Generator<Float> fGen = RD.uniformFloats(Float.MIN_VALUE, Float.MAX_VALUE);
>> 96:         Generator<Double> dGen = RD.uniformDoubles(Double.MIN_VALUE, Double.MAX_VALUE);
> 
> Are you sure you only want to draw from the uniform distribution?
> If you don't super care about the distribution, please just take `RD.ints/longs/floats/doubles()`.
> That way, you get all sorts of distributions, and also some that include NaN values etc. I think that would be important for your float cmp cases, no?

For float and double, we have to use the uniform distribution, because we have to make sure `NAN` is not generated. I added some comments about the reasons.

For other types, changed to use `RD.ints/longs`.

We have covered the special cases like +/- Inf, NaN.

-------------

PR Review Comment: https://git.openjdk.org/jdk/pull/24674#discussion_r2128376851
PR Review Comment: https://git.openjdk.org/jdk/pull/24674#discussion_r2128378888
PR Review Comment: https://git.openjdk.org/jdk/pull/24674#discussion_r2128375032


More information about the hotspot-compiler-dev mailing list