RFR: JDK-8319195: Move tier 1 vector API regression tests to tier 2

Joe Darcy darcy at openjdk.org
Wed Nov 1 02:37:02 UTC 2023


On Tue, 31 Oct 2023 20:14:45 GMT, Joe Darcy <darcy at openjdk.org> wrote:

> Due to their longer-than-typical running time and because the vector API is not (yet) in the base module, move the vector API tests in tier 1 to tier 2.

> May I ask how long it will take to run jdk_vector_sanity?
> 
> My testing in JDK-8295970 was less than 2min. See [#10879 (comment)](https://github.com/openjdk/jdk/pull/10879#issuecomment-1298126965)

The time taken is going to vary of course. That set of tests took about 2 minutes when run with 4 way concurrency on the configuration I use for development, 3 minutes 21 seconds when run serially. About 10 of the individual tests took more than 25 seconds latency to run on that config.

I don't think it would be hard to find, say 30 different API areas in the JDK outside of the base module, that might want "just 2 minutes of testing in tier1," which would cause tier 1 to take another hour to run.

Until the vector API is in the base module, I think a total tier 1 time budget of at most 10 seconds _total_, but being only in tier 2 and later tiers would be fine too IMO.

-------------

PR Comment: https://git.openjdk.org/jdk/pull/16437#issuecomment-1788307308


More information about the core-libs-dev mailing list