stable subset of jtreg tests?

Joseph D. Darcy joe.darcy at oracle.com
Thu Sep 17 00:25:24 UTC 2015


Dropping the jtreg alias.

On 9/16/2015 5:18 PM, Martin Buchholz wrote:
> Just now for the first time I ran all the jtreg tests in the 
> "jdk_stable" test set using
> make test TEST=jdk_stable
> and I got around 50 failures out of 5000.
> Is that expected?
>
> Instead, I expect that with all the work on the test suite y'all have 
> been doing, that the expected failure rate of something with a name 
> like "jdk_stable" would be 0.
>

For JDK 9 dev, the tier 1 tests across repos should be stable. 
Currently, only the langtools and jdk repos have non-empty tier 1 tests 
sets defined.

If you run

     jtreg ... -exclude:ProblemList.txt -k:intermittent :tier1

there are some tier 1 test that are known to fail intermittently, but at 
this point with very low frequency (at least with the testing I'm 
exposed to).

HTH,

-Joe



More information about the quality-discuss mailing list