stable subset of jtreg tests?
Joseph D. Darcy
joe.darcy at oracle.com
Thu Sep 17 00:25:24 UTC 2015
Dropping the jtreg alias.
On 9/16/2015 5:18 PM, Martin Buchholz wrote:
> Just now for the first time I ran all the jtreg tests in the
> "jdk_stable" test set using
> make test TEST=jdk_stable
> and I got around 50 failures out of 5000.
> Is that expected?
>
> Instead, I expect that with all the work on the test suite y'all have
> been doing, that the expected failure rate of something with a name
> like "jdk_stable" would be 0.
>
For JDK 9 dev, the tier 1 tests across repos should be stable.
Currently, only the langtools and jdk repos have non-empty tier 1 tests
sets defined.
If you run
jtreg ... -exclude:ProblemList.txt -k:intermittent :tier1
there are some tier 1 test that are known to fail intermittently, but at
this point with very low frequency (at least with the testing I'm
exposed to).
HTH,
-Joe
More information about the quality-discuss
mailing list