Fwd: Re: JTReg tests results on other ports

[Jonathan Gibbons]

Whereas for langtools, all the tests should pass all the time on all 
platforms, the same is regrettably not true for tests in the jdk/test/ 
folder.  That being said, we know about the problems there, and a lot of 
work is going on to make the jdk/tests/ work better/faster.  However, 
that work is currently mostly going on in the JDK 8 forest.

To work around the problem of unreliable tests, Kelly changed the 
test/Makefile to use a mechanism called the "Problem List", which we use 
to identify tests which are problematic in samevm mode.  That mechanism 
is not perfect but is a whole lot better than not using it. As of jtreg 
4.1 b03, jtreg natively supports the "problem list", so you should be 
able to go something like
     jjtreg -jdk:... -s -exclude:jdk/test/ProblemList.txt jdk/test/java/lang

-- Jon



On 09/28/2011 01:15 PM, Henri Gomez wrote:
> using -s make java/lang failure also :
>
> /Users/henri/Documents/jenkins/data/DROP_DIR/jtreg/linux/bin/jtreg
> -jdk:/Library/Java/JavaVirtualMachines/1.7.0.jdk/Contents/Home/
> -ignore:quiet -v:summary test/java/lang/
> Passed: java/lang/annotation/AnnotationTypeMismatchException/FoundType.java
> Passed: java/lang/annotation/loaderLeak/Main.java
> Passed: java/lang/annotation/Missing/MissingTest.java
> Passed: java/lang/annotation/package-info.java
> Passed: java/lang/annotation/ParameterAnnotations.java
> Passed: java/lang/annotation/RecursiveAnnotation.java
> ...
>
> /Users/henri/Documents/jenkins/data/DROP_DIR/jtreg/linux/bin/jtreg
> -jdk:/Library/Java/JavaVirtualMachines/1.7.0.jdk/Contents/Home/ -s
> -ignore:quiet -v:summary test/java/lang/
> Passed: java/lang/annotation/AnnotationTypeMismatchException/FoundType.java
> FAILED: java/lang/annotation/loaderLeak/Main.java
> Passed: java/lang/annotation/Missing/MissingTest.java
> Passed: java/lang/annotation/package-info.java
> Passed: java/lang/annotation/ParameterAnnotations.java
> Passed: java/lang/annotation/RecursiveAnnotation.java
> Passed: java/lang/annotation/UnitTest.java
> Passed: java/lang/Appendable/Basic.java
> Passed: java/lang/AssertionError/Cause.java
> Passed: java/lang/Boolean/Factory.java
> Passed: java/lang/Boolean/GetBoolean.java
> ...