running jtreg tests

[Jonathan Gibbons]

I would recommend adding -ignore:quiet to all uses of jtreg, since it 
suppresses errors caused by problems in the test that are unrelated to 
the product being tested.  These tests use @ignore to mark the tests as 
currently dysfunctional.

I would also recommend specifying explicit and distinct work and report 
directories for invocations of jtreg on separate test suites, such as 
jdk/test and langtools/test.  You can use the -w and -r options to set 
these values.   This will prevent the results from the two runs 
interfering with each other.  (The defaults are to use JTwork and 
JTreport.  I'd suggest using build/jtreg//testsuite//{work,report}  -- 
that way if you blow away the build/ directory for a clean build, you 
blow away the results as well.

-- Jon


On 05/13/2011 07:00 AM, Henri Gomez wrote:
> Oups.
>
> I updated this morning my IC script to do more tests :
>
>    echo "testing java/lang..."
>    $JTREG_DIR/linux/bin/jtreg
> -jdk:../build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home/
> -v:summary test/java/lang
>    echo "testing java/lang/invoke..."
>    $JTREG_DIR/linux/bin/jtreg -XX:+UnlockExperimentalVMOptions
> -XX:+EnableInvokeDynamic
> -jdk:../build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home/
> -v:summary test/java/lang/invoke/
>    echo "testing langtools..."
>    $JTREG_DIR/linux/bin/jtreg -XX:+UnlockExperimentalVMOptions
> -jdk:build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home
> -v:summary langtools/test/tools/
>
>
>
> 2011/5/13 Stephen Bannasch<stephen.bannasch at deanbrook.org>:
>> At 7:59 AM +0200 5/13/11, Henri Gomez wrote:
>>> Here are my jtreg results :
>>>
>>> testing build: ./build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home/bin/java
>>> -version
>>> Test results: passed: 282; failed: 75; error: 4
>> Henri,
>>
>> You didn't show the actual command you used to run thejtreg tests but that looks like you were running the jdk tests -- notthe langtool tests.
>>
>> Your run only ran about 350 tests. When I ran the jtreg tests on langtools I got these results:
>>
>>   Test results: passed: 1,756; failed: 35; error: 3
>>
>>