running jtreg tests

[Jonathan Gibbons]

On 05/13/2011 04:53 AM, Stephen Bannasch wrote:
> At 7:59 AM +0200 5/13/11, Henri Gomez wrote:
>> Here are my jtreg results :
>>
>> testing build: ./build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home/bin/java
>> -version
>> Test results: passed: 282; failed: 75; error: 4
> Henri,
>
> You didn't show the actual command you used to run thejtreg tests but that looks like you were running the jdk tests -- notthe langtool tests.
>
> Your run only ran about 350 tests. When I ran the jtreg tests on langtools I got these results:
>
>    Test results: passed: 1,756; failed: 35; error: 3
>

That's what I get.  The 3 errors are "expected" because 3 tests are 
current labeled with @ignore. You can suppress those errors by using the 
-ignore:quiet option to avoid running those tests. That leaves 35 test 
failures. In the langtools test suite, all the test should pass, so that 
would seem to indicate that these failures indicate problems with the 
port. Many of the test failures are @shell tests, because jtreg is 
setting an incorrect value for the TESTJAVAC env variable.  It is 
supposed to be an absolute path, but in the failures it is setting a 
relative path name -- and given the current directory, it has the wrong 
value.  I'll see if I can track it down to the JDK API call that is 
giving the wrong results.

-- Jon