jtreg testing integrated

[Mark Wielaard]

Hi Joe,

On Mon, 2008-05-19 at 09:59 -0700, Joseph D. Darcy wrote:
> Mark Wielaard wrote:
> > On Mon, 2008-05-19 at 11:21 +0200, Mark Wielaard wrote:
> >> make jtregcheck -k runs the testsuites of hotspot (4 tests, all PASS),
> >> langtools (1,342 PASS, 1 FAIL - the version check) and jdk (2,875 tests
> >> of which about 130 fail - rerunning tests now). corba, jaxp and jaxws
> >> don't come with any tests. This takes about 3 hours on my machine.
> > 
> > Uploaded the text summary files if someone wants to compare results, or
> > if someone is looking for a test failure to work on:
> > http://icedtea.classpath.org/~mjw/jtreg/
> > 
> > The final result for jdk was:
> > Test results: passed: 2,658; failed: 134; error: 7
>
> Last week, I started taking another look at the jtreg test results 
> inside Sun.  As has been noted, some of the tests are invalid for 
> OpenJDK 6.  I've started correcting them and some fixes will be in the 
> next source drop.

That is great. Do you have results published somewhere already to
compare with? Are there any tests you need help with or don't have time
for at the moment?

I think the most important thing is making sure the tests don't depend
on any sun internal only servers. That seems to solve the largest part
of the failures we are currently seeing.

Cheers,

Mark