Collecting test results (Was: For users of --with-openjdk)

[Mark Wielaard]

On Sat, 2010-08-28 at 19:55 -0500, DJ Lucas wrote:
> > On JDK, I don't think there's ever been a 100% pass, and some aren't even
> > stable tests.  So you're looking more for regressions between builds.
> > 
> > To my knowledge, the HotSpot and langtools suites should all pass (and
> > take a considerably shorter time to run).
> > 
> Is there a central place to share and view previous test results, or
> just search the distro-pkg-dev and openjdk-dev lists?

We should probably setup a real buildbot so people can more easily share
their results.

For now there is one autobuilder that puts its results at:
http://icedtea.classpath.org/builds/
It has build logs, test logs and the full test results, but only for the
last (successful) build.

See for example the full hotspot jtreg results for icedtea6:
http://icedtea.classpath.org/builds/icedtea6/test/hotspot/JTreport/html/index.html
Replace /icedtea6/ with /icedtea7/ if you are interested in the 7
branch, replace /hotspot/ with /langtools/ or /jdk/ if you are
interested in these jtreg runs.

If the autobuilder detects a change in test results or a build failure
it will send email to every committer since the last run plus the
icedtea-testresults mailinglist:
http://icedtea.classpath.org/pipermail/testresults/

Red Hat also has an autobuilder (based on hudson) that sends its results
to that list. I promised Pavel that I would make room on the autobuilder
site to post full test results (really, almost there now, disk space is
cheap, but time to move services around isn't...)

Cheers,

Mark