jtreg testing integrated

[Mark Wielaard]

Hi Andrew,

On Thu, 2008-05-22 at 01:23 +0100, Andrew John Hughes wrote:
> Indeed, I believe Mark started looking into this specifically for this
> reason; so that the tests could be run on the OpenJDK being packaged
> in distributions and so the community could have a goal to work
> towards in fixing any issues.

The reason I wanted the testsuite integrated into the normal build and
hopefully run on as many platforms/setups as possible was to spread the
testing effort as wide as possible. And to hopefully come to a common
baseline that all derivatives would follow as minimum quality that
should be reached. We will never be able to centrally test every
configuration/hardware/os setup, so it is important that the end user
can eventually do it themselves.

> So I apologise if any of my comments read as being abrasive or as not
> understanding the issues of Sun's 'production build'.  But it's
> something very foreign to us, and something I'd expect to remain so,
> while the production build remains a proprietary product.

Actually I don't think it is that foreign. We have always had derivative
works that are slightly different because of platform/runtime setups. It
is good we have some common test suites that can be run on all of them.
What is somewhat foreign is singling out one derivative as "the
production build" which has a configuration which is actually different
from the upstream defaults. We shouldn't hard code such configurations
into the testsuite, but it is certainly desirable to make them possible.

Cheers,

Mark