jtreg testing integrated

[Mark Wielaard]

Hi Jonathan,

On Mon, 2008-05-19 at 16:07 -0700, Jonathan Gibbons wrote:
> Separately, check out the options for handling @ignore tests. Even on 
> older versions
> of jtreg you can use "-k:!ignore" to ignore @ignore tests.  (This works 
> because @ignore
> tests are given an implicit "ignore" keyword.)   With later versions of 
> jtreg, you can use
> -Ignore:{quiet,error,run} to control how @ignore tests should be 
> handled. Using this
> option, you should be to get closer to the goal of "all tests should 
> pass", meaning
> that there are less failures and so less need to compare the output 
> results with jtdiff.

This is a really a great feature! For icedtea we now use "-v1 -a
-ignore:quiet", that give output and results that should be pretty
familiar to people. And this is the set that I hope we can get to be all
PASS in the default case.

One extension might be to have a "-ignore:try" that does try to run it,
that doesn't report it failure, but that does flag it as unexpected
XPASS to alert people to bugs that are (accidentally) fixed but where
the testcase was not yet enabled.

Cheers,

Mark