RFR: 7903318: Make -report:executed the default

[Daniel Jeliński]

On Tue, 20 Sep 2022 09:59:35 GMT, Daniel Jeliński <djelinski at openjdk.org> wrote:

> Please review this change to the default value of `reportMode` property.
> 
> The proposed report mode produces a report on the selected tests only; it is very fast to execute, and usually completes under a second.
> The current default mode produces a report on all tests in the same test suite. It requires scanning all directories and source files in the test suite, requires a long time to produce, and usually produces the same results when jtreg is invoked from make.
> 
> If this change is integrated, the old report mode will be available under command line option `-report:all-executed`

This brings back the original issue that [CODETOOLS-7902474](https://bugs.openjdk.org/browse/CODETOOLS-7902474) was probably meant to address. Specifically, when running:

make test TEST=tier1 JTREG=RETRY_COUNT=2

which internally reruns failed tests using `-status:fail,error`, jtreg report will only contain tests from the last run.

This issue could be addressed by making `report:all-executed` the default in jtreg when status filter is set. We could also change the jdk makefiles to explicitly add that parameter when retrying.

Alternatively, I suppose we could modify jdk makefiles to pass `report:executed` when not retrying, and leave jtreg unmodified. Let me know your preferences.

-------------

PR: https://git.openjdk.org/jtreg/pull/123