Test policy follow-up, third testing tier

[Joseph D. Darcy]

Hi Mani,

On 6/25/2015 2:31 PM, Mani Sarkar wrote:
> Thanks Martijn, Joe for your updates.
>
> Out of curiosity how do I run these tests from the command line:
>
> $ jtreg [runTier1 params]
> $ jtreg [runTier2 params]

$ jtreg [jtreg options] :tier1

More generally, the tiered test definitions are test groups and any test 
group can be specified for jtreg using ":$GROUP_NAME". For example, tier 
1 for the jdk repo is itself composed of several other test groups, 
jdk_lang, jdk_util, and jdk_math; see the TEST.groups file in jdk/test 
for details.

As discussed earlier in the thread, for "official" kinds of test runs, I 
would always recommend including the jtreg options

     -ea -esa -agentvm

(enable assertions, enable system assertions, use agent vm mode) and 
probably also -conc:$N thrown in too.

If nothing else, this is how we run the tests internally, so if a new 
test doesn't pass when run this way, it will get noticed :-)

>
> I mean whats the format to do so?
>
> When we do this:
>
> $ make test
>
> Are tests run in the same priority, tier1 tests, tier2 tests, etc... ?
>
> Any references to this will be appreciated - thanks guys.

I have a change in progress to all the tiered targets to be issued via make:

     JDK-8075571: Support tiered testing make targets
     https://bugs.openjdk.java.net/browse/JDK-8075571

For this in-progress fix, if issued via make the tiered tests in 
different repos will *not* be run concurrently. If you want run them 
concurrently, jtreg supports invoking test from different repos in a 
single test run.

HTH,

-Joe