RFR(M): JDK-8028160: [TESTBUG] Exclude failing (runtime) jtreg tests using @ignore

[Coleen Phillimore]

George,
This looks good.   Thanks for adding the bug numbers.   It will be 
useful to have no failures to ignore when running these tests.
thanks,
Coleen

On 11/25/2013 6:17 PM, Mikhailo Seledtsov wrote:
> The updated webrev has been posted at: 
> http://cr.openjdk.java.net/~mseledtsov/sponsored/george.triantafillou/8028160/webrev.01/ 
> <http://cr.openjdk.java.net/%7Emseledtsov/sponsored/george.triantafillou/8028160/webrev.01/> 
>
>
> George has updated the bug numbers that follow the @ignore tag 
> according to the feedback.
>
> Misha
>
> On 11/25/2013 1:32 PM, Christian Tornqvist wrote:
>> Hi Leonid,
>>
>> The benefits of using @ignore instead of problemlist are many so we 
>> went with using @ignore instead of introducing a problemlist.txt for 
>> hotspot. This is something that can be discussed when looking at how 
>> to improve jtreg in JDK9 if we feel that this doesn't meet all our 
>> requirements.
>>
>> Thanks,
>> Christian
>>
>> -----Original Message-----
>> From: hotspot-runtime-dev-bounces at openjdk.java.net 
>> [mailto:hotspot-runtime-dev-bounces at openjdk.java.net] On Behalf Of 
>> Leonid Mesnik
>> Sent: Monday, November 25, 2013 11:37 AM
>> To: David Holmes
>> Cc: hotspot-runtime-dev; GEORGE_TRIANTAFILLOU
>> Subject: Re: RFR(M): JDK-8028160: [TESTBUG] Exclude failing (runtime) 
>> jtreg tests using @ignore
>>
>> David
>>
>> I agree with Alan. I also wanted to ask about ProblemsList.txt for 
>> exclusion. However it seems we don't use it for hotspot.
>> We could file RFE to make it and support on all levels of testing 
>> however it requires much more effort in different systems (JPRT, 
>> Aurora, make, other?).
>>
>> Does it make a sense to do it for in JDK9?
>>
>> Leonid
>> On 11/25/2013 05:01 PM, Alan Bateman wrote:
>>> On 25/11/2013 00:49, David Holmes wrote:
>>>> I don't understand the reason for doing this. If the tests fail
>>>> because of a genuine problem then there should be a bug for that
>>>> problem and the test just becomes a "known failure". If that is
>>>> undesirable why not just add them to the ProblemList.txt file?
>>>>
>>>> It seems wrong to me to have any tests marked as @ignore.
>>> Looking at hotspot/test/Makefile then it looks like jtreg is not run
>>> with an exclude list so it doesn't look like there is a way to exclude
>>> tests that way. In any case, @ignore or an exclude list (like
>>> ProblemList.txt) amount to the same thing in that the test is not run.
>>> The advantage of an exclude list over @ignore is that you can exclude
>>> tests on specific platforms (which is really useful for some of the
>>> library tests).
>>>
>>> -Alan.
>>
>> -- 
>> Leonid Mesnik
>> JVM SQE
>>
>>
>>
>