Problems Excluding Specific Tests

Martin Buchholz martinrb at google.com
Wed Nov 7 16:21:05 UTC 2018 

(Author of test is curious ...)
There's a bunch of similar WhiteBox tests.
(They are expected to be brittle as you would expect from the name.)
Maybe it has to do with @run testng

On Wed, Nov 7, 2018 at 7:40 AM, Ben Walsh <ben_walsh at uk.ibm.com> wrote:

> I am experiencing weird problems when using jtreg ...
>
> I want to exclude the test https://hg.openjdk.java.net/
> jdk-updates/jdk11u/file/2c53a52abfee/test/jdk/java/util/concurrent/
> LinkedTransferQueue/WhiteBox.java
>
> Adding this line identifying this test ...
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> <https://github.com/eclipse/openj9/issues/3205>
> https://example.com/issues/1 generic-all
>
>
> ... to an exclude file and using the "-exclude:<the exclude file>"
> parameter, I'm NOT seeing this test excluded in any of my runs.
>
> Generally, there is no problem excluding other tests, including others
> under test/jdk/java/util/concurrent, using this method.
>
> These sets of commands and the responses illustrate the problems (I have
> added comments in [ *** ... *** ] to clarify) and how it seems to be worse
> than just a specific test not being excluded when it should be ...
>
> ------------------------------------------------------------
> ------------------------------------------------------------
> --------------------------------------------------------
>
> walshbp at bendev:~/jtreg_testing$ pwd
> /home/walshbp/jtreg_testing
> walshbp at bendev:~/jtreg_testing$ cat excludeFile
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> https://example.com/issues/1 generic-all
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/
> java/util/concurrent/LinkedTransferQueue
> Directory "JTwork" not found: creating
> Testsuite: /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk
> java/util/concurrent/LinkedTransferQueue/SpliteratorTraverseAddRemoveTe
> st.java
> Tests found: 1
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/
> java/util/concurrent/LinkedTransferQueue
> Testsuite: /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk
> java/util/concurrent/LinkedTransferQueue/SpliteratorTraverseAddRemoveTe
> st.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** EXPECTED - NOT USING EXCLUDE PARAMETER *** ]
> Tests found: 2
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** NOT EXPECTED - SHOULD HAVE BEEN EXCLUDED *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | tail
> java/util/concurrent/ThreadPoolExecutor/FlakyThreadFactory.java
> java/util/concurrent/ThreadPoolExecutor/ModifyCorePoolSize.java
> java/util/concurrent/ThreadPoolExecutor/ScheduledTickleService.java
> java/util/concurrent/ThreadPoolExecutor/SelfInterrupt.java
> java/util/concurrent/ThreadPoolExecutor/ShutdownNowExecuteRace.java
> java/util/concurrent/ThreadPoolExecutor/ThreadRestarts.java
> java/util/concurrent/ThreadPoolExecutor/ThrowingTasks.java
> java/util/concurrent/ThreadPoolExecutor/TimeOutShrink.java
> java/util/concurrent/TimeUnit/Basic.java
> Tests found: 108
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** EXPECTED - NOT USING EXCLUDE PARAMETER *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | tail
> java/util/concurrent/ThreadPoolExecutor/FlakyThreadFactory.java
> java/util/concurrent/ThreadPoolExecutor/ModifyCorePoolSize.java
> java/util/concurrent/ThreadPoolExecutor/ScheduledTickleService.java
> java/util/concurrent/ThreadPoolExecutor/SelfInterrupt.java
> java/util/concurrent/ThreadPoolExecutor/ShutdownNowExecuteRace.java
> java/util/concurrent/ThreadPoolExecutor/ThreadRestarts.java
> java/util/concurrent/ThreadPoolExecutor/ThrowingTasks.java
> java/util/concurrent/ThreadPoolExecutor/TimeOutShrink.java
> java/util/concurrent/TimeUnit/Basic.java
> Tests found: 108
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | grep
> WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** NOT EXPECTED - SHOULD HAVE BEEN EXCLUDED *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 821
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | grep
> WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** EXPECTED - NOT USING EXCLUDE PARAMETER *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 821
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** NOT EXPECTED - SHOULD HAVE BEEN EXCLUDED *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 5,275
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ *** EXPECTED - NOT USING EXCLUDE PARAMETER *** ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 5,275
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
>                [ *** NOT EXPECTED - SHOULD HAVE BEEN EXCLUDED *** ]
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | tail
> vm/runtime/MonitorCacheMaybeExpand_DeadLock.java
> vm/runtime/ReflectStackOverflow.java
> vm/runtime/ShiftTest.java
> vm/runtime/WideStrictInline.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTests.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTestsRun.java
> vm/verifier/TestStaticIF.java
> vm/verifier/VerifyProtectedConstructor.java
> vm/verifier/VerifyStackForExceptionHandlers.java
> Tests found: 9,478
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
>              [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | tail
> vm/runtime/MonitorCacheMaybeExpand_DeadLock.java
> vm/runtime/ReflectStackOverflow.java
> vm/runtime/ShiftTest.java
> vm/runtime/WideStrictInline.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTests.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTestsRun.java
> vm/verifier/TestStaticIF.java
> vm/verifier/VerifyProtectedConstructor.java
> vm/verifier/VerifyStackForExceptionHandlers.java
> Tests found: 9,478
>
> ------------------------------------------------------------
> ------------------------------------------------------------
> --------------------------------------------------------
>
> walshbp at bendev:~/jtreg_testing$ pwd
> /home/walshbp/jtreg_testing
> walshbp at bendev:~/jtreg_testing$ cat excludeFile
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
> https://example.com/issues/1 generic-all
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/
> java/util/concurrent/ArrayBlockingQueue
> Testsuite: /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk
> Tests found: 0
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/
> java/util/concurrent/ArrayBlockingQueue
> Testsuite: /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
>            [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> Tests found: 1
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | grep WhiteBox
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
>        [ PROBLEM - WHY HAVE FOUR TESTS BEEN EXCLUDED ? THREE MORE THAN
> EXPECTED ]
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | tail
> java/util/concurrent/ThreadPoolExecutor/FlakyThreadFactory.java
> java/util/concurrent/ThreadPoolExecutor/ModifyCorePoolSize.java
> java/util/concurrent/ThreadPoolExecutor/ScheduledTickleService.java
> java/util/concurrent/ThreadPoolExecutor/SelfInterrupt.java
> java/util/concurrent/ThreadPoolExecutor/ShutdownNowExecuteRace.java
> java/util/concurrent/ThreadPoolExecutor/ThreadRestarts.java
> java/util/concurrent/ThreadPoolExecutor/ThrowingTasks.java
> java/util/concurrent/ThreadPoolExecutor/TimeOutShrink.java
> java/util/concurrent/TimeUnit/Basic.java
> Tests found: 104
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
>            [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util/concurrent
> | tail
> java/util/concurrent/ThreadPoolExecutor/FlakyThreadFactory.java
> java/util/concurrent/ThreadPoolExecutor/ModifyCorePoolSize.java
> java/util/concurrent/ThreadPoolExecutor/ScheduledTickleService.java
> java/util/concurrent/ThreadPoolExecutor/SelfInterrupt.java
> java/util/concurrent/ThreadPoolExecutor/ShutdownNowExecuteRace.java
> java/util/concurrent/ThreadPoolExecutor/ThreadRestarts.java
> java/util/concurrent/ThreadPoolExecutor/ThrowingTasks.java
> java/util/concurrent/ThreadPoolExecutor/TimeOutShrink.java
> java/util/concurrent/TimeUnit/Basic.java
> Tests found: 108
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | grep
> WhiteBox
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
>        [ PROBLEM - WHY HAVE FOUR TESTS BEEN EXCLUDED ? THREE MORE THAN
> EXPECTED ]
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 817
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | grep
> WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
>            [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java/util | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 821
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | grep WhiteBox
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
>        [ PROBLEM - WHY HAVE FOUR TESTS BEEN EXCLUDED ? THREE MORE THAN
> EXPECTED ]
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 5,271
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
>            [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk/java | tail
> java/util/zip/TestCRC32.java
> java/util/zip/TestCRC32C.java
> java/util/zip/TestEmptyZip.java
> java/util/zip/TestExtraTime.java
> java/util/zip/TestLocalTime.java
> java/util/zip/TestZipError.java
> java/util/zip/TimeChecksum.java
> java/util/zip/TotalInOut.java
> java/util/zip/ZipCoding.java
> Tests found: 5,275
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | grep WhiteBox
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
>        [ PROBLEM - WHY HAVE FOUR TESTS BEEN EXCLUDED ? THREE MORE THAN
> EXPECTED ]
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> -exclude:/home/walshbp/jtreg_testing/excludeFile
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | tail
> vm/runtime/MonitorCacheMaybeExpand_DeadLock.java
> vm/runtime/ReflectStackOverflow.java
> vm/runtime/ShiftTest.java
> vm/runtime/WideStrictInline.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTests.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTestsRun.java
> vm/verifier/TestStaticIF.java
> vm/verifier/VerifyProtectedConstructor.java
> vm/verifier/VerifyStackForExceptionHandlers.java
> Tests found: 9,474
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | grep WhiteBox
> java/util/concurrent/ArrayBlockingQueue/WhiteBox.java
>            [ EXPECTED - NOT USING EXCLUDE PARAMETER ]
> java/util/concurrent/ConcurrentHashMap/WhiteBox.java
> java/util/concurrent/ConcurrentLinkedQueue/WhiteBox.java
> java/util/concurrent/LinkedTransferQueue/WhiteBox.java
> java/util/concurrent/PriorityBlockingQueue/WhiteBox.java
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -l
> /home/walshbp/jep_testing/test-openjdk-jdk11/test/jdk | tail
> vm/runtime/MonitorCacheMaybeExpand_DeadLock.java
> vm/runtime/ReflectStackOverflow.java
> vm/runtime/ShiftTest.java
> vm/runtime/WideStrictInline.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTests.java
> vm/verifier/defaultMethods/DefaultMethodRegressionTestsRun.java
> vm/verifier/TestStaticIF.java
> vm/verifier/VerifyProtectedConstructor.java
> vm/verifier/VerifyStackForExceptionHandlers.java
> Tests found: 9,478
>
> ------------------------------------------------------------
> ------------------------------------------------------------
> --------------------------------------------------------
>
> walshbp at bendev:~/jtreg_testing$ ../jtreg/bin/jtreg -version
> jtreg, version 4.2 dev 398
> Installed in /home/walshbp/jtreg/lib/jtreg.jar
> Running on platform version 11 from /home/walshbp/openjdk11-
> hotspot-binary/jdk-11.
> Built with Java(TM) 2 SDK, Version 1.8.0_121-b13 on June 11, 2018.
> Copyright (c) 1999, 2016, Oracle and/or its affiliates. All rights
> reserved.
> Use is subject to license terms.
> JTHarness: version 5.0
> JCov 3.0-2
> TestNG (testng.jar): version unknown
> TestNG (jcommander.jar): version 1.72
> AsmTools: version 7.0
>
> ------------------------------------------------------------
> ------------------------------------------------------------
> --------------------------------------------------------
>
>
> Please let me know what other information is required to investigate this
> further.
>
>
> Thanks,
> Ben Walsh
>
> Unless stated otherwise above:
> IBM United Kingdom Limited - Registered in England and Wales with number
> 741598.
> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openjdk.java.net/pipermail/jtreg-use/attachments/20181107/7916a71c/attachment-0001.html>

More information about the jtreg-use mailing list