September 2017 - quality-discuss

JDK 9 build 151 test results now available
by Muneer Kolarkunnu 22 Jan '18

22 Jan '18

JDK 9 ea build 151 test results are now available at http://www.java.net/download/openjdk/testresults/9/testresults.html The jdk test results contain 5 differences from the build 150 test results. There are 2 testcase failures, these failures are under investigation. 0: /home/jtest/merge9/150/jdk/JTwork pass: 6,116; fail: 7; not run: 2,233 1: /home/jtest/merge9/151/jdk/JTwork pass: 6,118; fail: 9; not run: 2,233 0 1 Test --- pass java/net/NetworkInterface/SubNetworkInterfaceTest.java --- pass java/util/TimeZone/Bug8167143.java pass fail java/util/concurrent/tck/JSR166TestCase.java --- fail java/util/concurrent/tck/JSR166TestCase.java#id1 --- pass javax/sound/sampled/Clip/OpenNonIntegralNumberOfSampleframes.java 5 differences The hotspot test results contain 10 differences from the build 150 test results. There is 1 testcase failure, this failure is under investigation. 0: /home/jtest/merge9/150/hotspot/JTwork pass: 1,418; fail: 6; error: 1; not run: 57 1: /home/jtest/merge9/151/hotspot/JTwork pass: 1,418; fail: 6; error: 3; not run: 56 0 1 Test --- pass compiler/c2/Test7005594.java pass --- compiler/c2/cr7005594/Test7005594.java --- pass compiler/floatingpoint/TestFMABrokenC1RegAlloc.java pass fail gc/TestNUMAPageSize.java pass error runtime/Thread/ThreadPriorities.java pass error runtime/Thread/TooSmallStackSize.java fail pass runtime/modules/IgnoreModulePropertiesTest.java --- pass serviceability/dcmd/jvmti/LoadAgentDcmdTest.java pass --- serviceability/jvmti/ExceptionCaughtOutOfPhase/ExceptionCaughtOutOfPhaseTest.java --- pass serviceability/sa/TestHeapDumpForInvokeDynamic.java 10 differences The langtools test results contain 6 differences from the build 150 test results. No new testcase failures found. 0: /home/jtest/merge9/150/langtools/JTwork pass: 3,540; fail: 4; not run: 291 1: /home/jtest/merge9/151/langtools/JTwork pass: 3,542; not run: 299 0 1 Test --- pass tools/javac/classreader/8171132/BadConstantValue.java --- pass tools/javac/lambda/8169091/T8169091.java fail --- tools/javac/modules/T8159439/NPEForModuleInfoWithNonZeroSuperClassTest.java fail --- tools/sjavac/ApiExtraction.java fail --- tools/sjavac/ClasspathDependencies.java fail --- tools/sjavac/IgnoreSymbolFile.java 6 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/151/emailable-repor… -- Regards, Abdul Muneer Quality Engineer Oracle, Bangalore, India

9 21

Re: running tests from make causes spurious repo changes
by Martin Buchholz 25 Sep '17

25 Sep '17

It should be standard practice for whoever does systematic jtreg testing to do it occasionally with the jdk sources mounted in a read-only file system, and ensure all the tests still pass. On Mon, Sep 25, 2017 at 4:54 AM, Maurizio Cimadamore < maurizio.cimadamore(a)oracle.com> wrote: > > > On 25/09/17 12:53, Erik Joelsson wrote: > >> I couldn't agree with you more, but AFAIK, this behavior is in the tests >> themselves and not something the build is doing. >> > I see - for the records, I got this when running the test group jdk_lang > > Maurizio > > >> /Erik >> >> >> On 2017-09-25 13:33, Maurizio Cimadamore wrote: >> >>> Hi, >>> if I try to run tests from make, after the test run an 'hg status' >>> reveal the following 'changes': >>> >>> M test/jdk/java/nio/channels/spi/SelectorProvider/inheritedCha >>> nnel/lib/linux-i586/libLauncher.so >>> M test/jdk/java/nio/channels/spi/SelectorProvider/inheritedCha >>> nnel/lib/solaris-amd64/libLauncher.so >>> M test/jdk/java/nio/channels/spi/SelectorProvider/inheritedCha >>> nnel/lib/solaris-sparcv9/libLauncher.so >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/freebl3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/nspr4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/nss3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/nssckbi.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/nssdbm3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/nssutil3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/plc4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/plds4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/softokn3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/sqlite3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-amd64/ssl3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/freebl3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/nspr4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/nss3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/nssckbi.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/nssdbm3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/nssutil3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/plc4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/plds4.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/softokn3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/sqlite3.dll >>> M test/jdk/sun/security/pkcs11/nss/lib/windows-i586/ssl3.dll >>> >>> What's up? Shouldn't this stuff end up in build folder? >>> >>> Cheers >>> Maurizio >>> >>> >> >

1 0

Release Announcement: General Availability of JDK 9
by Muneer Kolarkunnu 21 Sep '17

21 Sep '17

Hi All, Three items to share with you today JDK 9 General Availability GPL'd binaries from Oracle are available here: http://jdk.java.net/9 See Mark Reinhold's email for more details on the Release [1] delivery of Project Jigsaw [2] Are you JDK 9 Ready ? The Quality Outreach wiki[3] has been updated to include a JDK 9 Ready column. If you would like us to identify your project as JDK 9 ready , please let me know and I will add it to the wiki. Quality Outreach Report for September 2017[4] is available many thanks for your continued support and welcome to the new projects! [1] http://mail.openjdk.java.net/pipermail/announce/2017-September/000230.html [2] https://mreinhold.org/blog/jigsaw-complete [3] https://wiki.openjdk.java.net/display/quality/Quality+Outreach [4] https://wiki.openjdk.java.net/display/quality/Quality+Outreach+report+Septe… -- Regards, Abdul Muneer Kolarkunnu Quality Engineer Oracle, Bangalore, India

1 0

How to run the jdk10/hotspot regression tests?
by Volker Simonis 05 Sep '17

05 Sep '17

Hi, can somebody please describe what's the recommended way for running the jdk10/hotspotJTREG tests? There's a description for jdk9 on the "How to run the tests?" page [1] but at point "2.3 Running tests in hotspot/test" it reads: 2.3 Running tests in hotspot/test $ jtreg -dir:{openjdk source top directory}/hotspot/test -verbose:summary -nativepath:{location of the test native library} -exclude:{openjdk source top directory}/hotspot/test/ProblemList.txt -conc:auto -a -ignore:quiet -timeoutFactor:5 -agentvm -testjdk:{location of the test jdk} :jdk This isn't applicable to jdk10 any more because the ":jdk" test group was removed. So it would be nice if you could publish the command line Oracle is using for running the jdk10 regression tests and maybe also start reporting your test results in the same way you are already doing it for jdk8/jdk9. Thank you and best regards, Volker [1] http://download.java.net/openjdk/testresults/9/docs/howtoruntests.html

2 5