June 2014 - quality-discuss

Draft JEP: JDK Core Libraries Test Stabilization
by Stuart Marks 14 Nov '14

14 Nov '14

Hi all, It might be of interest to this group that I've posted a draft JEP about core libraries test stabilization (that is, fixing up the spuriously-failing tests) to core-libs-dev@openjdk. See the following message: http://mail.openjdk.java.net/pipermail/core-libs-dev/2014-May/026703.html Followup discussion should be on core-libs-dev. s'marks

5 4

JDK 8u20 ea b20 test results now available
by Balchandra Vaidya 26 Jun '14

26 Jun '14

JDK 8u20 ea b20 test results are now available at: http://www.java.net/download/openjdk/testresults/8/testresults.html The jdk test results contain 14 differences from the b19 test results. The failed test case is under investigation. 0: /home/jtest/merge8/jdk8u20-b19/jdk/JTwork pass: 4,713; fail: 14; not run: 952 1: /home/jtest/merge8/jdk8u20-b20/jdk/JTwork pass: 4,725; fail: 15; not run: 967 0 1 Test --- pass java/lang/annotation/typeAnnotations/TestExecutableGetAnnotatedType.java --- pass java/lang/invoke/VMAnonymousClass.java --- pass java/lang/invoke/lookup/SpecialStatic.java pass fail java/lang/management/MemoryMXBean/LowMemoryTest2.sh --- pass java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java --- pass java/time/test/java/time/format/TestDateTimeParsing.java --- pass java/time/test/java/time/temporal/TestIsoWeekFields.java --- pass java/util/HashMap/PutNullKey.java --- pass javax/xml/ws/8043129/MailTest.java --- pass sun/security/krb5/auto/AddressesAndNameType.java --- pass sun/security/krb5/auto/UdpTcp.java --- pass sun/security/krb5/etype/UnsupportedKeyType.java --- pass sun/security/tools/jarsigner/certpolicy.sh --- pass sun/text/resources/Format/Bug8037343.java 14 differences The hotspot test results contain 1 difference. No new test failure. 0: /home/jtest/merge8/jdk8u20-b19/hotspot/JTwork pass: 550; fail: 19; error: 2; not run: 7 1: /home/jtest/merge8/jdk8u20-b20/hotspot/JTwork pass: 551; fail: 19; error: 2; not run: 7 0 1 Test --- pass compiler/intrinsics/clone/TestObjectClone.java 1 differences The langtools test results contain 16 differences. 0: /home/jtest/merge8/jdk8u20-b19/langtools/JTwork pass: 3,010; not run: 7 1: /home/jtest/merge8/jdk8u20-b20/langtools/JTwork pass: 3,025; error: 1; not run: 7 0 1 Test --- pass tools/javac/NoStringToLower.java --- pass tools/javac/T8038975/AccessTest.java --- pass tools/javac/annotations/FinalReceiverTest.java --- pass tools/javac/annotations/LocalInnerReceiverTest.java --- pass tools/javac/defaultMethods/static/StaticInvoke.java --- pass tools/javac/flow/T8042741/PositionTest.java --- pass tools/javac/generics/diamond/T8041713/DiamondPlusUnexistingMethodRefCrashTest.java --- pass tools/javac/generics/inference/8043725/T8043725.java --- pass tools/javac/generics/inference/NestedWildcards.java --- pass tools/javac/generics/wildcards/T8015101.java --- error tools/javac/generics/wildcards/T8034147.java --- pass tools/javac/lambda/T8031967.java --- pass tools/javac/lambda/T8038182/CrashFunctionDescriptorExceptionTest.java --- pass tools/javac/lambda/T8042759/ImplicitLambdaConsideredForApplicabilityTest.java --- pass tools/javac/types/BadSigTest.java --- pass tools/javac/util/StringUtilsTest.java 16 differences Nashorn test result is available at: http://download.java.net/openjdk/testresults/8/archives8/jdk8u20-b20/emaila… Regards Balchandra

1 0

JDK 9 ea b19 test results now available
by Balchandra Vaidya 26 Jun '14

26 Jun '14

JDK 9 ea b19 test results are now available at http://www.java.net/download/openjdk/testresults/9/testresults.html The jdk test results contain 6 differences from the b18 test results. No new test case failure. 0: /home/jtest/merge9/b18/jdk/JTwork pass: 4,784; fail: 8; error: 1; not run: 1,083 1: /home/jtest/merge9/b19/jdk/JTwork pass: 4,790; fail: 8; error: 1; not run: 1,083 0 1 Test --- pass com/sun/tools/attach/StartManagementAgent.java --- pass java/lang/invoke/lookup/SpecialStatic.java --- pass java/lang/reflect/DefaultMethodMembers/FilterNotMostSpecific.java --- pass java/util/HashMap/PutNullKey.java --- pass sun/net/www/protocol/http/ZoneId.java --- pass sun/security/tools/keytool/default_options.sh 6 differences The hotspot test results contain 11 differences. The failed (error) test case is under investigation. 0: /home/jtest/merge9/b18/hotspot/JTwork pass: 562; fail: 25; error: 1; not run: 8 1: /home/jtest/merge9/b19/hotspot/JTwork pass: 564; fail: 22; error: 2; not run: 9 0 1 Test pass --- gc/arguments/TestParallelHeapSizeFlags.java pass --- gc/arguments/TestUseCompressedOopsErgo.java fail --- gc/g1/TestHumongousShrinkHeap.java fail --- gc/g1/TestStringDeduplicationMemoryUsage.java --- pass gc/metaspace/TestMetaspaceInitialization.java pass --- gc/parallelScavenge/TestDynShrinkHeap.java --- pass runtime/RedefineFinalizer/RedefineFinalizer.java --- pass runtime/SharedArchiveFile/SharedBaseAddress.java --- pass runtime/SharedArchiveFile/SpaceUtilizationCheck.java --- pass runtime/Thread/TestThreadDumpMonitorContention.java fail error serviceability/sa/jmap-hashcode/Test8028623.java 11 differences The langtools test results contain 15 differences. No new test case failure. 0: /home/jtest/merge9/b18/langtools/JTwork pass: 3,032; not run: 8 1: /home/jtest/merge9/b19/langtools/JTwork pass: 3,047; not run: 5 0 1 Test --- pass tools/javac/annotations/FinalReceiverTest.java --- pass tools/javac/annotations/LocalInnerReceiverTest.java --- pass tools/javac/annotations/typeAnnotations/failures/AnnotatedClassExpr.java --- pass tools/javac/annotations/typeAnnotations/failures/AnnotatedImport.java --- pass tools/javac/annotations/typeAnnotations/failures/AnnotatedPackage1.java --- pass tools/javac/annotations/typeAnnotations/failures/CantAnnotateStaticClass3.java --- pass tools/javac/annotations/typeAnnotations/newlocations/AllLocations.java --- pass tools/javac/annotations/typeAnnotations/referenceinfos/ConstructorInvocationTypeArgument.java --- pass tools/javac/annotations/typeAnnotations/referenceinfos/MethodInvocationTypeArgument.java --- pass tools/javac/annotations/typeAnnotations/referenceinfos/ResourceVariable.java --- pass tools/javac/api/TestSearchPaths.java --- pass tools/javac/api/taskListeners/CompileEvent.java --- pass tools/javac/generics/inference/8043725/T8043725.java --- pass tools/javac/generics/wildcards/T8015101.java --- pass tools/javac/lib/DPrinter.java 15 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b19/emailable-repor… Thanks Balchandra

1 0

JDK 9 ea b18 test results now available
by Rory O'Donnell 19 Jun '14

19 Jun '14

JDK 9 ea b18 test results are now available at http://www.java.net/download/openjdk/testresults/9/testresults.html Overall test results contain no difference from b17 test results. The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b18/emailable-repor… Rgds, Rory -- Rgds,Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland

1 0

JDK 8u20 ea b19 test results now available
by Rory O'Donnell 19 Jun '14

19 Jun '14

JDK 8u20 ea b19 test results are now available at: http://www.java.net/download/openjdk/testresults/8/testresults.html The jdk test results contain 3 differences from the b17 test results. No new test failure. 0: /home/jtest/merge8/jdk8u20-b17/jdk/JTwork pass: 4,710; fail: 15; error: 1; not run: 952 1: /home/jtest/merge8/jdk8u20-b19/jdk/JTwork pass: 4,713; fail: 14; not run: 952 0 1 Test --- pass com/sun/tools/attach/TempDirTest.java fail pass java/lang/management/MemoryMXBean/LowMemoryTest2.sh error pass sun/tools/jstatd/TestJstatdExternalRegistry.java 3 differences The hotspot test results contain 8 differences. No new test failure. 0: /home/jtest/merge8/jdk8u20-b17/hotspot/JTwork pass: 543; fail: 21; error: 2; not run: 7 1: /home/jtest/merge8/jdk8u20-b19/hotspot/JTwork pass: 550; fail: 19; error: 2; not run: 7 0 1 Test --- pass compiler/EscapeAnalysis/TestAllocatedEscapesPtrComparison.java --- pass compiler/intrinsics/hashcode/TestHashCode.java --- pass compiler/loopopts/TestLogSum.java --- pass compiler/uncommontrap/TestStackBangMonitorOwned.java fail pass compiler/whitebox/IsMethodCompilableTest.java fail --- gc/g1/TestStringDeduplicationMemoryUsage.java --- pass gc/metaspace/TestMetaspaceInitialization.java --- pass runtime/Thread/TestThreadDumpMonitorContention.java 8 differences The langtools test results contain no differences. Nashorn test result is available at: http://download.java.net/openjdk/testresults/8/archives8/jdk8u20-b19/emaila… -- Rgds,Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland

1 0

JDK 9 ea b16 test results now available
by Balchandra Vaidya 09 Jun '14

09 Jun '14

JDK 9 ea b16 test results are now available at http://www.java.net/download/openjdk/testresults/9/testresults.html Overall test results contain no new failures. The jdk test results contain 3 differences from the b15 test results. 0: /home/jtest/merge9/b15/jdk/JTwork pass: 4,781; fail: 9; error: 1; not run: 1,082 1: /home/jtest/merge9/b16/jdk/JTwork pass: 4,782; fail: 9; error: 1; not run: 1,083 0 1 Test pass --- com/sun/jdi/JdbReadTwiceTest.sh --- pass sun/nio/ch/ServerSocketAdaptorTest.java --- pass sun/security/tools/jarsigner/certpolicy.sh 3 differences The hotspot test results contain no differences. The langtools test results contain 2 differences. 0: /home/jtest/merge9/b15/langtools/JTwork pass: 3,028; not run: 8 1: /home/jtest/merge9/b16/langtools/JTwork pass: 3,030; not run: 8 0 1 Test --- pass tools/javac/lambda/T8031967.java --- pass tools/javac/types/BadSigTest.java 2 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b16/emailable-repor… Thanks Balchandra

1 0

JDK 8u20 ea b17 test results now available
by Balchandra Vaidya 06 Jun '14

06 Jun '14

JDK 8u20 ea b17 test results are now available at: http://www.java.net/download/openjdk/testresults/8/testresults.html The jdk test results contain 8 differences from the b16 test results and we are investigating the failures. 0: /home/jtest/merge8/jdk8u20-b16/jdk/JTwork pass: 4,714; fail: 13; not run: 939 1: /home/jtest/merge8/jdk8u20-b17/jdk/JTwork pass: 4,710; fail: 15; error: 1; not run: 952 0 1 Test --- pass java/lang/annotation/TypeVariableBounds.java pass fail java/lang/management/MemoryMXBean/LowMemoryTest2.sh pass --- java/lang/management/MemoryMXBean/LowMemoryTestConcMarkSweepGC.sh pass --- java/lang/management/MemoryMXBean/LowMemoryTestParallelGC.sh pass --- java/lang/management/MemoryMXBean/LowMemoryTestSerialGC.sh --- pass java/net/Authenticator/B8034170.java pass fail java/net/URLPermission/nstest/lookup.sh pass error sun/tools/jstatd/TestJstatdExternalRegistry.java 8 differences The hotspot test results contain 1 difference. No new test failure. 0: /home/jtest/merge8/jdk8u20-b16/hotspot/JTwork pass: 542; fail: 21; error: 2; not run: 7 1: /home/jtest/merge8/jdk8u20-b17/hotspot/JTwork pass: 543; fail: 21; error: 2; not run: 7 0 1 Test --- pass serviceability/jvmti/GetObjectSizeOverflow.java 1 differences The langtools test results contain 8 differences. No new test failure. 0: /home/jtest/merge8/jdk8u20-b16/langtools/JTwork pass: 3,008; not run: 7 1: /home/jtest/merge8/jdk8u20-b17/langtools/JTwork pass: 3,010; not run: 7 0 1 Test --- pass tools/javac/generics/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTesta.java --- pass tools/javac/generics/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTestb.java --- pass tools/javac/generics/inference/EagerReturnTypeResolution/PrimitiveTypeBoxingTest.java --- pass tools/javac/generics/wildcards/RefQueueBug.java pass --- tools/javac/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTesta.java pass --- tools/javac/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTestb.java pass --- tools/javac/inference/EagerReturnTypeResolution/PrimitiveTypeBoxingTest.java --- pass tools/javac/lambda/T8041704/ErrorMessageTest.java 8 differences Nashorn test result is available at: http://download.java.net/openjdk/testresults/8/archives8/jdk8u20-b17/emaila… Regards Balchandra

1 0

JDK 8u20 ea b16 test results now available
by Balchandra Vaidya 03 Jun '14

03 Jun '14

JDK 8u20 ea b16 test results are now available at: http://www.java.net/download/openjdk/testresults/8/testresults.html The overall test results contain no new failures. The jdk test results contain 1 difference from the b15 test results. 0: /home/jtest/merge8/jdk8u20-b15/jdk/JTwork pass: 4,713; fail: 13; error: 1; not run: 939 1: /home/jtest/merge8/jdk8u20-b16/jdk/JTwork pass: 4,714; fail: 13; not run: 939 0 1 Test error pass sun/tools/jstatd/TestJstatdExternalRegistry.java 1 differences The hotspot test results contain 1 difference. 0: /home/jtest/merge8/jdk8u20-b15/hotspot/JTwork pass: 541; fail: 21; error: 2; not run: 7 1: /home/jtest/merge8/jdk8u20-b16/hotspot/JTwork pass: 542; fail: 21; error: 2; not run: 7 0 1 Test --- pass runtime/classFileParserBug/TestEmptyBootstrapMethodsAttr.java 1 differences The langtools test results contain no differences. Nashorn test result is available at: http://download.java.net/openjdk/testresults/8/archives8/jdk8u20-b16/emaila… Regards Balchandra

1 0

JDK 9 ea b15 test results now available
by Balchandra Vaidya 03 Jun '14

03 Jun '14

JDK 9 ea b15 test results are now available at http://www.java.net/download/openjdk/testresults/9/testresults.html The jdk test results contain 22 differences from the b14 test results. 0: /home/jtest/merge9/b14/jdk/JTwork pass: 4,761; fail: 9; not run: 1,024 1: /home/jtest/merge9/b15/jdk/JTwork pass: 4,781; fail: 9; error: 1; not run: 1,082 0 1 Test --- pass java/beans/Introspector/Test8040656.java --- pass java/lang/annotation/TypeVariableBounds.java --- pass java/lang/invoke/LambdaFormTest.java --- pass javax/imageio/plugins/png/ReadMalformedPngTest.java --- pass javax/sql/testng/test/rowset/serial/SerialArrayTests.java --- pass javax/sql/testng/test/rowset/serial/SerialBlobTests.java --- pass javax/sql/testng/test/rowset/serial/SerialClobTests.java --- pass javax/sql/testng/test/rowset/serial/SerialDataLinkTests.java --- pass javax/sql/testng/test/rowset/serial/SerialExceptionTests.java --- pass javax/sql/testng/test/rowset/serial/SerialJavaObjectTests.java --- pass javax/sql/testng/test/rowset/serial/SerialRefTests.java --- pass javax/sql/testng/test/rowset/serial/SerialStructTests.java --- pass javax/sql/testng/util/BaseTest.java --- pass javax/sql/testng/util/StubArray.java --- pass javax/sql/testng/util/StubBlob.java --- pass javax/sql/testng/util/StubClob.java --- pass javax/sql/testng/util/StubRef.java --- pass javax/sql/testng/util/StubStruct.java --- pass javax/sql/testng/util/SuperHero.java --- pass javax/xml/ws/8043129/MailTest.java --- pass sun/text/resources/Format/Bug8037343.java pass error sun/tools/jstatd/TestJstatdExternalRegistry.java 22 differences The hotspot test results contain 10 differences. 0: /home/jtest/merge9/b14/hotspot/JTwork pass: 555; fail: 25; error: 2; not run: 11 1: /home/jtest/merge9/b15/hotspot/JTwork pass: 560; fail: 25; error: 1; not run: 9 0 1 Test --- pass compiler/EscapeAnalysis/TestAllocatedEscapesPtrComparison.java --- pass compiler/ciReplay/TestVM.sh --- pass compiler/ciReplay/TestVM_no_comp_level.sh fail pass compiler/membars/DekkerTest.java pass --- runtime/7110720/Test7110720.sh --- pass runtime/CommandLine/TestHexArguments.java pass --- runtime/SharedArchiveFile/CdsWriteError.java --- pass runtime/classFileParserBug/TestEmptyBootstrapMethodsAttr.java --- pass runtime/duplAttributes/DuplAttributesTest.java error fail serviceability/sa/jmap-hashcode/Test8028623.java 10 differences The langtools test results contain 10 differences and no new failures. 0: /home/jtest/merge9/b14/langtools/JTwork pass: 3,024; fail: 1; not run: 8 1: /home/jtest/merge9/b15/langtools/JTwork pass: 3,028; not run: 8 0 1 Test --- pass tools/javac/flow/T8042741/PositionTest.java --- pass tools/javac/generics/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTesta.java --- pass tools/javac/generics/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTestb.java --- pass tools/javac/generics/inference/EagerReturnTypeResolution/PrimitiveTypeBoxingTest.java pass --- tools/javac/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTesta.java pass --- tools/javac/inference/EagerReturnTypeResolution/EagerReturnTypeResolutionTestb.java pass --- tools/javac/inference/EagerReturnTypeResolution/PrimitiveTypeBoxingTest.java --- pass tools/javac/jvm/ClassRefDupInConstantPoolTest.java --- pass tools/javac/lambda/T8041704/ErrorMessageTest.java fail pass tools/javac/util/StringUtilsTest.java 10 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b15/emailable-repor… Thanks Balchandra

1 0