From martijnverburg at gmail.com Sun Feb 1 10:44:38 2015 From: martijnverburg at gmail.com (Martijn Verburg) Date: Sun, 1 Feb 2015 11:44:38 +0100 Subject: Code coverage statistics for OpenJDK Message-ID: Hi all, Recently, one of our Adopt OpenJDK incubator projects (for reference, these projects are outside of OpenJDK proper, the wiki holds the full list) managed to get some what we think are accurate code coverage stats for OpenJDK (jdk9-dev) tests. Thanks to Jonathan Gibbons from code-tools (jtreg/jcov) and Adopt's John Oliver for getting this out! I think this is potentially useful for the OpenJDK quality group to report alongside the existing weekly tests passing that Balchandra kindly pushes out. It can also be useful to OpenJDK contributors to have a guide on making a change -> writing a test -> seeing code coverage improve. Obviously we want to: * Make sure the numbers are correct. * Make it clear in the report that this does not represent how well OpenJDK / Java is actually tested (internally Oracle and others run a far more comprehensive test suite). Do people feel this is this a good idea? If so, who's the right person/people to analyse our results and ensure we're using jtreg and jcov correctly? Cheers, Martijn -------------- next part -------------- An HTML attachment was scrubbed... URL: From balchandra.vaidya at oracle.com Fri Feb 6 12:59:06 2015 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Fri, 06 Feb 2015 18:29:06 +0530 Subject: JDK 9 early access b48 test results now available Message-ID: <54D4BA9A.7000307@oracle.com> JDK 9 ea b48 test results are now available at : http://www.java.net/download/openjdk/testresults/9/testresults.html The jdk test results contain 18 differences from the b47 test results. There is 1 testcase failure, this failure is under investigation. 0: /home/jtest/merge9/b47/jdk/JTwork pass: 4,952; fail: 10; not run: 1,712 1: /home/jtest/merge9/b48/jdk/JTwork pass: 4,964; fail: 11; not run: 1,723 0 1 Test pass --- com/sun/jdi/CatchPatternTest.sh --- pass com/sun/net/httpserver/MissingTrailingSpace.java pass fail java/beans/XMLEncoder/java_awt_GridBagLayout.java --- pass java/lang/ClassLoader/LibraryPathProperty.java --- pass java/util/Hashtable/DeserializedLength.java --- pass java/util/concurrent/CompletableFuture/ThenComposeExceptionTest.java --- pass javax/sql/testng/test/rowset/CommonRowSetTests.java --- pass javax/sql/testng/test/rowset/cachedrowset/CachedRowSetTests.java --- pass javax/sql/testng/test/rowset/cachedrowset/CommonCachedRowSetTests.java --- pass javax/sql/testng/test/rowset/filteredrowset/CityFilter.java --- pass javax/sql/testng/test/rowset/filteredrowset/FilteredRowSetTests.java --- pass javax/sql/testng/test/rowset/filteredrowset/PrimaryKeyFilter.java --- pass javax/sql/testng/test/rowset/joinrowset/JoinRowSetTests.java --- pass javax/sql/testng/test/rowset/webrowset/CommonWebRowSetTests.java --- pass javax/sql/testng/test/rowset/webrowset/WebRowSetTests.java pass --- sun/jvmstat/monitor/MonitoredVm/CR6672135.java --- pass sun/security/provider/FileInputStreamPool/FileInputStreamPoolTest.java --- pass sun/security/ssl/ClientHandshaker/LengthCheckTest.java 18 differences The hotspot test results contain 17 differences from the b47 test results. There are 2 testcase failures, those failures are under investigation. 0: /home/jtest/merge9/b47/hotspot/JTwork pass: 698; fail: 36; error: 1; not run: 30 1: /home/jtest/merge9/b48/hotspot/JTwork pass: 698; fail: 37; error: 1; not run: 36 0 1 Test pass --- compiler/codecache/jmx/PoolsIndependenceTest.java --- pass compiler/codecache/stress/OverloadCompileQueueTest.java --- pass compiler/codecache/stress/RandomAllocationTest.java --- pass compiler/codecache/stress/UnexpectedDeoptimizationTest.java --- pass compiler/floatingpoint/TestPow2.java fail --- compiler/jsr292/RedefineMethodUsedByMultipleMethodHandles.java pass fail compiler/oracle/CheckCompileCommandOption.java pass --- compiler/profiling/spectrapredefineclass/Launcher.java pass --- compiler/profiling/spectrapredefineclass_classloaders/Launcher.java pass fail compiler/rtm/locking/TestRTMTotalCountIncrRate.java --- pass compiler/uncommontrap/TestUnstableIfTrap.java pass --- compiler/whitebox/ForceNMethodSweepTest.java pass --- runtime/NMT/ChangeTrackingLevel.java pass --- runtime/NMT/PrintNMTStatistics.java --- pass runtime/SharedArchiveFile/MaxMetaspaceSize.java --- pass runtime/Thread/ThreadPriorities.java --- pass runtime/Unsafe/Reallocate.java 17 differences The langtools test results contain 5 differences from the b47 test results. No new testcase failures found. 0: /home/jtest/merge9/b47/langtools/JTwork pass: 3,191; not run: 14 1: /home/jtest/merge9/b48/langtools/JTwork pass: 3,196; not run: 14 0 1 Test --- pass tools/javac/8052070/DuplicateTypeParameter.java --- pass tools/javac/lambda/MethodReferenceGenericTarget.java --- pass tools/javac/parser/extend/JavacExtensionTest.java --- pass tools/javac/varargs/warning/Warn6.java --- pass tools/javac/warnings/suppress/T8069094.java 5 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b48/emailable-report.html Thanks Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: From balchandra.vaidya at oracle.com Fri Feb 6 13:08:53 2015 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Fri, 06 Feb 2015 18:38:53 +0530 Subject: JDK 8u40 ea b23 test results now available Message-ID: <54D4BCE5.9080102@oracle.com> JDK 8u40 ea b23 test results are now available at http://www.java.net/download/openjdk/testresults/8/testresults.html The jdk test results contain 16 differences from the b22 test results. There are 4 testcase failures, those failures are under investigation. 0: /home/jtest/merge8/jdk8u40-b22/jdk/JTwork pass: 4,757; fail: 26; not run: 1,003 1: /home/jtest/merge8/jdk8u40-b23/jdk/JTwork pass: 4,768; fail: 18; not run: 1,006 0 1 Test --- fail com/sun/net/httpserver/MissingTrailingSpace.java fail pass java/lang/management/MemoryMXBean/LowMemoryTest2.sh fail pass java/rmi/activation/ActivationSystem/activeGroup/IdempotentActiveGroup.java pass fail java/rmi/transport/pinClientSocketFactory/PinClientSocketFactory.java --- fail java/util/concurrent/CompletableFuture/ThenComposeExceptionTest.java --- fail javax/print/PrintSEUmlauts/PrintSEUmlauts.java fail pass sun/security/ec/TestEC.java fail pass sun/security/ssl/com/sun/net/ssl/internal/ssl/ProtocolVersion/HttpsProtocols.java fail pass sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLContextImpl/CustomizedDefaultProtocols.java fail pass sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLContextImpl/DefaultEnabledProtocols.java fail pass sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLContextImpl/NoOldVersionContext.java fail pass sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLEngineImpl/DelegatedTaskWrongException.java fail pass sun/security/ssl/javax/net/ssl/NewAPIs/testEnabledProtocols.java fail pass sun/security/ssl/javax/net/ssl/ServerName/SSLEngineExplorer.java fail pass sun/security/ssl/javax/net/ssl/ServerName/SSLSocketExplorer.java fail pass sun/security/ssl/sanity/interop/ClientJSSEServerJSSE.java 16 differences The hotspot test results contain 2 differences from the b22 test results. There is 1 testcase failure, this failure is under investigation. 0: /home/jtest/merge8/jdk8u40-b22/hotspot/JTwork pass: 621; fail: 34; error: 1; not run: 16 1: /home/jtest/merge8/jdk8u40-b23/hotspot/JTwork pass: 622; fail: 33; error: 2; not run: 16 0 1 Test --- pass compiler/stringopts/TestOptimizeStringConcat.java fail error serviceability/sa/jmap-hashcode/Test8028623.java 2 differences The langtools test results contain 5 differences from the b22 test results. There are 3 testcase failures, those failures are under investigation. 0: /home/jtest/merge8/jdk8u40-b22/langtools/JTwork pass: 3,071; not run: 7 1: /home/jtest/merge8/jdk8u40-b23/langtools/JTwork pass: 3,071; fail: 2; error: 1; not run: 7 0 1 Test --- pass tools/javac/T8049305/WrongStackframeGenerationTest1.java --- pass tools/javac/T8049305/WrongStackframeGenerationTest2.java pass fail tools/javac/annotations/6214965/T6214965.java --- error tools/javac/enum/8069181/T8069181.java pass fail tools/javac/flow/LVTHarness.java 5 differences The nashorn test result is available at http://download.java.net/openjdk/testresults/8/archives8/jdk8u40-b23/emailable-report.html Thanks Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: From balchandra.vaidya at oracle.com Tue Feb 10 14:40:12 2015 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Tue, 10 Feb 2015 20:10:12 +0530 Subject: JDK 9 early access b49 test results now available Message-ID: <54DA184C.5020007@oracle.com> JDK 9 ea b49 test results are now available at : http://www.java.net/download/openjdk/testresults/9/testresults.html The jdk test results contain 21 differences from the b48 test results. No new testcase failures found. 0: /home/jtest/merge9/b48/jdk/JTwork pass: 4,964; fail: 11; not run: 1,723 1: /home/jtest/merge9/b49/jdk/JTwork pass: 4,981; fail: 11; not run: 1,723 0 1 Test pass --- java/lang/CharSequence/DefaultTest.java --- pass java/lang/instrument/NativeMethodPrefixAgent.java --- pass java/net/ServerSocket/AcceptInheritHandle.java pass --- java/util/ResourceBundle/Bug6287579.java --- pass javax/xml/jaxp/transform/8062923/XslSubstringTest.java --- pass javax/xml/ws/8046817/GenerateEnumSchema.java --- pass sun/security/krb5/auto/ForwardableCheck.java --- pass sun/security/tools/jarsigner/TsacertOptionTest.java --- pass sun/security/tools/jarsigner/warnings/AliasNotInStoreTest.java --- pass sun/security/tools/jarsigner/warnings/BadExtendedKeyUsageTest.java --- pass sun/security/tools/jarsigner/warnings/BadNetscapeCertTypeTest.java --- pass sun/security/tools/jarsigner/warnings/ChainNotValidatedTest.java --- pass sun/security/tools/jarsigner/warnings/HasExpiredCertTest.java --- pass sun/security/tools/jarsigner/warnings/HasExpiringCertTest.java --- pass sun/security/tools/jarsigner/warnings/HasUnsignedEntryTest.java --- pass sun/security/tools/jarsigner/warnings/MultipleWarningsTest.java --- pass sun/security/tools/jarsigner/warnings/NoTimestampTest.java --- pass sun/security/tools/jarsigner/warnings/NotSignedByAliasTest.java --- pass sun/security/tools/jarsigner/warnings/NotYetValidCertTest.java --- pass sun/tools/jmap/heapconfig/JMapHeapConfigTest.java --- pass sun/tools/jmap/heapconfig/LingeredAppTest.java 21 differences The hotspot test results contain 5 differences from the b48 test results. There are 2 testcase failures, those failures are under investigation. 0: /home/jtest/merge9/b48/hotspot/JTwork pass: 698; fail: 37; error: 1; not run: 36 1: /home/jtest/merge9/b49/hotspot/JTwork pass: 697; fail: 39; error: 1; not run: 36 0 1 Test pass fail compiler/arguments/CheckCompileThresholdScaling.java --- pass compiler/loopopts/7052494/Test7052494.java --- pass compiler/stringopts/TestOptimizeStringConcat.java pass fail gc/g1/TestShrinkAuxiliaryData25.java pass --- serviceability/dcmd/compiler/CompilerQueueTest.java 5 differences The langtools test results contain 0 differences from the b48 test results. No new testcase failures found. The nashorn test result is available at http://download.java.net/openjdk/testresults/9/archives/b49/emailable-report.html Thanks Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: From rory.odonnell at oracle.com Wed Feb 18 17:46:48 2015 From: rory.odonnell at oracle.com (Rory O'Donnell) Date: Wed, 18 Feb 2015 17:46:48 +0000 Subject: Moving the Quality Outreach wiki page to Quality Group In-Reply-To: <54E48FD2.9090807@oracle.com> References: <54DB7F28.6020803@oracle.com> <54E48FD2.9090807@oracle.com> Message-ID: <54E4D008.6000703@oracle.com> Hi All, Move completed. https://wiki.openjdk.java.net/display/quality/Quality+Outreach Rgds,Rory On 18/02/2015 13:12, dalibor topic wrote: > Thanks, Mario & Martijn. > > Rory, you're good to move the Quality Outreach page to the Quality > wiki. Let us know when it lands at its news home so that we can point > interested developers to it. Keep up the great work! > > cheers, > dalibor topic > > On 11.02.2015 19:10, Mario Torre wrote: >> +1 from me as well! >> >> Cheers, >> Mario >> >> 2015-02-11 19:06 GMT+01:00 Martijn Verburg : >>> +1 lets promote it out of the incubator :-) >>> >>> Cheers, >>> Martijn >>> >>> On 11 February 2015 at 16:11, dalibor topic >>> wrote: >>> >>>> Hi, >>>> >>>> as I mentioned at FOSDEM during the Q&A session, I'd like to >>>> discuss the >>>> move of the Quality Outreach wiki page to the Quality Group. >>>> >>>> Over the past year, thanks to the many introductions provided by >>>> all of >>>> you, we reached out to core developers on more than 50 FOSS >>>> Projects, and >>>> the majority of them liked the idea of regularly testing their code >>>> using >>>> their own test suites with Early Access builds, reporting back what >>>> they >>>> found. And report back they did, helping discover and fix a number >>>> of high >>>> priority issues and regressions before they could impact users. >>>> Like I said >>>> at FOSDEM: Thank you! >>>> >>>> With the Quality Group now up and running again for a while with >>>> Rory as >>>> its Lead, I believe that it's a good time to officially move the >>>> Quality >>>> Outreach effort to the Quality Group. >>>> >>>> cheers, >>>> dalibor topic >>>> -- >>>> Dalibor Topic | Principal Product Manager >>>> Phone: +494089091214 | Mobile: +491737185961 >>>> >>>> >>>> ORACLE Deutschland B.V. & Co. KG | K?hneh?fe 5 | 22761 Hamburg >>>> >>>> ORACLE Deutschland B.V. & Co. KG >>>> Hauptverwaltung: Riesstr. 25, D-80992 M?nchen >>>> Registergericht: Amtsgericht M?nchen, HRA 95603 >>>> Gesch?ftsf?hrer: J?rgen Kunz >>>> >>>> Komplement?rin: ORACLE Deutschland Verwaltung B.V. >>>> Hertogswetering 163/167, 3543 AS Utrecht, Niederlande >>>> Handelsregister der Handelskammer Midden-Niederlande, Nr. 30143697 >>>> Gesch?ftsf?hrer: Alexander van der Ven, Astrid Kepper, Val Maher >>>> >>>> Oracle is committed to developing >>>> practices and products that help protect the environment >>>> >> >> >> > -- Rgds,Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland From rory.odonnell at oracle.com Wed Feb 18 18:52:05 2015 From: rory.odonnell at oracle.com (Rory O'Donnell) Date: Wed, 18 Feb 2015 18:52:05 +0000 Subject: The Wisdom Of Crowd Testing OpenJDK Message-ID: <54E4DF55.8090604@oracle.com> Hi All, Dalibor and I gave a presentation at FOSDEM in February, the slides are now available on the Quality wiki . Rgds,Rory -- Rgds,Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland -------------- next part -------------- An HTML attachment was scrubbed... URL: From neugens.limasoftware at gmail.com Wed Feb 18 18:59:55 2015 From: neugens.limasoftware at gmail.com (Mario Torre) Date: Wed, 18 Feb 2015 19:59:55 +0100 Subject: The Wisdom Of Crowd Testing OpenJDK In-Reply-To: <54E4DF55.8090604@oracle.com> References: <54E4DF55.8090604@oracle.com> Message-ID: Thanks Rory! Do I have permission to upload them to the FOSDEM website as well? Otherwise I'll see if I can link them to the wiki somehow. Cheers, Mario 2015-02-18 19:52 GMT+01:00 Rory O'Donnell : > Hi All, > > Dalibor and I gave a presentation at FOSDEM in February, the slides are > now available on the Quality wiki. > > Rgds,Rory > > -- > Rgds,Rory O'Donnell > Quality Engineering Manager > Oracle EMEA , Dublin, Ireland -- pgp key: http://subkeys.pgp.net/ PGP Key ID: 80F240CF Fingerprint: BA39 9666 94EC 8B73 27FA FC7C 4086 63E3 80F2 40CF Java Champion - Blog: http://neugens.wordpress.com - Twitter: @neugens Proud GNU Classpath developer: http://www.classpath.org/ OpenJDK: http://openjdk.java.net/projects/caciocavallo/ Please, support open standards: http://endsoftpatents.org/ From rory.odonnell at oracle.com Wed Feb 18 19:02:41 2015 From: rory.odonnell at oracle.com (Rory O'Donnell) Date: Wed, 18 Feb 2015 19:02:41 +0000 Subject: The Wisdom Of Crowd Testing OpenJDK In-Reply-To: References: <54E4DF55.8090604@oracle.com> Message-ID: <54E4E1D1.4050802@oracle.com> On 18/02/2015 18:59, Mario Torre wrote: > Thanks Rory! > > Do I have permission to upload them to the FOSDEM website as well? > Otherwise I'll see if I can link them to the wiki somehow. A link would be great, they might just look at the other stuff on there ? Rgds,Rory > Cheers, > Mario > > 2015-02-18 19:52 GMT+01:00 Rory O'Donnell : >> Hi All, >> >> Dalibor and I gave a presentation at FOSDEM in February, the slides are >> now available on the Quality wiki. >> >> Rgds,Rory >> >> -- >> Rgds,Rory O'Donnell >> Quality Engineering Manager >> Oracle EMEA , Dublin, Ireland > > -- Rgds,Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland