From balchandra.vaidya at oracle.com Mon May 6 14:49:16 2013 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Mon, 06 May 2013 22:49:16 +0100 Subject: JDK 8 b88 ea build test results now available Message-ID: <5188255C.9020505@oracle.com> JDK 8 b88 ea build test results now available at : http://www.java.net/download/jdk8/testresults/testresults.html The jdk and langtools test results are identical to b87 jdk and langtools test results. The hotspot test results have two differences: 0: /home/jtest/merge/b87/hotspot/JTwork pass: 285; fail: 2; not run: 2 1: /home/jtest/merge/b88/hotspot/JTwork pass: 287; fail: 2; not run: 2 0 1 Test --- pass compiler/6443505/Test6443505.java --- pass compiler/8011901/Test8011901.java 2 differences No new failures found in Nashorn test results. Nashorn test result for b88 is available at: http://download.java.net/jdk8/testresults/archives/b88/emailable-report.html Regards Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130506/12ce1887/attachment.html From rory.odonnell at oracle.com Tue May 14 04:24:00 2013 From: rory.odonnell at oracle.com (Rory O'Donnell Oracle, Dublin Ireland) Date: Tue, 14 May 2013 12:24:00 +0100 Subject: JDK 8 b89 ea build test results now available Message-ID: <51921ED0.10507@oracle.com> JDK 8 b89 ea build test results now available at : http://www.java.net/download/jdk8/testresults/testresults.html JDK results have fewer fails & additional passes. Hotspot has one new test failure. Langtools has four new tests all passing. 0: /home/jtest/merge/b88/jdk/JTwork pass: 4,238; fail: 14; not run: 803 1: /home/jtest/merge/b89/jdk/JTwork pass: 4,256; fail: 12; not run: 806 0 1 Test --- pass java/beans/XMLEncoder/java_awt_CardLayout.java --- pass java/beans/XMLEncoder/java_awt_GridBagLayout.java pass --- java/io/Serializable/accessConstants/AccessConstants.java --- pass java/lang/CharSequence/DefaultTest.java --- pass java/lang/String/StringJoinTest.java pass --- java/lang/instrument/IsModifiableClassAgent.java --- pass java/net/Inet6Address/serialize/Inet6AddressSerializationTest.java --- pass java/nio/file/Files/walkFileTree/MaxDepth.java --- pass java/nio/file/Files/walkFileTree/SkipSiblings.java --- pass java/nio/file/Files/walkFileTree/SkipSubtree.java --- pass java/nio/file/Files/walkFileTree/TerminateWalk.java --- pass java/nio/file/Files/walkFileTree/find.sh pass --- java/nio/file/Files/walkFileTree/walk_file_tree.sh --- pass java/nio/file/attribute/BasicFileAttributeView/CreationTime.java fail pass java/time/test/java/util/TestFormatter.java --- pass java/util/Arrays/SetAllTest.java --- pass java/util/Base64/Base64GetEncoderTest.java --- pass java/util/Collection/CollectionDefaults.java --- pass java/util/Collection/ListDefaults.java --- pass java/util/StringJoiner/StringJoinerTest.java --- pass java/util/logging/DrainFindDeadlockTest.java --- pass java/util/logging/bundlesearch/ResourceBundleSearchTest.java --- pass sun/security/krb5/auto/SaslGSS.java fail pass sun/security/provider/SecureRandom/StrongSeedReader.java 24 differences 0: /home/jtest/merge/b88/hotspot/JTwork pass: 287; fail: 2; not run: 2 1: /home/jtest/merge/b89/hotspot/JTwork pass: 294; fail: 2; not run: 2 0 1 Test --- pass compiler/ciReplay/TestSA.sh --- pass compiler/ciReplay/TestVM.sh --- pass compiler/ciReplay/TestVM_no_comp_level.sh fail pass gc/TestVerifyDuringStartup.java --- pass gc/concurrentMarkSweep/GuardShrinkWarning.java --- pass runtime/lambda-features/PublicStaticInterfaceMethodHandling.java --- fail runtime/memory/ReserveMemory.java --- pass sanity/WhiteBox.java 8 differences 0: /home/jtest/merge/b88/langtools/JTwork pass: 2,727; not run: 16 1: /home/jtest/merge/b89/langtools/JTwork pass: 2,731; not run: 16 0 1 Test --- pass tools/javac/defaultMethods/CheckACC_STRICTFlagOnDefaultMethodTest.java --- pass tools/javac/doctree/positions/TestPosition.java --- pass tools/javac/lambda/methodReferenceExecution/MethodReferenceTestNewInnerImplicitArgs.java --- pass tools/javac/processing/model/element/TestTypeParameterAnnotations.java 4 differences No failures found in Nashorn test results, 31 additional tests. Nashorn test result for b89 is available at: http://download.java.net/jdk8/testresults/archives/b88/emailable-report.html -- Rgds, Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130514/035a1fe7/attachment.html From rory.odonnell at oracle.com Tue May 14 06:36:39 2013 From: rory.odonnell at oracle.com (Rory O'Donnell Oracle, Dublin Ireland) Date: Tue, 14 May 2013 14:36:39 +0100 Subject: JDK 8 b89 ea build test results now available In-Reply-To: <51921ED0.10507@oracle.com> References: <51921ED0.10507@oracle.com> Message-ID: <51923DE7.6000006@oracle.com> Mistake in original email - Nashorn test result for b89 is available at: http://download.java.net/jdk8/testresults/archives/b89/emailable-report.html On 14/05/2013 12:24, Rory O'Donnell Oracle, Dublin Ireland wrote: > JDK 8 b89 ea build test results now available at : > http://www.java.net/download/jdk8/testresults/testresults.html > > JDK results have fewer fails & additional passes. Hotspot has one new > test failure. > Langtools has four new tests all passing. > 0: /home/jtest/merge/b88/jdk/JTwork pass: 4,238; fail: 14; not run: 803 > 1: /home/jtest/merge/b89/jdk/JTwork pass: 4,256; fail: 12; not run: 806 > > 0 1 Test > --- pass java/beans/XMLEncoder/java_awt_CardLayout.java > --- pass java/beans/XMLEncoder/java_awt_GridBagLayout.java > pass --- java/io/Serializable/accessConstants/AccessConstants.java > --- pass java/lang/CharSequence/DefaultTest.java > --- pass java/lang/String/StringJoinTest.java > pass --- java/lang/instrument/IsModifiableClassAgent.java > --- pass java/net/Inet6Address/serialize/Inet6AddressSerializationTest.java > --- pass java/nio/file/Files/walkFileTree/MaxDepth.java > --- pass java/nio/file/Files/walkFileTree/SkipSiblings.java > --- pass java/nio/file/Files/walkFileTree/SkipSubtree.java > --- pass java/nio/file/Files/walkFileTree/TerminateWalk.java > --- pass java/nio/file/Files/walkFileTree/find.sh > pass --- java/nio/file/Files/walkFileTree/walk_file_tree.sh > --- pass java/nio/file/attribute/BasicFileAttributeView/CreationTime.java > fail pass java/time/test/java/util/TestFormatter.java > --- pass java/util/Arrays/SetAllTest.java > --- pass java/util/Base64/Base64GetEncoderTest.java > --- pass java/util/Collection/CollectionDefaults.java > --- pass java/util/Collection/ListDefaults.java > --- pass java/util/StringJoiner/StringJoinerTest.java > --- pass java/util/logging/DrainFindDeadlockTest.java > --- pass java/util/logging/bundlesearch/ResourceBundleSearchTest.java > --- pass sun/security/krb5/auto/SaslGSS.java > fail pass sun/security/provider/SecureRandom/StrongSeedReader.java > > 24 differences > > > > 0: /home/jtest/merge/b88/hotspot/JTwork pass: 287; fail: 2; not run: 2 > 1: /home/jtest/merge/b89/hotspot/JTwork pass: 294; fail: 2; not run: 2 > > 0 1 Test > --- pass compiler/ciReplay/TestSA.sh > --- pass compiler/ciReplay/TestVM.sh > --- pass compiler/ciReplay/TestVM_no_comp_level.sh > fail pass gc/TestVerifyDuringStartup.java > --- pass gc/concurrentMarkSweep/GuardShrinkWarning.java > --- pass runtime/lambda-features/PublicStaticInterfaceMethodHandling.java > --- fail runtime/memory/ReserveMemory.java > --- pass sanity/WhiteBox.java > > 8 differences > > 0: /home/jtest/merge/b88/langtools/JTwork pass: 2,727; not run: 16 > 1: /home/jtest/merge/b89/langtools/JTwork pass: 2,731; not run: 16 > > 0 1 Test > --- pass tools/javac/defaultMethods/CheckACC_STRICTFlagOnDefaultMethodTest.java > --- pass tools/javac/doctree/positions/TestPosition.java > --- pass tools/javac/lambda/methodReferenceExecution/MethodReferenceTestNewInnerImplicitArgs.java > --- pass tools/javac/processing/model/element/TestTypeParameterAnnotations.java > > 4 differences > > > No failures found in Nashorn test results, 31 additional tests. > Nashorn test result for b89 is available at: > http://download.java.net/jdk8/testresults/archives/b88/emailable-report.html > -- > Rgds, > Rory O'Donnell > > Quality Engineering Manager > Oracle EMEA , Dublin, Ireland > > > > -- Rgds, Rory O'Donnell Quality Engineering Manager Oracle EMEA , Dublin, Ireland -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130514/ef118292/attachment.html From rory.odonnell at oracle.com Fri May 17 01:12:01 2013 From: rory.odonnell at oracle.com (Rory O'Donnell Oracle, Dublin Ireland) Date: Fri, 17 May 2013 09:12:01 +0100 Subject: OpenJDK Test Fest in London today In-Reply-To: References: Message-ID: <5195E651.5000803@oracle.com> Hi Martijn, The feedback we received was very positive, most asked to replicate TestFests at various locations. We said we would look at creating a "teach the teachers" pack, with that in mind we have started to create videos of the TestFest presentations. The first to make it to YouTube Java channel is Alan Bateman's Introduction to the OpenJDK tests at: http://www.youtube.com/watch?v=ZcOGof_DXcU Thanks to Alan for making this happen. I will announce more as they become available in the coming weeks. Rgds, Rory On 23/03/2013 11:53, Martijn Verburg wrote: > Hi all, > > Just to make folks aware - we're currently sitting in an OpenJDK Test > fest led by IBM and Oracle for the London Java Community. > > ~30 new developers are writing their first jtreg tests :-). > > Thanks to everyone who's helped make this happen + extra thanks to Jon > Gibbons for updating the jtreg section in the nick of time! > > Lots more discussion on OpenJDK build and Test to follow. > > Cheers, > Martijn -- Rgds, Rory O'Donnell Senior Quality Engineering Manager Java Platform Group Oracle EMEA, Block P5, East Point Business Park, Dublin 3 Phone: +353 (0)1 8033887 From martijnverburg at gmail.com Fri May 17 01:58:17 2013 From: martijnverburg at gmail.com (Martijn Verburg) Date: Fri, 17 May 2013 09:58:17 +0100 Subject: OpenJDK Test Fest in London today In-Reply-To: <5195E651.5000803@oracle.com> References: <5195E651.5000803@oracle.com> Message-ID: Hi Rory, Wicked. Ben's spread the word and we've hooked the link into the Adopt OpenJDK programme site on java.net. A bunch of us have nearly finished the first usable cut of Betterrev which should mean the 'create test / submit patch' flow should work well for new contributors. Looking forward to more test fests! Cheers, Martijn On 17 May 2013 09:12, Rory O'Donnell Oracle, Dublin Ireland < rory.odonnell at oracle.com> wrote: > Hi Martijn, > > The feedback we received was very positive, most asked to replicate > TestFests at various locations. > > We said we would look at creating a "teach the teachers" pack, with that > in mind we have started to > create videos of the TestFest presentations. > > The first to make it to YouTube Java channel is Alan Bateman's > Introduction to the OpenJDK tests at: > > http://www.youtube.com/watch?**v=ZcOGof_DXcU > > Thanks to Alan for making this happen. > > I will announce more as they become available in the coming weeks. > > Rgds, Rory > > > > On 23/03/2013 11:53, Martijn Verburg wrote: > >> Hi all, >> >> Just to make folks aware - we're currently sitting in an OpenJDK Test >> fest led by IBM and Oracle for the London Java Community. >> >> ~30 new developers are writing their first jtreg tests :-). >> >> Thanks to everyone who's helped make this happen + extra thanks to Jon >> Gibbons for updating the jtreg section in the nick of time! >> >> Lots more discussion on OpenJDK build and Test to follow. >> >> Cheers, >> Martijn >> > > -- > Rgds, > Rory O'Donnell > > Senior Quality Engineering Manager > Java Platform Group > Oracle EMEA, Block P5, > East Point Business Park, Dublin 3 > Phone: +353 (0)1 8033887 > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130517/b578495d/attachment.html From neugens.limasoftware at gmail.com Fri May 17 02:04:20 2013 From: neugens.limasoftware at gmail.com (Mario Torre) Date: Fri, 17 May 2013 11:04:20 +0200 Subject: OpenJDK Test Fest in London today In-Reply-To: References: <5195E651.5000803@oracle.com> Message-ID: Awesome! Cheers, Mario 2013/5/17 Martijn Verburg : > Hi Rory, > > Wicked. Ben's spread the word and we've hooked the link into the Adopt > OpenJDK programme site on java.net. A bunch of us have nearly finished the > first usable cut of Betterrev which should mean the 'create test / submit > patch' flow should work well for new contributors. > > Looking forward to more test fests! > > > Cheers, > Martijn > > > On 17 May 2013 09:12, Rory O'Donnell Oracle, Dublin Ireland > wrote: >> >> Hi Martijn, >> >> The feedback we received was very positive, most asked to replicate >> TestFests at various locations. >> >> We said we would look at creating a "teach the teachers" pack, with that >> in mind we have started to >> create videos of the TestFest presentations. >> >> The first to make it to YouTube Java channel is Alan Bateman's >> Introduction to the OpenJDK tests at: >> >> http://www.youtube.com/watch?v=ZcOGof_DXcU >> >> Thanks to Alan for making this happen. >> >> I will announce more as they become available in the coming weeks. >> >> Rgds, Rory >> >> >> >> On 23/03/2013 11:53, Martijn Verburg wrote: >>> >>> Hi all, >>> >>> Just to make folks aware - we're currently sitting in an OpenJDK Test >>> fest led by IBM and Oracle for the London Java Community. >>> >>> ~30 new developers are writing their first jtreg tests :-). >>> >>> Thanks to everyone who's helped make this happen + extra thanks to Jon >>> Gibbons for updating the jtreg section in the nick of time! >>> >>> Lots more discussion on OpenJDK build and Test to follow. >>> >>> Cheers, >>> Martijn >> >> >> -- >> Rgds, >> Rory O'Donnell >> >> Senior Quality Engineering Manager >> Java Platform Group >> Oracle EMEA, Block P5, >> East Point Business Park, Dublin 3 >> Phone: +353 (0)1 8033887 >> >> >> >> > -- pgp key: http://subkeys.pgp.net/ PGP Key ID: 80F240CF Fingerprint: BA39 9666 94EC 8B73 27FA FC7C 4086 63E3 80F2 40CF IcedRobot: www.icedrobot.org Proud GNU Classpath developer: http://www.classpath.org/ Read About us at: http://planet.classpath.org OpenJDK: http://openjdk.java.net/projects/caciocavallo/ Please, support open standards: http://endsoftpatents.org/ From richard.warburton at gmail.com Sat May 18 03:26:54 2013 From: richard.warburton at gmail.com (Richard Warburton) Date: Sat, 18 May 2013 12:26:54 +0200 Subject: Code Coverage Message-ID: Hi, I'm currently helping Steve Poole run an openjdk test-fest in Krakow. The goal of the event to be incrementally improving test coverage in Openjdk. One of the issues that has cropped up is the lack of available coverage reports in openjdk. When this has been previously discussed it was commented there is already internal code coverage tooling, but this information wasn't publicly available. Any update or clarification on this situation would be most appreciated. If there is a barrier to making the tooling publicly available then even publicly publishing HTML or text reports to provide visibility into the situation would be helpful. The results of test runs are already regularly posted to this list. regards, Richard Warburton http://insightfullogic.com @RichardWarburto -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130518/08cd9e93/attachment.html From Alan.Bateman at oracle.com Sat May 18 08:49:54 2013 From: Alan.Bateman at oracle.com (Alan Bateman) Date: Sat, 18 May 2013 16:49:54 +0100 Subject: Code Coverage In-Reply-To: References: Message-ID: <5197A322.1080609@oracle.com> On 18/05/2013 11:26, Richard Warburton wrote: > Hi, > > I'm currently helping Steve Poole run an openjdk test-fest in Krakow. > The goal of the event to be incrementally improving test coverage in > Openjdk. One of the issues that has cropped up is the lack of > available coverage reports in openjdk. > > When this has been previously discussed it was commented there is > already internal code coverage tooling, but this information wasn't > publicly available. Any update or clarification on this situation > would be most appreciated. > > If there is a barrier to making the tooling publicly available then > even publicly publishing HTML or text reports to provide visibility > into the situation would be helpful. The results of test runs are > already regularly posted to this list. > In Oracle, the tool that we use is called "jcov", it's proprietary so I can't point you at anything. Maybe someday it could be proposed to the Code Tool Projects but I have no knowledge of specific plans on that. I wonder if anyone has tried using EMMA or any of the other code coverage tools out there? At least for the JDK releases in development then one challenge would be keeping the tool up to the date with the class file format, another would be taking care when instrumenting very core classes that are used early in VM startup. It's the same challenge that profiles and other tools that do bytecode instrumentation have used on a JDK version that is still in development. -Alan. From richard.bair at oracle.com Sat May 18 10:01:45 2013 From: richard.bair at oracle.com (Richard Bair) Date: Sat, 18 May 2013 10:01:45 -0700 Subject: Code Coverage In-Reply-To: <5197A322.1080609@oracle.com> References: <5197A322.1080609@oracle.com> Message-ID: <6C8F2DDB-D1E0-4250-ACE3-54D1AF057341@oracle.com> To my knowledge the only open code coverage tool being maintained is JaCoCo. We were going to try that for OpenJFX. The current build doesn't work on Java 8 though :-/ Richard On May 18, 2013, at 8:49 AM, Alan Bateman wrote: > On 18/05/2013 11:26, Richard Warburton wrote: >> Hi, >> >> I'm currently helping Steve Poole run an openjdk test-fest in Krakow. The goal of the event to be incrementally improving test coverage in Openjdk. One of the issues that has cropped up is the lack of available coverage reports in openjdk. >> >> When this has been previously discussed it was commented there is already internal code coverage tooling, but this information wasn't publicly available. Any update or clarification on this situation would be most appreciated. >> >> If there is a barrier to making the tooling publicly available then even publicly publishing HTML or text reports to provide visibility into the situation would be helpful. The results of test runs are already regularly posted to this list. >> > In Oracle, the tool that we use is called "jcov", it's proprietary so I can't point you at anything. Maybe someday it could be proposed to the Code Tool Projects but I have no knowledge of specific plans on that. > > I wonder if anyone has tried using EMMA or any of the other code coverage tools out there? At least for the JDK releases in development then one challenge would be keeping the tool up to the date with the class file format, another would be taking care when instrumenting very core classes that are used early in VM startup. It's the same challenge that profiles and other tools that do bytecode instrumentation have used on a JDK version that is still in development. > > -Alan. > > > > From jonathan.gibbons at oracle.com Sat May 18 10:13:42 2013 From: jonathan.gibbons at oracle.com (Jonathan Gibbons) Date: Sat, 18 May 2013 10:13:42 -0700 Subject: Code Coverage In-Reply-To: <5197A322.1080609@oracle.com> References: <5197A322.1080609@oracle.com> Message-ID: <5197B6C6.7000208@oracle.com> On 05/18/2013 08:49 AM, Alan Bateman wrote: > On 18/05/2013 11:26, Richard Warburton wrote: >> Hi, >> >> I'm currently helping Steve Poole run an openjdk test-fest in >> Krakow. The goal of the event to be incrementally improving test >> coverage in Openjdk. One of the issues that has cropped up is the >> lack of available coverage reports in openjdk. >> >> When this has been previously discussed it was commented there is >> already internal code coverage tooling, but this information wasn't >> publicly available. Any update or clarification on this situation >> would be most appreciated. >> >> If there is a barrier to making the tooling publicly available then >> even publicly publishing HTML or text reports to provide visibility >> into the situation would be helpful. The results of test runs are >> already regularly posted to this list. >> > In Oracle, the tool that we use is called "jcov", it's proprietary so > I can't point you at anything. Maybe someday it could be proposed to > the Code Tool Projects but I have no knowledge of specific plans on that. > > I wonder if anyone has tried using EMMA or any of the other code > coverage tools out there? At least for the JDK releases in development > then one challenge would be keeping the tool up to the date with the > class file format, another would be taking care when instrumenting > very core classes that are used early in VM startup. It's the same > challenge that profiles and other tools that do bytecode > instrumentation have used on a JDK version that is still in development. > > -Alan. > > > > Alan, I looked at EMMA. I see one notable problem with using it to get coverage data for OpenJDK while running the OpenJDK test suites. These test suites create *lots* of JVMs, for a variety of reasons. Even in "sameVM" mode, the langtools test suite creates about 80+ JVMs, last time I checked. This poses a problem for coverage tools, when they try and write out coverage data. It looks like EMMA tries to write out all data to a single file [1]. You can specify whether data in that file is to be overwritten by subsequent runs, or merged. In experiments in times past, merging has not been successful in our crazy worlds of concurrent JVMs coming and going. There are two possible ways a good coverage tool could get around this problem. It should either be possible to specify that each JVM should write its coverage data to a new uniquely named file (for later offline merging) or each JVM could write data to a server process which can coordinate access to a single shared file. -- Jon [1] http://emma.sourceforge.net/reference/ch03s02.html#prop-ref.table.file From richard.warburton at gmail.com Sat May 18 10:54:04 2013 From: richard.warburton at gmail.com (Richard Warburton) Date: Sat, 18 May 2013 19:54:04 +0200 Subject: Code Coverage In-Reply-To: <5197A322.1080609@oracle.com> References: <5197A322.1080609@oracle.com> Message-ID: Hi, Thanks for the replies everyone. In Oracle, the tool that we use is called "jcov", it's proprietary so I > can't point you at anything. Maybe someday it could be proposed to the Code > Tool Projects but I have no knowledge of specific plans on that. > If jcov produces HTML reports - would it be possible to have the reports from your internal CI builds published? This would at least improve the situation even in the absence of jcov being made available. I wonder if anyone has tried using EMMA or any of the other code coverage > tools out there? At least for the JDK releases in development then one > challenge would be keeping the tool up to the date with the class file > format, another would be taking care when instrumenting very core classes > that are used early in VM startup. It's the same challenge that profiles > and other tools that do bytecode instrumentation have used on a JDK version > that is still in development. > I imagine with sufficient effort Jacoco could be made to work - though I was hoping to avoid debugging Jacoco with Java 8. I'll have a look into this. At work we've got a patch against Jacoco in order to merge together the results from different sub module builds in maven, so I'll see if its possible to use this this same approach in order to make Jacoco work with merging separate files from different openjdk VMs as Johnathan has suggested. regards, Richard Warburton http://insightfullogic.com @RichardWarburto -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130518/3af3de47/attachment.html From jonathan.gibbons at oracle.com Sat May 18 16:08:07 2013 From: jonathan.gibbons at oracle.com (Jonathan Gibbons) Date: Sat, 18 May 2013 16:08:07 -0700 Subject: Code Coverage In-Reply-To: References: <5197A322.1080609@oracle.com> Message-ID: <519809D7.4090907@oracle.com> Richard, all, Yes, I agree it would be nice if we could get code-coverage reports published. But that being said, I have a couple of comments, which I will say up front appear contradictory, even to me, as I write them. 1. The Java SQE org does do what you're suggesting: they run coverage reports and look to plug the holes. 2. With respect, I think you're looking for needles in haystacks, and missing the giant low hanging fruit all around us. In other words, you're looking at the wrong granularity. When I was writing my recent blog entry last week, I went looking for examples of bad shell scripts. I started looking at the first 10 shell scripts that find showed me, and found problems. Within an hour, I had written scripts to identify more instances of those problems and filed bugs in the system. Separately, as you may know if you follow the various aliases, there is an ongoing effort to improve the reliability of many areas of the test suite, and/or to "fix" tests that appear on the Problem list". In other words, it's not so much that we need /more/ tests; we need /better/ tests. If you do want to write more, new tests, I think that is as easy as deciding what area you're interested in, and then asking on the relevant aliases. For example, even though the code coverage numbers for javac are pretty good, we do not have many tests that verify the debug attributes generated by javac, such LineNumberTable, LocalVariableTable, etc. Mostly, class files generated by javac are tested by running them. We do not have any/many tests that check javac's behavior with respect to reading invalid class files. We went *15 years* before anyone noticed and/or got concerned that javadoc generated invalid HTML. (Ooops.) So, bottom line, even without code coverage tools, there's still easy pickings ;-) -- Jon On 05/18/2013 10:54 AM, Richard Warburton wrote: > Hi, > > Thanks for the replies everyone. > > In Oracle, the tool that we use is called "jcov", it's proprietary > so I can't point you at anything. Maybe someday it could be > proposed to the Code Tool Projects but I have no knowledge of > specific plans on that. > > > If jcov produces HTML reports - would it be possible to have the > reports from your internal CI builds published? This would at least > improve the situation even in the absence of jcov being made available. > > I wonder if anyone has tried using EMMA or any of the other code > coverage tools out there? At least for the JDK releases in > development then one challenge would be keeping the tool up to the > date with the class file format, another would be taking care when > instrumenting very core classes that are used early in VM startup. > It's the same challenge that profiles and other tools that do > bytecode instrumentation have used on a JDK version that is still > in development. > > > I imagine with sufficient effort Jacoco could be made to work - though > I was hoping to avoid debugging Jacoco with Java 8. I'll have a look > into this. At work we've got a patch against Jacoco in order to merge > together the results from different sub module builds in maven, so > I'll see if its possible to use this this same approach in order to > make Jacoco work with merging separate files from different openjdk > VMs as Johnathan has suggested. > > regards, > > Richard Warburton > > http://insightfullogic.com > @RichardWarburto -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130518/e3028ec5/attachment.html From balchandra.vaidya at oracle.com Mon May 20 06:38:11 2013 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Mon, 20 May 2013 14:38:11 +0100 Subject: JDK 8 b90 ea build test results now available Message-ID: <519A2743.6010401@oracle.com> JDK 8 b90 ea build test results now available at : http://www.java.net/download/jdk8/testresults/testresults.html The jdk and langtools test results are identical to b89 jdk and langtools test results. The hotspot test results have eleven differences: 0: /home/jtest/merge/b89/hotspot/JTwork pass: 294; fail: 2; not run: 2 1: /home/jtest/merge/b90/hotspot/JTwork pass: 303; fail: 3; not run: 2 0 1 Test --- pass gc/concurrentMarkSweep/CheckAllocateAndSystemGC.java --- pass gc/concurrentMarkSweep/SystemGCOnForegroundCollector.java --- pass gc/g1/TestRegionAlignment.java --- pass gc/g1/TestShrinkToOneRegion.java pass fail runtime/6925573/SortMethodsTest.java --- pass runtime/ClassUnload/KeepAliveClass.java --- pass runtime/ClassUnload/KeepAliveClassLoader.java --- pass runtime/ClassUnload/KeepAliveObject.java --- pass runtime/ClassUnload/KeepAliveSoftReference.java --- pass runtime/ClassUnload/UnloadTest.java --- pass runtime/NMT/ReleaseCommittedMemory.java 11 differences No new failures found in Nashorn test results. Nashorn test result for b90 is available at: http://download.java.net/jdk8/testresults/archives/b90/emailable-report.html Regards Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130520/a79266a2/attachment.html From ptisnovs at redhat.com Fri May 24 08:37:52 2013 From: ptisnovs at redhat.com (Pavel Tisnovsky) Date: Fri, 24 May 2013 11:37:52 -0400 (EDT) Subject: Code Coverage Message-ID: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> Hi Richard, FYI: we are running many form of tests against OpenJDK internally in Red Hat. ATM our focus is to improve especially Mauve tests to have better coverage of all Java SE API classes. I'm also measuring test code coverage using JaCoCo and my own JVM TI based tool which is able to check code coverage on basic classes (where JaCoCo can't be used). All results are generated in HTML form + some graphs etc. etc. It would be perfect to have one (public) place to publish those results, so it would be nice to cooperate on this topic if you want to :) Cheers, Pavel Tisnovsky Red Hat From martijnverburg at gmail.com Fri May 24 09:23:04 2013 From: martijnverburg at gmail.com (Martijn Verburg) Date: Fri, 24 May 2013 17:23:04 +0100 Subject: Code Coverage In-Reply-To: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> References: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> Message-ID: Hi Pavel, That would be fantastic. The place we're combining all the workflow for submitting patches to OpenJDK is the Betterrev project --> https://bitbucket.org/adoptopenjdk/betterrev. Also see adoptopenjdk.java.net for the mailing list and IRC details. Cheers, Martijn On 24 May 2013 16:37, Pavel Tisnovsky wrote: > Hi Richard, > > FYI: we are running many form of tests against OpenJDK internally in Red > Hat. > ATM our focus is to improve especially Mauve tests to have better coverage > of all Java SE API classes. > I'm also measuring test code coverage using JaCoCo and my own JVM TI based > tool which is > able to check code coverage on basic classes (where JaCoCo can't be used). > All results > are generated in HTML form + some graphs etc. etc. > > It would be perfect to have one (public) place to publish those results, > so it would be nice to cooperate on this topic if you want to :) > > Cheers, > Pavel Tisnovsky > Red Hat > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130524/b5eff119/attachment.html From balchandra.vaidya at oracle.com Mon May 27 10:24:52 2013 From: balchandra.vaidya at oracle.com (Balchandra Vaidya) Date: Mon, 27 May 2013 18:24:52 +0100 Subject: JDK 8 b91 ea build test results now available Message-ID: <51A396E4.2090600@oracle.com> JDK 8 b91 ea build test results now available at: http://www.java.net/download/jdk8/testresults/testresults.html The jdk test result has 143 differences compared to b90 test result, and the differences are due to increase in test case numbers: 0: /home/jtest/merge/b90/jdk/JTwork pass: 4,256; fail: 12; not run: 806 1: /home/jtest/merge/b91/jdk/JTwork pass: 4,381; fail: 12; not run: 804 0 1 Test --- pass com/sun/security/sasl/digest/AuthRealmChoices.java --- pass java/io/BufferedReader/Lines.java --- pass java/io/File/NulFile.java --- pass java/lang/Runtime/exec/ExecCommand.java --- pass java/lang/StringBuffer/ToStringCache.java pass --- java/lang/Thread/StackTraces.java --- pass java/lang/management/MemoryMXBean/ResetPeakMemoryUsage.java --- pass java/net/HttpURLPermission/HttpURLPermissionTest.java --- pass java/net/HttpURLPermission/URLTest.java pass --- java/net/ResponseCache/B6181108.java --- pass java/nio/file/Files/NameLimits.java --- pass java/sql/JavatimeTest.java pass --- java/time/tck/java/time/format/TCKDateTimeFormatSymbols.java --- pass java/time/tck/java/time/format/TCKDecimalStyle.java --- pass java/time/tck/java/time/format/TCKInstantPrinterParser.java --- pass java/time/test/java/time/chrono/TestJapaneseChronology.java pass --- java/time/test/java/time/format/TestDateTimeFormatSymbols.java --- pass java/time/test/java/time/format/TestDecimalStyle.java --- pass java/util/BitSet/BitSetStreamTest.java --- pass java/util/Iterator/IteratorDefaults.java --- pass java/util/Random/RandomStreamTest.java --- pass java/util/concurrent/atomic/AtomicReferenceTest.java --- pass java/util/stream/boottest/java/util/stream/DoubleNodeTest.java --- pass java/util/stream/boottest/java/util/stream/FlagOpTest.java --- pass java/util/stream/boottest/java/util/stream/IntNodeTest.java --- pass java/util/stream/boottest/java/util/stream/LongNodeTest.java --- pass java/util/stream/boottest/java/util/stream/NodeBuilderTest.java --- pass java/util/stream/boottest/java/util/stream/NodeTest.java --- pass java/util/stream/boottest/java/util/stream/SpinedBufferTest.java --- pass java/util/stream/boottest/java/util/stream/StreamFlagsTest.java --- pass java/util/stream/boottest/java/util/stream/StreamOpFlagsTest.java --- pass java/util/stream/boottest/java/util/stream/StreamReuseTest.java --- pass java/util/stream/boottest/java/util/stream/UnorderedTest.java --- pass java/util/stream/test/org/openjdk/tests/java/lang/invoke/DeserializeMethodTest.java --- pass java/util/stream/test/org/openjdk/tests/java/lang/invoke/MHProxiesTest.java --- pass java/util/stream/test/org/openjdk/tests/java/lang/invoke/SerializedLambdaTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/FillableStringTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/MapTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/NullArgsTestCase.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/CollectionAndMapModifyStreamTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/DistinctOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/DoublePrimitiveOpsTests.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/ExplodeOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/FilterOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/FindAnyOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/FindFirstOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/ForEachOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/GroupByOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/InfiniteStreamWithLimitOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/IntPrimitiveOpsTests.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/IntReduceTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/IntSliceOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/IntUniqOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/LongPrimitiveOpsTests.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/MapOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/MatchOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/MinMaxTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/PrimitiveAverageOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/PrimitiveSumTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/ReduceByOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/ReduceTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SequentialOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SliceOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SortedOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorLateBindingFailFastTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SpliteratorTraversingAndSplittingTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/StreamBuilderTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/StreamLinkTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/StreamParSeqTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/StreamSpliteratorTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/SummaryStatisticsTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/TabulatorsTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/TeeOpTest.java --- pass java/util/stream/test/org/openjdk/tests/java/util/stream/ToArrayOpTest.java --- pass java/util/zip/GZIP/GZIPInZip.java --- pass java/util/zip/ZipFile/StreamZipEntriesTest.java --- pass javax/imageio/plugins/gif/GIFPassListenerTest.java --- pass javax/xml/jaxp/Encodings/CheckEncodingPropertiesFile.java --- pass javax/xml/jaxp/PrecisionDecimalDV/XPrecisionDecimalToString.java --- pass jdk/asm/AsmSanity.java --- pass jdk/lambda/ArrayCtorRefTest.java --- pass jdk/lambda/FDTest.java --- pass jdk/lambda/LambdaTranslationCompoundSamTest.java --- pass jdk/lambda/LambdaTranslationInInterface.java --- pass jdk/lambda/LambdaTranslationInnerConstructor.java --- pass jdk/lambda/LambdaTranslationTest1.java --- pass jdk/lambda/LambdaTranslationTest2.java --- pass jdk/lambda/MethodReferenceTestFDCCE.java --- pass jdk/lambda/MethodReferenceTestInnerDefault.java --- pass jdk/lambda/MethodReferenceTestInnerInstance.java --- pass jdk/lambda/MethodReferenceTestInnerVarArgsThis.java --- pass jdk/lambda/MethodReferenceTestInstance.java --- pass jdk/lambda/MethodReferenceTestInstanceMethod.java --- pass jdk/lambda/MethodReferenceTestKinds.java --- pass jdk/lambda/MethodReferenceTestNew.java --- pass jdk/lambda/MethodReferenceTestNewInner.java --- pass jdk/lambda/MethodReferenceTestSueCase1.java --- pass jdk/lambda/MethodReferenceTestSueCase2.java --- pass jdk/lambda/MethodReferenceTestSueCase4.java --- pass jdk/lambda/MethodReferenceTestSuper.java --- pass jdk/lambda/MethodReferenceTestSuperDefault.java --- pass jdk/lambda/MethodReferenceTestTypeConversion.java --- pass jdk/lambda/MethodReferenceTestVarArgs.java --- pass jdk/lambda/MethodReferenceTestVarArgsExt.java --- pass jdk/lambda/MethodReferenceTestVarArgsSuper.java --- pass jdk/lambda/MethodReferenceTestVarArgsSuperDefault.java --- pass jdk/lambda/MethodReferenceTestVarArgsThis.java --- pass jdk/lambda/TestInnerCtorRef.java --- pass jdk/lambda/TestPrivateCtorRef.java --- pass jdk/lambda/separate/AttributeInjector.java --- pass jdk/lambda/separate/ClassFile.java --- pass jdk/lambda/separate/ClassFilePreprocessor.java --- pass jdk/lambda/separate/ClassToInterfaceConverter.java --- pass jdk/lambda/separate/Compiler.java --- pass jdk/lambda/separate/DirectedClassLoader.java --- pass jdk/lambda/separate/SourceModel.java --- pass jdk/lambda/separate/TestHarness.java --- pass jdk/lambda/shapegen/ClassCase.java --- pass jdk/lambda/shapegen/Hierarchy.java --- pass jdk/lambda/shapegen/HierarchyGenerator.java --- pass jdk/lambda/shapegen/Rule.java --- pass jdk/lambda/shapegen/RuleGroup.java --- pass jdk/lambda/shapegen/TTNode.java --- pass jdk/lambda/shapegen/TTParser.java --- pass jdk/lambda/shapegen/TTShape.java --- pass jdk/lambda/vm/DefaultMethodRegressionTests.java --- pass jdk/lambda/vm/DefaultMethodsTest.java --- pass jdk/lambda/vm/InterfaceAccessFlagsTest.java --- pass jdk/lambda/vm/StrictfpDefault.java --- pass sun/misc/JavaLangAccess/NewUnsafeString.java pass --- sun/misc/URLClassPath/ClassnameCharTest.java pass --- sun/net/www/http/HttpClient/ProxyTest.java --- pass sun/net/www/protocol/http/B8012625.java --- pass sun/reflect/CallerSensitive/CallerSensitiveFinder.java --- pass sun/reflect/CallerSensitive/MissingCallerSensitive.java --- pass sun/reflect/Reflection/GetCallerClassTest.sh pass --- sun/security/provider/certpath/X509CertPath/ForwardBuildCompromised.java pass --- sun/security/provider/certpath/X509CertPath/ReverseBuildCompromised.java pass --- sun/security/provider/certpath/X509CertPath/ValidateCompromised.java --- pass tools/pack200/BandIntegrity.java --- pass tools/pack200/typeannos/TestTypeAnnotations.java 143 differences The hotspot test result has 17 differences: 0: /home/jtest/merge/b90/hotspot/JTwork pass: 303; fail: 3; not run: 2 1: /home/jtest/merge/b91/hotspot/JTwork pass: 317; fail: 3; error: 2; not run: 2 0 1 Test --- pass compiler/6934604/TestByteBoxing.java --- pass compiler/6934604/TestDoubleBoxing.java --- pass compiler/6934604/TestFloatBoxing.java --- pass compiler/6934604/TestIntBoxing.java --- pass compiler/6934604/TestLongBoxing.java --- pass compiler/6934604/TestShortBoxing.java --- pass gc/arguments/TestCMSHeapSizeFlags.java --- pass gc/arguments/TestG1HeapSizeFlags.java --- pass gc/arguments/TestInitialTenuringThreshold.java --- pass gc/arguments/TestMinInitialErgonomics.java --- pass gc/arguments/TestParallelHeapSizeFlags.java --- pass gc/arguments/TestSerialHeapSizeFlags.java --- fail gc/g1/TestPrintGCDetails.java --- error gc/g1/TestPrintRegionRememberedSetInfo.java fail pass runtime/6925573/SortMethodsTest.java --- error runtime/RedefineObject/TestRedefineObject.java --- pass runtime/SharedArchiveFile/SharedArchiveFile.java 17 differences The langtool test result has 38 differences: 0: /home/jtest/merge/b90/langtools/JTwork pass: 2,731; not run: 16 1: /home/jtest/merge/b91/langtools/JTwork pass: 2,765; not run: 19 0 1 Test --- pass com/sun/javadoc/InheritDocForUserTags/DocTest.java --- pass com/sun/javadoc/testIndentation/TestIndentation.java --- pass com/sun/javadoc/testLiteralCodeInPre/TestLiteralCodeInPre.java --- pass com/sun/javadoc/testSimpleTagInherit/TestSimpleTagInherit.java --- pass com/sun/javadoc/typeAnnotations/smoke/TestSmoke.java --- pass tools/javac/Diagnostics/compressed/T8012003a.java --- pass tools/javac/Diagnostics/compressed/T8012003b.java --- pass tools/javac/Diagnostics/compressed/T8012003c.java --- pass tools/javac/annotations/clinit/AnnoWithClinit1.java --- pass tools/javac/annotations/clinit/AnnoWithClinitFail.java --- pass tools/javac/annotations/typeAnnotations/classfile/CombinationsTargetTest1.java --- pass tools/javac/annotations/typeAnnotations/classfile/CombinationsTargetTest2.java --- pass tools/javac/annotations/typeAnnotations/classfile/CombinationsTargetTest3.java --- pass tools/javac/annotations/typeAnnotations/classfile/T8008769.java --- pass tools/javac/annotations/typeAnnotations/classfile/T8010015.java --- pass tools/javac/annotations/typeAnnotations/classfile/TestNewCastArray.java --- pass tools/javac/annotations/typeAnnotations/failures/T8008751.java --- pass tools/javac/annotations/typeAnnotations/failures/T8009360.java --- pass tools/javac/annotations/typeAnnotations/failures/T8011722.java --- pass tools/javac/annotations/typeAnnotations/failures/common/arrays/DeclarationAnnotation.java --- pass tools/javac/annotations/typeAnnotations/failures/common/receiver/DeclarationAnnotation.java --- pass tools/javac/annotations/typeAnnotations/failures/common/wildcards/DeclarationAnnotation.java --- pass tools/javac/annotations/typeAnnotations/newlocations/AnonymousClass.java --- pass tools/javac/annotations/typeAnnotations/newlocations/MultiCatch.java --- pass tools/javac/annotations/typeAnnotations/referenceinfos/Initializers.java --- pass tools/javac/annotations/typeAnnotations/referenceinfos/MultiCatch.java --- pass tools/javac/api/TestGetElementReference.java --- pass tools/javac/doctree/DocTreePathScannerTest.java --- pass tools/javac/lambda/LambdaInterfaceStaticField.java --- pass tools/javac/lambda/LambdaWithInterfaceSuper.java pass --- tools/javac/lambda/MethodReference66.java --- pass tools/javac/lambda/MethodReference67.java --- pass tools/javac/lambda/NoWarnOnImplicitParams.java pass --- tools/javac/lambda/lambdaExecution/InInterface.java --- pass tools/javac/lambda/methodReference/TreeMakerParamsIsGoofy.java --- pass tools/javac/multicatch/Pos11.java --- pass tools/javac/multicatch/Pos12.java --- pass tools/javac/processing/model/type/BasicAnnoTests.java 38 differences No new failures found in Nashorn test results. Nashorn test result for b91 is available at: http://download.java.net/jdk8/testresults/archives/b91/emailable-report.html Regards Balchandra -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130527/647a874a/attachment-0001.html From ptisnovs at redhat.com Tue May 28 05:55:03 2013 From: ptisnovs at redhat.com (Pavel Tisnovsky) Date: Tue, 28 May 2013 08:55:03 -0400 (EDT) Subject: Code Coverage In-Reply-To: References: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> Message-ID: <492387889.7349281.1369745703593.JavaMail.root@redhat.com> ----- Martijn Verburg wrote: > Hi Pavel, > > That would be fantastic. The place we're combining all the workflow for > submitting patches to OpenJDK is the Betterrev project --> > https://bitbucket.org/adoptopenjdk/betterrev. Also see > adoptopenjdk.java.net for the mailing list and IRC details. > Hi Martijn, thank you very much for the info mentioned above. What should I do to present Mauve code coverage results somewhere publicly available? Cheers, Pavel > Cheers, > Martijn > > > On 24 May 2013 16:37, Pavel Tisnovsky wrote: > > > Hi Richard, > > > > FYI: we are running many form of tests against OpenJDK internally in Red > > Hat. > > ATM our focus is to improve especially Mauve tests to have better coverage > > of all Java SE API classes. > > I'm also measuring test code coverage using JaCoCo and my own JVM TI based > > tool which is > > able to check code coverage on basic classes (where JaCoCo can't be used). > > All results > > are generated in HTML form + some graphs etc. etc. > > > > It would be perfect to have one (public) place to publish those results, > > so it would be nice to cooperate on this topic if you want to :) > > > > Cheers, > > Pavel Tisnovsky > > Red Hat > > From martijnverburg at gmail.com Tue May 28 10:29:49 2013 From: martijnverburg at gmail.com (Martijn Verburg) Date: Tue, 28 May 2013 18:29:49 +0100 Subject: Code Coverage In-Reply-To: <492387889.7349281.1369745703593.JavaMail.root@redhat.com> References: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> <492387889.7349281.1369745703593.JavaMail.root@redhat.com> Message-ID: Hi Pavel, As part of Betterrev we'll be providing some public hosting, we're still a few weeks from going live, but it shouldn't be too far away. We could then provide a place to host these results on that server. Cheers, Martijn On 28 May 2013 13:55, Pavel Tisnovsky wrote: > > ----- Martijn Verburg wrote: > > Hi Pavel, > > > > That would be fantastic. The place we're combining all the workflow for > > submitting patches to OpenJDK is the Betterrev project --> > > https://bitbucket.org/adoptopenjdk/betterrev. Also see > > adoptopenjdk.java.net for the mailing list and IRC details. > > > > Hi Martijn, > > thank you very much for the info mentioned above. > What should I do to present Mauve code coverage results somewhere publicly > available? > > Cheers, > Pavel > > > Cheers, > > Martijn > > > > > > On 24 May 2013 16:37, Pavel Tisnovsky wrote: > > > > > Hi Richard, > > > > > > FYI: we are running many form of tests against OpenJDK internally in > Red > > > Hat. > > > ATM our focus is to improve especially Mauve tests to have better > coverage > > > of all Java SE API classes. > > > I'm also measuring test code coverage using JaCoCo and my own JVM TI > based > > > tool which is > > > able to check code coverage on basic classes (where JaCoCo can't be > used). > > > All results > > > are generated in HTML form + some graphs etc. etc. > > > > > > It would be perfect to have one (public) place to publish those > results, > > > so it would be nice to cooperate on this topic if you want to :) > > > > > > Cheers, > > > Pavel Tisnovsky > > > Red Hat > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130528/7e4a78d3/attachment.html From spoole at linux.vnet.ibm.com Tue May 28 15:28:20 2013 From: spoole at linux.vnet.ibm.com (Steve Poole) Date: Tue, 28 May 2013 23:28:20 +0100 Subject: Code Coverage In-Reply-To: References: <1781937830.6043728.1369409872500.JavaMail.root@redhat.com> <492387889.7349281.1369745703593.JavaMail.root@redhat.com> Message-ID: <1C91515E-B577-477D-8FC9-D1F4F6C7F382@linux.vnet.ibm.com> hi Pavel - this is great news. There are many people who are interested in the results of this sort of analysis so it would be very good if you could publish your first set of data as soon as possible - even if its a "one-off download the zip" style process. On 28 May 2013, at 18:29, Martijn Verburg wrote: > Hi Pavel, > > As part of Betterrev we'll be providing some public hosting, we're still a few weeks from going live, but it shouldn't be too far away. We could then provide a place to host these results on that server. > > Cheers, > Martijn > > > On 28 May 2013 13:55, Pavel Tisnovsky wrote: > > ----- Martijn Verburg wrote: > > Hi Pavel, > > > > That would be fantastic. The place we're combining all the workflow for > > submitting patches to OpenJDK is the Betterrev project --> > > https://bitbucket.org/adoptopenjdk/betterrev. Also see > > adoptopenjdk.java.net for the mailing list and IRC details. > > > > Hi Martijn, > > thank you very much for the info mentioned above. > What should I do to present Mauve code coverage results somewhere publicly > available? > > Cheers, > Pavel > > > Cheers, > > Martijn > > > > > > On 24 May 2013 16:37, Pavel Tisnovsky wrote: > > > > > Hi Richard, > > > > > > FYI: we are running many form of tests against OpenJDK internally in Red > > > Hat. > > > ATM our focus is to improve especially Mauve tests to have better coverage > > > of all Java SE API classes. > > > I'm also measuring test code coverage using JaCoCo and my own JVM TI based > > > tool which is > > > able to check code coverage on basic classes (where JaCoCo can't be used). > > > All results > > > are generated in HTML form + some graphs etc. etc. > > > > > > It would be perfect to have one (public) place to publish those results, > > > so it would be nice to cooperate on this topic if you want to :) > > > > > > Cheers, > > > Pavel Tisnovsky > > > Red Hat > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130528/19bc400b/attachment.html