[fyi] [icedtea-web] new code coverage direction - jacoco

[Jiri Vanek]

On 11/29/2012 09:40 AM, Jiri Vanek wrote:
> On 11/28/2012 06:17 PM, Jiri Vanek wrote:
>> On 11/27/2012 06:36 PM, Jiri Vanek wrote:
>>> hi all!
>>>
>>> Last few days I was hidding behind new codecoverage for icedtea-web. It have appeared to be more
>>> tricky then I thought:
>>>
>>> * Support for jdk7 on field of coverage tool is desperate - the only tool which support it and is
>>> alive (actually I really think it is the only one right now) is JACOCO.
>>> * jacoco packages in fedora are broken - I have fixed them and post patch to its maintainer
>>> * jacoco itself do not support coverage of boot-classapth, I have fixed this too, and I hope I will
>>> be able to upstream this patch - quite simple patch but it will need some more tuning (xboot.patch)
>>> [as I do not see to alll corners of this amazing tool]
>>> * jacoco although having excellent API, have no commandline tool for report generation and for
>>> merging of results. I have wrote my own (simple one, jacoco-tool.diff) and I hope I will be able to
>>> upstream it to rather then fill icedtea-web with it.
>>>
>>> So do not use this patch for now - it uses custom packages upon custom sources with custom
>>> dependences (Asm4 instead of asm3) :), but if all the fixes will go upstream then the results are
>>> amazing!
>>>
>>> The integration of patched package with patched sources is then quite simple and same as emma was.
>>> Coverage of unit tests, coverage of individual reproducers run, then merged all reproducers together
>>> and at the end merged all reproducers and unit test's results.
>>> On each sub-step xml and html report is generated.
>>>
>>> Good new is that it will be easy to cover also plugin [work in progress]
>>>
>>> Best regards
>>>    J.
>>>
>>>
>>> ps: with litlle bit more tweaking on xbooth.patch I was able to create coverage report for most
>>> rt.jar  itself  on openjdk build:)
>>>
>> hmm.. sun.reflect.* must be excluded on jdk7 too...
>>
>
> Here is the example of yesterdays run:
> http://10.34.2.200/icedtea-web-dailyreport/jacocoPreview/
>
> not bad comapring to latrest emma run:
> http://10.34.2.200/icedtea-web-dailyreport/ICWDR_1343375169/tests.build/coverage/index.html
>
> :)

Here is final version of my patch. Althoug my suggested changes are moving forward, untill it reach 
packages can take an ages, so  would like to push it if there will be good soul to review it. I will 
attach the results of latest unit+javaws+plugin tests.

I will track the jacoco changes and modify this patch how needed.


J.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: all+plugin+clean-integration.patch
Type: text/x-patch
Size: 19160 bytes
Desc: not available
Url : http://mail.openjdk.java.net/pipermail/distro-pkg-dev/attachments/20121205/9a79ff95/allpluginclean-integration.patch 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: all+plugin+clean-reportGenerator.patch
Type: text/x-patch
Size: 31756 bytes
Desc: not available
Url : http://mail.openjdk.java.net/pipermail/distro-pkg-dev/attachments/20121205/9a79ff95/allpluginclean-reportGenerator.patch 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: all+plugin+clean-pluginPatch.patch
Type: text/x-patch
Size: 1685 bytes
Desc: not available
Url : http://mail.openjdk.java.net/pipermail/distro-pkg-dev/attachments/20121205/9a79ff95/allpluginclean-pluginPatch.patch