[fyi] [icedtea-web] new code coverage direction - jacoco

[Jiri Vanek]

On 12/05/2012 04:47 PM, Jiri Vanek wrote:
> On 11/29/2012 09:40 AM, Jiri Vanek wrote:
>> On 11/28/2012 06:17 PM, Jiri Vanek wrote:
>>> On 11/27/2012 06:36 PM, Jiri Vanek wrote:
>>>> hi all!
>>>>
>>>> Last few days I was hidding behind new codecoverage for icedtea-web. It have appeared to be more
>>>> tricky then I thought:
>>>>
>>>> * Support for jdk7 on field of coverage tool is desperate - the only tool which support it and is
>>>> alive (actually I really think it is the only one right now) is JACOCO.
>>>> * jacoco packages in fedora are broken - I have fixed them and post patch to its maintainer
>>>> * jacoco itself do not support coverage of boot-classapth, I have fixed this too, and I hope I will
>>>> be able to upstream this patch - quite simple patch but it will need some more tuning (xboot.patch)
>>>> [as I do not see to alll corners of this amazing tool]
>>>> * jacoco although having excellent API, have no commandline tool for report generation and for
>>>> merging of results. I have wrote my own (simple one, jacoco-tool.diff) and I hope I will be able to
>>>> upstream it to rather then fill icedtea-web with it.
>>>>
>>>> So do not use this patch for now - it uses custom packages upon custom sources with custom
>>>> dependences (Asm4 instead of asm3) :), but if all the fixes will go upstream then the results are
>>>> amazing!
>>>>
>>>> The integration of patched package with patched sources is then quite simple and same as emma was.
>>>> Coverage of unit tests, coverage of individual reproducers run, then merged all reproducers
>>>> together
>>>> and at the end merged all reproducers and unit test's results.
>>>> On each sub-step xml and html report is generated.
>>>>
>>>> Good new is that it will be easy to cover also plugin [work in progress]
>>>>
>>>> Best regards
>>>>    J.
>>>>
>>>>
>>>> ps: with litlle bit more tweaking on xbooth.patch I was able to create coverage report for most
>>>> rt.jar  itself  on openjdk build:)
>>>>
>>> hmm.. sun.reflect.* must be excluded on jdk7 too...
>>>
>>
>> Here is the example of yesterdays run:
>> http://10.34.2.200/icedtea-web-dailyreport/jacocoPreview/
>>
>> not bad comapring to latrest emma run:
>> http://10.34.2.200/icedtea-web-dailyreport/ICWDR_1343375169/tests.build/coverage/index.html
>>
>> :)
>
> Here is final version of my patch. Althoug my suggested changes are moving forward, untill it reach
> packages can take an ages, so  would like to push it if there will be good soul to review it. I will
> attach the results of latest unit+javaws+plugin tests.
>
> I will track the jacoco changes and modify this patch how needed.
>
>
> J.
>
Here is updated promissedexample - http://10.34.2.200/icedtea-web-dailyreport/jacocoPreview/ . 
Worthy to walk through!
Due to recent Saad's patch the plugin patch will need to be updated, but the logic will remains same.

J.