Good benchmarks for testing GC performance/scalability

[Azeem Jiva]

Yeah SPECjEnterprise2010 is good for GC testing, but as you've found out 
setup is more complicated than other SPEC benchmarks.  I would recommend 
using SPECjbb2005 for now.

Azeem Jiva
@javawithjiva


On 06/12/2012 02:12 AM, Lokesh Gidra wrote:
> Thanks for the info. BTW, is SPECjEnterprise any good for this 
> purpose? What i could understand is that it needs multiple hosts for 
> testing. I want to GC performance on a single instance of jvm.
>
> Thanks
> Lokesh
>
> Azeem Jiva <azeem.jiva at oracle.com> wrote:
> Sorry, I wrote "slightly different ways", I meant to just say "different"
>
> Azeem Jiva
> @javawithjiva
>
> On 06/12/2012 01:47 AM, Azeem Jiva wrote:
>> Just an FYI, SPECjbb2012 is still under development.  Release date is 
>> later this year.  Even though both benchmarks are named "JBB" they 
>> are vastly different and are not comparable.  They both test business 
>> logic, albeit in slightly different ways.   SPECjbb2012 has an SLA 
>> requirement that SPECjbb2005 doesn't and the code for SPECjbb2012 is 
>> written from the ground up and shares nothing with SPECjbb2005.
>> Azeem Jiva
>> @javawithjiva
>>
>> On 06/12/2012 01:01 AM, Lokesh Gidra wrote:
>>> Actually i have tried SPECjvm2008 but even there benchmarks do not 
>>> have large heap requirements.
>>>
>>> Is it worth to make both SPECjbb2012 and SPECjbb2005 tests or the 
>>> former one covers the later?
>>>
>>> Thanks
>>> Lokesh
>>>
>>> Igor Veresov <iggy.veresov at gmail.com> wrote:
>>> If you have access to SPEC benchmarks,  SPECjbb2012 and SPECjvm2008 
>>> are worth trying too. They're all multithreaded and in many 
>>> instances would benefit from memory placement opts.
>>>
>>> igor
>>>
>>> On Jun 11, 2012, at 7:39 PM, Lokesh Gidra wrote:
>>>
>>>> Hello,
>>>>
>>>> I am making some NUMA related optimizations to the parallelScavenge 
>>>> GC. And I want to test the performance on NUMA multo-core server 
>>>> with some multi-threaded benchmarks with multi-GB heap 
>>>> requirements. I have tried DaCapo but its heap requirements are 
>>>> pretty small. I know of SPECjbb2055, but nothing other than that. 
>>>> Can someone please suggest me some benchmarks for this purpose.
>>>>
>>>> Thanks in advance.
>>>>
>>>> Lokesh
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.openjdk.org/pipermail/hotspot-gc-dev/attachments/20120612/b098217a/attachment.htm>