how reliable JMH's results are

[Maurizio Cimadamore]

On 25/03/2019 23:54, Aleksey Shipilev wrote:
> I spy with my little eye the bimodal result: either it is 170 Kops/ms, or 164 Kops/ms. The "dips" in
> iteration performance is quite often a GC

I agree that smaller differences can often be down to GC - I've seen 
bimodal behavior as well. But note my other email, where we basically 
have one jump from 131417 to 216897 - that's seem a bit extreme in terms 
of bimodal (at least I have never encountered such a stark one); and 
follow up experiments have never been able to replicate the 131Kop/s 
rate, which to me suggests it's something else (most likely 
changes/improvements to the BSM code itself).

Maurizio