Warmup Iterations

[Richard Warburton]

Hi,

>From brief experimentation JMH uses a fixed number of warmup iterations
which can be specified as a commandline parameter.  What would be
preferable from a user's perspective is continuing to run warmup iterations
until the times stabilise, or at least an option to do so. IMHO this is a
sensible default for running warmup iterations

Similarly for iterations, it would be nice if it were possible to run
enough iterations for some confidence interval of the claimed difference in
performance between the results.  Or perhaps just dumping out the P-value
or bayes number implied by the number of samples collected?

Perhaps there is already something along these lines and I've just missed
it, but I didn't see it in the documentation.

regards,

  Richard Warburton

  http://insightfullogic.com
  @RichardWarburto <http://twitter.com/richardwarburto>