Dropping outliner forks per benchmark

Aleksey Shipilev aleksey.shipilev at oracle.com
Mon May 30 17:19:13 UTC 2016


On 05/27/2016 10:35 PM, Roman Leventov wrote:
> In recent versions of Windows it became particularly hard to obtain
> reliable benchmark results, because Windows regularly runs some kind of
> jobs like indexing which last for about 5-10s and skew results of entire
> forks. It would useful to be able to drop serveral slowest forks per
> benchmark.

Well, we don't know if those "slowest forks" are indeed the run-to-run
variance we need to capture in the results, or those are the outliers we
really need to filter. Therefore, JMH should not and would not filter.

I would suggest to disable any process that can affect benchmarks on
your target machine. This is a general environment setup step anyhow.

Thanks,
-Aleksey




More information about the jmh-dev mailing list