[meta] How to benchmark reliably?

[-]

Hi,
To ensure the Class-File API stays efficient, we often run benchmarks and
check its results. However, I frequently get perturbations in my results on
Windows: it seems that background applications or browsers can potentially
slow down Java benchmarks, making the results unreliable between branch
checkouts.

What's the environments on which you run benchmarks? I just wish to find
one that would be free from outside influences. Is WSL2 (building for
Linux) a good alternative, or is my best luck on some other rented
machines/dedicated CIs?

Chen Liang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.openjdk.org/pipermail/classfile-api-dev/attachments/20240212/5c9a1e41/attachment.htm>