Unable to run validation.jar benchmarks

Aleksey Shipilev aleksey.shipilev at oracle.com
Thu Dec 18 14:32:53 UTC 2014


Hi Matt,

On 12/18/2014 03:42 PM, Matt Warren wrote:
> This fix would have to be replicated in a few other places in
> MainValidation.java, as other tests also fail. But I don't know if this
> fits with what the code is supposed to be doing?

The jmh-core-benchmarks/validation.jar is one of those hidden
non-advertised gems, and we run it only occasionally. In this particular
case, the last time we have run the validation.jar was before the change
in benchmark matching policy.

You are right we may anchor the benchmark names to overcome this. Also,
the code is missing the reasonable benchmark defaults. Fixed both now:
 https://bugs.openjdk.java.net/browse/CODETOOLS-7901218

Thanks,
-Aleksey.




More information about the jmh-dev mailing list