Raw data output

[Petr Stefan]

Hi,

you're right, but not for SampleTime mode of benchmarking. We could 
probably use SingleShot mode, but there are some issues with it. For 
example, SingleShot mode ignores "measurementTime" option, so you have 
to specify exact number of "measurementIterations" to get some data. The 
same holds for warmup phase, of course. So, in our opinion SampleTime 
mode is quite better. With proposed patch, it's easy to get that hidden 
data from Statistics (where they already are) without breaking any 
existing code. Then, we can extend the current JSON printer to serve 
these "real raw" data or add a new one as we propose in our second 
patch. We expect that you wouldn't like to change existing format, so we 
proposed a new one (but we provided 2 patches, to be flexible with both 
variants).

Cheers,

Petr Stefan


P.S.: I just found misplaced comma in some cases of new raw JSON 
printer. I'm sorry, but fixed version is attached. The other patch is 
correct and you already have it, so I'm not resending it.


Dne 22.6.2016 v 14:25 Jens Wilke napsal(a):
> Can you please double check. In my JSON results, raw data is included. Example:
>
>          "primaryMetric" : {
>              "score" : 2.6992631363634273E7,
>              "scoreError" : 3362666.9122555815,
>              "scoreConfidence" : [
>                  2.3629964451378692E7,
>                  3.0355298275889855E7
>              ],
>              "scorePercentiles" : {
>                  "0.0" : 2.549073134560909E7,
>                  "50.0" : 2.751281317032709E7,
>                  "90.0" : 2.8017559168625783E7,
>                  "95.0" : 2.8017559168625783E7,
>                  "99.0" : 2.8017559168625783E7,
>                  "99.9" : 2.8017559168625783E7,
>                  "99.99" : 2.8017559168625783E7,
>                  "99.999" : 2.8017559168625783E7,
>                  "99.9999" : 2.8017559168625783E7,
>                  "100.0" : 2.8017559168625783E7
>              },
>              "scoreUnit" : "ops/s",
>              "rawData" : [
>                  [
>                      2.712889602844093E7,
>                      2.549073134560909E7,
>                      2.7912823329979304E7
>                  ],
>                  [
>                      2.789673031221325E7,
>                      2.5509047996937286E7,
>                      2.8017559168625783E7
>                  ]
>              ]
>          },
>
> Using JMH version 1.11.3.
>
> Cheers,
>
> Jens
>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: New_formatter_for_raw_data_output_fix.patch
Type: text/x-patch
Size: 18634 bytes
Desc: not available
URL: <http://mail.openjdk.java.net/pipermail/jmh-dev/attachments/20160622/646e5171/New_formatter_for_raw_data_output_fix.patch>