RFR(M): 7197327: 40% regression on 8 b41 comp 8 b40 on specjvm2008.mpegaudio on oob

Vladimir Kozlov vladimir.kozlov at oracle.com
Mon Feb 11 08:58:08 PST 2013


Thank you, Roland

I think you can push changes.

Can you reproduce jvm2008 mpegaudio 80% when run only it?

Thanks,
Vladimir

On 2/11/13 8:14 AM, Roland Westrelin wrote:
>> I'll send the refworkload numbers when I have them.
>
> Here they are.
>
> Roland.
>
> tserver-base: reference_server
>    Benchmark         Samples        Mean     Stdev
>    jetstream              10       78.35      0.02
>      Copy                 10     1199.40      0.11
>      Parse                10       41.40      0.02
>      Read                 10       15.80      0.04
>      Write                10      341.10      0.06
>    scimark                10      459.17      0.01
>      Sparse               10      221.56      0.02
>      LU                   10      698.92      0.02
>      SOR                  10      762.50      0.00
>      FFT                  10       32.41      0.00
>      Monte                10      580.48      0.01
>    specjbb2000            10   394215.13      0.01
>      First_Warehouse      10    60579.87      0.01
>      Last_Warehouse       10   394215.12      0.01
>    specjbb2005            10   212518.83      0.02
>      peak                 10   221111.20      0.02
>      peak_warehouse       10        5.00      0.33
>      last                 10   212518.82      0.02
>      interval_average     10    12501.00      0.02
>      first                10    31740.30      0.00
>      overall_average      10   175630.19      0.01
>      last_warehouse       10        8.00      0.00
>    specjvm98              10      592.36      0.01
>      javac                10      427.46      0.01
>      db                   10      416.82      0.04
>      jess                 10      700.88      0.09
>      jack                 10      500.81      0.01
>      compress             10      500.22      0.00
>      mtrt                 10      973.70      0.16
>      mpegaudio            10      852.99      0.00
>    volano25               10   161404.00      0.01
>      connections          10      400.00      0.00
>      time                 10        4.96      0.01
>    --------------------------------------------------------------------------
>    Weighted Geomean             16496.09
> ============================================================================
> tserver-optim: reference_server
>    Benchmark         Samples        Mean     Stdev   %Diff    P   Significant
>    jetstream              10       85.16      0.01    8.69 0.000          Yes
>      Copy                 10      927.70      0.04   22.65 0.000          Yes
>      Parse                10       41.60      0.02   -0.48 0.628            *
>      Read                 10       15.80      0.04   -0.00 1.000            *
>      Write                10      312.50      0.02    8.38 0.001          Yes
>    scimark                10      456.80      0.01   -0.52 0.116            *
>      Sparse               10      219.26      0.02   -1.04 0.250            *
>      LU                   10      694.58      0.03   -0.62 0.566            *
>      SOR                  10      762.05      0.00   -0.06 0.225            *
>      FFT                  10       32.43      0.00    0.06 0.399            *
>      Monte                10      575.70      0.02   -0.82 0.226            *
>    specjbb2000            10   391142.03      0.01   -0.78 0.168            *
>      First_Warehouse      10    60763.27      0.01    0.30 0.422            *
>      Last_Warehouse       10   391142.03      0.01   -0.78 0.168            *
>    specjbb2005            10   212063.28      0.03   -0.21 0.845            *
>      peak                 10   218643.15      0.01   -1.12 0.080            *
>      peak_warehouse       10        4.80      0.35    4.00 0.791            *
>      last                 10   212063.28      0.03   -0.21 0.845            *
>      interval_average     10    12474.30      0.03   -0.21 0.846            *
>      first                10    31639.17      0.00   -0.32 0.129            *
>      overall_average      10   174238.53      0.01   -0.79 0.019            *
>      last_warehouse       10        8.00      0.00   -0.00 0.000            *
>    specjvm98              10      595.23      0.02    0.48 0.505            *
>      javac                10      426.63      0.00   -0.19 0.502            *
>      db                   10      415.02      0.04   -0.43 0.801            *
>      jess                 10      701.05      0.09    0.02 0.995            *
>      jack                 10      496.22      0.01   -0.92 0.039            *
>      compress             10      498.61      0.01   -0.32 0.196            *
>      mtrt                 10     1029.01      0.20    5.68 0.509            *
>      mpegaudio            10      855.53      0.01    0.30 0.266            *
>    volano25               10   162667.70      0.01    0.78 0.149            *
>      connections          10      400.00      0.00    0.00 0.000            *
>      time                 10        4.92      0.01    0.78 0.149            *
>    --------------------------------------------------------------------------
>    Weighted Geomean             16630.75              0.82
> ============================================================================
>
> ============================================================================
> tjvm2008-base
>    Benchmark         Samples        Mean     Stdev
>    specjvm2008            10      168.55      0.01
>      startup.crypto.signverify 10       43.02      0.03
>      startup.xml.transform 10        2.21      0.07
>      startup.compress     10       27.26      0.00
>      scimark.sparse.large 10       10.72      0.03
>      xml                  10      606.91      0.01
>      scimark.sparse.small 10      268.67      0.00
>      scimark.lu.small     10      464.54      0.00
>      scimark.sor.large    10       24.32      0.00
>      derby                10      331.63      0.03
>      startup.scimark.fft  10       42.94      0.01
>      startup.sunflow      10       15.42      0.02
>      startup.compiler.sunflow 10        7.20      0.00
>      crypto               10      339.48      0.01
>      startup.scimark.monte_carlo 10       22.47      0.01
>      startup              10       19.35      0.01
>      crypto.aes           10      113.78      0.01
>      scimark.lu.large     10        4.45      0.04
>      serial               10      171.39      0.05
>      startup.serial       10       12.18      0.01
>      scimark.small        10      386.53      0.02
>      startup.scimark.sor  10       35.58      0.00
>      startup.scimark.lu   10       38.21      0.00
>      compress             10      289.09      0.00
>      xml.validation       10      762.40      0.02
>      scimark.fft.small    10      516.50      0.04
>      startup.crypto.rsa   10       40.31      0.07
>      startup.compiler.compiler 10        3.57      0.02
>      mpegaudio            10      112.77      0.01
>      startup.crypto.aes   10       11.96      0.02
>      scimark.monte_carlo  10      369.16      0.07
>      crypto.rsa           10      489.22      0.00
>      scimark.fft.large    10       12.52      0.06
>      compiler.compiler    10      672.82      0.01
>      startup.scimark.sparse 10       23.79      0.14
>      startup.helloworld   10      191.11      0.03
>      compiler             10      453.06      0.00
>      sunflow              10      108.98      0.01
>      startup.mpegaudio    10       11.93      0.01
>      crypto.signverify    10      702.91      0.00
>      startup.xml.validation 10       17.73      0.01
>      xml.transform        10      483.16      0.01
>      scimark.large        10       22.16      0.02
>      compiler.sunflow     10      305.08      0.00
>      scimark.sor.small    10      363.56      0.00
> ============================================================================
> tjvm2008-optim
>    Benchmark         Samples        Mean     Stdev   %Diff    P   Significant
>    specjvm2008            10      177.79      0.01    5.48 0.000          Yes
>      startup.crypto.signverify 10       40.90      0.09   -4.94 0.126            *
>      startup.xml.transform 10        2.22      0.05    0.36 0.893            *
>      startup.compress     10       27.01      0.03   -0.92 0.305            *
>      scimark.sparse.large 10       10.74      0.05    0.14 0.937            *
>      xml                  10      606.35      0.01   -0.09 0.864            *
>      scimark.sparse.small 10      268.56      0.00   -0.04 0.830            *
>      scimark.lu.small     10      466.15      0.00    0.35 0.093            *
>      scimark.sor.large    10       24.33      0.00    0.04 0.375            *
>      derby                10      329.01      0.04   -0.79 0.613            *
>      startup.scimark.fft  10       42.52      0.02   -0.97 0.225            *
>      startup.sunflow      10       15.18      0.06   -1.59 0.420            *
>      startup.compiler.sunflow 10        7.11      0.02   -1.29 0.072            *
>      crypto               10      339.74      0.00    0.08 0.717            *
>      startup.scimark.monte_carlo 10       22.42      0.01   -0.26 0.558            *
>      startup              10       19.67      0.03    1.62 0.165            *
>      crypto.aes           10      114.00      0.01    0.20 0.734            *
>      scimark.lu.large     10        4.34      0.06   -2.58 0.242            *
>      serial               10      170.91      0.07   -0.28 0.917            *
>      startup.serial       10       12.03      0.02   -1.22 0.125            *
>      scimark.small        10      386.71      0.02    0.05 0.947            *
>      startup.scimark.sor  10       35.45      0.01   -0.36 0.284            *
>      startup.scimark.lu   10       37.74      0.03   -1.26 0.281            *
>      compress             10      289.23      0.00    0.05 0.793            *
>      xml.validation       10      761.03      0.02   -0.18 0.853            *
>      scimark.fft.small    10      519.18      0.04    0.52 0.784            *
>      startup.crypto.rsa   10       39.73      0.06   -1.42 0.630            *
>      startup.compiler.compiler 10        3.55      0.03   -0.56 0.609            *
>      mpegaudio            10      203.26      0.01   80.24 0.000          Yes
>      startup.crypto.aes   10       11.93      0.05   -0.23 0.901            *
>      scimark.monte_carlo  10      367.35      0.08   -0.49 0.887            *
>      crypto.rsa           10      488.76      0.00   -0.09 0.483            *
>      scimark.fft.large    10       12.54      0.04    0.09 0.969            *
>      compiler.compiler    10      673.01      0.01    0.03 0.930            *
>      startup.scimark.sparse 10       24.00      0.12    0.88 0.882            *
>      startup.helloworld   10      185.84      0.07   -2.76 0.277            *
>      compiler             10      452.21      0.00   -0.19 0.351            *
>      sunflow              10      109.13      0.01    0.14 0.701            *
>      startup.mpegaudio    10       18.79      0.03   57.58 0.000          Yes
>      crypto.signverify    10      703.80      0.00    0.13 0.448            *
>      startup.xml.validation 10       17.44      0.05   -1.61 0.294            *
>      xml.transform        10      483.18      0.01    0.00 0.990            *
>      scimark.large        10       22.03      0.02   -0.60 0.563            *
>      compiler.sunflow     10      303.85      0.00   -0.40 0.008          Yes
>      scimark.sor.small    10      363.37      0.00   -0.05 0.172            *
> ============================================================================
>
>


More information about the hotspot-compiler-dev mailing list