RFR(M): 7197327: 40% regression on 8 b41 comp 8 b40 on specjvm2008.mpegaudio on oob

Roland Westrelin roland.westrelin at oracle.com
Mon Feb 11 08:14:44 PST 2013


> I'll send the refworkload numbers when I have them.

Here they are.

Roland.

tserver-base: reference_server
  Benchmark         Samples        Mean     Stdev
  jetstream              10       78.35      0.02
    Copy                 10     1199.40      0.11
    Parse                10       41.40      0.02
    Read                 10       15.80      0.04
    Write                10      341.10      0.06
  scimark                10      459.17      0.01
    Sparse               10      221.56      0.02
    LU                   10      698.92      0.02
    SOR                  10      762.50      0.00
    FFT                  10       32.41      0.00
    Monte                10      580.48      0.01
  specjbb2000            10   394215.13      0.01
    First_Warehouse      10    60579.87      0.01
    Last_Warehouse       10   394215.12      0.01
  specjbb2005            10   212518.83      0.02
    peak                 10   221111.20      0.02
    peak_warehouse       10        5.00      0.33
    last                 10   212518.82      0.02
    interval_average     10    12501.00      0.02
    first                10    31740.30      0.00
    overall_average      10   175630.19      0.01
    last_warehouse       10        8.00      0.00
  specjvm98              10      592.36      0.01
    javac                10      427.46      0.01
    db                   10      416.82      0.04
    jess                 10      700.88      0.09
    jack                 10      500.81      0.01
    compress             10      500.22      0.00
    mtrt                 10      973.70      0.16
    mpegaudio            10      852.99      0.00
  volano25               10   161404.00      0.01
    connections          10      400.00      0.00
    time                 10        4.96      0.01
  --------------------------------------------------------------------------
  Weighted Geomean             16496.09
============================================================================
tserver-optim: reference_server
  Benchmark         Samples        Mean     Stdev   %Diff    P   Significant
  jetstream              10       85.16      0.01    8.69 0.000          Yes
    Copy                 10      927.70      0.04   22.65 0.000          Yes
    Parse                10       41.60      0.02   -0.48 0.628            *
    Read                 10       15.80      0.04   -0.00 1.000            *
    Write                10      312.50      0.02    8.38 0.001          Yes
  scimark                10      456.80      0.01   -0.52 0.116            *
    Sparse               10      219.26      0.02   -1.04 0.250            *
    LU                   10      694.58      0.03   -0.62 0.566            *
    SOR                  10      762.05      0.00   -0.06 0.225            *
    FFT                  10       32.43      0.00    0.06 0.399            *
    Monte                10      575.70      0.02   -0.82 0.226            *
  specjbb2000            10   391142.03      0.01   -0.78 0.168            *
    First_Warehouse      10    60763.27      0.01    0.30 0.422            *
    Last_Warehouse       10   391142.03      0.01   -0.78 0.168            *
  specjbb2005            10   212063.28      0.03   -0.21 0.845            *
    peak                 10   218643.15      0.01   -1.12 0.080            *
    peak_warehouse       10        4.80      0.35    4.00 0.791            *
    last                 10   212063.28      0.03   -0.21 0.845            *
    interval_average     10    12474.30      0.03   -0.21 0.846            *
    first                10    31639.17      0.00   -0.32 0.129            *
    overall_average      10   174238.53      0.01   -0.79 0.019            *
    last_warehouse       10        8.00      0.00   -0.00 0.000            *
  specjvm98              10      595.23      0.02    0.48 0.505            *
    javac                10      426.63      0.00   -0.19 0.502            *
    db                   10      415.02      0.04   -0.43 0.801            *
    jess                 10      701.05      0.09    0.02 0.995            *
    jack                 10      496.22      0.01   -0.92 0.039            *
    compress             10      498.61      0.01   -0.32 0.196            *
    mtrt                 10     1029.01      0.20    5.68 0.509            *
    mpegaudio            10      855.53      0.01    0.30 0.266            *
  volano25               10   162667.70      0.01    0.78 0.149            *
    connections          10      400.00      0.00    0.00 0.000            *
    time                 10        4.92      0.01    0.78 0.149            *
  --------------------------------------------------------------------------
  Weighted Geomean             16630.75              0.82
============================================================================

============================================================================
tjvm2008-base
  Benchmark         Samples        Mean     Stdev
  specjvm2008            10      168.55      0.01
    startup.crypto.signverify 10       43.02      0.03
    startup.xml.transform 10        2.21      0.07
    startup.compress     10       27.26      0.00
    scimark.sparse.large 10       10.72      0.03
    xml                  10      606.91      0.01
    scimark.sparse.small 10      268.67      0.00
    scimark.lu.small     10      464.54      0.00
    scimark.sor.large    10       24.32      0.00
    derby                10      331.63      0.03
    startup.scimark.fft  10       42.94      0.01
    startup.sunflow      10       15.42      0.02
    startup.compiler.sunflow 10        7.20      0.00
    crypto               10      339.48      0.01
    startup.scimark.monte_carlo 10       22.47      0.01
    startup              10       19.35      0.01
    crypto.aes           10      113.78      0.01
    scimark.lu.large     10        4.45      0.04
    serial               10      171.39      0.05
    startup.serial       10       12.18      0.01
    scimark.small        10      386.53      0.02
    startup.scimark.sor  10       35.58      0.00
    startup.scimark.lu   10       38.21      0.00
    compress             10      289.09      0.00
    xml.validation       10      762.40      0.02
    scimark.fft.small    10      516.50      0.04
    startup.crypto.rsa   10       40.31      0.07
    startup.compiler.compiler 10        3.57      0.02
    mpegaudio            10      112.77      0.01
    startup.crypto.aes   10       11.96      0.02
    scimark.monte_carlo  10      369.16      0.07
    crypto.rsa           10      489.22      0.00
    scimark.fft.large    10       12.52      0.06
    compiler.compiler    10      672.82      0.01
    startup.scimark.sparse 10       23.79      0.14
    startup.helloworld   10      191.11      0.03
    compiler             10      453.06      0.00
    sunflow              10      108.98      0.01
    startup.mpegaudio    10       11.93      0.01
    crypto.signverify    10      702.91      0.00
    startup.xml.validation 10       17.73      0.01
    xml.transform        10      483.16      0.01
    scimark.large        10       22.16      0.02
    compiler.sunflow     10      305.08      0.00
    scimark.sor.small    10      363.56      0.00
============================================================================
tjvm2008-optim
  Benchmark         Samples        Mean     Stdev   %Diff    P   Significant
  specjvm2008            10      177.79      0.01    5.48 0.000          Yes
    startup.crypto.signverify 10       40.90      0.09   -4.94 0.126            *
    startup.xml.transform 10        2.22      0.05    0.36 0.893            *
    startup.compress     10       27.01      0.03   -0.92 0.305            *
    scimark.sparse.large 10       10.74      0.05    0.14 0.937            *
    xml                  10      606.35      0.01   -0.09 0.864            *
    scimark.sparse.small 10      268.56      0.00   -0.04 0.830            *
    scimark.lu.small     10      466.15      0.00    0.35 0.093            *
    scimark.sor.large    10       24.33      0.00    0.04 0.375            *
    derby                10      329.01      0.04   -0.79 0.613            *
    startup.scimark.fft  10       42.52      0.02   -0.97 0.225            *
    startup.sunflow      10       15.18      0.06   -1.59 0.420            *
    startup.compiler.sunflow 10        7.11      0.02   -1.29 0.072            *
    crypto               10      339.74      0.00    0.08 0.717            *
    startup.scimark.monte_carlo 10       22.42      0.01   -0.26 0.558            *
    startup              10       19.67      0.03    1.62 0.165            *
    crypto.aes           10      114.00      0.01    0.20 0.734            *
    scimark.lu.large     10        4.34      0.06   -2.58 0.242            *
    serial               10      170.91      0.07   -0.28 0.917            *
    startup.serial       10       12.03      0.02   -1.22 0.125            *
    scimark.small        10      386.71      0.02    0.05 0.947            *
    startup.scimark.sor  10       35.45      0.01   -0.36 0.284            *
    startup.scimark.lu   10       37.74      0.03   -1.26 0.281            *
    compress             10      289.23      0.00    0.05 0.793            *
    xml.validation       10      761.03      0.02   -0.18 0.853            *
    scimark.fft.small    10      519.18      0.04    0.52 0.784            *
    startup.crypto.rsa   10       39.73      0.06   -1.42 0.630            *
    startup.compiler.compiler 10        3.55      0.03   -0.56 0.609            *
    mpegaudio            10      203.26      0.01   80.24 0.000          Yes
    startup.crypto.aes   10       11.93      0.05   -0.23 0.901            *
    scimark.monte_carlo  10      367.35      0.08   -0.49 0.887            *
    crypto.rsa           10      488.76      0.00   -0.09 0.483            *
    scimark.fft.large    10       12.54      0.04    0.09 0.969            *
    compiler.compiler    10      673.01      0.01    0.03 0.930            *
    startup.scimark.sparse 10       24.00      0.12    0.88 0.882            *
    startup.helloworld   10      185.84      0.07   -2.76 0.277            *
    compiler             10      452.21      0.00   -0.19 0.351            *
    sunflow              10      109.13      0.01    0.14 0.701            *
    startup.mpegaudio    10       18.79      0.03   57.58 0.000          Yes
    crypto.signverify    10      703.80      0.00    0.13 0.448            *
    startup.xml.validation 10       17.44      0.05   -1.61 0.294            *
    xml.transform        10      483.18      0.01    0.00 0.990            *
    scimark.large        10       22.03      0.02   -0.60 0.563            *
    compiler.sunflow     10      303.85      0.00   -0.40 0.008          Yes
    scimark.sor.small    10      363.37      0.00   -0.05 0.172            *
============================================================================




More information about the hotspot-compiler-dev mailing list