[aarch64-port-dev ] JTREG, SPECjbb2013 and Hadoop/Terasort results for OpenJDK 8 on AArch64

Thu Jun 2 07:47:44 UTC 2016

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 10 days.

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/summary/2016/153/summary.html

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/29 pass: 645; fail: 37; error: 5
Build 1: aarch64/2015/nov/04 pass: 643; fail: 39; error: 5
Build 2: aarch64/2015/nov/27 pass: 643; fail: 38; error: 6
Build 3: aarch64/2016/jan/07 pass: 644; fail: 38; error: 5
Build 4: aarch64/2016/jan/23 pass: 643; fail: 38; error: 7
Build 5: aarch64/2016/jan/27 pass: 643; fail: 37; error: 8
Build 6: aarch64/2016/may/11 pass: 649; fail: 41; error: 12
Build 7: aarch64/2016/may/18 pass: 642; fail: 49; error: 11
Build 8: aarch64/2016/may/21 pass: 647; fail: 41; error: 14
Build 9: aarch64/2016/jun/01 pass: 647; fail: 43; error: 12

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/29 pass: 5,521; fail: 209; error: 23
Build 1: aarch64/2015/nov/04 pass: 5,509; fail: 222; error: 22
Build 2: aarch64/2015/nov/27 pass: 5,517; fail: 214; error: 22
Build 3: aarch64/2016/jan/07 pass: 5,521; fail: 208; error: 24
Build 4: aarch64/2016/jan/23 pass: 5,508; fail: 224; error: 21
Build 5: aarch64/2016/jan/27 pass: 5,507; fail: 213; error: 33
Build 6: aarch64/2016/may/11 pass: 5,515; fail: 221; error: 36
Build 7: aarch64/2016/may/18 pass: 3,750; fail: 289; error: 1,733
Build 8: aarch64/2016/may/21 pass: 5,515; fail: 223; error: 34
Build 9: aarch64/2016/jun/01 pass: 5,525; fail: 217; error: 30

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/29 pass: 3,081; error: 10
Build 1: aarch64/2015/nov/04 pass: 3,080; fail: 1; error: 10
Build 2: aarch64/2015/nov/27 pass: 3,079; error: 12
Build 3: aarch64/2016/jan/07 pass: 3,079; error: 12
Build 4: aarch64/2016/jan/23 pass: 3,079; error: 12
Build 5: aarch64/2016/jan/27 pass: 3,079; fail: 2; error: 10
Build 6: aarch64/2016/may/11 pass: 3,084; error: 10
Build 7: aarch64/2016/may/18 pass: 3,065; fail: 16; error: 13
Build 8: aarch64/2016/may/21 pass: 3,083; error: 11
Build 9: aarch64/2016/jun/01 pass: 3,081; error: 13

Previous results can be found here: 

  http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/index.html

SPECjbb2013 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2013 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2014-04-01.

In accordance with [1], the SPECjbb2013 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 1.15x
Relative performance: Server critical-jOPS (nc): 1.47x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/SPECjbb2013-1.00-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 48.51, Server: 89.9

Client 48.51 / Client 2014-04-01 (43.00): 1.13x
Server 89.9 / Server 2014-04-01 (71.00): 1.27x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 10 days.

2015-10-27 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2015/300/results/
2015-10-29 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2015/302/results/
2015-11-04 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2015/308/results/
2015-11-27 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2015/331/results/
2016-01-07 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/007/results/
2016-01-23 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/023/results/
2016-01-27 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/027/results/
2016-05-18 pass rate: 11557/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/139/results/
2016-05-21 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/142/results/
2016-06-01 pass rate: 11558/11558, results: http://openjdk.linaro.org/jcstress-nightly-runs/2016/153/results/

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jcstress-nightly-runs/