[aarch64-port-dev ] JTREG, SPECjbb2013 and Hadoop/Terasort results for OpenJDK 8 on AArch64

Tue May 24 09:23:16 UTC 2016

Hi All,

We have switched the overnight OpenJDK tests to run from the aarch64 jdk8u tree, rather than the aarch64 jdk8 tree, as the jdk8 tree is now frozen.

The tests are done nightly is there has been a commit and take ~20 hours to run so the results should be posted later each day.

We are also looking at setting up a CI loop for jdk9.

All the best,
Ed.

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 10 days.

For detailed information on the test output please refer to:

  http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/summary/2016/142/summary.html

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/27 pass: 644; fail: 38; error: 5
Build 1: aarch64/2015/oct/29 pass: 645; fail: 37; error: 5
Build 2: aarch64/2015/nov/04 pass: 643; fail: 39; error: 5
Build 3: aarch64/2015/nov/27 pass: 643; fail: 38; error: 6
Build 4: aarch64/2016/jan/07 pass: 644; fail: 38; error: 5
Build 5: aarch64/2016/jan/23 pass: 643; fail: 38; error: 7
Build 6: aarch64/2016/jan/27 pass: 643; fail: 37; error: 8
Build 7: aarch64/2016/may/11 pass: 649; fail: 41; error: 12
Build 8: aarch64/2016/may/18 pass: 642; fail: 49; error: 11
Build 9: aarch64/2016/may/21 pass: 647; fail: 41; error: 14

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/27 pass: 5,495; fail: 234; error: 24
Build 1: aarch64/2015/oct/29 pass: 5,521; fail: 209; error: 23
Build 2: aarch64/2015/nov/04 pass: 5,509; fail: 222; error: 22
Build 3: aarch64/2015/nov/27 pass: 5,517; fail: 214; error: 22
Build 4: aarch64/2016/jan/07 pass: 5,521; fail: 208; error: 24
Build 5: aarch64/2016/jan/23 pass: 5,508; fail: 224; error: 21
Build 6: aarch64/2016/jan/27 pass: 5,507; fail: 213; error: 33
Build 7: aarch64/2016/may/11 pass: 5,515; fail: 221; error: 36
Build 8: aarch64/2016/may/18 pass: 3,750; fail: 289; error: 1,733
Build 9: aarch64/2016/may/21 pass: 5,515; fail: 223; error: 34

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2015/oct/27 pass: 3,083; error: 8
Build 1: aarch64/2015/oct/29 pass: 3,081; error: 10
Build 2: aarch64/2015/nov/04 pass: 3,080; fail: 1; error: 10
Build 3: aarch64/2015/nov/27 pass: 3,079; error: 12
Build 4: aarch64/2016/jan/07 pass: 3,079; error: 12
Build 5: aarch64/2016/jan/23 pass: 3,079; error: 12
Build 6: aarch64/2016/jan/27 pass: 3,079; fail: 2; error: 10
Build 7: aarch64/2016/may/11 pass: 3,084; error: 10
Build 8: aarch64/2016/may/18 pass: 3,065; fail: 16; error: 13
Build 9: aarch64/2016/may/21 pass: 3,083; error: 11

Previous results can be found here:

  http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/index.html

SPECjbb2013 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2013 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2014-04-01.

In accordance with [1], the SPECjbb2013 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 1.21x
Relative performance: Server critical-jOPS (nc): 1.44x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/SPECjbb2013-1.00-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 48.84, Server: 90.48

Client 48.84 / Client 2014-04-01 (43.00): 1.14x
Server 90.48 / Server 2014-04-01 (71.00): 1.27x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 10 days.

2015-10-22 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2015/295/results/
2015-10-27 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2015/300/results/
2015-10-29 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2015/302/results/
2015-11-04 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2015/308/results/
2015-11-27 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2015/331/results/
2016-01-07 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2016/007/results/
2016-01-23 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2016/023/results/
2016-01-27 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2016/027/results/
2016-05-18 pass rate: 11557/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2016/139/results/
2016-05-21 pass rate: 11558/11558, results:
http://openjdk.linaro.org/jcstress-nightly-runs/2016/142/results/

For detailed information on the test output please refer to:

  http://openjdk.linaro.org/jcstress-nightly-runs/