[aarch64-port-dev ] JTREG, JCStress, SPECjbb2015 and Hadoop/Terasort results for OpenJDK 8u on AArch64

Sat Feb 25 05:05:08 UTC 2017

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 15 days.

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk8u/openjdk-jtreg-nightly-tests/summary/2017/055/summary.html

-------------------------------------------------------------------------------
client-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/01 pass: 668; fail: 44; error: 6
Build 1: aarch64/2016/dec/21 pass: 668; fail: 44; error: 6
Build 2: aarch64/2017/jan/18 pass: 672; fail: 44; error: 3
Build 3: aarch64/2017/feb/04 pass: 672; fail: 44; error: 3
Build 4: aarch64/2017/feb/24 pass: 672; fail: 44; error: 3

-------------------------------------------------------------------------------
client-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 5,621; fail: 219; error: 45
Build 1: aarch64/2017/jan/18 pass: 5,683; fail: 213; error: 36
Build 2: aarch64/2017/feb/04 pass: 5,667; fail: 234; error: 41
Build 3: aarch64/2017/feb/24 pass: 5,701; fail: 217; error: 27

-------------------------------------------------------------------------------
client-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/01 pass: 3,091; error: 16
Build 1: aarch64/2016/dec/21 pass: 3,096; error: 11
Build 2: aarch64/2017/jan/18 pass: 3,098; error: 13
Build 3: aarch64/2017/feb/04 pass: 3,094; error: 17
Build 4: aarch64/2017/feb/24 pass: 3,106; error: 6

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2016/nov/03 pass: 664; fail: 44; error: 6
Build 1: aarch64/2016/nov/08 pass: 664; fail: 44; error: 6
Build 2: aarch64/2016/nov/09 pass: 664; fail: 44; error: 6
Build 3: aarch64/2016/nov/21 pass: 668; fail: 44; error: 6
Build 4: aarch64/2016/dec/01 pass: 669; fail: 43; error: 6
Build 5: aarch64/2016/dec/21 pass: 668; fail: 44; error: 6
Build 6: aarch64/2017/jan/18 pass: 673; fail: 43; error: 3
Build 7: aarch64/2017/feb/04 pass: 673; fail: 43; error: 3
Build 8: aarch64/2017/feb/24 pass: 673; fail: 43; error: 3

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 5,618; fail: 226; error: 41
Build 1: aarch64/2017/jan/18 pass: 5,690; fail: 206; error: 36
Build 2: aarch64/2017/feb/04 pass: 5,669; fail: 214; error: 59
Build 3: aarch64/2017/feb/24 pass: 5,701; fail: 221; error: 23

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2016/nov/03 pass: 3,092; error: 15
Build 1: aarch64/2016/nov/08 pass: 3,092; error: 15
Build 2: aarch64/2016/nov/09 pass: 3,091; error: 16
Build 3: aarch64/2016/nov/21 pass: 3,095; error: 12
Build 4: aarch64/2016/dec/01 pass: 3,095; error: 12
Build 5: aarch64/2016/dec/21 pass: 3,092; error: 15
Build 6: aarch64/2017/jan/18 pass: 3,102; error: 9
Build 7: aarch64/2017/feb/04 pass: 3,099; error: 12
Build 8: aarch64/2017/feb/24 pass: 3,109; error: 3

Previous results can be found here: 

  http://openjdk.linaro.org/jdk8u/openjdk-jtreg-nightly-tests/index.html

SPECjbb2015 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2015 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2016-11-21.

In accordance with [1], the SPECjbb2015 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 0.96x
Relative performance: Server critical-jOPS (nc): 0.95x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk8u/SPECjbb2015-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 57.61, Server: 107.75

Client 57.61 / Client 2014-04-01 (43.00): 1.34x
Server 107.75 / Server 2014-04-01 (71.00): 1.52x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk8u/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 15 days.

2016-11-03 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/308/results/
2016-11-21 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/326/results/
2016-12-01 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/336/results/
2016-12-22 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/356/results/
2017-01-18 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/018/results/
2017-02-06 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/035/results/
2017-02-25 pass rate: 5176/5176, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/055/results/

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/