[aarch64-port-dev ] JTREG, SPECjbb2013 and Hadoop/Terasort results for OpenJDK 8 on AArch64

Sun Jan 24 20:03:05 UTC 2016

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 10 days.

For detailed information on the test output please refer to:

   http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/summary/2016/023/summary.html

-------------------------------------------------------------------------------
client-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 637; fail: 45; error: 5
Build 1: aarch64/2015/sep/04 pass: 636; fail: 46; error: 5
Build 2: aarch64/2015/sep/08 pass: 636; fail: 46; error: 5
Build 3: aarch64/2015/oct/22 pass: 637; fail: 45; error: 5
Build 4: aarch64/2015/oct/27 pass: 637; fail: 45; error: 5
Build 5: aarch64/2015/oct/29 pass: 637; fail: 45; error: 5
Build 6: aarch64/2015/nov/04 pass: 637; fail: 45; error: 5
Build 7: aarch64/2015/nov/27 pass: 637; fail: 45; error: 5
Build 8: aarch64/2016/jan/07 pass: 637; fail: 45; error: 5
Build 9: aarch64/2016/jan/23 pass: 637; fail: 45; error: 6

-------------------------------------------------------------------------------
client-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 5,502; fail: 233; error: 18
Build 1: aarch64/2015/sep/04 pass: 5,477; fail: 254; error: 22
Build 2: aarch64/2015/sep/08 pass: 5,477; fail: 254; error: 22
Build 3: aarch64/2015/oct/22 pass: 5,482; fail: 254; error: 17
Build 4: aarch64/2015/oct/27 pass: 5,472; fail: 259; error: 22
Build 5: aarch64/2015/oct/29 pass: 5,503; fail: 229; error: 21
Build 6: aarch64/2015/nov/04 pass: 5,503; fail: 228; error: 22
Build 7: aarch64/2015/nov/27 pass: 5,506; fail: 227; error: 20
Build 8: aarch64/2016/jan/07 pass: 5,504; fail: 229; error: 20
Build 9: aarch64/2016/jan/23 pass: 5,504; fail: 229; error: 20

-------------------------------------------------------------------------------
client-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 3,081; error: 10
Build 1: aarch64/2015/sep/04 pass: 3,078; error: 13
Build 2: aarch64/2015/sep/08 pass: 3,078; error: 13
Build 3: aarch64/2015/oct/22 pass: 3,077; error: 14
Build 4: aarch64/2015/oct/27 pass: 3,081; error: 10
Build 5: aarch64/2015/oct/29 pass: 3,079; error: 12
Build 6: aarch64/2015/nov/04 pass: 3,080; error: 11
Build 7: aarch64/2015/nov/27 pass: 3,078; error: 13
Build 8: aarch64/2016/jan/07 pass: 3,076; error: 15
Build 9: aarch64/2016/jan/23 pass: 3,077; error: 14

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 645; fail: 37; error: 5
Build 1: aarch64/2015/sep/04 pass: 645; fail: 37; error: 5
Build 2: aarch64/2015/sep/08 pass: 645; fail: 37; error: 5
Build 3: aarch64/2015/oct/22 pass: 644; fail: 38; error: 5
Build 4: aarch64/2015/oct/27 pass: 644; fail: 38; error: 5
Build 5: aarch64/2015/oct/29 pass: 645; fail: 37; error: 5
Build 6: aarch64/2015/nov/04 pass: 643; fail: 39; error: 5
Build 7: aarch64/2015/nov/27 pass: 643; fail: 38; error: 6
Build 8: aarch64/2016/jan/07 pass: 644; fail: 38; error: 5
Build 9: aarch64/2016/jan/23 pass: 643; fail: 38; error: 7

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 5,512; fail: 217; error: 24
Build 1: aarch64/2015/sep/04 pass: 5,471; fail: 257; error: 25
Build 2: aarch64/2015/sep/08 pass: 5,471; fail: 257; error: 25
Build 3: aarch64/2015/oct/22 pass: 5,489; fail: 241; error: 23
Build 4: aarch64/2015/oct/27 pass: 5,495; fail: 234; error: 24
Build 5: aarch64/2015/oct/29 pass: 5,521; fail: 209; error: 23
Build 6: aarch64/2015/nov/04 pass: 5,509; fail: 222; error: 22
Build 7: aarch64/2015/nov/27 pass: 5,517; fail: 214; error: 22
Build 8: aarch64/2016/jan/07 pass: 5,521; fail: 208; error: 24
Build 9: aarch64/2016/jan/23 pass: 5,508; fail: 224; error: 21

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2015/jul/21 pass: 3,081; error: 10
Build 1: aarch64/2015/sep/04 pass: 3,078; error: 13
Build 2: aarch64/2015/sep/08 pass: 3,078; error: 13
Build 3: aarch64/2015/oct/22 pass: 3,082; fail: 2; error: 7
Build 4: aarch64/2015/oct/27 pass: 3,083; error: 8
Build 5: aarch64/2015/oct/29 pass: 3,081; error: 10
Build 6: aarch64/2015/nov/04 pass: 3,080; fail: 1; error: 10
Build 7: aarch64/2015/nov/27 pass: 3,079; error: 12
Build 8: aarch64/2016/jan/07 pass: 3,079; error: 12
Build 9: aarch64/2016/jan/23 pass: 3,079; error: 12

Previous results can be found here:

   http://openjdk.linaro.org/openjdk8-jtreg-nightly-tests/index.html

SPECjbb2013 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2013 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2014-04-01.

In accordance with [1], the SPECjbb2013 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 1.13x
Relative performance: Server critical-jOPS (nc): 1.37x

Details of the test setup and historical results may be found here:

     http://openjdk.linaro.org/SPECjbb2013-1.00-results/

[1]http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 48.84, Server: 90.48

Client 48.84 / Client 2014-04-01 (43.00): 1.14x
Server 90.48 / Server 2014-04-01 (71.00): 1.27x

Details of the test setup and historical results may be found here:

     http://openjdk.linaro.org/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 10 days.

2015-07-21 pass rate: 11556/11556, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/202/results/
2015-09-04 pass rate: 11555/11556, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/247/results/
2015-09-08 pass rate: 11555/11556, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/251/results/
2015-10-22 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/295/results/
2015-10-27 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/300/results/
2015-10-29 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/302/results/
2015-11-04 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/308/results/
2015-11-27 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2015/331/results/
2016-01-07 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2016/007/results/
2016-01-23 pass rate: 11558/11558, results:http://openjdk.linaro.org/jcstress-nightly-runs/2016/023/results/

For detailed information on the test output please refer to:

   http://openjdk.linaro.org/jcstress-nightly-runs/