[aarch64-port-dev ] JTREG, JCStress, SPECjbb2015 and Hadoop/Terasort results for OpenJDK 10 on AArch64

Thu Nov 2 15:06:49 UTC 2017

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 15 days.

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk10/openjdk-jtreg-nightly-tests/summary/2017/305/summary.html

-------------------------------------------------------------------------------
client-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 1,400; fail: 11,561
Build 1: aarch64/2017/sep/20 pass: 1,369; fail: 35; error: 1
Build 2: aarch64/2017/oct/04 pass: 1,419; fail: 12; error: 1
Build 3: aarch64/2017/oct/06 pass: 1,385; fail: 49
Build 4: aarch64/2017/oct/18 pass: 1,423; fail: 12
Build 5: aarch64/2017/oct/19 pass: 1,425; fail: 11
Build 6: aarch64/2017/oct/21 pass: 1,425; fail: 11; error: 1
Build 7: aarch64/2017/oct/25 pass: 1,428; fail: 10; error: 1
Build 8: aarch64/2017/oct/27 pass: 1,429; fail: 11
Build 9: aarch64/2017/oct/29 pass: 1,429; fail: 10; error: 1
Build 10: aarch64/2017/oct/31 pass: 1,429; fail: 11
Build 11: aarch64/2017/nov/01 pass: 1,429; fail: 11

2 fatal errors were detected; please follow the link above for more detail.

-------------------------------------------------------------------------------
client-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 7,432; fail: 714; error: 20
Build 1: aarch64/2017/sep/20 pass: 7,469; fail: 689; error: 22
Build 2: aarch64/2017/oct/06 pass: 7,467; fail: 731; error: 23
Build 3: aarch64/2017/oct/18 pass: 7,468; fail: 732; error: 24
Build 4: aarch64/2017/oct/19 pass: 7,474; fail: 728; error: 22
Build 5: aarch64/2017/oct/21 pass: 7,470; fail: 730; error: 24
Build 6: aarch64/2017/oct/25 pass: 7,477; fail: 730; error: 20
Build 7: aarch64/2017/oct/27 pass: 7,470; fail: 736; error: 21
Build 8: aarch64/2017/oct/29 pass: 7,468; fail: 738; error: 21
Build 9: aarch64/2017/oct/31 pass: 7,486; fail: 720; error: 21
Build 10: aarch64/2017/nov/01 pass: 7,472; fail: 734; error: 21

-------------------------------------------------------------------------------
client-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 3,784
Build 1: aarch64/2017/sep/20 pass: 3,783; fail: 1
Build 2: aarch64/2017/oct/06 pass: 3,799; fail: 3
Build 3: aarch64/2017/oct/18 pass: 3,808; fail: 3
Build 4: aarch64/2017/oct/19 pass: 3,808; fail: 3
Build 5: aarch64/2017/oct/21 pass: 3,808; fail: 3
Build 6: aarch64/2017/oct/25 pass: 3,810; fail: 4
Build 7: aarch64/2017/oct/27 pass: 3,810; fail: 4
Build 8: aarch64/2017/oct/29 pass: 3,807; fail: 3; error: 4
Build 9: aarch64/2017/oct/31 pass: 3,808; fail: 4; error: 2
Build 10: aarch64/2017/nov/01 pass: 3,810; fail: 4

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 1,403; fail: 11,562; error: 1
Build 1: aarch64/2017/sep/20 pass: 1,373; fail: 37
Build 2: aarch64/2017/oct/04 pass: 1,422; fail: 15
Build 3: aarch64/2017/oct/06 pass: 1,304; fail: 134; error: 1
Build 4: aarch64/2017/oct/18 pass: 1,427; fail: 13
Build 5: aarch64/2017/oct/19 pass: 1,427; fail: 13; error: 1
Build 6: aarch64/2017/oct/21 pass: 1,428; fail: 13; error: 1
Build 7: aarch64/2017/oct/25 pass: 1,431; fail: 12; error: 1
Build 8: aarch64/2017/oct/27 pass: 1,433; fail: 12
Build 9: aarch64/2017/oct/29 pass: 1,432; fail: 12; error: 1
Build 10: aarch64/2017/oct/31 pass: 1,433; fail: 12
Build 11: aarch64/2017/nov/01 pass: 1,433; fail: 12

2 fatal errors were detected; please follow the link above for more detail.

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 7,469; fail: 675; error: 22
Build 1: aarch64/2017/sep/20 pass: 7,452; fail: 705; error: 23
Build 2: aarch64/2017/oct/06 pass: 7,494; fail: 706; error: 21
Build 3: aarch64/2017/oct/18 pass: 7,460; fail: 740; error: 24
Build 4: aarch64/2017/oct/19 pass: 7,479; fail: 723; error: 22
Build 5: aarch64/2017/oct/21 pass: 7,492; fail: 711; error: 21
Build 6: aarch64/2017/oct/25 pass: 7,464; fail: 744; error: 19
Build 7: aarch64/2017/oct/27 pass: 7,473; fail: 732; error: 22
Build 8: aarch64/2017/oct/29 pass: 7,485; fail: 721; error: 21
Build 9: aarch64/2017/oct/31 pass: 7,471; fail: 733; error: 23
Build 10: aarch64/2017/nov/01 pass: 7,483; fail: 723; error: 21

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2017/sep/06 pass: 3,782; error: 2
Build 1: aarch64/2017/sep/20 pass: 3,783; fail: 1
Build 2: aarch64/2017/oct/06 pass: 3,798; fail: 4
Build 3: aarch64/2017/oct/18 pass: 3,807; fail: 4
Build 4: aarch64/2017/oct/19 pass: 3,807; fail: 4
Build 5: aarch64/2017/oct/21 pass: 3,808; fail: 3
Build 6: aarch64/2017/oct/25 pass: 3,811; fail: 3
Build 7: aarch64/2017/oct/27 pass: 3,810; fail: 3; error: 1
Build 8: aarch64/2017/oct/29 pass: 3,807; fail: 4; error: 3
Build 9: aarch64/2017/oct/31 pass: 3,808; fail: 3; error: 3
Build 10: aarch64/2017/nov/01 pass: 3,810; fail: 4

Previous results can be found here: 

  http://openjdk.linaro.org/jdk10/openjdk-jtreg-nightly-tests/index.html

SPECjbb2015 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2015 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2016-11-21.

In accordance with [1], the SPECjbb2015 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 1.03x
Relative performance: Server critical-jOPS (nc): 0.83x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk10/SPECjbb2015-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 70.58, Server: 113.83

Client 70.58 / Client 2014-04-01 (43.00): 1.64x
Server 113.83 / Server 2014-04-01 (71.00): 1.60x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk10/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 15 days.

2017-09-07 pass rate: 11556/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/249/results/
2017-09-21 pass rate: 11556/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/263/results/
2017-10-04 pass rate: 11556/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/276/results/
2017-10-05 pass rate: 11558/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/277/results/
2017-10-07 pass rate: 11555/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/279/results/
2017-10-19 pass rate: 11557/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/291/results/
2017-10-20 pass rate: 11558/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/292/results/
2017-10-22 pass rate: 11557/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/294/results/
2017-10-26 pass rate: 11557/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/298/results/
2017-10-28 pass rate: 11556/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/300/results/
2017-10-30 pass rate: 11558/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/302/results/
2017-11-01 pass rate: 11558/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/304/results/
2017-11-02 pass rate: 11556/11559, results: http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/2017/305/results/

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk10/jcstress-nightly-runs/