[aarch64-port-dev ] JTREG, JCStress, SPECjbb2015 and Hadoop/Terasort results for OpenJDK 8u on AArch64

Wed Nov 15 16:41:28 UTC 2017

This is a summary of the JTREG test results
===========================================

The build and test results are cycled every 15 days.

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk8u/openjdk-jtreg-nightly-tests/summary/2017/319/summary.html

-------------------------------------------------------------------------------
client-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 668; fail: 44; error: 6
Build 1: aarch64/2017/jan/18 pass: 672; fail: 44; error: 3
Build 2: aarch64/2017/feb/04 pass: 672; fail: 44; error: 3
Build 3: aarch64/2017/feb/24 pass: 672; fail: 44; error: 3
Build 4: aarch64/2017/mar/29 pass: 672; fail: 44; error: 3
Build 5: aarch64/2017/apr/05 pass: 672; fail: 44; error: 3
Build 6: aarch64/2017/apr/20 pass: 673; fail: 44; error: 3
Build 7: aarch64/2017/jun/12 pass: 713; fail: 6; error: 2
Build 8: aarch64/2017/jun/26 pass: 713; fail: 6; error: 2
Build 9: aarch64/2017/jul/21 pass: 708; fail: 12; error: 2
Build 10: aarch64/2017/aug/16 pass: 708; fail: 12; error: 2
Build 11: aarch64/2017/aug/19 pass: 708; fail: 12; error: 2
Build 12: aarch64/2017/aug/31 pass: 708; fail: 12; error: 2
Build 13: aarch64/2017/oct/25 pass: 715; fail: 6; error: 2
Build 14: aarch64/2017/nov/15 pass: 715; fail: 6; error: 2

-------------------------------------------------------------------------------
client-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 5,621; fail: 219; error: 45
Build 1: aarch64/2017/jan/18 pass: 5,683; fail: 213; error: 36
Build 2: aarch64/2017/feb/04 pass: 5,667; fail: 234; error: 41
Build 3: aarch64/2017/feb/24 pass: 5,701; fail: 217; error: 27
Build 4: aarch64/2017/mar/29 pass: 5,686; fail: 225; error: 34
Build 5: aarch64/2017/apr/05 pass: 5,677; fail: 235; error: 33
Build 6: aarch64/2017/apr/20 pass: 5,671; fail: 254; error: 34
Build 7: aarch64/2017/jun/12 pass: 5,765; fail: 175; error: 23
Build 8: aarch64/2017/jun/26 pass: 5,757; fail: 174; error: 23
Build 9: aarch64/2017/jul/21 pass: 5,768; fail: 172; error: 22
Build 10: aarch64/2017/aug/16 pass: 5,753; fail: 188; error: 21
Build 11: aarch64/2017/aug/19 pass: 5,763; fail: 177; error: 23
Build 12: aarch64/2017/aug/31 pass: 5,754; fail: 183; error: 26
Build 13: aarch64/2017/oct/25 pass: 5,766; fail: 181; error: 21
Build 14: aarch64/2017/nov/15 pass: 5,773; fail: 175; error: 21

-------------------------------------------------------------------------------
client-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 3,096; error: 11
Build 1: aarch64/2017/jan/18 pass: 3,098; error: 13
Build 2: aarch64/2017/feb/04 pass: 3,094; error: 17
Build 3: aarch64/2017/feb/24 pass: 3,106; error: 6
Build 4: aarch64/2017/mar/29 pass: 3,105; fail: 2; error: 5
Build 5: aarch64/2017/apr/05 pass: 3,104; fail: 2; error: 6
Build 6: aarch64/2017/apr/20 pass: 3,101; fail: 2; error: 10
Build 7: aarch64/2017/jun/12 pass: 3,109; fail: 2; error: 2
Build 8: aarch64/2017/jun/26 pass: 3,109; fail: 2; error: 2
Build 9: aarch64/2017/jul/21 pass: 3,110; fail: 2; error: 2
Build 10: aarch64/2017/aug/16 pass: 3,111; fail: 2; error: 1
Build 11: aarch64/2017/aug/19 pass: 3,111; fail: 2; error: 1
Build 12: aarch64/2017/aug/31 pass: 3,110; fail: 2; error: 2
Build 13: aarch64/2017/oct/25 pass: 3,111; fail: 2; error: 1
Build 14: aarch64/2017/nov/15 pass: 3,111; fail: 2; error: 1

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 668; fail: 44; error: 6
Build 1: aarch64/2017/jan/18 pass: 673; fail: 43; error: 3
Build 2: aarch64/2017/feb/04 pass: 673; fail: 43; error: 3
Build 3: aarch64/2017/feb/24 pass: 673; fail: 43; error: 3
Build 4: aarch64/2017/mar/29 pass: 673; fail: 43; error: 3
Build 5: aarch64/2017/apr/05 pass: 673; fail: 43; error: 3
Build 6: aarch64/2017/apr/20 pass: 674; fail: 43; error: 3
Build 7: aarch64/2017/jun/12 pass: 714; fail: 5; error: 2
Build 8: aarch64/2017/jun/26 pass: 714; fail: 5; error: 2
Build 9: aarch64/2017/jul/21 pass: 709; fail: 11; error: 2
Build 10: aarch64/2017/aug/16 pass: 709; fail: 11; error: 2
Build 11: aarch64/2017/aug/19 pass: 709; fail: 11; error: 2
Build 12: aarch64/2017/aug/31 pass: 709; fail: 11; error: 2
Build 13: aarch64/2017/oct/25 pass: 716; fail: 5; error: 2
Build 14: aarch64/2017/nov/15 pass: 716; fail: 5; error: 2

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 5,618; fail: 226; error: 41
Build 1: aarch64/2017/jan/18 pass: 5,690; fail: 206; error: 36
Build 2: aarch64/2017/feb/04 pass: 5,669; fail: 214; error: 59
Build 3: aarch64/2017/feb/24 pass: 5,701; fail: 221; error: 23
Build 4: aarch64/2017/mar/29 pass: 5,696; fail: 222; error: 27
Build 5: aarch64/2017/apr/05 pass: 5,692; fail: 229; error: 24
Build 6: aarch64/2017/apr/20 pass: 5,705; fail: 220; error: 34
Build 7: aarch64/2017/jun/12 pass: 5,778; fail: 161; error: 24
Build 8: aarch64/2017/jun/26 pass: 5,770; fail: 159; error: 25
Build 9: aarch64/2017/jul/21 pass: 5,769; fail: 168; error: 25
Build 10: aarch64/2017/aug/16 pass: 5,761; fail: 181; error: 20
Build 11: aarch64/2017/aug/19 pass: 5,768; fail: 175; error: 20
Build 12: aarch64/2017/aug/31 pass: 5,761; fail: 177; error: 25
Build 13: aarch64/2017/oct/25 pass: 5,769; fail: 178; error: 21
Build 14: aarch64/2017/nov/15 pass: 5,785; fail: 161; error: 23

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2016/dec/21 pass: 3,092; error: 15
Build 1: aarch64/2017/jan/18 pass: 3,102; error: 9
Build 2: aarch64/2017/feb/04 pass: 3,099; error: 12
Build 3: aarch64/2017/feb/24 pass: 3,109; error: 3
Build 4: aarch64/2017/mar/29 pass: 3,104; fail: 2; error: 6
Build 5: aarch64/2017/apr/05 pass: 3,105; fail: 2; error: 5
Build 6: aarch64/2017/apr/20 pass: 3,098; fail: 2; error: 13
Build 7: aarch64/2017/jun/12 pass: 3,109; fail: 2; error: 2
Build 8: aarch64/2017/jun/26 pass: 3,109; fail: 2; error: 2
Build 9: aarch64/2017/jul/21 pass: 3,110; fail: 2; error: 2
Build 10: aarch64/2017/aug/16 pass: 3,110; fail: 2; error: 2
Build 11: aarch64/2017/aug/19 pass: 3,110; fail: 2; error: 2
Build 12: aarch64/2017/aug/31 pass: 3,110; fail: 2; error: 2
Build 13: aarch64/2017/oct/25 pass: 3,111; fail: 2; error: 1
Build 14: aarch64/2017/nov/15 pass: 3,110; fail: 2; error: 2

Previous results can be found here: 

  http://openjdk.linaro.org/jdk8u/openjdk-jtreg-nightly-tests/index.html

SPECjbb2015 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2015 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2016-11-21.

In accordance with [1], the SPECjbb2015 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 0.96x
Relative performance: Server critical-jOPS (nc): 0.89x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk8u/SPECjbb2015-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 57.15, Server: 111.14

Client 57.15 / Client 2014-04-01 (43.00): 1.33x
Server 111.14 / Server 2014-04-01 (71.00): 1.57x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdk8u/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================

The build and test results are cycled every 15 days.

2016-12-01 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/336/results/
2016-12-22 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2016/356/results/
2017-01-18 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/018/results/
2017-02-06 pass rate: 5140/5140, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/035/results/
2017-02-25 pass rate: 5176/5176, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/055/results/
2017-03-29 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/088/results/
2017-04-05 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/095/results/
2017-04-20 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/110/results/
2017-06-13 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/163/results/
2017-06-27 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/177/results/
2017-08-16 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/228/results/
2017-08-19 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/231/results/
2017-08-31 pass rate: 8484/8485, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/243/results/
2017-10-26 pass rate: 8489/8490, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/298/results/
2017-11-15 pass rate: 8489/8490, results: http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/2017/319/results/

For detailed information on the test output please refer to: 

  http://openjdk.linaro.org/jdk8u/jcstress-nightly-runs/