[aarch64-port-dev ] JTREG, JCStress, SPECjbb2015 and Hadoop/Terasort results for OpenJDK JDK on AArch64

ci_notify at linaro.org ci_notify at linaro.org
Sun Jun 10 23:28:38 UTC 2018


This is a summary of the JTREG test results
===========================================
 
The build and test results are cycled every 15 days.
 
For detailed information on the test output please refer to: 
 
  http://openjdk.linaro.org/jdkX/openjdk-jtreg-nightly-tests/summary/2018/160/summary.html
 
-------------------------------------------------------------------------------
client-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 1,675; fail: 14; error: 1; not run: 11,615
Build 1: aarch64/2018/may/10 pass: 3,190; fail: 14; error: 3; not run: 11,616
Build 2: aarch64/2018/may/11 pass: 3,192; fail: 12; error: 3; not run: 11,616
Build 3: aarch64/2018/may/13 pass: 3,191; fail: 13; error: 3; not run: 11,616
Build 4: aarch64/2018/may/15 pass: 3,234; fail: 34; error: 4; not run: 11,619
Build 5: aarch64/2018/may/17 pass: 3,263; fail: 34; error: 4; not run: 11,619
Build 6: aarch64/2018/may/21 pass: 3,769; fail: 38; error: 5; not run: 11,619
Build 7: aarch64/2018/may/23 pass: 3,868; fail: 37; error: 4; not run: 11,619
Build 8: aarch64/2018/may/25 pass: 5,209; fail: 45; error: 3; not run: 11,619
Build 9: aarch64/2018/may/27 pass: 5,210; fail: 43; error: 4; not run: 11,619
Build 10: aarch64/2018/may/29 pass: 5,209; fail: 44; error: 4; not run: 11,619
Build 11: aarch64/2018/jun/03 pass: 5,640; fail: 24; error: 5; not run: 11,619
Build 12: aarch64/2018/jun/05 pass: 5,642; fail: 25; error: 3; not run: 11,619
Build 13: aarch64/2018/jun/07 pass: 5,640; fail: 26; error: 4; not run: 11,619
Build 14: aarch64/2018/jun/09 pass: 5,654; fail: 25; error: 3; not run: 11,619

2 fatal errors were detected; please follow the link above for more detail.

-------------------------------------------------------------------------------
client-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 7,800; fail: 621; error: 15
Build 1: aarch64/2018/may/10 pass: 7,905; fail: 595; error: 22
Build 2: aarch64/2018/may/11 pass: 7,880; fail: 623; error: 19
Build 3: aarch64/2018/may/13 pass: 7,903; fail: 599; error: 23
Build 4: aarch64/2018/may/15 pass: 7,865; fail: 629; error: 32
Build 5: aarch64/2018/may/17 pass: 8,329; fail: 595; error: 29
Build 6: aarch64/2018/may/21 pass: 8,326; fail: 604; error: 25
Build 7: aarch64/2018/may/23 pass: 8,328; fail: 610; error: 24
Build 8: aarch64/2018/may/25 pass: 8,302; fail: 638; error: 23
Build 9: aarch64/2018/may/27 pass: 8,331; fail: 611; error: 23
Build 10: aarch64/2018/may/29 pass: 8,320; fail: 616; error: 29
Build 11: aarch64/2018/jun/03 pass: 8,362; fail: 629; error: 25
Build 12: aarch64/2018/jun/05 pass: 8,395; fail: 599; error: 23
Build 13: aarch64/2018/jun/07 pass: 8,384; fail: 612; error: 24
Build 14: aarch64/2018/jun/09 pass: 8,388; fail: 614; error: 22

4 fatal errors were detected; please follow the link above for more detail.

-------------------------------------------------------------------------------
client-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 3,856; fail: 6; error: 2
Build 1: aarch64/2018/may/10 pass: 3,865; fail: 6
Build 2: aarch64/2018/may/11 pass: 3,865; fail: 6
Build 3: aarch64/2018/may/13 pass: 3,862; fail: 6; error: 4
Build 4: aarch64/2018/may/15 pass: 3,863; fail: 6; error: 3
Build 5: aarch64/2018/may/17 pass: 3,864; fail: 6; error: 3
Build 6: aarch64/2018/may/21 pass: 3,867; fail: 6; error: 2
Build 7: aarch64/2018/may/23 pass: 3,871; fail: 6; error: 3
Build 8: aarch64/2018/may/25 pass: 3,877; fail: 6; error: 5
Build 9: aarch64/2018/may/27 pass: 3,880; fail: 6; error: 2
Build 10: aarch64/2018/may/29 pass: 3,879; fail: 6; error: 4
Build 11: aarch64/2018/jun/03 pass: 3,882; fail: 6; error: 3
Build 12: aarch64/2018/jun/05 pass: 3,884; fail: 6; error: 4
Build 13: aarch64/2018/jun/07 pass: 3,887; fail: 6; error: 3
Build 14: aarch64/2018/jun/09 pass: 3,887; fail: 6; error: 5

-------------------------------------------------------------------------------
server-release/hotspot
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 1,682; fail: 14; error: 1; not run: 11,615
Build 1: aarch64/2018/may/10 pass: 3,199; fail: 12; error: 3; not run: 11,616
Build 2: aarch64/2018/may/11 pass: 3,199; fail: 12; error: 3; not run: 11,616
Build 3: aarch64/2018/may/13 pass: 3,200; fail: 11; error: 3; not run: 11,616
Build 4: aarch64/2018/may/15 pass: 3,243; fail: 33; error: 3; not run: 11,619
Build 5: aarch64/2018/may/17 pass: 3,274; fail: 31; error: 3; not run: 11,619
Build 6: aarch64/2018/may/21 pass: 3,783; fail: 34; error: 2; not run: 11,619
Build 7: aarch64/2018/may/23 pass: 3,879; fail: 34; error: 3; not run: 11,619
Build 8: aarch64/2018/may/25 pass: 5,219; fail: 42; error: 3; not run: 11,619
Build 9: aarch64/2018/may/27 pass: 5,220; fail: 40; error: 4; not run: 11,619
Build 10: aarch64/2018/may/29 pass: 5,219; fail: 42; error: 3; not run: 11,619
Build 11: aarch64/2018/jun/03 pass: 5,651; fail: 22; error: 3; not run: 11,619
Build 12: aarch64/2018/jun/05 pass: 5,651; fail: 23; error: 3; not run: 11,619
Build 13: aarch64/2018/jun/07 pass: 5,650; fail: 24; error: 3; not run: 11,619
Build 14: aarch64/2018/jun/09 pass: 5,663; fail: 24; error: 2; not run: 11,619

1 fatal errors were detected; please follow the link above for more detail.

-------------------------------------------------------------------------------
server-release/jdk
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 7,825; fail: 593; error: 18
Build 1: aarch64/2018/may/10 pass: 7,918; fail: 586; error: 18
Build 2: aarch64/2018/may/11 pass: 7,912; fail: 592; error: 18
Build 3: aarch64/2018/may/13 pass: 7,892; fail: 616; error: 17
Build 4: aarch64/2018/may/15 pass: 7,918; fail: 586; error: 22
Build 5: aarch64/2018/may/17 pass: 8,349; fail: 587; error: 18
Build 6: aarch64/2018/may/21 pass: 8,363; fail: 578; error: 15
Build 7: aarch64/2018/may/23 pass: 8,361; fail: 583; error: 19
Build 8: aarch64/2018/may/25 pass: 8,357; fail: 591; error: 16
Build 9: aarch64/2018/may/27 pass: 8,359; fail: 589; error: 18
Build 10: aarch64/2018/may/29 pass: 8,372; fail: 576; error: 18
Build 11: aarch64/2018/jun/03 pass: 8,379; fail: 618; error: 20
Build 12: aarch64/2018/jun/05 pass: 8,415; fail: 586; error: 17
Build 13: aarch64/2018/jun/07 pass: 8,382; fail: 622; error: 17
Build 14: aarch64/2018/jun/09 pass: 8,425; fail: 584; error: 16

-------------------------------------------------------------------------------
server-release/langtools
-------------------------------------------------------------------------------
Build 0: aarch64/2018/apr/17 pass: 3,854; fail: 6; error: 4
Build 1: aarch64/2018/may/10 pass: 3,862; fail: 6; error: 3
Build 2: aarch64/2018/may/11 pass: 3,860; fail: 6; error: 5
Build 3: aarch64/2018/may/13 pass: 3,861; fail: 6; error: 5
Build 4: aarch64/2018/may/15 pass: 3,858; fail: 6; error: 8
Build 5: aarch64/2018/may/17 pass: 3,861; fail: 6; error: 6
Build 6: aarch64/2018/may/21 pass: 3,863; fail: 6; error: 6
Build 7: aarch64/2018/may/23 pass: 3,867; fail: 6; error: 7
Build 8: aarch64/2018/may/25 pass: 3,878; fail: 6; error: 4
Build 9: aarch64/2018/may/27 pass: 3,877; fail: 6; error: 5
Build 10: aarch64/2018/may/29 pass: 3,877; fail: 6; error: 6
Build 11: aarch64/2018/jun/03 pass: 3,884; fail: 6; error: 1
Build 12: aarch64/2018/jun/05 pass: 3,885; fail: 6; error: 3
Build 13: aarch64/2018/jun/07 pass: 3,887; fail: 6; error: 3
Build 14: aarch64/2018/jun/09 pass: 3,888; fail: 6; error: 4

Previous results can be found here: 
 
  http://openjdk.linaro.org/jdkX/openjdk-jtreg-nightly-tests/index.html
 

SPECjbb2015 composite regression test completed
===============================================

This test measures the relative performance of the server
compiler running the SPECjbb2015 composite tests and compares
the performance against the baseline performance of the server
compiler taken on 2016-11-21.

In accordance with [1], the SPECjbb2015 tests are run on a system
which is not production ready and does not meet all the
requirements for publishing compliant results. The numbers below
shall be treated as non-compliant (nc) and are for experimental
purposes only.

Relative performance: Server max-jOPS (nc): 0.62x
Relative performance: Server critical-jOPS (nc): 0.55x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdkX/SPECjbb2015-results/

[1] http://www.spec.org/fairuse.html#Academic

Regression test Hadoop-Terasort completed
=========================================

This test measures the performance of the server and client compilers
running Hadoop sorting a 1GB file using Terasort and compares
the performance against the baseline performance of the Zero interpreter
and against the baseline performance of the client and server compilers
on 2014-04-01.

Relative performance: Zero: 1.0, Client: 66.27, Server: 109.42

Client 66.27 / Client 2014-04-01 (43.00): 1.54x
Server 109.42 / Server 2014-04-01 (71.00): 1.54x

Details of the test setup and historical results may be found here:

    http://openjdk.linaro.org/jdkX/hadoop-terasort-benchmark-results/

This is a summary of the jcstress test results
==============================================
 
The build and test results are cycled every 15 days.
 
2018-04-18 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/107/results/
2018-05-11 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/130/results/
2018-05-13 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/131/results/
2018-05-14 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/133/results/
2018-05-16 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/135/results/
2018-05-18 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/137/results/
2018-05-22 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/141/results/
2018-05-25 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/143/results/
2018-05-26 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/145/results/
2018-05-28 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/147/results/
2018-05-31 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/149/results/
2018-06-04 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/154/results/
2018-06-06 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/156/results/
2018-06-09 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/158/results/
2018-06-10 pass rate: 11560/11560, results: http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/2018/160/results/
 
For detailed information on the test output please refer to: 
 
  http://openjdk.linaro.org/jdkX/jcstress-nightly-runs/


More information about the aarch64-port-dev mailing list