Questions about JCK test failures on x86_64 Ubuntu 16.04 with openjdk8

[Simon Rushton]

JCK8b is being run at the AdoptOpenJDK project with a view to marking 
builds created at the AdoptOpenJDK site as JCK compliant.

The test machine is linux_x86_64 running Ubuntu 16.04.  We are unable to 
get a clean run of the JCK because a number of the JCK tests in the 
java_awt test suite seem to be sensitive to the window manager and display 
setup.  The test results are consistent across the AdoptOpenJDK builds and 
Oracle builds.

Specifically:

1. If the standard Ubuntu desktop is used (DISPLAY=:0) the following tests 
fail:
java_awt/Window/OpacityPixelChecking
java_awt/Window/ShapePixelChecking
java_awt/Window/OpacityPixelChecking_Cross
The tests pass with Windows 7.

The OpacityPixelChecking test will pass if a delay is inserted between two 
lines in the test case:

fgWindow.setOpacity(1.0f);
<insert delay here>
fgWindow.setBackground(fgWindowColor);

So perhaps the test case assumes that some asynchronous activity has 
occurred before is actually has happened?

2. If a plain Xvfb X server is used without a window manager running, two 
java_awt tests fail which do not fail with the 'real' display:
a. 
api/java_awt/awt_focus_subsystem/focusable_windows/index_FocusableWindow3.
- There was an issue about this test six years ago which showed on OSX: 
http://macosx-port-dev.openjdk.java.narkive.com/jcQB6tyL/7u4-review-request-for-7145827-macosx-jck-failure-in-b11-focusablewindow3 
- it was supposedly fixed by jdk8b115.
b. api/java_awt/Frame/indexTGF_GetSetExtendedState
- see also https://bugs.openjdk.java.net/browse/JDK-7145827
- This test passes when metacity is running on the Xvfb display (but see 
below).

3. If the metacity window manager is running on the Xvfb display, the 
api/java_awt/Frame/indexTGF_GetSetExtendedState test passes (2b. above), 
but these tests fail instead:

SplashScreen/CreateGraphicsTestsTsp_CreateGraphicsTestsTsp
SplashScreen/StaticContentTestsArgGIF_StaticContentTestsArgGIF
SplashScreen/StaticContentTestsArgJPG_StaticContentTestsArgJPG
SplashScreen/StaticContentTestsArgPNG_StaticContentTestsArgPNG
SplashScreen/StaticContentTestsMnfGIF_StaticContentTestsMnfGIF
SplashScreen/StaticContentTestsMnfJPG_StaticContentTestsMnfJPG
SplashScreen/StaticContentTestsMnfPNG_StaticContentTestsMnfPNG
SplashScreen/index_PrecedenceTest


So some questions:
1. Is x86_64 with Ubuntu 16.04 a platform we would expect to run the JCK 
successfully with openjdk8?
2. Is x86_64 a platform with Ubuntu 16.04 a platform which has been tested 
already?
- If so were those runs successful?
- If the runs were successful what windows manager was used in the 
testing?
3. On which other x86 linux operating systems have the awt tests been 
executed successfully, and which windows manager setup was used?






Simon M Rushton
 Hursley Park

Java Test Architect
 Hursley, SO21 2JN
430821
 United Kingdom
IBM Software Group, Application and Integration Middleware Software
 

Phone:
+44-1962-818298
 

e-mail:
rushton at uk.ibm.com
 


Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openjdk.java.net/pipermail/conformance-discuss/attachments/20180110/3e009814/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 360 bytes
Desc: not available
URL: <http://mail.openjdk.java.net/pipermail/conformance-discuss/attachments/20180110/3e009814/attachment.gif>