SAPs OpenJDK 8 ppc test setup for JDK jtreg tests

Lindenmaier, Goetz goetz.lindenmaier at sap.com
Fri Jul 23 07:12:37 UTC 2021


Hi,

After SAP discontinued the support of linuxppc64 and aixppc64
of OpenJDK 8 I want to share how we ran the
hotspot jtreg tests, and especially which tests we excluded.
Most of the test excludes could be fixed by downporting
test changes.
Also, issues might be fixed after we excluded them, I did not
check this.

We build with only mandatory configure settings, except for
linuxppc64:  --with-extra-cflags=-Wno-strict-aliasing
aix:         --with-native-debug-symbols=internal

We run the jtreg tests with the following settings:
-Djava.awt.headless=true
-k:(!headful)&(!printer)&(!intermittent)&(!jfr)

We excluded the following tests:

First, tests that fail on all platforms we tested:


# Uses jfr functionality, but lacks key jfr. Eventually the commands
# should not be compiled into the VM if jfr is disabled in configure.
com/sun/management/DiagnosticCommandMBean/DcmdMBeanPermissionsTest.java      generic-all

# Does not compile
javax/management/remote/mandatory/connection/RMIConnector_NPETest.java       generic-all

# headfuld keyword exists in head, was it removed in the downport?
javax/swing/JEditorPane/8195095/ImageViewTest.java                           generic-all
javax/swing/JProgressBar/8161664/ProgressBarMemoryLeakTest.java              generic-all
java/awt/Container/MoveToOtherScreenTest/MoveToOtherScreenTest.java          generic-all
java/awt/event/SequencedEvent/MultipleContextsFunctionalTest.java            generic-all
java/awt/Focus/NullActiveWindowOnFocusLost/NullActiveWindowOnFocusLost.java  generic-all
java/awt/Mouse/EnterExitEvents/ModalDialogEnterExitEventsTest.java           generic-all
java/awt/ScrollPane/ScrollPaneValidateTest.java                              generic-all

# BindException: Address already in use
javax/xml/ws/publish/WSTest.java                                             generic-all

# 8237834: com/sun/jndi/ldap/LdapDnsProviderTest.java failing with LDAP response read timeout
com/sun/jndi/ldap/LdapDnsProviderTest.java                                   generic-all

# Probably "8037485: Refactor java.awt.datatransfer to eliminate dependency on AWT"
# is missing to run this test headless.
java/awt/datatransfer/SystemFlavorMap/AddFlavorTest.java

# These need regular test updates.
jdk/security/infra/java/security/cert/CertPathValidator/certification/HaricaCA.java   generic-all
security/infra/java/security/cert/CertPathValidator/certification/BuypassCA.java      generic-all
security/infra/java/security/cert/CertPathValidator/certification/ComodoCA.java       generic-all
security/infra/java/security/cert/CertPathValidator/certification/LetsEncryptCA.java  generic-all
security/infra/java/security/cert/CertPathValidator/certification/QuoVadisCA.java     generic-all

# These fail on the listed platforms we curretly test.
java/beans/Introspector/7064279/Test7064279.java              windows-all,solaris-all
java/beans/Introspector/Test7172865.java                      windows-all,solaris-all
java/beans/Introspector/Test7195106.java                      windows-all,solaris-all
java/beans/Introspector/Test8027905.java                      windows-all,solaris-all
java/beans/Introspector/Test8027648.java                                  generic-ppc64,solaris-all
java/beans/PropertyEditor/6380849/TestPropertyEditor.java     windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestColorClass.java                 windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestColorClassJava.java             windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestColorClassNull.java             windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestColorClassValue.java            windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestFontClass.java                  windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestFontClassJava.java              windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestFontClassNull.java              windows-all,generic-ppc64,solaris-all
java/beans/PropertyEditor/TestFontClassValue.java             windows-all,generic-ppc64,solaris-all
java/beans/XMLEncoder/java_awt_ScrollPane.java                windows-all,generic-ppc64,solaris-all
java/net/MulticastSocket/TestInterfaces.java                                            solaris-all
java/net/NetworkInterface/UniqueMacAddressesTest.java                                   solaris-all
java/net/URLConnection/HandleContentTypeWithAttrs.java        windows-all,generic-ppc64,solaris-all
java/nio/file/Files/CopyAndMove.java                          windows-all
javax/imageio/plugins/bmp/BMP8BPPLoadTest.java                windows-all,generic-ppc64,solaris-all
sun/security/tools/keytool/printssl.sh                        windows-all


# Does not work because C1 is missing in ppc64. Uses flag -client.
java/awt/font/LineBreakMeasurer/FRCTest.java                                 generic-ppc64

# Unclear. A row of test fixes are missing. Might be shell issue.
java/awt/Toolkit/BadDisplayTest/BadDisplayTest.java                          aix-all

# TestJapaneseLineBreak {
#  ja line break failure: failed to skip position before '?' (\\ufd3e) at 2 and bounded at 1
#   Uncaught exception thrown in test method TestJapaneseLineBreak
java/text/BreakIterator/BreakIteratorTest.java                               aix-all

# Unclear. NullPointerException: null target encoding
sun/awt/datatransfer/SuplementaryCharactersTransferTest.java

# Might need "8196572: Tests ColConvCCMTest.java and MTColConvTest.java fail"
sun/java2d/cmm/ColorConvertOp/ColConvCCMTest.java                            aix-all
sun/java2d/cmm/ColorConvertOp/MTColConvTest.java                             aix-all

# Unclear
sun/tools/clhsdb/Basic.sh                                                    aix-all
sun/tools/hsdb/Basic.sh                                                      aix-all

# Exclude what fails only on our platforms
java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java                     aix-all
java/beans/XMLEncoder/javax_swing_JTree.java                                 aix-all
java/beans/XMLEncoder/Test4631471.java                                       aix-all
java/beans/XMLEncoder/Test4903007.java                                       aix-all
java/lang/ClassLoader/Assert.java                                            aix-all
java/net/MulticastSocket/SetGetNetworkInterfaceTest.java                     aix-all
java/net/MulticastSocket/SetLoopbackMode.java                                aix-all
java/net/MulticastSocket/Test.java                                           aix-all
java/net/ServerSocket/AcceptInheritHandle.java                               aix-all
java/net/Socket/InheritHandle.java                                           aix-all
java/nio/channels/Selector/RacyDeregister.java                               aix-all
java/nio/channels/AsyncCloseAndInterrupt.java                                aix-all
java/nio/file/Files/delete_on_close.sh                                       aix-all
java/nio/file/Files/SBC.java                                                 aix-all
sun/security/krb5/auto/Unreachable.java                                      aix-all
sun/security/tools/jarsigner/diffend.sh                                      aix-all
tools/launcher/MultipleJRE.sh                                                aix-all

# Needs "8194869: [TESTBUG][aix, s390] Adapt tests to platforms"
javax/imageio/spi/AppletContextTest/BadPluginConfigurationTest.sh            aix-all
java/awt/FontClass/CreateFont/fileaccess/FontFile.java                       aix-all
java/awt/JAWT/JAWT.sh                                                        aix-all
java/awt/Toolkit/AutoShutdown/EventQueuePush/EventQueuePushAutoshutdown.sh   aix-all

# Is it the unsolved issue in 8197797?
java/awt/Graphics2D/DrawString/RotTransText.java                             aix-all

@key headful and similar tags were added to a huge amount of tests
in upstream repositories. Many of the changes adding these were contributed
by us to get the ppc tests run headless green.
In 8, we just added the tests of these changes to the ProblemList
instead of downporting the test adaptions.
I just enumerate the changes here, listing all the tests
is pointless I guess.

# 8207830: [aix] disable jfr in build and tests
# 8183286: Some java/awt and javax/swing tests miss headful jtreg keyword
# 8185500: [TESTBUG] Add keywords headful/printer in java/awt and javax tests.
# 8160974: [TESTBUG] Mark more headful tests with @key headful.
# 8159690: [TESTBUG] Mark headful tests with @key headful.
# 8196196: Headful tests should not be run in headless mode
# 8198333: ProblemList should be updated for headless mode

Best regards,
  Goetz
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.openjdk.java.net/pipermail/ppc-aix-port-dev/attachments/20210723/f2c050f6/attachment-0001.htm>


More information about the ppc-aix-port-dev mailing list