SAPs OpenJDK 8 ppc test setup for JDK jtreg tests
Hi, After SAP discontinued the support of linuxppc64 and aixppc64 of OpenJDK 8 I want to share how we ran the hotspot jtreg tests, and especially which tests we excluded. Most of the test excludes could be fixed by downporting test changes. Also, issues might be fixed after we excluded them, I did not check this. We build with only mandatory configure settings, except for linuxppc64: --with-extra-cflags=-Wno-strict-aliasing aix: --with-native-debug-symbols=internal We run the jtreg tests with the following settings: -Djava.awt.headless=true -k:(!headful)&(!printer)&(!intermittent)&(!jfr) We excluded the following tests: First, tests that fail on all platforms we tested: # Uses jfr functionality, but lacks key jfr. Eventually the commands # should not be compiled into the VM if jfr is disabled in configure. com/sun/management/DiagnosticCommandMBean/DcmdMBeanPermissionsTest.java generic-all # Does not compile javax/management/remote/mandatory/connection/RMIConnector_NPETest.java generic-all # headfuld keyword exists in head, was it removed in the downport? javax/swing/JEditorPane/8195095/ImageViewTest.java generic-all javax/swing/JProgressBar/8161664/ProgressBarMemoryLeakTest.java generic-all java/awt/Container/MoveToOtherScreenTest/MoveToOtherScreenTest.java generic-all java/awt/event/SequencedEvent/MultipleContextsFunctionalTest.java generic-all java/awt/Focus/NullActiveWindowOnFocusLost/NullActiveWindowOnFocusLost.java generic-all java/awt/Mouse/EnterExitEvents/ModalDialogEnterExitEventsTest.java generic-all java/awt/ScrollPane/ScrollPaneValidateTest.java generic-all # BindException: Address already in use javax/xml/ws/publish/WSTest.java generic-all # 8237834: com/sun/jndi/ldap/LdapDnsProviderTest.java failing with LDAP response read timeout com/sun/jndi/ldap/LdapDnsProviderTest.java generic-all # Probably "8037485: Refactor java.awt.datatransfer to eliminate dependency on AWT" # is missing to run this test headless. java/awt/datatransfer/SystemFlavorMap/AddFlavorTest.java # These need regular test updates. jdk/security/infra/java/security/cert/CertPathValidator/certification/HaricaCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/BuypassCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/ComodoCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/LetsEncryptCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/QuoVadisCA.java generic-all # These fail on the listed platforms we curretly test. java/beans/Introspector/7064279/Test7064279.java windows-all,solaris-all java/beans/Introspector/Test7172865.java windows-all,solaris-all java/beans/Introspector/Test7195106.java windows-all,solaris-all java/beans/Introspector/Test8027905.java windows-all,solaris-all java/beans/Introspector/Test8027648.java generic-ppc64,solaris-all java/beans/PropertyEditor/6380849/TestPropertyEditor.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClass.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassJava.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassNull.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassValue.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClass.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassJava.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassNull.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassValue.java windows-all,generic-ppc64,solaris-all java/beans/XMLEncoder/java_awt_ScrollPane.java windows-all,generic-ppc64,solaris-all java/net/MulticastSocket/TestInterfaces.java solaris-all java/net/NetworkInterface/UniqueMacAddressesTest.java solaris-all java/net/URLConnection/HandleContentTypeWithAttrs.java windows-all,generic-ppc64,solaris-all java/nio/file/Files/CopyAndMove.java windows-all javax/imageio/plugins/bmp/BMP8BPPLoadTest.java windows-all,generic-ppc64,solaris-all sun/security/tools/keytool/printssl.sh windows-all # Does not work because C1 is missing in ppc64. Uses flag -client. java/awt/font/LineBreakMeasurer/FRCTest.java generic-ppc64 # Unclear. A row of test fixes are missing. Might be shell issue. java/awt/Toolkit/BadDisplayTest/BadDisplayTest.java aix-all # TestJapaneseLineBreak { # ja line break failure: failed to skip position before '?' (\\ufd3e) at 2 and bounded at 1 # Uncaught exception thrown in test method TestJapaneseLineBreak java/text/BreakIterator/BreakIteratorTest.java aix-all # Unclear. NullPointerException: null target encoding sun/awt/datatransfer/SuplementaryCharactersTransferTest.java # Might need "8196572: Tests ColConvCCMTest.java and MTColConvTest.java fail" sun/java2d/cmm/ColorConvertOp/ColConvCCMTest.java aix-all sun/java2d/cmm/ColorConvertOp/MTColConvTest.java aix-all # Unclear sun/tools/clhsdb/Basic.sh aix-all sun/tools/hsdb/Basic.sh aix-all # Exclude what fails only on our platforms java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java aix-all java/beans/XMLEncoder/javax_swing_JTree.java aix-all java/beans/XMLEncoder/Test4631471.java aix-all java/beans/XMLEncoder/Test4903007.java aix-all java/lang/ClassLoader/Assert.java aix-all java/net/MulticastSocket/SetGetNetworkInterfaceTest.java aix-all java/net/MulticastSocket/SetLoopbackMode.java aix-all java/net/MulticastSocket/Test.java aix-all java/net/ServerSocket/AcceptInheritHandle.java aix-all java/net/Socket/InheritHandle.java aix-all java/nio/channels/Selector/RacyDeregister.java aix-all java/nio/channels/AsyncCloseAndInterrupt.java aix-all java/nio/file/Files/delete_on_close.sh aix-all java/nio/file/Files/SBC.java aix-all sun/security/krb5/auto/Unreachable.java aix-all sun/security/tools/jarsigner/diffend.sh aix-all tools/launcher/MultipleJRE.sh aix-all # Needs "8194869: [TESTBUG][aix, s390] Adapt tests to platforms" javax/imageio/spi/AppletContextTest/BadPluginConfigurationTest.sh aix-all java/awt/FontClass/CreateFont/fileaccess/FontFile.java aix-all java/awt/JAWT/JAWT.sh aix-all java/awt/Toolkit/AutoShutdown/EventQueuePush/EventQueuePushAutoshutdown.sh aix-all # Is it the unsolved issue in 8197797? java/awt/Graphics2D/DrawString/RotTransText.java aix-all @key headful and similar tags were added to a huge amount of tests in upstream repositories. Many of the changes adding these were contributed by us to get the ppc tests run headless green. In 8, we just added the tests of these changes to the ProblemList instead of downporting the test adaptions. I just enumerate the changes here, listing all the tests is pointless I guess. # 8207830: [aix] disable jfr in build and tests # 8183286: Some java/awt and javax/swing tests miss headful jtreg keyword # 8185500: [TESTBUG] Add keywords headful/printer in java/awt and javax tests. # 8160974: [TESTBUG] Mark more headful tests with @key headful. # 8159690: [TESTBUG] Mark headful tests with @key headful. # 8196196: Headful tests should not be run in headless mode # 8198333: ProblemList should be updated for headless mode Best regards, Goetz
participants (1)
-
Lindenmaier, Goetz