From goetz.lindenmaier at sap.com Fri Jul 23 07:07:40 2021 From: goetz.lindenmaier at sap.com (Lindenmaier, Goetz) Date: Fri, 23 Jul 2021 07:07:40 +0000 Subject: SAPs OpenJDK 8 ppc test setup for HOTSPOT jtreg tests Message-ID: Hi, After SAP discontinued the support of linuxppc64 and aixppc64 of OpenJDK 8 I want to share how we ran the hotspot jtreg tests, and especially which tests we excluded. Most of the test excludes could be fixed by downporting test changes. Also, issues might be fixed after we excluded them, I did not check this. We build with only mandatory configure settings, except for the following: linuxppc64: --with-extra-cflags=-Wno-strict-aliasing aix: --with-native-debug-symbols=internal We run jtreg with the following settings: -Djava.awt.headless=true -k:(!headful)&(!ignore)&(!stress)&(!intermittent) We excluded the following tests: First, tests that fail on all platforms we tested: # Testbug # This test copied or moved the root directory / to some subdirectory, filling up the disc compiler/ciReplay/TestSA.sh generic-all compiler/ciReplay/TestVM_no_comp_level.sh generic-all compiler/ciReplay/TestVM.sh generic-all # Fails in 8 until 8044416 will be fixed or # the test exclusion change 8044540 will be downported from jdk9 serviceability/sa/jmap-hashcode/Test8028623.java generic-all # Fixed in 11 by 8195621: JTReg failure: gc/g1/TestLargePageUseForAuxMemory.java gc/g1/TestLargePageUseForAuxMemory.java generic-all Further, tests we see failing on ppc but not on x86_64. # Class data sharing not implemented on ppc. runtime/CDSCompressedKPtrs/CDSCompressedKPtrs.java generic-ppc64 runtime/CDSCompressedKPtrs/CDSCompressedKPtrsError.java generic-ppc64 runtime/CompressedOops/CompressedClassPointers.java generic-ppc64 runtime/NMT/NMTWithCDS.java generic-ppc64 runtime/NMT/VirtualAllocCommitUncommitRecommit.java generic-ppc64 runtime/SharedArchiveFile/CdsDifferentObjectAlignment.java generic-ppc64 runtime/SharedArchiveFile/CdsSameObjectAlignment.java generic-ppc64 runtime/SharedArchiveFile/LimitSharedSizes.java generic-ppc64 runtime/SharedArchiveFile/PrintSharedArchiveAndExit.java generic-ppc64 runtime/SharedArchiveFile/SharedArchiveFile.java generic-ppc64 runtime/SharedArchiveFile/SharedBaseAddress.java aix-ppc64 runtime/SharedArchiveFile/SpaceUtilizationCheck.java generic-ppc64 # C1 not implemented. In jdk9 these are moved to subdir /c1/. compiler/6478991/NullCheckTest.java generic_ppc64 compiler/6579789/Test6579789.java generic_ppc64 compiler/6756768/Test6756768_2.java generic_ppc64 compiler/6756768/Test6756768.java generic_ppc64 compiler/6757316/Test6757316.java generic_ppc64 compiler/6758234/Test6758234.java generic_ppc64 compiler/6769124/TestArrayCopy6769124.java generic_ppc64 compiler/6769124/TestDeoptInt6769124.java generic_ppc64 compiler/6769124/TestUnalignedLoad6769124.java generic_ppc64 compiler/6795465/Test6795465.java generic_ppc64 compiler/6849574/Test.java generic_ppc64 compiler/6855215/Test6855215.java generic_ppc64 compiler/6932496/Test6932496.java generic_ppc64 compiler/7042153/Test7042153.java generic_ppc64 compiler/7090976/Test7090976.java generic_ppc64 compiler/7103261/Test7103261.java generic_ppc64 compiler/7123108/Test7123108.java generic_ppc64 compiler/8011706/Test8011706.java generic_ppc64 compiler/8011771/Test8011771.java generic_ppc64 # tests that set -client which is currently not supported compiler/8004051/Test8004051.java generic-ppc64 gc/g1/TestHumongousCodeCacheRoots.java generic-ppc64 compiler/tiered/Level2RecompilationTest.java generic-ppc64 # Don't look at tests that will be renamed. These don't show obvious errors in the port. compiler/8004051/Test8004051.java generic-ppc64 # Fail because of 64K page size # Fixed in 9, but 8067941 not downported. compiler/exceptions/TestRecursiveReplacedException.java generic-ppc64 compiler/runtime/6865265/StackOverflowBug.java linux-ppc64 compiler/6865265/StackOverflowBug.java linux-ppc64 # In addition, this test is shaky in the amount of stack frames pushed. compiler/uncommontrap/8009761/Test8009761.java linux-ppc64,aix-ppc64,windows-all compiler/8009761/Test8009761.java linux-ppc64,aix-ppc64,windows-all compiler/uncommontrap/StackOverflowGuardPagesOff.java linux-ppc64 compiler/uncommontrap/TestStackBangMonitorOwned.java linux-ppc64 compiler/uncommontrap/TestStackBangRbp.java linux-ppc64 gc/arguments/TestMaxHeapSizeTools.java linux-ppc64 gc/g1/TestGCLogMessages.java linux-ppc64 gc/g1/TestHumongousAllocInitialMark.java linux-ppc64 runtime/whitebox/WBStackSize.java linux-ppc64 sanity/ExecuteInternalVMTests.java linux-ppc64 # These also fail because of the 64K problem. gc/arguments/TestCMSHeapSizeFlags.java linux-ppc64 gc/arguments/TestG1HeapSizeFlags.java linux-ppc64 gc/arguments/TestParallelHeapSizeFlags.java linux-ppc64 gc/arguments/TestSerialHeapSizeFlags.java linux-ppc64 # Fail on aix because OS not supported in test. # Fixed in 9, but 8068013 not downported. serviceability/dcmd/DynLibDcmdTest.java aix-ppc64 testlibrary_tests/TestMutuallyExclusivePlatformPredicates.java aix-ppc64 # Fail on aix and mac because SA not supported. # Fixed in 9, but 8068778 not downported # linux-ppc64: SA isn't downported gc/metaspace/CompressedClassSpaceSizeInJmapHeap.java generic-all,macosx-all gc/metaspace/CompressedClassSpaceSizeInJmapHeap.jtr generic-all,macosx-all # Fail on ppc64 because tiered compilation not supported. # Test fixed in 9, but 8067941 not downported compiler/arguments/CheckCompileThresholdScaling.java generic-ppc64 # OptimizeFill is broken on ppc. compiler/6982370/Test6982370.java generic-ppc64 # These require test_env.sh-like adaptions (mention AIX in switch statement). # They are not in jdk9, so no fix to downport. compiler/6894807/IsInstanceTest.java aix-ppc64 runtime/7110720/Test7110720.java aix-ppc64 runtime/7110720/Test7110720.sh aix-ppc64 # Must add SIGTRAP in check code. runtime/memory/ReserveMemory.java aix-ppc64 # Modes don't work in 8. runtime/CompressedOops/UseCompressedOops.java aix-ppc64 Best regards, Goetz. -------------- next part -------------- An HTML attachment was scrubbed... URL: From goetz.lindenmaier at sap.com Fri Jul 23 07:12:37 2021 From: goetz.lindenmaier at sap.com (Lindenmaier, Goetz) Date: Fri, 23 Jul 2021 07:12:37 +0000 Subject: SAPs OpenJDK 8 ppc test setup for JDK jtreg tests Message-ID: Hi, After SAP discontinued the support of linuxppc64 and aixppc64 of OpenJDK 8 I want to share how we ran the hotspot jtreg tests, and especially which tests we excluded. Most of the test excludes could be fixed by downporting test changes. Also, issues might be fixed after we excluded them, I did not check this. We build with only mandatory configure settings, except for linuxppc64: --with-extra-cflags=-Wno-strict-aliasing aix: --with-native-debug-symbols=internal We run the jtreg tests with the following settings: -Djava.awt.headless=true -k:(!headful)&(!printer)&(!intermittent)&(!jfr) We excluded the following tests: First, tests that fail on all platforms we tested: # Uses jfr functionality, but lacks key jfr. Eventually the commands # should not be compiled into the VM if jfr is disabled in configure. com/sun/management/DiagnosticCommandMBean/DcmdMBeanPermissionsTest.java generic-all # Does not compile javax/management/remote/mandatory/connection/RMIConnector_NPETest.java generic-all # headfuld keyword exists in head, was it removed in the downport? javax/swing/JEditorPane/8195095/ImageViewTest.java generic-all javax/swing/JProgressBar/8161664/ProgressBarMemoryLeakTest.java generic-all java/awt/Container/MoveToOtherScreenTest/MoveToOtherScreenTest.java generic-all java/awt/event/SequencedEvent/MultipleContextsFunctionalTest.java generic-all java/awt/Focus/NullActiveWindowOnFocusLost/NullActiveWindowOnFocusLost.java generic-all java/awt/Mouse/EnterExitEvents/ModalDialogEnterExitEventsTest.java generic-all java/awt/ScrollPane/ScrollPaneValidateTest.java generic-all # BindException: Address already in use javax/xml/ws/publish/WSTest.java generic-all # 8237834: com/sun/jndi/ldap/LdapDnsProviderTest.java failing with LDAP response read timeout com/sun/jndi/ldap/LdapDnsProviderTest.java generic-all # Probably "8037485: Refactor java.awt.datatransfer to eliminate dependency on AWT" # is missing to run this test headless. java/awt/datatransfer/SystemFlavorMap/AddFlavorTest.java # These need regular test updates. jdk/security/infra/java/security/cert/CertPathValidator/certification/HaricaCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/BuypassCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/ComodoCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/LetsEncryptCA.java generic-all security/infra/java/security/cert/CertPathValidator/certification/QuoVadisCA.java generic-all # These fail on the listed platforms we curretly test. java/beans/Introspector/7064279/Test7064279.java windows-all,solaris-all java/beans/Introspector/Test7172865.java windows-all,solaris-all java/beans/Introspector/Test7195106.java windows-all,solaris-all java/beans/Introspector/Test8027905.java windows-all,solaris-all java/beans/Introspector/Test8027648.java generic-ppc64,solaris-all java/beans/PropertyEditor/6380849/TestPropertyEditor.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClass.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassJava.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassNull.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestColorClassValue.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClass.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassJava.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassNull.java windows-all,generic-ppc64,solaris-all java/beans/PropertyEditor/TestFontClassValue.java windows-all,generic-ppc64,solaris-all java/beans/XMLEncoder/java_awt_ScrollPane.java windows-all,generic-ppc64,solaris-all java/net/MulticastSocket/TestInterfaces.java solaris-all java/net/NetworkInterface/UniqueMacAddressesTest.java solaris-all java/net/URLConnection/HandleContentTypeWithAttrs.java windows-all,generic-ppc64,solaris-all java/nio/file/Files/CopyAndMove.java windows-all javax/imageio/plugins/bmp/BMP8BPPLoadTest.java windows-all,generic-ppc64,solaris-all sun/security/tools/keytool/printssl.sh windows-all # Does not work because C1 is missing in ppc64. Uses flag -client. java/awt/font/LineBreakMeasurer/FRCTest.java generic-ppc64 # Unclear. A row of test fixes are missing. Might be shell issue. java/awt/Toolkit/BadDisplayTest/BadDisplayTest.java aix-all # TestJapaneseLineBreak { # ja line break failure: failed to skip position before '?' (\\ufd3e) at 2 and bounded at 1 # Uncaught exception thrown in test method TestJapaneseLineBreak java/text/BreakIterator/BreakIteratorTest.java aix-all # Unclear. NullPointerException: null target encoding sun/awt/datatransfer/SuplementaryCharactersTransferTest.java # Might need "8196572: Tests ColConvCCMTest.java and MTColConvTest.java fail" sun/java2d/cmm/ColorConvertOp/ColConvCCMTest.java aix-all sun/java2d/cmm/ColorConvertOp/MTColConvTest.java aix-all # Unclear sun/tools/clhsdb/Basic.sh aix-all sun/tools/hsdb/Basic.sh aix-all # Exclude what fails only on our platforms java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java aix-all java/beans/XMLEncoder/javax_swing_JTree.java aix-all java/beans/XMLEncoder/Test4631471.java aix-all java/beans/XMLEncoder/Test4903007.java aix-all java/lang/ClassLoader/Assert.java aix-all java/net/MulticastSocket/SetGetNetworkInterfaceTest.java aix-all java/net/MulticastSocket/SetLoopbackMode.java aix-all java/net/MulticastSocket/Test.java aix-all java/net/ServerSocket/AcceptInheritHandle.java aix-all java/net/Socket/InheritHandle.java aix-all java/nio/channels/Selector/RacyDeregister.java aix-all java/nio/channels/AsyncCloseAndInterrupt.java aix-all java/nio/file/Files/delete_on_close.sh aix-all java/nio/file/Files/SBC.java aix-all sun/security/krb5/auto/Unreachable.java aix-all sun/security/tools/jarsigner/diffend.sh aix-all tools/launcher/MultipleJRE.sh aix-all # Needs "8194869: [TESTBUG][aix, s390] Adapt tests to platforms" javax/imageio/spi/AppletContextTest/BadPluginConfigurationTest.sh aix-all java/awt/FontClass/CreateFont/fileaccess/FontFile.java aix-all java/awt/JAWT/JAWT.sh aix-all java/awt/Toolkit/AutoShutdown/EventQueuePush/EventQueuePushAutoshutdown.sh aix-all # Is it the unsolved issue in 8197797? java/awt/Graphics2D/DrawString/RotTransText.java aix-all @key headful and similar tags were added to a huge amount of tests in upstream repositories. Many of the changes adding these were contributed by us to get the ppc tests run headless green. In 8, we just added the tests of these changes to the ProblemList instead of downporting the test adaptions. I just enumerate the changes here, listing all the tests is pointless I guess. # 8207830: [aix] disable jfr in build and tests # 8183286: Some java/awt and javax/swing tests miss headful jtreg keyword # 8185500: [TESTBUG] Add keywords headful/printer in java/awt and javax tests. # 8160974: [TESTBUG] Mark more headful tests with @key headful. # 8159690: [TESTBUG] Mark headful tests with @key headful. # 8196196: Headful tests should not be run in headless mode # 8198333: ProblemList should be updated for headless mode Best regards, Goetz -------------- next part -------------- An HTML attachment was scrubbed... URL: