running jtreg tests

[Stephen Bannasch]

At 3:37 PM -0700 5/12/11, Jonathan Gibbons wrote:
>Mac folk,
>
>Bear with me, I'm a relative newbie to Mac and the Mac OS X port, although I've been around JDK for a while.
>
>First up, I'm impressed how easy it was to get the OpenJDK build up and running on my new MacBook Pro. Congratulations to whoever helped make it that simple and easy.
>
>That being said, I'm trying to run the jtreg tests on the langtools repo, and without changing anything, I'm getting 37 failures. Most if not all of them look related to jtreg not correctly determining an absolute path for the JDK under test.
>
>Before I put a lot of effort into debugging this further, I thought I'd ask if this is to be expected, at this stage of the game.  Should I expect all the langtools tests to pass?   In a standard Windows/Linux/Solaris build all the langtools tests should pass.
>
>Any advice would be appreciated.
>
>-- Jon



I haven't run the langtools tests after a build before but I did just now and got 1756 passing tests, 35 failed tests and threethat stopped with errors -- does this correspond to the results you get?

$ jtreg -XX:+UnlockExperimentalVMOptions -jdk:build/macosx-universal/j2sdk-bundle/1.7.0.jdk/Contents/Home  -v:summary langtools/test/tools/

...

Test results: passed: 1,756; failed: 35; error: 3

Here's a summary of test that failed:

Execution failed: `main' threw exception: java.lang.Exception: 10 errors occurred.

  tools/javadoc/6958836/Test.java : javadoc should support -Xmaxerrs and -Xmaxwarns
 
Execution failed: exit code 1

  tools/apt/Basics/apt.sh : test consistency of annotation discovery
  tools/apt/Basics/print.sh : test availabilty of print option
  tools/apt/Compile/compile.sh : Test simple usages of apt, including delegating to javac
  tools/apt/Discovery/discovery.sh : Test consistency of annotation discovery
  tools/apt/Misc/misc.sh : Miscelleneous tests
  tools/apt/Options/options.sh : Test availabilty of command line options in processors
  tools/apt/Scanners/scanner.sh : Test source order scanner
  tools/javac/ClassPathTest/ClassPathTest.sh : Test -classpath option and classpath defaults.
  tools/javac/ExtDirs/ExtDirs.sh : Test that '.jar' files in -extdirs are found.
  tools/javac/Paths/Class-Path.sh : Test handling of the Class-Path attribute in jar file manifests
  tools/javac/Paths/Class-Path2.sh : Test handling of the Class-Path attribute in jar file manifests
  tools/javac/Paths/Diagnostics.sh : Test for proper diagnostics during path manipulation operations
  tools/javac/Paths/Help.sh : Check for -help and -X flags
  tools/javac/Paths/MineField.sh : Test that javac and java find files in similar ways
  tools/javac/Paths/wcMineField.sh : Test classpath wildcards for javac and java -classpath option.
  tools/javac/javazip/Test.sh : check that source files inside zip files on the class path are ignored
  tools/javac/newlines/Newlines.sh : portability : javac.properties
  tools/javah/ReadOldClass.sh : Ensure that javah/javadoc doesn't try to read (new) source files
  tools/javap/PublicInterfaceTest.sh : Verify that javap marks public interfaces as public

Execution failed: exit code 127

  tools/javac/ProtectedInnerClass/ProtectedInnerClass.sh : Verify allowed access to protected class from another package.
  tools/javac/T5090006/T5090006.java : javac fails with assertion error
  tools/javac/constDebug/ConstDebug.java : javac compiler incorrectly inserts <clinit> when -g is specified
  tools/javac/fatalErrors/NoJavaLang.java : Verify that the compiler does not crash when java.lang is not found.
  tools/javac/innerClassFile/Driver.sh : Prob w/static inner class with same name as a regular class
  tools/javac/links/links.sh : javac no longer follows symlinks
  tools/javac/stackmap/T4955930.java : The "method0" StackMap attribute should have two entries instead of three
  tools/javac/unicode/SupplementaryJavaID6.sh : Ensure that a supplementary character can be used as part/whole of a class name on platforms that have Unicode aware filesystems.
  tools/javap/pathsep.sh : In Windows, javap doesnt load classes from rt.jar
  tools/javap/stackmap/T6271292.sh : Verify that javap prints StackMapTable attribute contents

Execution failed: exit code 2

  tools/javac/4846262/Test.sh : check that javac operates correctly in EBCDIC locale
  tools/javac/6302184/T6302184.sh : javac hidden options that generate source should use the given encoding, if available
  tools/javac/versions/check.sh : Check interpretation of -target and -source options
  tools/javah/6257087/foo.sh :
  tools/javah/ConstMacroTest.sh :

Here's a summary of the three tests with errors:

Test ignored: Need to make the contentCache in JavacFileManager be aware of changes to the encoding. Need to propogate -source (and -encoding?) down to the JavacFileManager

  tools/javac/api/T6306137.java : JSR 199: encoding option doesn't affect standard file manager

Test ignored: fix has been disabled as a consequence of 6996415

  tools/javac/generics/OverrideBridge.java : javac should create bridge methods when type variable bounds restricted

Test ignored: this test should be rewritten when fixing 6473901

  tools/javac/api/T6397104.java : JSR 199: JavaFileManager.getFileForOutput should have sibling argument