comparing jtreg test results
Matthias Klose
doko at ubuntu.com
Fri Jan 16 07:27:57 PST 2009
[this is all done using IcedTea builds]
Comparing 6b12 and 6b14 builds on ix86 I do see some regressions in the tests
(compared by diffing the log output):
jdk:
+FAILED: com/sun/jdi/EarlyReturnNegativeTest.java
+FAILED: com/sun/jdi/NewInstanceTest.java
+FAILED: com/sun/jdi/RedefineCrossEvent.java
+FAILED: javax/crypto/Cipher/TestGetInstance.java
+FAILED: javax/naming/ldap/LdapName/CompareToEqualsTests.java
+FAILED: sun/rmi/rmic/RMIGenerator/RmicDefault.java
+FAILED: sun/security/util/Oid/OidFormat.java
+FAILED: sun/security/x509/AlgorithmId/ExtensibleAlgorithmId.java
+FAILED: sun/security/x509/AVA/EmailAddressEncoding.java
+FAILED: sun/security/x509/X500Name/AllAttribs.java
Some tests just disappear (assuming this is due to the hotspot import in icedtea):
hotspot:
-Passed: compiler/6547163/Test.java
-Passed: compiler/6563987/Test.java
-Passed: compiler/6571539/Test.java
-Passed: compiler/6595044/Main.java
-Passed: compiler/6707044/LuceneCrash.java
Can somebody reproduce these?
Then when running the testsuite with the xvfb xserver, I get many errors "Cannot
connect to the X server", although the mauve testsuite runs fine with the xvfb
server.
Matthias
The single failures:
+FAILED: com/sun/jdi/EarlyReturnNegativeTest.java
EarlyReturnNegativeTest: failed
debugee in doit
----------System.err:(32/2097)----------
run args: [EarlyReturnNegativeTarg]
failure: com.sun.jdi.ClassNotLoadedException: Class java.lang.Object not loaded
com.sun.jdi.ClassNotLoadedException: Class java.lang.Object not loaded
at
com.sun.tools.jdi.ClassLoaderReferenceImpl.findType(ClassLoaderReferenceImpl.java:106)
at com.sun.tools.jdi.ReferenceTypeImpl.findType(ReferenceTypeImpl.java:1168)
at com.sun.tools.jdi.MethodImpl.findType(MethodImpl.java:148)
at
com.sun.tools.jdi.MethodImpl$ReturnContainer.findType(MethodImpl.java:241)
at
com.sun.tools.jdi.ArrayReferenceImpl.validateAssignment(ArrayReferenceImpl.java:243)
at
com.sun.tools.jdi.ObjectReferenceImpl.prepareForAssignmentTo(ObjectReferenceImpl.java:557)
at com.sun.tools.jdi.ValueImpl.prepareForAssignment(ValueImpl.java:48)
at
com.sun.tools.jdi.ThreadReferenceImpl.forceEarlyReturn(ThreadReferenceImpl.java:532)
at EarlyReturnNegativeTest.doEarly(EarlyReturnNegativeTest.java:212)
at
EarlyReturnNegativeTest.breakpointReached(EarlyReturnNegativeTest.java:262)
at TestScaffold$EventHandler.notifyEvent(TestScaffold.java:191)
at TestScaffold$EventHandler.run(TestScaffold.java:275)
at java.lang.Thread.run(Thread.java:636)
java.lang.Exception: EarlyReturnNegativeTest: failed
at EarlyReturnNegativeTest.runTests(EarlyReturnNegativeTest.java:370)
at TestScaffold.startTests(TestScaffold.java:429)
at EarlyReturnNegativeTest.main(EarlyReturnNegativeTest.java:189)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainWrapper$MainThread.run(MainWrapper.java:94)
at java.lang.Thread.run(Thread.java:636)
+FAILED: com/sun/jdi/NewInstanceTest.java
----------System.err:(23/1367)----------
run args: [NewInstanceTarg]
Making array for field: objArray
com.sun.jdi.ClassNotLoadedException: Class java.lang.Object[] not loaded
at
com.sun.tools.jdi.ClassLoaderReferenceImpl.findType(ClassLoaderReferenceImpl.java:106)
at com.sun.tools.jdi.ReferenceTypeImpl.findType(ReferenceTypeImpl.java:1168)
at com.sun.tools.jdi.FieldImpl.findType(FieldImpl.java:73)
at com.sun.tools.jdi.FieldImpl.type(FieldImpl.java:68)
at NewInstanceTest.makeArray(NewInstanceTest.java:81)
at NewInstanceTest.runTests(NewInstanceTest.java:97)
at TestScaffold.startTests(TestScaffold.java:429)
at NewInstanceTest.main(NewInstanceTest.java:73)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainWrapper$MainThread.run(MainWrapper.java:94)
at java.lang.Thread.run(Thread.java:636)
IOException reading output of child java interpreter:Stream closed
+FAILED: com/sun/jdi/RedefineCrossEvent.java
run args: [-redefstart, -redefevent, NewInstanceTarg]
Redefining class NewInstanceTarg (loaded by instance of
sun.misc.Launcher$AppClassLoader(id=51))
Redefining class NewInstanceTarg (loaded by instance of
sun.misc.Launcher$AppClassLoader(id=51))
Making array for field: objArray
com.sun.jdi.ClassNotLoadedException: Class java.lang.Object[] not loaded
at
com.sun.tools.jdi.ClassLoaderReferenceImpl.findType(ClassLoaderReferenceImpl.java:106)
at com.sun.tools.jdi.ReferenceTypeImpl.findType(ReferenceTypeImpl.java:1168)
at com.sun.tools.jdi.FieldImpl.findType(FieldImpl.java:73)
at com.sun.tools.jdi.FieldImpl.type(FieldImpl.java:68)
at NewInstanceTest.makeArray(NewInstanceTest.java:81)
at NewInstanceTest.runTests(NewInstanceTest.java:97)
at TestScaffold.startTests(TestScaffold.java:429)
at NewInstanceTest.main(NewInstanceTest.java:73)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainWrapper$MainThread.run(MainWrapper.java:94)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: com.sun.jdi.ClassNotLoadedException:
Class java.lang.Object[] not loaded
JavaTest Message: shutting down test
+FAILED: javax/crypto/Cipher/TestGetInstance.java
----------System.err:(14/747)----------
java.security.NoSuchAlgorithmException: No such algorithm: foo
at javax.crypto.Cipher.getInstance(Cipher.java:589)
at javax.crypto.Cipher.getInstance(Cipher.java:510)
at TestGetInstance.main(TestGetInstance.java:134)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: java.security.NoSuchAlgorithmException
JavaTest Message: shutting down test
+FAILED: javax/naming/ldap/LdapName/CompareToEqualsTests.java
Checking name1: cn=config and name2: Cn=COnFIG
name1.hashCode(): 1993513894 name2.hashCode(): 1993506733
----------System.err:(13/715)----------
java.lang.Exception: hashCode test failed for name1:cn=config name2:Cn=COnFIG
at CompareToEqualsTests.checkResults(CompareToEqualsTests.java:118)
at CompareToEqualsTests.main(CompareToEqualsTests.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: java.lang.Exception
JavaTest Message: shutting down test
+FAILED: sun/rmi/rmic/RMIGenerator/RmicDefault.java
+FAILED: sun/security/util/Oid/OidFormat.java
Trying 0
java.io.IOException: ObjectIdentifier() -- Must be at least two oid components
java.lang.NullPointerException
at sun.security.x509.AlgorithmId.algOID(AlgorithmId.java:568)
at sun.security.x509.AlgorithmId.get(AlgorithmId.java:409)
at
javax.crypto.EncryptedPrivateKeyInfo.<init>(EncryptedPrivateKeyInfo.java:137)
at OidFormat.testBad(OidFormat.java:154)
at OidFormat.main(OidFormat.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: java.lang.NullPointerException
JavaTest Message: shutting down test
+FAILED: sun/security/x509/AlgorithmId/ExtensibleAlgorithmId.java
----------messages:(3/141)----------
command: main ExtensibleAlgorithmId
reason: Assumed action based on file name: run main ExtensibleAlgorithmId
elapsed time (seconds): 0.002
----------System.out:(0/0)----------
----------System.err:(15/806)----------
java.lang.NullPointerException
at sun.security.x509.AlgorithmId.algOID(AlgorithmId.java:568)
at sun.security.x509.AlgorithmId.get(AlgorithmId.java:409)
at sun.security.x509.AlgorithmId.getAlgorithmId(AlgorithmId.java:395)
at ExtensibleAlgorithmId.main(ExtensibleAlgorithmId.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: java.lang.NullPointerException
JavaTest Message: shutting down test
+FAILED: sun/security/x509/AVA/EmailAddressEncoding.java
----------messages:(3/139)----------
command: main EmailAddressEncoding
reason: Assumed action based on file name: run main EmailAddressEncoding
elapsed time (seconds): 0.002
----------System.out:(0/0)----------
----------System.err:(23/1298)----------
java.lang.IllegalArgumentException: improperly specified input name: c=us,
emailaddress=foo at bar, cn=foobar
at javax.security.auth.x500.X500Principal.<init>(X500Principal.java:169)
at javax.security.auth.x500.X500Principal.<init>(X500Principal.java:121)
at EmailAddressEncoding.main(EmailAddressEncoding.java:39)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.io.IOException: Invalid keyword "EMA?LADDRESS"
at sun.security.x509.AVAKeyword.getOID(AVA.java:1268)
at sun.security.x509.AVA.<init>(AVA.java:192)
at sun.security.x509.AVA.<init>(AVA.java:145)
at sun.security.x509.RDN.<init>(RDN.java:151)
at sun.security.x509.X500Name.parseDN(X500Name.java:918)
at sun.security.x509.X500Name.<init>(X500Name.java:165)
at javax.security.auth.x500.X500Principal.<init>(X500Principal.java:167)
... 8 more
JavaTest Message: Test threw exception: java.lang.IllegalArgumentException
JavaTest Message: shutting down test
+FAILED: sun/security/x509/X500Name/AllAttribs.java
----------messages:(3/119)----------
command: main AllAttribs
reason: Assumed action based on file name: run main AllAttribs
elapsed time (seconds): 0.001
----------System.out:(0/0)----------
----------System.err:(19/965)----------
java.io.IOException: Invalid keyword "G?VENNAME"
at sun.security.x509.AVAKeyword.getOID(AVA.java:1268)
at sun.security.x509.AVA.<init>(AVA.java:192)
at sun.security.x509.AVA.<init>(AVA.java:145)
at sun.security.x509.RDN.<init>(RDN.java:151)
at sun.security.x509.X500Name.parseDN(X500Name.java:918)
at sun.security.x509.X500Name.<init>(X500Name.java:165)
at sun.security.x509.X500Name.<init>(X500Name.java:152)
at AllAttribs.main(AllAttribs.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.sun.javatest.regtest.MainAction$SameVMThread.run(MainAction.java:595)
at java.lang.Thread.run(Thread.java:636)
JavaTest Message: Test threw exception: java.io.IOException
JavaTest Message: shutting down test
Matthias
More information about the jdk6-dev
mailing list