On 16/03/2013 01:50, Mani Sarkar wrote:
Hi,

I ran JTReg tests on my Ubuntu 12.04 and MacOS X 10.7 Lion systems, via the ~/sources/jdk8_tl/test folder after installing jtreg and setting up the environment with paths settings for jt_home and product_home. I got the below results, although the issues were similar in both environments there are differences between the two across more than one test component.

For completeness sake I have combined the results of the two into one email and not omitted any common bits.

:

I have compared them with the reference at http://download.java.net/jdk8/testresults/testresults.html?q=download/jdk8/testresults/testresults.html, which expect a number of tests to fail or not run and made notes above.

I looked at a few of your logs.

If I understand correctly, you are trying to run the JCK. The "Gaining Access to the JCK" page [1] describes the process to obtain this.

For the jdk tests then it looks like you are running into several issues. I don't have time to look at all your logs but just to mention a few things:

For the jdk_jmx make target (JMX tests) then I assume the issue is that your host name is resolving to 127.0.1.1. This causes a number of test failures, include the issue you are seeing. Eric Wang contributed a fix to the tests for this, see 7183800 [1] so if you sync up your clone of jdk8/tl (I assume jdk_tl is a clone of this forest) then you will get it.

For the jdk_security3 make target the SecMod failures may be NSS version related, see 8009438 [3].

For the jdk_tools target then I think tools/launcher/ExecutionEnvironment.java is failing for you because you have only built the client VM. The test checks both -client and -server when on 32-bit Linux.

The jdk_jfr target runs tests for Java Flight Recorder that are not in OpenJDK. I don't know what to say about this, there are a few Oracle specific configuration bits in the make tree.

Finally, you mention about comparing the results against those on java.net. One difference is that you are running the jdk_awt and jdk_swing test targets. If I understand the results on java.net correctly then the tests covered by those make file targets are not run (for reliability or test reasons perhaps).

-Alan

[1] http://openjdk.java.net/groups/conformance/JckAccess/index.html
[2] http://hg.openjdk.java.net/jdk8/tl/jdk/rev/ca9469a15792
[3] http://bugs.sun.com/view_bug.do?bug_id=8009438