MacOS X 10.7 Lion & Ubuntu 12.04 - JTReg tests failing!

[Alan Bateman]

On 16/03/2013 01:50, Mani Sarkar wrote:
> Hi,
>
> I ran JTReg tests on my Ubuntu 12.04 and MacOS X 10.7 Lion systems, 
> via the /~/sources/jdk8_tl/test/ folder after installing *jtreg* and 
> setting up the environment with paths settings for jt_home and 
> product_home. I got the below results, although the issues were 
> similar in both environments there are differences between the two 
> across more than one test component.
>
> For completeness sake I have combined the results of the two into one 
> email and not omitted any common bits.
>
> /:/
> /
> /
> I have compared them with the reference at 
> http://download.java.net/jdk8/testresults/testresults.html?q=download/jdk8/testresults/testresults.html, 
> which expect a number of tests to fail or not run and made notes above.
>
I looked at a few of your logs.

If I understand correctly, you are trying to run the JCK. The "Gaining 
Access to the JCK" page [1] describes the process to obtain this.

For the jdk tests then it looks like you are running into several 
issues. I don't have time to look at all your logs but just to mention a 
few things:

For the jdk_jmx make target (JMX tests) then I assume the issue is that 
your host name is resolving to 127.0.1.1. This causes a number of test 
failures, include the issue you are seeing. Eric Wang contributed a fix 
to the tests for this, see 7183800 [1] so if you sync up your clone of 
jdk8/tl (I assume jdk_tl is a clone of this forest) then you will get it.

For the jdk_security3 make target the SecMod failures may be NSS version 
related, see 8009438 [3].

For the jdk_tools target then I think 
tools/launcher/ExecutionEnvironment.java is failing for you because you 
have only built the client VM. The test checks both -client and -server 
when on 32-bit Linux.

The jdk_jfr target runs tests for Java Flight Recorder that are not in 
OpenJDK. I don't know what to say about this, there are a few Oracle 
specific configuration bits in the make tree.

Finally, you mention about comparing the results against those on 
java.net. One difference is that you are running the jdk_awt and 
jdk_swing test targets. If I understand the results on java.net 
correctly then the tests covered by those make file targets are not run 
(for reliability or test reasons perhaps).

-Alan

[1] http://openjdk.java.net/groups/conformance/JckAccess/index.html
[2] http://hg.openjdk.java.net/jdk8/tl/jdk/rev/ca9469a15792
[3] http://bugs.sun.com/view_bug.do?bug_id=8009438
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.openjdk.java.net/pipermail/quality-discuss/attachments/20130316/9bae31e7/attachment.html