Hi,

Just back from a vacation and saw this question. My comments are below for jtreg tests:

On 03/16/13 01:50 AM, Mani Sarkar wrote:

Hi,

I ran JTReg tests on my Ubuntu 12.04 and MacOS X 10.7 Lion systems, via the ~/sources/jdk8_tl/test folder after installing jtreg and setting up the environment with paths settings for jt_home and product_home. I got the below results, although the issues were similar in both environments there are differences between the two across more than one test component.

jdk_lang (logs: http://bit.ly/Z97COE)

(TEST STATS: name=jdk_lang run=426 pass=415 fail=11 excluded=5)

Failure reasons: Tests failed without specifying any reason, ??? returned!

FAILED: java/lang/invoke/AccessControlTest.java

FAILED: java/lang/invoke/BigArityTest.java

FAILED: java/lang/invoke/ClassValueTest.java

FAILED: java/lang/invoke/InvokeGenericTest.java

FAILED: java/lang/invoke/JavaDocExamplesTest.java

FAILED: java/lang/invoke/MethodHandlesTest.java

FAILED: java/lang/invoke/MethodTypeTest.java

FAILED: java/lang/invoke/PermuteArgsTest.java

FAILED: java/lang/invoke/PrivateInvokeTest.java

FAILED: java/lang/invoke/RicochetTest.java

FAILED: java/lang/invoke/ThrowExceptionsTest.java

These above tests should have passed as per the test results archive!

Above tests require JUnit. Copy junit.jar into jtreg/lib directory and then check
again.

-----------------------------

There are more packages failing tests on Ubuntu than MacOS, more tests in total have failed and under each component. Should I report these to other report mailing lists as well?

Rory, Balchandra - am I running these tests differently than you are since your test results (test results archive) differs from mine.

I run the tests using the below syntax:

$ make TEST=<test component name>

Just to isolate the test failures I ran each test component rather than what people usually do jdk_default, jdk_core and jdk_all. Could you also make the make command failure error messages a bit more verbose and human-friendly so we can figure out whats to start looking at. If I have missed out on config I would love to know.

If you see any test failures with the make target, I suggest, run the failed
tests (group of tests) using jtreg directly. This will isolate Makefile related issues.

Here is the instruction about how I run the tests:
http://bambi.ie.oracle.com/web/openjdk/results-large/docs/howtoruntests.html

You can also run an individual test, for example:
$ jtreg -verbose:fail java/lang/invoke/AccessControlTest.java

You can run all tests under particular sub-directory, for example:
$ jtreg -verbose:fail java/lang/invoke

Thanks
Balchandra

Thanks.

Cheers,

mani
--
Twitter: @theNeomatrix369
Blog: http://neomatrix369.wordpress.com

JUG activity: LJC Advocate (@adoptopenjdk & @adoptajsr programs)

Meet-a-Project: https://github.com/MutabilityDetector

Come to Devoxx UK 2013: http://www.devoxx.com/display/UK13/Home

Don't chase success, rather aim for "Excellence", and success will come chasing after you!