<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
Hi,<br>
<br>
Just back from a vacation and saw this question. My comments are
below for jtreg tests:<br>
<br>
On 03/16/13 01:50 AM, Mani Sarkar wrote:
<blockquote
cite="mid:CAGHtMW=VrM5JrTSj6dEsdb1O7OT2QfayoVfcNWLifXvjmMrKYQ@mail.gmail.com"
type="cite">
<div><span
style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Hi,</span></div>
<div><span
style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><br>
</span></div>
<div><span
style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:13px;background-color:rgb(255,255,255)">I
ran JTReg tests on my Ubuntu 12.04 and MacOS X 10.7 Lion
systems, via the <i>~/sources/jdk8_tl/test</i> folder after
installing <b>jtreg</b> and setting up the environment with
paths settings for jt_home and product_home. I got the below
results, although the issues were similar in both environments
there are differences between the two across more than one
test component.</span></div>
<div style="color: rgb(34, 34, 34); font-family: arial,sans-serif;
font-size: 13px; background-color: rgb(255, 255, 255);"><span
style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:13px;background-color:rgb(255,255,255)"></span><br>
<div
style="vertical-align:baseline;font-family:Arial,Helvetica,sans-serif;margin:0px;border:0px;padding:0px"><br>
</div>
<div
style="vertical-align:baseline;font-family:Arial,Helvetica,sans-serif;margin:0px;border:0px;padding:0px"><b>jdk_lang</b> <b>(logs: <a
moz-do-not-send="true" href="http://bit.ly/Z97COE"
target="_blank" style="color:rgb(17,85,204)">http://bit.ly/Z97COE</a>)</b></div>
<div
style="vertical-align:baseline;font-family:Arial,Helvetica,sans-serif;margin:0px;border:0px;padding:0px">(TEST
STATS: name=jdk_lang run=426 pass=415 fail=11 excluded=5)<br>
</div>
<div
style="vertical-align:baseline;font-family:Arial,Helvetica,sans-serif;margin:0px;border:0px;padding:0px"><i><span
style="background-color:transparent"><font color="#222222">Failure
reasons: </font></span>Tests failed without specifying
any reason, ??? returned!</i></div>
<div style="vertical-align: baseline; margin: 0px; border: 0px
none; padding: 0px;">
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/AccessControlTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/BigArityTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px">
<font face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/ClassValueTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/InvokeGenericTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/JavaDocExamplesTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px">
<font face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/MethodHandlesTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/MethodTypeTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/PermuteArgsTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px">
<font face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/PrivateInvokeTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/RicochetTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px"><font
face="Arial, Helvetica, sans-serif" color="#222222">FAILED:
java/lang/invoke/ThrowExceptionsTest.java</font></div>
<div
style="vertical-align:baseline;margin:0px;border:0px;padding:0px">
<font face="Arial, Helvetica, sans-serif" color="#222222"><br>
</font></div>
<div style="font-family: Arial,Helvetica,sans-serif;"><i
style="font-family: arial,sans-serif;">
<div style="font-family:Arial,Helvetica,sans-serif">These
above tests should have passed as per the test results
archive!</div>
</i></div>
</div>
</div>
</blockquote>
<br>
Above tests require JUnit. Copy junit.jar into jtreg/lib directory
and then check<br>
again.<br>
<br>
<blockquote
cite="mid:CAGHtMW=VrM5JrTSj6dEsdb1O7OT2QfayoVfcNWLifXvjmMrKYQ@mail.gmail.com"
type="cite">
<div>
<div>
<div style="color: rgb(34, 34, 34); font-family:
arial,sans-serif; background-color: rgb(255, 255, 255);">
<div style="font-size:13px">
<div>-----------------------------</div>
<div><br>
</div>
<div>There are more packages failing tests on Ubuntu than
MacOS, more tests in total have failed and under each
component. Should I report these to other report mailing
lists as well?</div>
</div>
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px">Rory, Balchandra - am I running
these tests differently than you are since your test
results (test results archive) differs from mine.</div>
<div style="font-size:13px">
<br>
</div>
<div style="font-size:13px">I run the tests using the below
syntax:</div>
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px"><i>$ make TEST=<test
component name> </i></div>
<div style="font-size:13px">
<br>
</div>
<div style="font-size:13px">Just to isolate the test
failures I ran each test component rather than what people
usually do jdk_default, jdk_core and jdk_all. Could you
also make the make command failure error messages a bit
more verbose and human-friendly so we can figure out whats
to start looking at. If I have missed out on config I
would love to know.</div>
</div>
</div>
</div>
</blockquote>
<br>
If you see any test failures with the make target, I suggest, run
the failed<br>
tests (group of tests) using jtreg directly. This will isolate
Makefile related issues.<br>
<br>
Here is the instruction about how I run the tests:<br>
<a class="moz-txt-link-freetext" href="http://bambi.ie.oracle.com/web/openjdk/results-large/docs/howtoruntests.html">http://bambi.ie.oracle.com/web/openjdk/results-large/docs/howtoruntests.html</a><br>
<br>
You can also run an individual test, for example:<br>
$ jtreg -verbose:fail java/lang/invoke/AccessControlTest.java<br>
<br>
You can run all tests under particular sub-directory, for example:<br>
$ jtreg -verbose:fail java/lang/invoke <br>
<br>
<br>
<br>
Thanks<br>
Balchandra<br>
<br>
<br>
<blockquote
cite="mid:CAGHtMW=VrM5JrTSj6dEsdb1O7OT2QfayoVfcNWLifXvjmMrKYQ@mail.gmail.com"
type="cite">
<div>
<div>
<div
style="color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)">
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px">Thanks.</div>
<div style="font-size:13px"><br>
</div>
</div>
</div>
</div>
<div>Cheers,</div>
<div>mani</div>
-- <br>
<b>Twitter:</b> @theNeomatrix369
<div><b>Blog:</b> <a moz-do-not-send="true"
href="http://neomatrix369.wordpress.com" target="_blank">http://neomatrix369.wordpress.com</a></div>
<div><b>JUG activity:</b> LJC Advocate (@adoptopenjdk &
@adoptajsr programs)</div>
<div><b>Meet-a-Project:</b> <a moz-do-not-send="true"
href="https://github.com/MutabilityDetector" target="_blank">https://github.com/MutabilityDetector</a></div>
<div><b>Come to Devoxx UK 2013:</b> <a moz-do-not-send="true"
href="http://www.devoxx.com/display/UK13/Home" target="_blank">http://www.devoxx.com/display/UK13/Home</a></div>
<div><b><i>Don't chase success, rather aim for "Excellence", and
success will come chasing after you!</i></b></div>
</blockquote>
<br>
</body>
</html>