regression test failures
David Holmes
david.holmes at oracle.com
Tue Jan 14 02:26:46 UTC 2014
Hi Lance,
On 13/01/2014 4:18 AM, Lance Andersen wrote:
> I just downloaded the following jtreg version from openjdk:
>
> ---------
> new-host-4:test lance$ ~/Dropbox/LancePTR/jtreg/win32/bin/jtreg -version
> jtreg, version 4.0 dev b00
> Installed in /Users/lance/Dropbox/LancePTR/jtreg/lib/jtreg.jar
> Running on platform version 1.8.0-internal from /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/build/macosx-x86_64-normal-server-release/images/j2sdk-image/jre.
> Built with 1.7.0_25 on 01/05/2014 09:12 PM.
> Copyright (c) 1999, 2013, Oracle and/or its affiliates. All rights reserved.
> Use is subject to license terms.
> TestNG: version 6.8-201210030754
> ---------------------------------------------
Yes you need a jtreg that understands groups.
> I reran the tests and they still are failing but a slightly different error.:
>
>
> --------------------------
>
> new-host-4:test lance$ make PRODUCT_HOME=/Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/build/macosx-x86_64-normal-server-release/images/j2sdk-image all
> make -k -C ../jdk/test TEST=jdk_all jdk_all
> echo "Running tests: jdk_all"
> Running tests: jdk_all
> for each in jdk_all; do \
> make -j 1 TEST_SELECTION=":$each" UNIQUE_DIR=$each jtreg_tests; \
> done
> ( \
> ( JT_HOME=/Users/lance/Dropbox/LancePTR/jtreg/; \
> export JT_HOME; \
> /Users/lance/Dropbox/LancePTR/jtreg//win32/bin/jtreg \
> -agentvm -a -ea -esa -v:fail,error,time -retain:fail,error -ignore:quiet -timeoutFactor:4 -J-Xmx512m \
> -r:/Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/JTreport \
> -w:/Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/JTwork \
> -jdk:/Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/build/macosx-x86_64-normal-server-release/images/j2sdk-image \
> -exclude:ProblemList.txt \
> -vmoption:-Xmx512m \
> :jdk_all \
> ) ; \
> ( jtregExitCode=$? && _summary="/Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/JTreport/text/summary.txt"; rm -f -f /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/passlist.txt /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/faillist.txt /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt; echo "${jtregExitCode}" > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt; if [ -r "${_summary}" ] ; then echo "Summary: jdk_all" > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt; expand ${_summary} | egrep -v ' Not run\.' > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt; egrep ' Passed\.' /Us!
ers/lanc
e/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt | egrep -v ' Error\.' | egrep -v ' Failed\.' > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/passlist.txt; ( egrep ' Failed\.' /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt; egrep ' Error\.' /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt; egrep -v ' Passed\.' /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt ) | sort | uniq > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/faillist.txt; if [ ${jtregExitCode} != 0 -o -s /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/faillist.txt ] ; then expand /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/faillist.txt | cut -d' ' -f1 | sed -e 's@^@FAILED: @' >> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt; if !
[ ${jtreg
ExitCode} = 0 ] ; then jtregExitCode=1; fi; fi; runc="`cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/runlist.txt | wc -l | awk '{print $1;}'`"; passc="`cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/passlist.txt | wc -l | awk '{print $1;}'`"; failc="`cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/faillist.txt | wc -l | awk '{print $1;}'`"; exclc="FIXME CODETOOLS-7900176"; echo "TEST STATS: name=jdk_all run=${runc} pass=${passc} fail=${failc}" >> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt; else echo "Missing file: ${_summary}" >> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt; fi; if [ -f /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt ] ; then cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/Stats.txt; fi; ( mkdir -p `dirname /U!
sers/lanc
e/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/ARCHIVE_BUNDLE.zip` && cd /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all && chmod -R a+r . && zip -q -r /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/ARCHIVE_BUNDLE.zip . ) ; if [ ! -s /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt ] ; then echo "ERROR: EXITCODE file not filled in."; echo "1" > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt; fi ; testExitCode=`cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt`; echo "EXIT CODE: ${testExitCode}"; exit ${testExitCode} ) \
> ) 2>&1 | tee /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/output.txt ; if [ ! -s /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt ] ; then echo "ERROR: EXITCODE file not filled in."; echo "1" > /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt; fi ; testExitCode=`cat /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/exitcode.txt`; echo "EXIT CODE: ${testExitCode}"; exit ${testExitCode}
> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/test/TEST.groups: group needs_jre: file not found: java/text/Bidi/Bug6665028.java
> Error: No tests selected
Try running jtreg -l :jdk_all to see what it lists; also look at the
definition of :jdk_all to see what it should contain.
> java/text/Bidi/Bug6665028.java does not exist in the workspace that i pulled over yesterday:
>
> ls test/java/text/Bidi/
> BidiBug.java BidiEmbeddingTest.java Bug6850113.java Bug7041232.java Bug7051769.java
> BidiConformance.java BidiSurrogateTest.java Bug7002398.java Bug7042148.java Bug8005277.java
>
>
> I do see it in older workspaces, though that I have for jdk8,
That's a non-fatal error. People have to know/remember to check the test
group definitions when they add/remove tests in case the group
definitions need modifying as well.
David
-----
> Best
> Lance
>
> On Jan 12, 2014, at 10:52 AM, Alan Bateman <Alan.Bateman at oracle.com> wrote:
>
>> On 11/01/2014 19:15, Lance Andersen wrote:
>>> :
>>> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/test/TEST.groups: group compact2_minimal: file not found: :needs_compact3
>>> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/test/TEST.groups: group compact2_minimal: file not found: :needs_jre
>>> /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/test/TEST.groups: group compact2_minimal: file not found: :needs_jdk
>>> Error: No tests selected
>>> Missing file: /Users/lance/Documents/hg-workspaces/jdk8/jdbc-jdk/jdk/testoutput/jdk_all/JTreport/text/summary.txt
>>> EXIT CODE: 1
>>> -------------------
>>>
>>> is there another setting I need?
>>>
>> I haven't seen this but it looks like jtreg is interpreting properties that it doesn't understand into files to read. Do you know which version of jtreg you have? I just wonder if you might have a really old version that doesn't understand groups.
>>
>> -Alan.
>
>
>
>
> Lance Andersen| Principal Member of Technical Staff | +1.781.442.2037
> Oracle Java Engineering
> 1 Network Drive
> Burlington, MA 01803
> Lance.Andersen at oracle.com
>
>
>
>
More information about the build-dev
mailing list