TestNG tests appear to hang with latest lambda
Ben Evans
benjamin.john.evans at gmail.com
Thu Feb 21 05:09:38 PST 2013
Tried again, tests pass about 1/3 (others SIGSEGV) - but without
appreciable speedup for ant test-libs.
Ben
On 20 Feb 2013 20:31, "Brian Goetz" <brian.goetz at oracle.com> wrote:
> The error you see is a transient VM error that we're chasing down,
> meanwhile the tests may pass if you try again.
>
> On 2/20/2013 8:19 PM, Ben Evans wrote:
>
>> Hi Cédric,
>>
>> I've tried with 6.9-beta. It reduces the amount of memory used
>> slightly (but the process still grows to over 2Gb) and the time taken
>> somewhat - now down to 8 mins for the ant test target.
>>
>> However, the ant test-libs target is now dying with a SIGSEGV (hs_err
>> files attached) - although this may of course be for unrelated
>> reasons.
>>
>> Thanks,
>>
>> Ben
>>
>> On Wed, Feb 20, 2013 at 5:29 PM, Cédric Beust ♔ <cedric at beust.com> wrote:
>>
>>> I provided a beta version in the issue provided by Michael (reproduced
>>> below) which gets rid of EmailableReporter. Ben, can you try with this
>>> beta
>>> version and see if it fixes the problem?
>>>
>>> Issue: https://github.com/cbeust/**testng/issues/219<https://github.com/cbeust/testng/issues/219>
>>> Beta: http://testng.org/beta
>>>
>>> --
>>> Cédric
>>>
>>>
>>> --
>>> Cédric
>>>
>>>
>>>
>>> On Wed, Feb 20, 2013 at 1:53 PM, Brian Goetz <brian.goetz at oracle.com>
>>> wrote:
>>>
>>> I think that's likely what's going on -- TestNG buffering lots of
>>>> per-test metadata, expanding the heap and causing paging/frequent GCs.
>>>>
>>>> There's a smaller test suite for the libraries only (ant test-libs) that
>>>> we usually run.
>>>>
>>>> On 2/20/2013 4:32 PM, Jonathan Gibbons wrote:
>>>>
>>>>> My understanding is that TestNG does not scale well with too many test
>>>>> cases,
>>>>> and folk are just testing stuff "too much" these days :-)
>>>>>
>>>>> -- Jon
>>>>>
>>>>> On 02/20/2013 01:27 PM, Ben Evans wrote:
>>>>>
>>>>>> OK, following up to my own mail.
>>>>>>
>>>>>> The tests will actually complete if left for long enough, but the
>>>>>> process gets *huge* - at least 2.8G in size, and if other processes
>>>>>> are running, it will take a very long time to complete.
>>>>>>
>>>>>> Does anyone have any insight as to why the tests consume so much
>>>>>> memory?
>>>>>>
>>>>>> Ben
>>>>>>
>>>>>> On Wed, Feb 20, 2013 at 3:40 PM, Ben Evans
>>>>>> <benjamin.john.evans at gmail.com**> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I'm writing some docs for AdoptOpenJDK about getting started writing
>>>>>>> TestNG tests, in advance of the hackdays at Devoxx UK.
>>>>>>>
>>>>>>> However, with latest lambda, the TestNG tests appear to hang (output
>>>>>>> below). The process grows in size to over 1Gb, and then appears to
>>>>>>> freeze. It's still responsive (so I can connect jvisualvm to it, but
>>>>>>> when I sample the code, nothing appears to be running).
>>>>>>>
>>>>>>> This is on Mac 10.7 with OpenJDK 8 from current lambda.
>>>>>>>
>>>>>>> Any ideas?
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Ben
>>>>>>>
>>>>>>> ariel:test-ng boxcat$ ant test
>>>>>>> Buildfile: /Users/boxcat/projects/lambda/**jdk/test-ng/build.xml
>>>>>>>
>>>>>>> prepare:
>>>>>>>
>>>>>>> test-compile:
>>>>>>> [javac] /Users/boxcat/projects/lambda/**
>>>>>>> jdk/test-ng/build.xml:78:
>>>>>>> warning: 'includeantruntime' was not set, defaulting to
>>>>>>> build.sysclasspath=last; set to false for repeatable builds
>>>>>>> [javac] /Users/boxcat/projects/lambda/**
>>>>>>> jdk/test-ng/build.xml:82:
>>>>>>> warning: 'includeantruntime' was not set, defaulting to
>>>>>>> build.sysclasspath=last; set to false for repeatable builds
>>>>>>> [javac] /Users/boxcat/projects/lambda/**
>>>>>>> jdk/test-ng/build.xml:86:
>>>>>>> warning: 'includeantruntime' was not set, defaulting to
>>>>>>> build.sysclasspath=last; set to false for repeatable builds
>>>>>>>
>>>>>>> test:
>>>>>>> [echo] Results at:
>>>>>>>
>>>>>> file:../../build/test-ng/test-**reports/index.html
>>>>
>>>>> [testng] [TestNG] Running:
>>>>>>> [testng] Ant suite
>>>>>>> [testng]
>>>>>>> [testng]
>>>>>>> [testng] Generating exhaustive interface....
>>>>>>> [testng] 8 No default
>>>>>>> [testng] 8 Error
>>>>>>> [testng] 48 OK
>>>>>>> [testng] 64 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating exhaustive class....
>>>>>>> [testng] 729 No default
>>>>>>> [testng] 49 Error
>>>>>>> [testng] 950 OK
>>>>>>> [testng] 1728 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating shapes interface....
>>>>>>> [testng] 109 No default
>>>>>>> [testng] 280 Error
>>>>>>> [testng] 507 OK
>>>>>>> [testng] 896 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating shapes class/interface....
>>>>>>> [testng] 190 No default
>>>>>>> [testng] 568 Error
>>>>>>> [testng] 536 OK
>>>>>>> [testng] 1294 Total
>>>>>>> [testng]
>>>>>>> [testng] Expect OK: 2041 -- unique 1813
>>>>>>> [testng] Expect Error: 905 -- unique 773
>>>>>>> [testng]
>>>>>>> [testng] Generating exhaustive interface....
>>>>>>> [testng] 8 No default
>>>>>>> [testng] 8 Error
>>>>>>> [testng] 48 OK
>>>>>>> [testng] 64 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating exhaustive class....
>>>>>>> [testng] 729 No default
>>>>>>> [testng] 49 Error
>>>>>>> [testng] 950 OK
>>>>>>> [testng] 1728 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating shapes interface....
>>>>>>> [testng] 109 No default
>>>>>>> [testng] 280 Error
>>>>>>> [testng] 507 OK
>>>>>>> [testng] 896 Total
>>>>>>> [testng]
>>>>>>> [testng] Generating shapes class/interface....
>>>>>>> [testng] 190 No default
>>>>>>> [testng] 568 Error
>>>>>>> [testng] 536 OK
>>>>>>> [testng] 1294 Total
>>>>>>> [testng]
>>>>>>> [testng] Expect OK: 2041 -- unique 1813
>>>>>>> [testng] Expect Error: 905 -- unique 773
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
More information about the lambda-dev
mailing list