TestNG tests appear to hang with latest lambda

[Brian Goetz]

I think that's likely what's going on -- TestNG buffering lots of 
per-test metadata, expanding the heap and causing paging/frequent GCs.

There's a smaller test suite for the libraries only (ant test-libs) that 
we usually run.

On 2/20/2013 4:32 PM, Jonathan Gibbons wrote:
> My understanding is that TestNG does not scale well with too many test
> cases,
> and folk are just testing stuff "too much" these days :-)
>
> -- Jon
>
> On 02/20/2013 01:27 PM, Ben Evans wrote:
>> OK, following up to my own mail.
>>
>> The tests will actually complete if left for long enough, but the
>> process gets *huge* - at least 2.8G in size, and if other processes
>> are running, it will take a very long time to complete.
>>
>> Does anyone have any insight as to why the tests consume so much memory?
>>
>> Ben
>>
>> On Wed, Feb 20, 2013 at 3:40 PM, Ben Evans
>> <benjamin.john.evans at gmail.com> wrote:
>>> Hi,
>>>
>>> I'm writing some docs for AdoptOpenJDK about getting started writing
>>> TestNG tests, in advance of the hackdays at Devoxx UK.
>>>
>>> However, with latest lambda, the TestNG tests appear to hang (output
>>> below). The process grows in size to over 1Gb, and then appears to
>>> freeze. It's still responsive (so I can connect jvisualvm to it, but
>>> when I sample the code, nothing appears to be running).
>>>
>>> This is on Mac 10.7 with OpenJDK 8 from current lambda.
>>>
>>> Any ideas?
>>>
>>> Thanks,
>>>
>>> Ben
>>>
>>> ariel:test-ng boxcat$ ant test
>>> Buildfile: /Users/boxcat/projects/lambda/jdk/test-ng/build.xml
>>>
>>> prepare:
>>>
>>> test-compile:
>>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:78:
>>> warning: 'includeantruntime' was not set, defaulting to
>>> build.sysclasspath=last; set to false for repeatable builds
>>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:82:
>>> warning: 'includeantruntime' was not set, defaulting to
>>> build.sysclasspath=last; set to false for repeatable builds
>>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:86:
>>> warning: 'includeantruntime' was not set, defaulting to
>>> build.sysclasspath=last; set to false for repeatable builds
>>>
>>> test:
>>>        [echo] Results at: file:../../build/test-ng/test-reports/index.html
>>>      [testng] [TestNG] Running:
>>>      [testng]   Ant suite
>>>      [testng]
>>>      [testng]
>>>      [testng] Generating exhaustive interface....
>>>      [testng]       8 No default
>>>      [testng]       8 Error
>>>      [testng]      48 OK
>>>      [testng]      64 Total
>>>      [testng]
>>>      [testng] Generating exhaustive class....
>>>      [testng]     729 No default
>>>      [testng]      49 Error
>>>      [testng]     950 OK
>>>      [testng]    1728 Total
>>>      [testng]
>>>      [testng] Generating shapes interface....
>>>      [testng]     109 No default
>>>      [testng]     280 Error
>>>      [testng]     507 OK
>>>      [testng]     896 Total
>>>      [testng]
>>>      [testng] Generating shapes class/interface....
>>>      [testng]     190 No default
>>>      [testng]     568 Error
>>>      [testng]     536 OK
>>>      [testng]    1294 Total
>>>      [testng]
>>>      [testng] Expect OK:    2041 -- unique 1813
>>>      [testng] Expect Error: 905 -- unique 773
>>>      [testng]
>>>      [testng] Generating exhaustive interface....
>>>      [testng]       8 No default
>>>      [testng]       8 Error
>>>      [testng]      48 OK
>>>      [testng]      64 Total
>>>      [testng]
>>>      [testng] Generating exhaustive class....
>>>      [testng]     729 No default
>>>      [testng]      49 Error
>>>      [testng]     950 OK
>>>      [testng]    1728 Total
>>>      [testng]
>>>      [testng] Generating shapes interface....
>>>      [testng]     109 No default
>>>      [testng]     280 Error
>>>      [testng]     507 OK
>>>      [testng]     896 Total
>>>      [testng]
>>>      [testng] Generating shapes class/interface....
>>>      [testng]     190 No default
>>>      [testng]     568 Error
>>>      [testng]     536 OK
>>>      [testng]    1294 Total
>>>      [testng]
>>>      [testng] Expect OK:    2041 -- unique 1813
>>>      [testng] Expect Error: 905 -- unique 773
>
>