TestNG tests appear to hang with latest lambda

[Ben Evans]

Hi Cédric,

I've tried with 6.9-beta. It reduces the amount of memory used
slightly (but the process still grows to over 2Gb) and the time taken
somewhat - now down to 8 mins for the ant test target.

However, the ant test-libs target is now dying with a SIGSEGV (hs_err
files attached) - although this may of course be for unrelated
reasons.

Thanks,

Ben

On Wed, Feb 20, 2013 at 5:29 PM, Cédric Beust ♔ <cedric at beust.com> wrote:
> I provided a beta version in the issue provided by Michael (reproduced
> below) which gets rid of EmailableReporter. Ben, can you try with this beta
> version and see if it fixes the problem?
>
> Issue: https://github.com/cbeust/testng/issues/219
> Beta: http://testng.org/beta
>
> --
> Cédric
>
>
> --
> Cédric
>
>
>
> On Wed, Feb 20, 2013 at 1:53 PM, Brian Goetz <brian.goetz at oracle.com> wrote:
>
>> I think that's likely what's going on -- TestNG buffering lots of
>> per-test metadata, expanding the heap and causing paging/frequent GCs.
>>
>> There's a smaller test suite for the libraries only (ant test-libs) that
>> we usually run.
>>
>> On 2/20/2013 4:32 PM, Jonathan Gibbons wrote:
>> > My understanding is that TestNG does not scale well with too many test
>> > cases,
>> > and folk are just testing stuff "too much" these days :-)
>> >
>> > -- Jon
>> >
>> > On 02/20/2013 01:27 PM, Ben Evans wrote:
>> >> OK, following up to my own mail.
>> >>
>> >> The tests will actually complete if left for long enough, but the
>> >> process gets *huge* - at least 2.8G in size, and if other processes
>> >> are running, it will take a very long time to complete.
>> >>
>> >> Does anyone have any insight as to why the tests consume so much memory?
>> >>
>> >> Ben
>> >>
>> >> On Wed, Feb 20, 2013 at 3:40 PM, Ben Evans
>> >> <benjamin.john.evans at gmail.com> wrote:
>> >>> Hi,
>> >>>
>> >>> I'm writing some docs for AdoptOpenJDK about getting started writing
>> >>> TestNG tests, in advance of the hackdays at Devoxx UK.
>> >>>
>> >>> However, with latest lambda, the TestNG tests appear to hang (output
>> >>> below). The process grows in size to over 1Gb, and then appears to
>> >>> freeze. It's still responsive (so I can connect jvisualvm to it, but
>> >>> when I sample the code, nothing appears to be running).
>> >>>
>> >>> This is on Mac 10.7 with OpenJDK 8 from current lambda.
>> >>>
>> >>> Any ideas?
>> >>>
>> >>> Thanks,
>> >>>
>> >>> Ben
>> >>>
>> >>> ariel:test-ng boxcat$ ant test
>> >>> Buildfile: /Users/boxcat/projects/lambda/jdk/test-ng/build.xml
>> >>>
>> >>> prepare:
>> >>>
>> >>> test-compile:
>> >>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:78:
>> >>> warning: 'includeantruntime' was not set, defaulting to
>> >>> build.sysclasspath=last; set to false for repeatable builds
>> >>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:82:
>> >>> warning: 'includeantruntime' was not set, defaulting to
>> >>> build.sysclasspath=last; set to false for repeatable builds
>> >>>       [javac] /Users/boxcat/projects/lambda/jdk/test-ng/build.xml:86:
>> >>> warning: 'includeantruntime' was not set, defaulting to
>> >>> build.sysclasspath=last; set to false for repeatable builds
>> >>>
>> >>> test:
>> >>>        [echo] Results at:
>> file:../../build/test-ng/test-reports/index.html
>> >>>      [testng] [TestNG] Running:
>> >>>      [testng]   Ant suite
>> >>>      [testng]
>> >>>      [testng]
>> >>>      [testng] Generating exhaustive interface....
>> >>>      [testng]       8 No default
>> >>>      [testng]       8 Error
>> >>>      [testng]      48 OK
>> >>>      [testng]      64 Total
>> >>>      [testng]
>> >>>      [testng] Generating exhaustive class....
>> >>>      [testng]     729 No default
>> >>>      [testng]      49 Error
>> >>>      [testng]     950 OK
>> >>>      [testng]    1728 Total
>> >>>      [testng]
>> >>>      [testng] Generating shapes interface....
>> >>>      [testng]     109 No default
>> >>>      [testng]     280 Error
>> >>>      [testng]     507 OK
>> >>>      [testng]     896 Total
>> >>>      [testng]
>> >>>      [testng] Generating shapes class/interface....
>> >>>      [testng]     190 No default
>> >>>      [testng]     568 Error
>> >>>      [testng]     536 OK
>> >>>      [testng]    1294 Total
>> >>>      [testng]
>> >>>      [testng] Expect OK:    2041 -- unique 1813
>> >>>      [testng] Expect Error: 905 -- unique 773
>> >>>      [testng]
>> >>>      [testng] Generating exhaustive interface....
>> >>>      [testng]       8 No default
>> >>>      [testng]       8 Error
>> >>>      [testng]      48 OK
>> >>>      [testng]      64 Total
>> >>>      [testng]
>> >>>      [testng] Generating exhaustive class....
>> >>>      [testng]     729 No default
>> >>>      [testng]      49 Error
>> >>>      [testng]     950 OK
>> >>>      [testng]    1728 Total
>> >>>      [testng]
>> >>>      [testng] Generating shapes interface....
>> >>>      [testng]     109 No default
>> >>>      [testng]     280 Error
>> >>>      [testng]     507 OK
>> >>>      [testng]     896 Total
>> >>>      [testng]
>> >>>      [testng] Generating shapes class/interface....
>> >>>      [testng]     190 No default
>> >>>      [testng]     568 Error
>> >>>      [testng]     536 OK
>> >>>      [testng]    1294 Total
>> >>>      [testng]
>> >>>      [testng] Expect OK:    2041 -- unique 1813
>> >>>      [testng] Expect Error: 905 -- unique 773
>> >
>> >
>>
>>
>