very very slow starting up on Solaris T5240

Sat Oct 3 21:05:53 UTC 2009

> Message: 1
> Date: Sat, 3 Oct 2009 22:40:41 +0300
> From: <atilla.demirel at turkcell.com.tr>
> Subject: very very slow starting up on Solaris T5240
> To: <hotspot-gc-dev at openjdk.java.net>
> Message-ID:
> 	<069B728771D6134C9ECEB525D929B07C0338B5FF1B at EXVMBX2.turkcell.entp.tgc>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi everybody,
>
>
> i send a first mail to group,   we have a start-up problem.
>
> we have huge number of Solaris Servers.  Sun v490&890  is normal for staring up . New generation Sun T5240  is extremly good for CPU& MEM. -
>
> but our WeblogicServer application server is very very slow starting up on Solaris T5240.
>  ~1hour.
>
> Why could it be ?
>
> Regards from Turkey,
>
>
>
> We are using these args:
>
> 24575:  /turkcell/extusr/jdk519/bin/java -Dweblogic.Name=EXT-WLS10-PROD-MAN1-M1-3 -serv
> argv[0]: /turkcell/extusr/jdk519/bin/java
> argv[1]: -Dweblogic.Name=EXT-WLS10-PROD-MAN1-M1-3
> argv[2]: -server
> argv[3]: -Xms1792m
> argv[4]: -Xmx1792m
> argv[5]: -Xss128k
> argv[6]: -Xmn510m
> argv[7]: -XX:SurvivorRatio=4
> argv[8]: -XX:+UseParNewGC
> argv[9]: -XX:+UseConcMarkSweepGC
> argv[10]: -XX:+CMSClassUnloadingEnabled
> argv[11]: -XX:PermSize=512m
> argv[12]: -XX:MaxPermSize=512m
> argv[13]: -verbosegc
> argv[14]: -XX:+PrintGCTimeStamps
> argv[15]: -XX:+PrintGCDetails
> argv[16]: -XX:+PrintTenuringDistribution
> argv[17]: -XX:+PrintHeapAtGC
> argv[18]: -Xloggc:/turkcell/extusr/wlserver10/wlserver_10.0/domains/EXT-WLS10-PROD-DMN/logs/MAN1-3gc.logs
> argv[19]: -Xcheck:jni
> argv[20]: -Djavax.net.ssl.trustStore=/usr/jdk/jdk160_05/jre/lib/security/cacerts
> argv[21]: -Dweblogic.configuration.schemaValidationEnabled=false
> argv[22]: -DPosnetLogDir=/data/beawllog
> argv[23]: -Dweblogic.management.username=****
> argv[24]: -Dweblogic.management.password=***
> argv[25]: -Dweblogic.management.server=https://***:**
> argv[26]: -Dweblogic.security.SSL.ignoreHostnameVerification=true
> argv[27]: -Djava.security.policy=/turkcell/extusr/wlserver10/wlserver_10.0/server/lib/weblogic.policy
> argv[28]: -DEnv=PROD
> argv[29]: -DHostName_WLSName=trafalgar-MAN1-M1-3
> argv[30]: -Dweblogic.webservice.i18n.charset=ISO-8859-9
> argv[31]: -Dfile.encoding=ISO-8859-9
> argv[32]: -Dorg.apache.xerces.xni.parser.XMLParserConfiguration=org.apache.xerces.parsers.XIncludeAwareParserConfiguration
> argv[33]: weblogic.Server
>
>
>
>
> little begin- Gc out
>
> 156.793: [GC {Heap before gc invocations=0:
>  par new generation   total 435200K, used 348160K [0x63c00000, 0x83a00000, 0x83a00000)
>   eden space 348160K, 100% used [0x63c00000, 0x79000000, 0x79000000)
>   from space 87040K,   0% used [0x79000000, 0x79000000, 0x7e500000)
>   to   space 87040K,   0% used [0x7e500000, 0x7e500000, 0x83a00000)
>  concurrent mark-sweep generation total 1312768K, used 0K [0x83a00000, 0xd3c00000, 0xd3c00000)
>  concurrent-mark-sweep perm gen total 524288K, used 24076K [0xd3c00000, 0xf3c00000, 0xf3c00000)
> 156.794: [ParNew
> Desired survivor size 44564480 bytes, new threshold 15 (max 15)
> - age   1:   15784840 bytes,   15784840 total
> - age   2:      10944 bytes,   15795784 total
> : 348160K->15709K(435200K), 0.2141873 secs] 348160K->15709K(1747968K)Heap after gc invocations=1:
>  par new generation   total 435200K, used 15709K [0x63c00000, 0x83a00000, 0x83a00000)
>   eden space 348160K,   0% used [0x63c00000, 0x63c00000, 0x79000000)
>   from space 87040K,  18% used [0x7e500000, 0x7f4577a8, 0x83a00000)
>   to   space 87040K,   0% used [0x79000000, 0x79000000, 0x7e500000)
>  concurrent mark-sweep generation total 1312768K, used 0K [0x83a00000, 0xd3c00000, 0xd3c00000)
>  concurrent-mark-sweep perm gen total 524288K, used 24076K [0xd3c00000, 0xf3c00000, 0xf3c00000)
> }
> , 0.2152029 secs]
> 189.791: [GC {Heap before gc invocations=1:
>  par new generation   total 435200K, used 363869K [0x63c00000, 0x83a00000, 0x83a00000)
>   eden space 348160K, 100% used [0x63c00000, 0x79000000, 0x79000000)
>   from space 87040K,  18% used [0x7e500000, 0x7f4577a8, 0x83a00000)
>   to   space 87040K,   0% used [0x79000000, 0x79000000, 0x7e500000)
>  concurrent mark-sweep generation total 1312768K, used 0K [0x83a00000, 0xd3c00000, 0xd3c00000)
>
>
> ************************************************************************
> Bu elektronik posta ve onunla iletilen butun dosyalar sadece gondericisi tarafindan almasi amaclanan yetkili gercek ya da tuzel kisinin kullanimi icindir.  Eger soz konusu yetkili alici degilseniz bu elektronik postanin icerigini aciklamaniz, kopyalamaniz, yonlendirmeniz ve kullanmaniz kesinlikle yasaktir ve bu elektronik postayi derhal silmeniz gerekmektedir.
> TURKCELL bu mesajin icerdigi bilgilerin dogrulugu veya eksiksiz oldugu konusunda herhangi bir garanti vermemektedir.  Bu nedenle bu bilgilerin ne sekilde olursa olsun iceriginden, iletilmesinden, alinmasindan ve saklanmasindan sorumlu degildir. Bu mesajdaki gorusler yalnizca gonderen kisiye aittir ve TURKCELLin goruslerini yansitmayabilir
> Bu e-posta bilinen butun bilgisayar viruslerine karsi taranmistir.
> ************************************************************************
> This e-mail and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient you are hereby notified that any dissemination, forwarding, copying or use of any of the information is strictly prohibited, and the e-mail should immediately be deleted.
> TURKCELL makes no warranty as to the accuracy or completeness of any information contained in this message and hereby excludes any liability of any kind for the information contained therein or for the information transmission, reception, storage or use of such in any way whatsoever.  The opinions expressed in this message belong to sender alone and may not necessarily reflect the opinions of TURKCELL.
> This e-mail has been scanned for all known computer viruses.
> ************************************************************************
My experience has been that slow startup is usually due to class loading and verification, and is not typically limited by GC.  If the same application is behaving differently on different platforms, I'd first look for differences in configuration and class libraries, then consider whether disk access is slower on the problem system.

-- 
Dan Hicks
Music was invented to confirm human loneliness.  --Lawrence Durrell