JPRT system changes

Tim Bell tim.bell at oracle.com
Fri Oct 26 10:31:45 PDT 2012 

On 10/26/12 10:14, Vladimir Kozlov wrote:
> Tim,
>
> It is not just JBB. Here is current status:

Hmmm... not sure what it is, then.

>   [ 3 windows_x64_6.1 clients, 3 hosts ]
>     sc11136526(P1)[DevOps VM Windows 7 X64]: running 
> <2012-10-26-154155.jcoomes.gc-push> 
> windows_x64-product-c2-GCBasher_ParOldGC(46m 40s)

No traces of that job on sc11136526:

jprtadm at SC11136526:/cygdrive/c/MKS/mksnt> cd /cygdrive/c/MKS/mksnt && 
./ps -ef | grep $USER
  jprtadm   1092    524  0   Oct 20 con  0:00 C:\cygwin\bin\cygrunsrv.exe
  jprtadm   1116    376  0   Oct 20 con  0:04 
\??\C:\Windows\system32\conhost.exe 
"-1483141665-707719824-1770841038-590923786-3215500991937909109-844736201686794369
  jprtadm   1476   1140  0   Oct 20 con  0:01 C:\cygwin\usr\sbin\sshd.exe -D
  jprtadm   1196    524  0   Oct 24 con  0:00 "taskhost.exe"
  jprtadm   1652    372  0   Oct 24 con  0:00 rdpclip
  jprtadm   2052    864  0   Oct 24 con  0:00 "C:\Windows\system32\Dwm.exe"
  jprtadm   3572   3536  0   Oct 24 con  0:05 C:\Windows\Explorer.EXE
  jprtadm   1992   3084  0   Oct 24 con  0:00 "C:\Program Files 
(x86)\Common Files\Java\Java Update\jucheck.exe" -auto -scheduled -critical
  jprtadm   2580   1316  0   Oct 24 con  0:00 "C:\Program Files 
(x86)\McAfee\Common Framework\UdaterUI.exe" 
/EventName=UPDATER_UI_EVENT128252be
  jprtadm   1552   2580  0   Oct 24 con  0:00 /load
  jprtadm   4012   3188  0 10:17:05 con  0:00 
C:\cygwin\usr\sbin\sshd.exe -D -R
  jprtadm   3136   4108  0 10:17:07 con  0:00 C:\cygwin\bin\bash.exe
  jprtadm   3044   3136  0 10:19:33 con  0:00 C:\cygwin\bin\bash.exe
  jprtadm   3796   3044  0 10:19:33 con  0:00 C:\MKS\mksnt\ps.exe -ef
  jprtadm   3372   3796  0 10:19:33 con  0:00 ntps.exe -ef
  jprtadm   2000   4824  0 10:19:33 con  0:00 C:\cygwin\bin\grep.exe jprtadm


> sc11136598(P1)[DevOps VM Windows 7 X64]: running 
> <2012-10-26-003719.vkozlov.7163534> 
> windows_x64-fastdebug-c2-jbb_default_nontiered(56m 10s)

No sign of that job on sc11136598:

jprtadm at SC11136598:/cygdrive/c/MKS/mksnt> cd /cygdrive/c/MKS/mksnt && 
./ps -ef | grep $USER
  jprtadm   3156    524  0   Oct 24 con  0:00 "taskhost.exe"
  jprtadm    600    372  0   Oct 24 con  0:00 rdpclip
  jprtadm   2472    860  0   Oct 24 con  0:00 "C:\Windows\system32\Dwm.exe"
  jprtadm   3196    588  0   Oct 24 con  0:04 C:\Windows\Explorer.EXE
  jprtadm   3940   3724  0   Oct 24 con  0:00 "C:\Program Files 
(x86)\Common Files\Java\Java Update\jusched.exe"
  jprtadm   1904   3724  0   Oct 24 con  0:01 "C:\Program Files 
(x86)\McAfee\Host Intrusion Prevention\FireTray.exe"
  jprtadm   3504   1392  0   Oct 24 con  0:00 "C:\Program Files 
(x86)\McAfee\Common Framework\UdaterUI.exe" 
/EventName=UPDATER_UI_EVENT12e6c98d
  jprtadm   1816   3504  0   Oct 24 con  0:00 /load
  jprtadm   2332   3940  0   Oct 24 con  0:00 "C:\Program Files 
(x86)\Common Files\Java\Java Update\jucheck.exe" -auto -scheduled -critical
  jprtadm   4796    524  0 09:37:10 con  0:00 C:\cygwin\bin\cygrunsrv.exe
  jprtadm   5880    376  0 09:37:10 con  0:00 
\??\C:\Windows\system32\conhost.exe 
"-1794119873914084936-13665211491113271794989327951480364587-1969885781-473977465
  jprtadm   4512    824  0 09:37:10 con  0:00 C:\cygwin\usr\sbin\sshd.exe -D
  jprtadm   5500   5532  0 10:20:33 con  0:00 
C:\cygwin\usr\sbin\sshd.exe -D -R
  jprtadm   5612   4044  0 10:20:35 con  0:00 C:\cygwin\bin\bash.exe
  jprtadm   1776   5612  0 10:20:56 con  0:00 C:\cygwin\bin\bash.exe
  jprtadm   5556   1776  0 10:20:56 con  0:00 C:\MKS\mksnt\ps.exe -ef
  jprtadm   2544   2268  0 10:20:56 con  0:00 C:\cygwin\bin\grep.exe jprtadm
  jprtadm   3864   5556  0 10:20:56 con  0:00 ntps.exe -ef

> sc11136603(P1)[DevOps VM Windows 7 X64]: running 
> <2012-10-26-154155.jcoomes.gc-push> 
> windows_x64-product-c2-runThese_Xcomp(36m 52s)

sc11136603 is not responding to ssh or to remote desktop.


Tim

>
> Vladimir
>
> Tim Bell wrote:
>> Adding hotspot-dev for the question about jbb_default below.
>>
>> Kelly-
>>
>>> I'll be taking all the Windows 7 systems out of the queues until we 
>>> resolve this.
>>
>> Rather than take them out, could you make thw W7 systems build-only?
>>
>> The root of the problem is that jbb does not really run properly in 
>> headless mode.  Everything after that has been us standing on our 
>> heads trying to work around breakage in jbb or in AWT.
>>
>> Is jbb_default worth keeping, or is it simply run out of habit? Just 
>> asking because it is causing a fair amount of trouble.
>>
>>
>> Tim
>>
>> On 10/26/12 09:56, Kelly O'Hair wrote:
>>> It's the Windows 7 jbb issue.
>>>
>>> We have seen this before in JPRT Stockholm, which was the first JPRT 
>>> system that had Windows 7.
>>>
>>> Current theory, not sure how much we understand this, is that the 
>>> CYGWIN sshd service is somehow
>>> involved, and that if we manually start sshd the hang goes away.
>>> But so far we haven't had any solutions on how to get this manual 
>>> sshd startup to work on reboots.
>>>
>>> I'll be taking all the Windows 7 systems out of the queues until we 
>>> resolve this.
>>>
>>> -kto
>>>
>>> On Oct 26, 2012, at 9:31 AM, Vladimir Kozlov wrote:
>>>
>>>> It looks like some of new machines periodically timeout during jbb 
>>>> test run (>25min) so out jobs failed.
>>>>
>>>>   windows_x64-fastdebug-c2-jbb_default FAILED(25m 40s)
>>>>         USED:     hostname=sc11136526 platform=windows_x64_6.1 
>>>> osname=windows osarch=x64 cpus=2 parallelcount=2 ram=7899MB 
>>>> instance=P1 compiler=VS2010 mks=true cygwin=true installshield=true 
>>>> dxsdk=true pstools=true
>>>>         ATTRS:    cygwin=true
>>>>         TIMING:   clean=1s init=13s work=25m12s fini=5s
>>>>         VMFLAGS:  -server -Djava.awt.headless=true
>>>>         NEEDS:    cygwin,gnumake381,jbb,jtreg
>>>>
>>>>
>>>>   windows_x64-fastdebug-c2-jbb_default FAILED(25m 50s)
>>>>         USED:     hostname=sc11136603 platform=windows_x64_6.1 
>>>> osname=windows osarch=x64 cpus=2 parallelcount=2 ram=7899MB 
>>>> instance=P1 compiler=VS2010 mks=true cygwin=true installshield=true 
>>>> dxsdk=true pstools=true
>>>>         ATTRS:    mks=true
>>>>         TIMING:   clean=12s init=13s work=25m13s fini=4s
>>>>         VMFLAGS:  -server -Djava.awt.headless=true
>>>>         NEEDS:    gnumake381,jbb,jtreg,mks
>>>>
>>>> Vladimir
>>>>
>>>> Kelly O'Hair wrote:
>>>>> I have updated all the JPRT systems to a new version.
>>>>> JPRT Version: 3.0.47: (2012-10-23) Case of the Unwelcome Well
>>>>> Changes:
>>>>> * hotspotwest will get all the Windows X64 machines currently used 
>>>>> by the sfbay queue (4 X64 systems, 1 is a VM)
>>>>> * sfbay will get 6 new Windows X64 DevOps VM's
>>>>> * Both sfbay and hotspotwest will each get 3 new Windows 7 X64 
>>>>> DevOp VMs
>>>>> * some changes with regards to how JPRT kills off processes on 
>>>>> clients, should help kill off failed or hung cygwin builds
>>>>> * An attempt to allow ccache to work on Solaris with build-infra 
>>>>> builds
>>>>> There are some JPRT sfbay machines that are down, tickets have 
>>>>> been filed. So sfbay is shy Solaris SPARC and one MacPro.
>>>>> JPRT East is missing some Solaris SPARC machines.
>>>>> -kto
>>
>>

More information about the hotspot-dev mailing list