- Xymon - Xymon mailman web

[hobbit] numbers for CPU load less meaningful than runque numbers?
by tmyers＠autom.net 26 Jan '06

26 Jan '06

The idle reports the same on sar as mpstat, I also noticed that vmstat run queue matches uptime numbers. I haven't seen numbers this hi on 4.3.3 systems with out them being slow to the point of pain. I am getting loads of 40 - 60 in production with still showing idle time. -----Original Message----- From: Jeff Newman [mailto:jeffnewman75 at gmail.com] Sent: Tuesday, January 24, 2006 11:34 AM To: hobbit at hswn.dk Subject: Re: [hobbit] numbers for CPU load less meaningful than runque numbers? How does it compare to say, sar -P ALL 1 in terms of %idle? -Jeff On 1/24/06, Myers, Timothy L. < tmyers at autom.net> wrote: Anyone else running AIX 5.3ml3 seeing load numbers coming form uptime, to be less useful than the mpstat runque numbers? mpstat reports - cpu min maj mpc int cs ics rq mig lpa sysc us sy wa id pc 0 275 1 0 160 7069 2986 0 13277 100.0 12950 17.9 9.6 3.9 68.6 0.51 1 16 0 0 165 7986 3601 1 11905 100.0 9791 17.6 8.7 2.5 71.3 0.49 2 179 1 0 163 8064 4211 0 11460 100.0 11374 16.3 9.0 2.7 72.0 0.49 3 132 2 0 319 9523 4963 0 14572 100.0 9470 18.1 9.5 3.0 69.4 0.51 ALL 602 4 0 807 32642 15761 1 51214 100.0 43585 17.5 9.2 3.0 70.3 2.00 -------------------------------------------------------------------------------------------------------- 0 251 4 0 160 6926 2864 0 12986 100.0 11030 17.6 9.0 3.0 70.4 0.49 1 45 1 0 159 8211 3864 0 11921 100.0 13722 19.0 9.0 4.1 67.9 0.50 2 166 3 0 155 8425 4490 0 11967 100.0 10509 16.3 8.3 2.6 72.9 0.49 3 100 0 0 310 9537 4970 0 14084 100.0 10018 18.5 8.8 3.6 69.2 0.51 ALL 562 8 0 784 33099 16188 0 50958 100.0 45279 17.9 8.7 3.3 70.1 1.99 uptime reports - 09:06AM up 2 days, 14:51, 56 users, load average: 41.50, 34.30, 29.37 I am not seeing any of the slowness I would expect from this kind of load so I have spent the last couple of days with snapshots trying to figure it out just what is going wrong. I don't know but I suspect that the problems with the utmp and wtmp files are causing finger issues The performance and processes are much more in line with mpstat run queue numbers than with uptime run able process numbers. Timothy L Myers Senior Developer Autom 5226 South 31st Place Phoenix AZ 85040

1 0

Plotting temperature.
by rmcgraw＠purdue.edu 25 Jan '06

25 Jan '06

>From the hobbit archives I tried to glean how to plot temperature for a host. I have done the following. On my client I have the following being sent to msg.txt [temperature] Device Temp(C) Temp(F) ------------------------------------------- &green CPU0 47 116 &green CPU1 45 113 ------------------------------------------- On the server I have set my host to plot temperature in the TRENDS: as follows: 128.210.3.999 xxx.math.purdue.edu #ntp ssh smtp imaps pop3s \ TRENDS:*,vmstat:vmstat2|vmstat3|vmstat6|vmstat7|vmstat8|vmstat9|vmstat0,nets tat:\ netstat|netstat2|netstat3,temperature,!bbtest,!bbgen There are tabs between device and temperature. Would this cause any problem? Am I even doing this correctly? _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067

1 0

do_temperature.c question
by rmcgraw＠purdue.edu 25 Jan '06

25 Jan '06

In the do_temperature.c program it show an example of what is expected for input. &green CPU 0 Ambient 27 80 &green CPU 1 Die 73 163 &green CPU 1 Ambient 26 78 ----------------------------------- Status green: All devices look okay Is the line "Status green: All devices look okay" have to be included? Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067

2 1

[hobbit] bb-prtdiag and temperature.sh question (still having problems on the server)
by rdeal＠tigr.ORG 24 Jan '06

24 Jan '06

The server is a munged thing right now. I use the hobbitlaunch.cfg on the server and have this setting: [prtdiag] ENVFILE /local/packages/IT/HOBBIT/hobbit/client/etc/hobbitclient.cfg NEEDS hobbitd CMD /local/packages/IT/HOBBIT/hobbit/client/ext/bb-prtdiag.sh LOGFILE $BBSERVERLOGS/bb-prtdiag.log INTERVAL 5m So that it basically uses the client config. > -----Original Message----- > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > Sent: Tuesday, January 24, 2006 6:08 PM > To: hobbit at hswn.dk > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question (still having > problems on the server) > > Richard > > I thought I saw the problem but I guess not. > > I have put the changes in the client directory of the server and restarted > the server. It does not see to pick up what is in the client directory. If > I run runclient.sh on the client then it works but I have read that it is > not necessary to run runclient.sh on the server. > > What needs to be done on the server to get bb-pridiag to work on the > server? > > Thanks > > Robert > > > > > > _____________________________________________________________________ > Robert P. McGraw, Jr. > Manager, Computer System EMAIL: rmcgraw at purdue.edu > Purdue University ROOM: MATH-807 > Department of Mathematics PHONE: (765) 494-6055 > 150 N. University Street FAX: (419) 821-0540 > West Lafayette, IN 47907-2067 > > > > -----Original Message----- > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > Sent: Tuesday, January 24, 2006 10:36 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question. > > > > Yes the modification goes in the clientlaunch.cfg and no change is > needed > > on the server side. I have these added to my clientlaunch.cfg for most > > sun machines: > > > > [meta] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/meta > > LOGFILE $HOBBITCLIENTHOME/logs/meta.log > > INTERVAL 5m > > > > [ntp] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/bb-ntp.sh > > LOGFILE $HOBBITCLIENTHOME/logs/bb-ntp.log > > INTERVAL 5m > > > > [ntpstat] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/ntpstat.sh > > LOGFILE $HOBBITCLIENTHOME/logs/ntpstat.log > > INTERVAL 5m > > > > [prtdiag] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/bb-prtdiag.sh > > LOGFILE $HOBBITCLIENTHOME/logs/bb-prtdiag.log > > INTERVAL 5m > > > > [cpu2] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/bb-cpu2.sh > > LOGFILE $HOBBITCLIENTHOME/logs/bb-cpu2.log > > INTERVAL 5m > > > > [msgs] > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/bb-msgs.sh > > LOGFILE $HOBBITCLIENTHOME/logs/bb-msgs.log > > INTERVAL 5m > > > > [sge] > > DISABLED > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/sge.sh > > LOGFILE $HOBBITCLIENTHOME/logs/sge.log > > INTERVAL 5m > > > > [vx] > > DISABLED > > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > > CMD $HOBBITCLIENTHOME/ext/bb-vxcheck.sh > > LOGFILE $HOBBITCLIENTHOME/logs/bb-vxcheck.log > > INTERVAL 5m > > > > SGE and VX check are enabled on the few hosts were it is needed. > > Richard > > > > > -----Original Message----- > > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > > Sent: Tuesday, January 24, 2006 10:30 AM > > > To: hobbit at hswn.dk > > > Subject: [hobbit] bb-prtdiag and temperature.sh question. > > > > > > Richard, > > > > > > Thanks for your reply. > > > > > > When I think I understand how hobbit works, I seem to get confused > > again. > > > > > > I see the modifications you suggest in hobbitclient.cfg and bb- > prtdiag. > > No > > > problem in making these. > > > > > > I am confused where to set it to execute. > > > > > > Let me see if I got how hobbit works on the client. > > > > > > 1) Hobbitlaunch reads the clientlaunch.cfg file. > > > > > > 2) Clientlaunch.cfg file reads hobbitclient.cfg file and executes > > > hobbitclient.sh > > > > > > 3) hobbitclient.sh calls hobbitclient-sunos.sh (in my case) which > > executes > > > the programs in hobbitclient-sunos.sh and writes the output to > msg.txt. > > > > > > 4 hobbitclient.sh sends msg.txt to the $BBDISP. > > > > > > Now I want to execute the bb-prtdiag and bb-prtdiag seems to send the > > data > > > to $BBDISP inside the script. > > > > > > Do I put the execution of $BBDISP in clientlaunch.cfg? > > > > > > What do I need to do on the server side for this to show up in the > > hobbit > > > html? > > > > > > Thanks > > > > > > Robert > > > > > > > > > ________________________________________ > > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > > Sent: Tuesday, January 24, 2006 8:48 AM > > > To: hobbit at hswn.dk > > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > I didn't have to modify bb-prtdiag at all to get it running under the > > > hobbit > > > client. > > > You will have to modify the etc/hobbitclient.cfg file to represent > your > > > environment and the bb-prtdiag modifications should also be added. > > > I have these lines added to hobbitclient.cfg: > > > (might be some line modification by email but you get the idea) > > > # > > > #from prtdiag script > > > # > > > UNAME="/sbin/uname" > > > #PLATFORM_SPEC=`${UNAME} -i` > > > #PRTDIAG_COMMAND="/usr/platform/${PLATFORM_SPEC}/sbin/prtdiag" > > > PRTDIAG_OPT="-v" > > > ZONENAME=/usr/bin/zonename > > > #Systems that don't support temperature checks > > > EXCLUDE_SYSTEMS="Ultra-1 Ultra-2 Ultra-5_10 Ultra-30 Ultra-60 Ultra-80 > > > UltraAX-i > > > 2 UltraSPARC-IIi-cEngine Sun-Fire Netra-T4 UltraAX-e2 > > > Ultra-Enterprise-10000" > > > PRTDIAG_IGNORE_ERRORS="No failures|Most recent AC Power > Failure|Minimum > > > Availabl > > > e|CS Fail|No Hardware failures|^===|currently no Boards|Fault Fan" > > > PRTDIAG_IGNORE_FAULTS="No Recent System Faults found|No System Faults > > > found|Faul > > > t Value|Fault LED|NO_FAULT|Power Fault|Status > > > Fault|Fault > > > off" > > > LOM_COMMAND="/usr/sbin/lom" > > > LOM_OPT="-pfvt" > > > > > > Woops there is one slight modification to the bb-prtdiag script. > Since > > > hobbitclient.cfg does not allow for execution, just variable setting, > I > > > had > > > to uncomment these two lines in bb-prtdiag: > > > PLATFORM_SPEC=`$UNAME -i` > > > PRTDIAG_COMMAND="/usr/platform/$PLATFORM_SPEC/sbin/prtdiag" > > > > > > > > > > > > ________________________________________ > > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > > Sent: Tuesday, January 24, 2006 8:34 AM > > > To: hobbit at hswn.dk > > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > > > > > > > Has anyone rewritten the solaris temperature.sh and bb-prtdiag for > > hobbit? > > > I > > > would like to get these going on and just did not want to redo work > that > > > has > > > already been done. > > > > > > Thanks > > > > > > Robert > > > > > > > > > > > > > > > _____________________________________________________________________ > > > Robert P. McGraw, Jr. > > > Manager, Computer System > EMAIL: > > > rmcgraw at purdue.edu > > > Purdue University > > > ROOM: MATH-807 > > > Department of Mathematics > PHONE: > > > (765) 494-6055 > > > 150 N. University Street > > > FAX: (419) 821-0540 > > > West Lafayette, IN 47907-2067 > > > > To unsubscribe from the hobbit list, send an e-mail to > > hobbit-unsubscribe at hswn.dk > >

1 0

[hobbit] bb-prtdiag and temperature.sh question (still having problems on the server)
by rmcgraw＠purdue.edu 24 Jan '06

24 Jan '06

Richard I thought I saw the problem but I guess not. I have put the changes in the client directory of the server and restarted the server. It does not see to pick up what is in the client directory. If I run runclient.sh on the client then it works but I have read that it is not necessary to run runclient.sh on the server. What needs to be done on the server to get bb-pridiag to work on the server? Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067 > -----Original Message----- > From: Deal, Richard [mailto:rdeal at tigr.ORG] > Sent: Tuesday, January 24, 2006 10:36 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question. > > Yes the modification goes in the clientlaunch.cfg and no change is needed > on the server side. I have these added to my clientlaunch.cfg for most > sun machines: > > [meta] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/meta > LOGFILE $HOBBITCLIENTHOME/logs/meta.log > INTERVAL 5m > > [ntp] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-ntp.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-ntp.log > INTERVAL 5m > > [ntpstat] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/ntpstat.sh > LOGFILE $HOBBITCLIENTHOME/logs/ntpstat.log > INTERVAL 5m > > [prtdiag] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-prtdiag.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-prtdiag.log > INTERVAL 5m > > [cpu2] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-cpu2.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-cpu2.log > INTERVAL 5m > > [msgs] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-msgs.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-msgs.log > INTERVAL 5m > > [sge] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/sge.sh > LOGFILE $HOBBITCLIENTHOME/logs/sge.log > INTERVAL 5m > > [vx] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-vxcheck.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-vxcheck.log > INTERVAL 5m > > SGE and VX check are enabled on the few hosts were it is needed. > Richard > > > -----Original Message----- > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 10:30 AM > > To: hobbit at hswn.dk > > Subject: [hobbit] bb-prtdiag and temperature.sh question. > > > > Richard, > > > > Thanks for your reply. > > > > When I think I understand how hobbit works, I seem to get confused > again. > > > > I see the modifications you suggest in hobbitclient.cfg and bb-prtdiag. > No > > problem in making these. > > > > I am confused where to set it to execute. > > > > Let me see if I got how hobbit works on the client. > > > > 1) Hobbitlaunch reads the clientlaunch.cfg file. > > > > 2) Clientlaunch.cfg file reads hobbitclient.cfg file and executes > > hobbitclient.sh > > > > 3) hobbitclient.sh calls hobbitclient-sunos.sh (in my case) which > executes > > the programs in hobbitclient-sunos.sh and writes the output to msg.txt. > > > > 4 hobbitclient.sh sends msg.txt to the $BBDISP. > > > > Now I want to execute the bb-prtdiag and bb-prtdiag seems to send the > data > > to $BBDISP inside the script. > > > > Do I put the execution of $BBDISP in clientlaunch.cfg? > > > > What do I need to do on the server side for this to show up in the > hobbit > > html? > > > > Thanks > > > > Robert > > > > > > ________________________________________ > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > Sent: Tuesday, January 24, 2006 8:48 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > I didn't have to modify bb-prtdiag at all to get it running under the > > hobbit > > client. > > You will have to modify the etc/hobbitclient.cfg file to represent your > > environment and the bb-prtdiag modifications should also be added. > > I have these lines added to hobbitclient.cfg: > > (might be some line modification by email but you get the idea) > > # > > #from prtdiag script > > # > > UNAME="/sbin/uname" > > #PLATFORM_SPEC=`${UNAME} -i` > > #PRTDIAG_COMMAND="/usr/platform/${PLATFORM_SPEC}/sbin/prtdiag" > > PRTDIAG_OPT="-v" > > ZONENAME=/usr/bin/zonename > > #Systems that don't support temperature checks > > EXCLUDE_SYSTEMS="Ultra-1 Ultra-2 Ultra-5_10 Ultra-30 Ultra-60 Ultra-80 > > UltraAX-i > > 2 UltraSPARC-IIi-cEngine Sun-Fire Netra-T4 UltraAX-e2 > > Ultra-Enterprise-10000" > > PRTDIAG_IGNORE_ERRORS="No failures|Most recent AC Power Failure|Minimum > > Availabl > > e|CS Fail|No Hardware failures|^===|currently no Boards|Fault Fan" > > PRTDIAG_IGNORE_FAULTS="No Recent System Faults found|No System Faults > > found|Faul > > t Value|Fault LED|NO_FAULT|Power Fault|Status > > Fault|Fault > > off" > > LOM_COMMAND="/usr/sbin/lom" > > LOM_OPT="-pfvt" > > > > Woops there is one slight modification to the bb-prtdiag script. Since > > hobbitclient.cfg does not allow for execution, just variable setting, I > > had > > to uncomment these two lines in bb-prtdiag: > > PLATFORM_SPEC=`$UNAME -i` > > PRTDIAG_COMMAND="/usr/platform/$PLATFORM_SPEC/sbin/prtdiag" > > > > > > > > ________________________________________ > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 8:34 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > > > Has anyone rewritten the solaris temperature.sh and bb-prtdiag for > hobbit? > > I > > would like to get these going on and just did not want to redo work that > > has > > already been done. > > > > Thanks > > > > Robert > > > > > > > > > > _____________________________________________________________________ > > Robert P. McGraw, Jr. > > Manager, Computer System EMAIL: > > rmcgraw at purdue.edu > > Purdue University > > ROOM: MATH-807 > > Department of Mathematics PHONE: > > (765) 494-6055 > > 150 N. University Street > > FAX: (419) 821-0540 > > West Lafayette, IN 47907-2067 > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk >

2 1

MRTG & Hobbit
by chrisw＠supranet.net 24 Jan '06

24 Jan '06

> cfgmaker generated the mrtg.cfg with all the interfaces on the switch. A > little tweaking got it generating > graphs correctly. The labels on each graph look mostly correct (i.e. > .fa0_0_0 inbound and .fa0_0_0) {the . in front of > the label name is why I say mostly correct, I don't really care much about > that} so that is all good. > > Here's the question. > > The fa0_0_0 is useful for my network guy, but doesn't mean anything to me. > Looking at the mrtg.cfg > I see it has in it the info that would be useful to me. Here is a snippet > (question below snippet) > > Title[mrtg.Fa0_0_0]: Traffic Analysis for Fa0/0/0 -- RPCFIR1 > PageTop[mrtg.Fa0_0_0]: <H1>Traffic Analysis for Fa0/0/0 -- RPCFIR1</H1> > <TABLE> > <TR><TD>System:</TD> <TD>RPCFIR1 in </TD></TR> > <TR><TD>Maintainer:</TD> <TD></TD></TR> > <TR><TD>Description:</TD><TD>FastEthernet0/0/0 OA Link Subnet15 > </TD></TR> > <TR><TD>ifType:</TD> <TD>ethernetCsmacd (6)</TD></TR> > <TR><TD>ifName:</TD> <TD>Fa0/0/0</TD></TR> > <TR><TD>Max Speed:</TD> <TD>12.5 MBytes/s</TD></TR> > <TR><TD>Ip:</TD> <TD>167.76.15.2 ()</TD></TR> > </TABLE> Hello, New to the list, this "reply" won't show up correctly in the archives. oh well. What in this snippet is useful to you? I'm assuming it's "FastEthernet0/0/0 OA Link Subnet15", correct? MRTG creates these using cfgmaker. The man page of cfgmaker shows to use the "--ifref=SOMETHING" command to use other things as the description of the interface. You probably want: cfgmaker --ifref=descr public at 1.2.3.4 --Chris

1 0

[hobbit] bb-prtdiag and temperature.sh question.
by rmcgraw＠purdue.edu 24 Jan '06

24 Jan '06

Richard, Never mind, I thing I have found the problem. This is working ok on the server one I resolved a "stupid" problem. Again thanks for all you help. Robert Richard, I ran the runclient.sh in the client directory of the server. When I did this things worked. I thought that starting and stopping the server also took care of the client. Is this not the case. Thanks again Richard, This worked like you advertised on my client. I went and put the changes in the client directory of the server and restarted the server but I do not get the output. Are there any other files that I need to change to get this to work on the server? Doing this has been a big help as I am finally seeing how things are set up and interact. Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067 > -----Original Message----- > From: Deal, Richard [mailto:rdeal at tigr.ORG] > Sent: Tuesday, January 24, 2006 10:36 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question. > > Yes the modification goes in the clientlaunch.cfg and no change is needed > on the server side. I have these added to my clientlaunch.cfg for most > sun machines: > > [meta] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/meta > LOGFILE $HOBBITCLIENTHOME/logs/meta.log > INTERVAL 5m > > [ntp] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-ntp.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-ntp.log > INTERVAL 5m > > [ntpstat] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/ntpstat.sh > LOGFILE $HOBBITCLIENTHOME/logs/ntpstat.log > INTERVAL 5m > > [prtdiag] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-prtdiag.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-prtdiag.log > INTERVAL 5m > > [cpu2] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-cpu2.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-cpu2.log > INTERVAL 5m > > [msgs] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-msgs.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-msgs.log > INTERVAL 5m > > [sge] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/sge.sh > LOGFILE $HOBBITCLIENTHOME/logs/sge.log > INTERVAL 5m > > [vx] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-vxcheck.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-vxcheck.log > INTERVAL 5m > > SGE and VX check are enabled on the few hosts were it is needed. > Richard > > > -----Original Message----- > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 10:30 AM > > To: hobbit at hswn.dk > > Subject: [hobbit] bb-prtdiag and temperature.sh question. > > > > Richard, > > > > Thanks for your reply. > > > > When I think I understand how hobbit works, I seem to get confused > again. > > > > I see the modifications you suggest in hobbitclient.cfg and bb-prtdiag. > No > > problem in making these. > > > > I am confused where to set it to execute. > > > > Let me see if I got how hobbit works on the client. > > > > 1) Hobbitlaunch reads the clientlaunch.cfg file. > > > > 2) Clientlaunch.cfg file reads hobbitclient.cfg file and executes > > hobbitclient.sh > > > > 3) hobbitclient.sh calls hobbitclient-sunos.sh (in my case) which > executes > > the programs in hobbitclient-sunos.sh and writes the output to msg.txt. > > > > 4 hobbitclient.sh sends msg.txt to the $BBDISP. > > > > Now I want to execute the bb-prtdiag and bb-prtdiag seems to send the > data > > to $BBDISP inside the script. > > > > Do I put the execution of $BBDISP in clientlaunch.cfg? > > > > What do I need to do on the server side for this to show up in the > hobbit > > html? > > > > Thanks > > > > Robert > > > > > > ________________________________________ > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > Sent: Tuesday, January 24, 2006 8:48 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > I didn't have to modify bb-prtdiag at all to get it running under the > > hobbit > > client. > > You will have to modify the etc/hobbitclient.cfg file to represent your > > environment and the bb-prtdiag modifications should also be added. > > I have these lines added to hobbitclient.cfg: > > (might be some line modification by email but you get the idea) > > # > > #from prtdiag script > > # > > UNAME="/sbin/uname" > > #PLATFORM_SPEC=`${UNAME} -i` > > #PRTDIAG_COMMAND="/usr/platform/${PLATFORM_SPEC}/sbin/prtdiag" > > PRTDIAG_OPT="-v" > > ZONENAME=/usr/bin/zonename > > #Systems that don't support temperature checks > > EXCLUDE_SYSTEMS="Ultra-1 Ultra-2 Ultra-5_10 Ultra-30 Ultra-60 Ultra-80 > > UltraAX-i > > 2 UltraSPARC-IIi-cEngine Sun-Fire Netra-T4 UltraAX-e2 > > Ultra-Enterprise-10000" > > PRTDIAG_IGNORE_ERRORS="No failures|Most recent AC Power Failure|Minimum > > Availabl > > e|CS Fail|No Hardware failures|^===|currently no Boards|Fault Fan" > > PRTDIAG_IGNORE_FAULTS="No Recent System Faults found|No System Faults > > found|Faul > > t Value|Fault LED|NO_FAULT|Power Fault|Status > > Fault|Fault > > off" > > LOM_COMMAND="/usr/sbin/lom" > > LOM_OPT="-pfvt" > > > > Woops there is one slight modification to the bb-prtdiag script. Since > > hobbitclient.cfg does not allow for execution, just variable setting, I > > had > > to uncomment these two lines in bb-prtdiag: > > PLATFORM_SPEC=`$UNAME -i` > > PRTDIAG_COMMAND="/usr/platform/$PLATFORM_SPEC/sbin/prtdiag" > > > > > > > > ________________________________________ > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 8:34 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > > > Has anyone rewritten the solaris temperature.sh and bb-prtdiag for > hobbit? > > I > > would like to get these going on and just did not want to redo work that > > has > > already been done. > > > > Thanks > > > > Robert > > > > > > > > > > _____________________________________________________________________ > > Robert P. McGraw, Jr. > > Manager, Computer System EMAIL: > > rmcgraw at purdue.edu > > Purdue University > > ROOM: MATH-807 > > Department of Mathematics PHONE: > > (765) 494-6055 > > 150 N. University Street > > FAX: (419) 821-0540 > > West Lafayette, IN 47907-2067 > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk >

1 0

[hobbit] bb-prtdiag and temperature.sh question.
by rmcgraw＠purdue.edu 24 Jan '06

24 Jan '06

Richard, I ran the runclient.sh in the client directory of the server. When I did this things worked. I thought that starting and stopping the server also took care of the client. Is this not the case. Thanks again Richard, This worked like you advertised on my client. I went and put the changes in the client directory of the server and restarted the server but I do not get the output. Are there any other files that I need to change to get this to work on the server? Doing this has been a big help as I am finally seeing how things are set up and interact. Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067 > -----Original Message----- > From: Deal, Richard [mailto:rdeal at tigr.ORG] > Sent: Tuesday, January 24, 2006 10:36 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question. > > Yes the modification goes in the clientlaunch.cfg and no change is needed > on the server side. I have these added to my clientlaunch.cfg for most > sun machines: > > [meta] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/meta > LOGFILE $HOBBITCLIENTHOME/logs/meta.log > INTERVAL 5m > > [ntp] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-ntp.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-ntp.log > INTERVAL 5m > > [ntpstat] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/ntpstat.sh > LOGFILE $HOBBITCLIENTHOME/logs/ntpstat.log > INTERVAL 5m > > [prtdiag] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-prtdiag.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-prtdiag.log > INTERVAL 5m > > [cpu2] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-cpu2.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-cpu2.log > INTERVAL 5m > > [msgs] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-msgs.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-msgs.log > INTERVAL 5m > > [sge] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/sge.sh > LOGFILE $HOBBITCLIENTHOME/logs/sge.log > INTERVAL 5m > > [vx] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-vxcheck.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-vxcheck.log > INTERVAL 5m > > SGE and VX check are enabled on the few hosts were it is needed. > Richard > > > -----Original Message----- > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 10:30 AM > > To: hobbit at hswn.dk > > Subject: [hobbit] bb-prtdiag and temperature.sh question. > > > > Richard, > > > > Thanks for your reply. > > > > When I think I understand how hobbit works, I seem to get confused > again. > > > > I see the modifications you suggest in hobbitclient.cfg and bb-prtdiag. > No > > problem in making these. > > > > I am confused where to set it to execute. > > > > Let me see if I got how hobbit works on the client. > > > > 1) Hobbitlaunch reads the clientlaunch.cfg file. > > > > 2) Clientlaunch.cfg file reads hobbitclient.cfg file and executes > > hobbitclient.sh > > > > 3) hobbitclient.sh calls hobbitclient-sunos.sh (in my case) which > executes > > the programs in hobbitclient-sunos.sh and writes the output to msg.txt. > > > > 4 hobbitclient.sh sends msg.txt to the $BBDISP. > > > > Now I want to execute the bb-prtdiag and bb-prtdiag seems to send the > data > > to $BBDISP inside the script. > > > > Do I put the execution of $BBDISP in clientlaunch.cfg? > > > > What do I need to do on the server side for this to show up in the > hobbit > > html? > > > > Thanks > > > > Robert > > > > > > ________________________________________ > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > Sent: Tuesday, January 24, 2006 8:48 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > I didn't have to modify bb-prtdiag at all to get it running under the > > hobbit > > client. > > You will have to modify the etc/hobbitclient.cfg file to represent your > > environment and the bb-prtdiag modifications should also be added. > > I have these lines added to hobbitclient.cfg: > > (might be some line modification by email but you get the idea) > > # > > #from prtdiag script > > # > > UNAME="/sbin/uname" > > #PLATFORM_SPEC=`${UNAME} -i` > > #PRTDIAG_COMMAND="/usr/platform/${PLATFORM_SPEC}/sbin/prtdiag" > > PRTDIAG_OPT="-v" > > ZONENAME=/usr/bin/zonename > > #Systems that don't support temperature checks > > EXCLUDE_SYSTEMS="Ultra-1 Ultra-2 Ultra-5_10 Ultra-30 Ultra-60 Ultra-80 > > UltraAX-i > > 2 UltraSPARC-IIi-cEngine Sun-Fire Netra-T4 UltraAX-e2 > > Ultra-Enterprise-10000" > > PRTDIAG_IGNORE_ERRORS="No failures|Most recent AC Power Failure|Minimum > > Availabl > > e|CS Fail|No Hardware failures|^===|currently no Boards|Fault Fan" > > PRTDIAG_IGNORE_FAULTS="No Recent System Faults found|No System Faults > > found|Faul > > t Value|Fault LED|NO_FAULT|Power Fault|Status > > Fault|Fault > > off" > > LOM_COMMAND="/usr/sbin/lom" > > LOM_OPT="-pfvt" > > > > Woops there is one slight modification to the bb-prtdiag script. Since > > hobbitclient.cfg does not allow for execution, just variable setting, I > > had > > to uncomment these two lines in bb-prtdiag: > > PLATFORM_SPEC=`$UNAME -i` > > PRTDIAG_COMMAND="/usr/platform/$PLATFORM_SPEC/sbin/prtdiag" > > > > > > > > ________________________________________ > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 8:34 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > > > Has anyone rewritten the solaris temperature.sh and bb-prtdiag for > hobbit? > > I > > would like to get these going on and just did not want to redo work that > > has > > already been done. > > > > Thanks > > > > Robert > > > > > > > > > > _____________________________________________________________________ > > Robert P. McGraw, Jr. > > Manager, Computer System EMAIL: > > rmcgraw at purdue.edu > > Purdue University > > ROOM: MATH-807 > > Department of Mathematics PHONE: > > (765) 494-6055 > > 150 N. University Street > > FAX: (419) 821-0540 > > West Lafayette, IN 47907-2067 > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk >

1 0

[hobbit] bb-prtdiag and temperature.sh question.
by rmcgraw＠purdue.edu 24 Jan '06

24 Jan '06

Richard, This worked like you advertised on my client. I went and put the changes in the client directory of the server and restarted the server but I do not get the output. Are there any other files that I need to change to get this to work on the server? Doing this has been a big help as I am finally seeing how things are set up and interact. Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street FAX: (419) 821-0540 West Lafayette, IN 47907-2067 > -----Original Message----- > From: Deal, Richard [mailto:rdeal at tigr.ORG] > Sent: Tuesday, January 24, 2006 10:36 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] bb-prtdiag and temperature.sh question. > > Yes the modification goes in the clientlaunch.cfg and no change is needed > on the server side. I have these added to my clientlaunch.cfg for most > sun machines: > > [meta] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/meta > LOGFILE $HOBBITCLIENTHOME/logs/meta.log > INTERVAL 5m > > [ntp] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-ntp.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-ntp.log > INTERVAL 5m > > [ntpstat] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/ntpstat.sh > LOGFILE $HOBBITCLIENTHOME/logs/ntpstat.log > INTERVAL 5m > > [prtdiag] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-prtdiag.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-prtdiag.log > INTERVAL 5m > > [cpu2] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-cpu2.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-cpu2.log > INTERVAL 5m > > [msgs] > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-msgs.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-msgs.log > INTERVAL 5m > > [sge] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/sge.sh > LOGFILE $HOBBITCLIENTHOME/logs/sge.log > INTERVAL 5m > > [vx] > DISABLED > ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg > CMD $HOBBITCLIENTHOME/ext/bb-vxcheck.sh > LOGFILE $HOBBITCLIENTHOME/logs/bb-vxcheck.log > INTERVAL 5m > > SGE and VX check are enabled on the few hosts were it is needed. > Richard > > > -----Original Message----- > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 10:30 AM > > To: hobbit at hswn.dk > > Subject: [hobbit] bb-prtdiag and temperature.sh question. > > > > Richard, > > > > Thanks for your reply. > > > > When I think I understand how hobbit works, I seem to get confused > again. > > > > I see the modifications you suggest in hobbitclient.cfg and bb-prtdiag. > No > > problem in making these. > > > > I am confused where to set it to execute. > > > > Let me see if I got how hobbit works on the client. > > > > 1) Hobbitlaunch reads the clientlaunch.cfg file. > > > > 2) Clientlaunch.cfg file reads hobbitclient.cfg file and executes > > hobbitclient.sh > > > > 3) hobbitclient.sh calls hobbitclient-sunos.sh (in my case) which > executes > > the programs in hobbitclient-sunos.sh and writes the output to msg.txt. > > > > 4 hobbitclient.sh sends msg.txt to the $BBDISP. > > > > Now I want to execute the bb-prtdiag and bb-prtdiag seems to send the > data > > to $BBDISP inside the script. > > > > Do I put the execution of $BBDISP in clientlaunch.cfg? > > > > What do I need to do on the server side for this to show up in the > hobbit > > html? > > > > Thanks > > > > Robert > > > > > > ________________________________________ > > From: Deal, Richard [mailto:rdeal at tigr.ORG] > > Sent: Tuesday, January 24, 2006 8:48 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > I didn't have to modify bb-prtdiag at all to get it running under the > > hobbit > > client. > > You will have to modify the etc/hobbitclient.cfg file to represent your > > environment and the bb-prtdiag modifications should also be added. > > I have these lines added to hobbitclient.cfg: > > (might be some line modification by email but you get the idea) > > # > > #from prtdiag script > > # > > UNAME="/sbin/uname" > > #PLATFORM_SPEC=`${UNAME} -i` > > #PRTDIAG_COMMAND="/usr/platform/${PLATFORM_SPEC}/sbin/prtdiag" > > PRTDIAG_OPT="-v" > > ZONENAME=/usr/bin/zonename > > #Systems that don't support temperature checks > > EXCLUDE_SYSTEMS="Ultra-1 Ultra-2 Ultra-5_10 Ultra-30 Ultra-60 Ultra-80 > > UltraAX-i > > 2 UltraSPARC-IIi-cEngine Sun-Fire Netra-T4 UltraAX-e2 > > Ultra-Enterprise-10000" > > PRTDIAG_IGNORE_ERRORS="No failures|Most recent AC Power Failure|Minimum > > Availabl > > e|CS Fail|No Hardware failures|^===|currently no Boards|Fault Fan" > > PRTDIAG_IGNORE_FAULTS="No Recent System Faults found|No System Faults > > found|Faul > > t Value|Fault LED|NO_FAULT|Power Fault|Status > > Fault|Fault > > off" > > LOM_COMMAND="/usr/sbin/lom" > > LOM_OPT="-pfvt" > > > > Woops there is one slight modification to the bb-prtdiag script. Since > > hobbitclient.cfg does not allow for execution, just variable setting, I > > had > > to uncomment these two lines in bb-prtdiag: > > PLATFORM_SPEC=`$UNAME -i` > > PRTDIAG_COMMAND="/usr/platform/$PLATFORM_SPEC/sbin/prtdiag" > > > > > > > > ________________________________________ > > From: McGraw, Robert P. [mailto:rmcgraw at purdue.edu] > > Sent: Tuesday, January 24, 2006 8:34 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Repeat entries in bb-hosts > > > > > > > > Has anyone rewritten the solaris temperature.sh and bb-prtdiag for > hobbit? > > I > > would like to get these going on and just did not want to redo work that > > has > > already been done. > > > > Thanks > > > > Robert > > > > > > > > > > _____________________________________________________________________ > > Robert P. McGraw, Jr. > > Manager, Computer System EMAIL: > > rmcgraw at purdue.edu > > Purdue University > > ROOM: MATH-807 > > Department of Mathematics PHONE: > > (765) 494-6055 > > 150 N. University Street > > FAX: (419) 821-0540 > > West Lafayette, IN 47907-2067 > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk >

1 0

numbers for CPU load less meaningful than runque numbers?
by tmyers＠autom.net 24 Jan '06

24 Jan '06

Anyone else running AIX 5.3ml3 seeing load numbers coming form uptime, to be less useful than the mpstat runque numbers? mpstat reports - cpu min maj mpc int cs ics rq mig lpa sysc us sy wa id pc 0 275 1 0 160 7069 2986 0 13277 100.0 12950 17.9 9.6 3.9 68.6 0.51 1 16 0 0 165 7986 3601 1 11905 100.0 9791 17.6 8.7 2.5 71.3 0.49 2 179 1 0 163 8064 4211 0 11460 100.0 11374 16.3 9.0 2.7 72.0 0.49 3 132 2 0 319 9523 4963 0 14572 100.0 9470 18.1 9.5 3.0 69.4 0.51 ALL 602 4 0 807 32642 15761 1 51214 100.0 43585 17.5 9.2 3.0 70.3 2.00 -------------------------------------------------------------------------------------------------------- 0 251 4 0 160 6926 2864 0 12986 100.0 11030 17.6 9.0 3.0 70.4 0.49 1 45 1 0 159 8211 3864 0 11921 100.0 13722 19.0 9.0 4.1 67.9 0.50 2 166 3 0 155 8425 4490 0 11967 100.0 10509 16.3 8.3 2.6 72.9 0.49 3 100 0 0 310 9537 4970 0 14084 100.0 10018 18.5 8.8 3.6 69.2 0.51 ALL 562 8 0 784 33099 16188 0 50958 100.0 45279 17.9 8.7 3.3 70.1 1.99 uptime reports - 09:06AM up 2 days, 14:51, 56 users, load average: 41.50, 34.30, 29.37 I am not seeing any of the slowness I would expect from this kind of load so I have spent the last couple of days with snapshots trying to figure it out just what is going wrong. I don't know but I suspect that the problems with the utmp and wtmp files are causing finger issues The performance and processes are much more in line with mpstat run queue numbers than with uptime run able process numbers. Timothy L Myers Senior Developer Autom 5226 South 31st Place Phoenix AZ 85040

2 1