April 2007 - Xymon - Xymon mailman web

hobbit users list reorganized
by tj_yang＠hotmail.com 20 Apr '07

20 Apr '07

Please see http://en.wikibooks.org/wiki/System_Monitoring_with_Hobbit/User_Guide/The_h… for the new layout. Please correct the mistake if I didn't put you in correct country/state. tj

1 0

Hobbit article in the Netapp TechOntap newsletter
by tomg＠mcclatchyinteractive.com 20 Apr '07

20 Apr '07

There is an article about Hobbit and using it to monitor filers in the Netapp Tech Ontap newsletter. http://www.netapp.com/news/techontap/hobbit.html -- Tom Georgoulias Systems Engineer McClatchy Interactive tomg at mcclatchyinteractive.com

1 0

MySQL graphing woes
by jonescr＠cisco.com 20 Apr '07

20 Apr '07

I'm setting up mysql checks and graphing using the hobbit-modified bb-mysql.pl. I have the statuses working fine: Thu Apr 12 04:42:40 2007 MySQL Server OK threads: 10 questions: 2751997 slow queries: 2100 opens: 304 flush tables: 3 open tables: 100 queries per second avg: 8.514 maxcon: 400 Server version: 4.1.9-standard-log Uptime: 3 days 17 hours 47 min 3 sec Server reports timestamp of 2007-04-12 04:42:40 However, instead of a graph at the bottom, I just have: "hobbit graph ncv:mysql" next to the hourglass. I'm using Hobbit 4.20 plus the latest "all in one" patch. Here are the relevant sections from my config files, hopefully someone can point out what I'm doing wrong? hobbitserver.cfg: TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,files,procs=processes,ports,clock,lines,mysql=ncv" GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql:mysqlslow,mysql:mysqlthread" NCV_mysql="*:GAUGE" hobbitgraph.cfg (these are the default entries that come with Hobbit): [mysqlslow] DEF:slow=mysql.rrd:Slowqueries:AVERAGE TITLE MySQL Slow Queries YAXIS # LINE2:slow#00CCCC:Slow Queries COMMENT:\n GPRINT:slow:LAST: \: %5.1lf (cur) GPRINT:slow:MAX: \: %5.1lf (max) GPRINT:slow:MIN: \: %5.1lf (min) GPRINT:slow:AVERAGE: \: %5.1lf (avg)\n [mysqlthread] DEF:threads=mysql.rrd:Threads:AVERAGE TITLE MySQL Active Threads YAXIS # AREA:threads#00CCCC:Threads COMMENT:\n GPRINT:threads:LAST: \: %5.1lf (cur) GPRINT:threads:MAX: \: %5.1lf (max) GPRINT:threads:MIN: \: %5.1lf (min) GPRINT:threads:AVERAGE: \: %5.1lf (avg)\n Note I have also dumped out one of the rrd files, and they have data, so I don't think the problem lies with my NCV definition: /$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/ <name> threads </name> <value> 2.6730000000e+03 </value> <name> questions </name> <value> 8.1735172200e+08 </value> <name> slowqueries </name> <value> 6.2488800000e+05 </value> <name> opens </name> <value> 9.0288000000e+04 </value> <name> flushtables </name> <value> 8.9100000000e+02 </value> <name> opentables </name> <value> 2.9700000000e+04 </value> <name> queriespersecondavg </name> <value> 2.5239060000e+03 </value> <name> maxcon </name> <value> 1.1880000000e+05 </value> <name> Uptime </name> <value> 8.9100000000e+02 </value> <name> Serverreportstimest </name> <value> 1.5444000000e+04 </value> So there we have it...the data is getting to Hobbit and being stored in the rrd files, it's just not displaying the graphs for some reason, and at the moment I can't see why. I searched the email archive and found lots of other posts of people having similar problems, with various solutions, none of which seem to work (yes I restart Hobbit after editing hobbitserver.cfg).

4 7

Global TMP
by Galen.Johnson＠sas.com 20 Apr '07

20 Apr '07

Hey, Working on converting a script to be Hobbit only...what environment variable replaces $BBTMP? (yes, I know I can use BBTMP but would prefer to use a Hobbit env variable). I've noticed that the internal tests (like disk, vmstat, etc) use the $HOBBITCLIENT/tmp folder. Does Hobbit even set a global environment variable besides BBTMP for this path? =G=

1 1

Variable lines in graphs
by hobbitdoubt＠gmail.com 20 Apr '07

20 Apr '07

Thanks for the answer. Yes, I already have the scripts (one for Linux and other for Windows) and I have others scripts with their graphs but I don't know how to create files like you say (fan.1.rrd). I only make a graph called fan.rrd for each server and I haven't found anything about it in man pages. How can I make them? Thanks for your help!

2 9

Interval issue
by Galen.Johnson＠sas.com 19 Apr '07

19 Apr '07

Ok, I must be missing something. I have a client-side monitor that only needs to run once per day so I set 'INTERVAL 1d'. However, that task went purple on the server side. Do I still need to provide something in the bb command like in BB (status+1440)? Or is there something else required on the server side? =G=

1 1

[hobbit] Common time periods on the ACK page
by gumby3203＠gmail.com 19 Apr '07

19 Apr '07

In our install of BB, we modified the ACK page to give a list of some common ack intervals in minutes at the bottom of the page. For instance, 4 hr = 240 | 6 hr = 360 | 8 hr = 480 | 12 hr = 720 | 1 day = 1440 | 3 days = 4320 | 1 week = 10080 I can't seem to find a way to do this with Hobbit, since the ACK page is generated by a compiled cgi script. Is there any other way to do this? I looked at the bb-ack.c source file, but couldn't easily find what I was looking for.

4 7

Interesting finding (bug?)
by Galen.Johnson＠sas.com 19 Apr '07

19 Apr '07

Hey, I was setting up a custom script on one of my client machines and accidentally added the arguments to the script to the LOG definition...hobbit happily created the log file "some.log -arg1 -arg2 ...". I would think that this should be considered a defect as the log file should be a filename w/o whitespace and definitely without " -*" since that plays hob with unix commands. Thoughts? =G=

2 1

[hobbit] "hobbitd status-board not available" from bbgen on solaris 10
by cspargo2＠csc.com 19 Apr '07

19 Apr '07

Missed out the other bug, which is a duplicate of the one below. It gives more detail about the issue: "Bug ID: 6454060 Synopsis: select()/poll() indicate a socket as readable when there is no data available Description: pollsys() (on behalf of select()) indicates available data on a socket but a following recvfrom() fails with EAGAIN:" I'm not sure if this does apply here, but it is a spurious type of issue. Colin Spargo/GIS/SC/CSC 19/04/2007 18:10 To hobbit at hswn.dk cc Subject RE: [hobbit] "hobbitd status-board not available" from bbgen on solaris 10 Good to hear! A trawl through sunsolve shows a few bugs that may have something to do with it: Bug ID: 6458410 Synopsis: read() may spuriously return EAGAIN while unfusing a TCP connection No patch for this yet I believe. "T.J. Yang" <tj_yang at hotmail.com> 19/04/2007 17:46 Please respond to hobbit at hswn.dk To hobbit at hswn.dk cc Subject RE: [hobbit] "hobbitd status-board not available" from bbgen on solaris 10 1. stop hobbit server 2. zero out the existing log file 3. apply the online fix 4. So far so good, I can confirm the status-board error message is now gone ;) bash-3.00# grep -i status-board *.log bash-3.00# pwd /var/opt/hobbitserver42/log bash-3.00# ls *.log acknowledge.log cgierror.log hobbitlaunch.log rrd-data.log bb-display.log clientdata.log hobbitlaunch.pid rrd-status.log bb-network.log history.log hostdata.log bb-retest.log hobbitd.log notifications.log bbcombotest.log hobbitd.pid page.log bash-3.00# cat /etc/release Solaris 10 6/06 s10s_u2wos_09a SPARC Copyright 2006 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 09 June 2006 bash-3.00# Good job on track down the cause on providing the fix. T.J. Yang >From: Colin Spargo <cspargo2 at csc.com> >Reply-To: hobbit at hswn.dk >To: hobbit at hswn.dk >Subject: [hobbit] "hobbitd status-board not available" from bbgen on >solaris 10 >Date: Thu, 19 Apr 2007 12:30:23 +0100 > >If anyone has been having issues with bbgen logging this error mesage on >Solaris 10 and intermittently failing, resulting in blank status pages, >then I think I have found a workaround. > >If you disable TCP fusion be adding the following kernel parameter to >/etc/system and reboot, hopefully you will find that the problem goes >away. > >set ip:do_tcp_fusion = 0 > >Apparently this can be done on a live system as well (without rebooting), >but will require hobbit to be restarted. To do this: > >echo do_tcp_fusion/W0 | mdb -kw > > >TCP fusion is only used on local loopback connections to speed them up by >bypassing the normal TCP stack. I found that the problem only occured when >connecting to hobbitd locally. I tried running "bb localhost hobbitdboard" >once a second, and found it would often return no data, but if I ran the >same command from another host to the hobbit server, it always returned >correct data. This made me suspect TCP fusion, as I have run into issues >with it before. It it is best left disabled in my opinion. _________________________________________________________________ MSN is giving away a trip to Vegas to see Elton John. Enter to win today. http://msnconcertcontest.com?icid-nceltontagline To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

"hobbitd status-board not available" from bbgen on solaris 10
by cspargo2＠csc.com 19 Apr '07

19 Apr '07

If anyone has been having issues with bbgen logging this error mesage on Solaris 10 and intermittently failing, resulting in blank status pages, then I think I have found a workaround. If you disable TCP fusion be adding the following kernel parameter to /etc/system and reboot, hopefully you will find that the problem goes away. set ip:do_tcp_fusion = 0 Apparently this can be done on a live system as well (without rebooting), but will require hobbit to be restarted. To do this: echo do_tcp_fusion/W0 | mdb -kw TCP fusion is only used on local loopback connections to speed them up by bypassing the normal TCP stack. I found that the problem only occured when connecting to hobbitd locally. I tried running "bb localhost hobbitdboard" once a second, and found it would often return no data, but if I ran the same command from another host to the hobbit server, it always returned correct data. This made me suspect TCP fusion, as I have run into issues with it before. It it is best left disabled in my opinion.

3 3