November 2005 - Xymon - Xymon mailman web

[hobbit] Changing default graph resolution
by v.everett＠afgonline.com.au 22 Dec '05

22 Dec '05

Hi all Anybody help me with graphing? In hobbitgraph.cfg, I have the following definition, and it produces wonderful, but somewhat cluttered graphs. ---snip--- [ora9-sga] FNPATTERN tablespace.rrd TITLE TableSpace Utilization YAXIS % Full DEF:xdb at RRDIDX@=@RRDFN@:siebprd_XDB:AVERAGE DEF:whsidx at RRDIDX@=@RRDFN@:siebprd_WHS_INDEX:AVERAGE DEF:whsdata at RRDIDX@=@RRDFN@:siebprd_WHS_DATA:AVERAGE DEF:users at RRDIDX@=@RRDFN@:siebprd_USERS:AVERAGE DEF:undotbs1 at RRDIDX@=@RRDFN@:siebprd_UNDOTBS1:AVERAGE DEF:tools at RRDIDX@=@RRDFN@:siebprd_TOOLS:AVERAGE DEF:system at RRDIDX@=@RRDFN@:siebprd_SYSTEM:AVERAGE DEF:siebind at RRDIDX@=@RRDFN@:siebprd_SIEB_INDEX:AVERAGE DEF:siebdata at RRDIDX@=@RRDFN@:siebprd_SIEB_DATA:AVERAGE DEF:loader at RRDIDX@=@RRDFN@:siebprd_LOADER_DATA:AVERAGE LINE2:xdb at RRDIDX@#@COLOR@:XDB LINE2:whsidx at RRDIDX@#@COLOR@:WHS_INDEX LINE2:whsdata at RRDIDX@#@COLOR@:WHS_DATA LINE2:users at RRDIDX@#@COLOR@:USERS LINE2:undotbs1 at RRDIDX@#@COLOR@:UNDO LINE2:tools at RRDIDX@#@COLOR@:TOOLS LINE2:system at RRDIDX@#@COLOR@:SYSTEM LINE2:siebind at RRDIDX@#@COLOR@:SIEB_INDEX LINE2:siebdata at RRDIDX@#@COLOR@:SIEB_DATA LINE2:loader at RRDIDX@#@COLOR@:LOADER -u 100 -l 0 ---snip--- How do I get it to split this across 2 or even 3 graphs, like the disk utilisation graphs. Cheers Vernon _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

3 3

Questions about Enable/Disable/NOTICE
by jonescr＠cisco.com 19 Dec '05

19 Dec '05

1. When I disable a host in hobbit, it says it was disabled by unknown at 1.2.3.4 <mailto:unknown at 1.2.3.4>. In the bb maint.pl script, it had an option to put a username, but I don't see an option to do this in the Hobbit Maint page, so is "unknown" hard coded, or does it look for it somewhere else? 2. I added the "NOTICE" rule to my hobbit-alerts.cfg HOST=* SERVICE=* COLOR=red MAIL me at mydomain.com <mailto:me at mydomain.com> RECOVERED NOTICE I then tested disabling the cpu service for a host, and I received an email with the disable message: ----- From: hobbit at myhost.com <mailto:hobbit at myhost.com> Sent: Wednesday, November 09, 2005 5:01 PM To: me at mydomain.com <mailto:me at mydomain.com> Subject: Hobbit servername:cpu NOTICE servername:cpu INFO Monitoring of servername:cpu has been DISABLED by unknown for 240 minutes Disabled by: unknown @ 1.2.3.4 Reason: testing disable notice ----- This is what I expected to get. However, I then went and re-enabled the disabled service, and I did not get an email saying it was re-enabled. I checked the /var/log/maillog to make sure that it wasn't a mail delay. There simply was no email sent about the enable. I assume this isn't normal behavior :) -Charles

4 6

Hobbit 4.1.2p1 available
by henrik＠hswn.dk 08 Dec '05

08 Dec '05

Some of you have already noticed that I put a 4.1.2p1 "patch 1" release up for download on my Hobbit demo-site. It is hereby officially released and available via Sourceforge. As the version number indicates, this is solely a bug-fix release for 4.1.2. I am working on some new stuff, but you won't find it in this release (if you're interested, get the snapshots instead). This release fixes a number of bugs in Hobbit 4.1.2, some of which could cause parts of Hobbit to crash; it also changes how alerts are handled when a status goes green->yellow->red. Updating is recommended. Changes from 4.1.2 -> 4.1.2p1 (10 Nov 2005) ------------------------------------------- Bugfixes: * hobbitd could crash when processing a "combo" message, due to an incorrect test of the color of one message inside the combo-message before that color was actually deciphered. * hobbitd_alert would crash when attempting to save a checkpoint while cleaning up a "dead" alert. * Disk graphs would show up with all graphs in a single image, when the status message included any colored icons (typically, when the status was red or yellow). * The handling of alerts was counting the duration of an event based on when the color last changed. This meant that each time the color changed, any DURATION counters were reset. This would cause alerts to not go out if a status was changing between yellow and red faster than any DURATION setting. Changed this to count the event start as the *first* time the status went into an alert state (yellow or red, usually). * An idle hobbitd process would accumulate zombie processes. Improvements: * When a status goes yellow->red, the repeat-interval is now cleared for any alerts. This makes sure you get an alert immediately for the most severe state seen. This only affects the first such transition; if the status later changes between yellow/red, this normal REPEAT interval applies. Regards, Henrik

2 1

Question on Alert Notifications
by billieperez＠gmail.com 01 Dec '05

01 Dec '05

Hi, I was wondering if there was a way to modify the 'hobbit' name of the alert notifications and also if there was a way to modify the subject of the alerts in the email notifications. Thanks, Billie

5 10

[hobbit] Dumb hobbit network test question
by KauffmanT＠nibco.com 30 Nov '05

30 Nov '05

Oh, how it helps to have additional minds on these things. Reverse lookup looks to be the culprit. I cloned all these systems in a bit of a hurry -- and the cloning changed the dns resolution config to point at (in order) my D/R hotsite Win2003 domain controller (active), my D/R hotsite D/R test domain controller (non-existent), my D/R hotsite hobbit system (also not there), and THEN my local DNS server -- so if the D/R DC didn't answer (wonder why IT goes away every two hours?) I would go through multiple retries to non-existent systems. One more item added to the system clone checklist. Thanks! Tom -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Wednesday, November 30, 2005 4:59 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Dumb hobbit network test question On Wed, Nov 30, 2005 at 03:38:56PM -0500, Kauffman, Tom wrote: > Henrik, can you clarify what this really means? > > Address=10.8.224.9:21, open=1, res=0, err=1, connecttime=0.003110, totaltime=10.063026, "open=1" means that the connection to the server succeeded. The interesting thing here is that it took only 0.003 seconds to get a connection, but then Hobbit spent more than 10 seconds waiting for a banner to appear. It never did - at least not within those 10 secs; the "err=1" means it gave up waiting for the data and signals a timeout. > Address=10.8.224.38:21, open=1, res=0, err=0, connecttime=0.003060, totaltime=0.028471, > banner='220 wabash FTP server (Version 4.2 Sat Feb 5 10:12:55 CST 2005) ready. 221 Goodbye.' (86 bytes) This is a different server. Again, connecting takes about 0.003 secs, but the banner appears almost immediately - the entire exchange happens in 28 milliseconds. It might be that the FTP server performs a reverse DNS lookup of the Hobbit servers' IP address when Hobbit connects to check the FTP service. Sometimes DNS lookups take a while - maybe long enough for Hobbit to reach the 10 seconds timeout. Maybe your ftp server has a local DNS cache, and the timeout only happens when the cached DNS entry expires and has to be refreshed. One thing you can try is to add a "--timeout=30" option to the bbtest-net command in hobbitlaunch.cfg; that makes it wait up to 30 seconds before flagging a timeout. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] Dumb hobbit network test question
by KauffmanT＠nibco.com 30 Nov '05

30 Nov '05

OK -- I used the --debug option; it wasn't as bad as I thought it would be, the resulting log was just over 11 MB when my problem occurred and I could turn it off. Henrik, can you clarify what this really means? Address=10.8.224.9:21, open=1, res=0, err=1, connecttime=0.003110, totaltime=10.063026, Address=10.8.224.38:21, open=1, res=0, err=0, connecttime=0.003060, totaltime=0.028471, banner='220 wabash FTP server (Version 4.2 Sat Feb 5 10:12:55 CST 2005) ready. 221 Goodbye. ' (86 bytes) (good response) 2005-11-30 14:03:59 tcp_got_expected: No data in banner 2005-11-30 14:03:59 Adding to combo msg: status volga.ftp yellow  Wed Nov 30 14:03:00 2005 ftp NOT ok This system is showing a load of 0.1 (max 2.0) om a 2-way 1.6 GHz machine; the FTP connect time is 17.4 microseconds (avg) and peaked in the last 48 hours at 5.2 milliseconds TIA Tom Kauffman NIBCO, Inc -----Original Message----- From: Kauffman, Tom [mailto:KauffmanT at nibco.com] Sent: Tuesday, November 29, 2005 11:28 AM To: hobbit at hswn.dk Subject: [hobbit] Dumb hobbit network test question I've just done my tri-annual hardware shuffle, swapping out all my on-lease RS-6000 for brand spanking new systems. Part of this included upgrading from AIX 5.1 to AIX 5.3. Now, on half the systems (the last set replaced) I get errors on the smtp and ftp tests -- typically one test every two hours. Interestingly, all these systems barf on the same test cycle. This is obviously something not quite right in the AIX config, but I'm at a loss on what. I just found out today that we also have production rsh scripts that time out on the same cycle (yeah, I know -- but they've been rsh since year dot, and getting them to ssh is real low on the list . . ) Here's a sample of the network test error: Service ftp on hudson is not OK : Unexpected service response Service smtp on hudson is not OK : Unexpected service response How can I log the actual response? I'm currently running hobbit 4.03rc1; that's scheduled to change sometime next week. Other suggestions? TIA -- Tom Kauffman NIBCO, Inc To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 1

[hobbit] documentation links
by ReifJefferyM＠JohnDeere.com 30 Nov '05

30 Nov '05

Thanks. I don't know why I didn't see that the first time around. ________________________________ From: Allan.Marillier at dana.com [mailto:Allan.Marillier at dana.com] Sent: Wednesday, November 30, 2005 11:16 AM To: hobbit at hswn.dk Subject: Re: [hobbit] documentation links I got mine working exactly the same as BB with no special configs - just create files /var/lib/hobbit/www/notes/server.domain.html "Reif Jeffery M" <ReifJefferyM at JohnDeere.com> 11/30/2005 11:50 AM Please respond to hobbit at hswn.dk To hobbit at hswn.dk cc Subject [hobbit] documentation links Is there a way to link the monitored server name to external documentation, like BB did with the "notes" directory? Thank you. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

hobbitd_client purple?
by jeffnewman75＠gmail.com 30 Nov '05

30 Nov '05

All, I started up the hobbit client on my hobbit server, and for a while (i.e. days at least) all seemed fine. Now the hobbitd_client is purple! I've restarted the hobbit client and that doesn't fix it. When I click on it, it says: -Program Crashed fatal signal caught and yet if I do a ps: # ps -ef | grep hobbitd_client hobbit 24258 24250 0 14:00 ? 00:00:00 hobbitd_channel --channel=client --log=/var/log/hobbit/clientdata.log hobbitd_client hobbit 24259 24258 0 14:00 ? 00:00:00 hobbitd_client it's running. I would attach output from log files if I knew which ones anyone wanted to see, so just let me know. Thanks! Jeff

3 4

documentation links
by ReifJefferyM＠JohnDeere.com 30 Nov '05

30 Nov '05

Is there a way to link the monitored server name to external documentation, like BB did with the "notes" directory? Thank you.

3 2

[hobbit] Disk monitoring and alerts
by Craig_Whilding＠mentor.com 30 Nov '05

30 Nov '05

On a similar note to this, I've just been looking at monitoring certain processes or services which will need a different alert to others on the same box. I don't want to have to write separate scripts to monitor each service as the clients already check the status of each, I was just wondering if it was possible server side to split the alerting of each proc/service or allow the check to be redirected to another page. An example of what I mean is that we check the virus scanner is running on all systems but don't care about this as much as if our clearcase server processes stopped working. Thanks, Craig Whilding ________________________________ From: Allan.Marillier at dana.com [mailto:Allan.Marillier at dana.com] Sent: 30 November 2005 16:41 To: hobbit at hswn.dk Subject: [hobbit] Disk monitoring and alerts We are undergoing some restructuring among support teams, and are separating and defining some responsibilities a little better. System admins will be called on system specific problems, while DBAs and apps support people will be called on others. One of my frequent complaints in the past has been getting calls on filled file systems containing Oracle trace files, dumps, logs, temporary files etc. that I don't feel I should be making decisions to remove, gzip etc. That is changing - DBAs will be called on those file systems in other environments where we're using HP's ITO (aka Vantage Point / OpenView, call it what you will). I want to try to do the same on the servers I am monitoring with hobbit. Is there any way, or a possibility of a feature request that would allow me to specify alerts to me for all filesystems, other than a few specific ones? E.g. using a modified version of the hobbit-alerts page example: HOST=www.foo.com MAIL dba at foo.com SERVICE=disk.ora-db,disk.ora-idx,disk.ora-log REPEAT=1h MAIL unixsupport at foo.com SERVICE=cpu,disk,memory

1 0