June 2006 - Xymon - Xymon mailman web

bb-services feature request(s)
by jonescr＠cisco.com 15 Jun '06

15 Jun '06

1. It would be useful if you could use an EXEC keyword in bb-services, which would execute a shell script or program, which you could then parse the output. This could be easier than having a server-side external script in some cases, and could also be used to handle difficult to check services, so you don't have to use arcade methods like the one used to check oratns (see bb-services [oratns] entry) . It would be assumed that if EXEC is used, no port number needs to be defined. For example: [pgpool] exec '/usr/bin/psql -U postgres -h dbpool -c "show pool_status" template1' expect "replication_enabled | 1" 2. It would be nice if we could define multiple expect statements, and that it didn't matter where in the output the strings were. For example: [pgpool] exec '/usr/bin/psql -U postgres -h dbpool -c "show pool_status" template1' expect "replication_enabled | 1" expect "server_status | master(192.168.0.200 on 5432) up secondary(192.168.0.201 on 5432) up |" 3. It would be handy if we could use regular expressions in expect strings. 4. It would be cool if you could use an option to either show only the lines that matched "expect", or highlight them (bold?) For example: [pgpool] exec '/usr/bin/psql -U postgres -h dbpool -c "show pool_status" template1' expect "replication_enabled | 1" expect "server_status | master(192.168.0.200 on 5432) up secondary(192.168.0.201 on 5432) up |" options banner,highlight or [pgpool] exec '/usr/bin/psql -U postgres -h dbpool -c "show pool_status" template1' expect "replication_enabled | 1" expect "server_status | master(192.168.0.200 on 5432) up secondary(192.168.0.201 on 5432) up |" options showmatch Just some ideas :-) -Charles

1 0

nopropred wildcards for hostname?
by jonescr＠cisco.com 15 Jun '06

15 Jun '06

I'm using the bb-host "page" option to have seperate pages for Dev, Stage, and Prod environments. I want to use "nopropred" to keep alerts for the Stage and Dev hosts from setting the main page red (it's not enough to tell people to only use the NKView). From looking at the man page it looks like the nopropred options are only per testname. Can you suggest another way to get the effect that I want? To be specific I want the main page background to match the status color of the "Prod" page/dot. The other pages/dots colors should change color appropriately, but not affect the main page status.

1 0

[hobbit] Client Dies HP-UX 11.11 and 11.23 with no error
by Camp.external＠qimonda.com 15 Jun '06

15 Jun '06

Thanks this really helped! Come to find out the processes were being terminated. I asked the admins, and come to find out they had some scripts that killed "Orphaned" processes. They made modifications to the script, and now I am golden. Thanks for your help! -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Thursday, June 15, 2006 9:08 AM To: hobbit at hswn.dk Subject: Re: [hobbit] Client Dies HP-UX 11.11 and 11.23 with no error On Thu, Jun 15, 2006 at 07:48:53AM -0400, Camp.external at qimonda.com wrote: > It happened again. I tried adjusting the vmstat from 300 to 290 just > as a guess, but no luck. I cannot find any cores, any logs anything > that indicates anything going on. Is there some sort of debug mode I > can turn on or tracing I can do to figure out why it is dying? Login as the hobbit client user, cd to the the client/ directory, then cut-and-paste this to start the hobbitlaunch utility as a foreground task with debug output enabled: MACHINEDOTS="`uname -n`" \ MACHINE="`uname -n | sed -e's/\./,/g'`" \ BBOSTYPE="`uname -s | tr '[A-Z]' '[a-z]'`" \ BBOSSCRIPT="hobbitclient-`uname -s | tr '[A-Z]' '[a-z]'`.sh" \ HOBBITCLIENTHOME="`pwd`" \ bin/hobbitlaunch --config=etc/clientlaunch.cfg --no-daemon --debug Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

hobbitd_client crashing
by michael.nemeth＠lmco.com 15 Jun '06

15 Jun '06

On my hobbit server Im getting the hobbitd_client dot popping up red, message is: Program crashed Fatal sigal caught. snapshot from june 12 Solarias 9 system Also noted: in clientdata.log Worker process died with exit code 134, terminating. -- +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ | _p_ Mike Nemeth | ___| |_____ email(w) michael.nemeth at lmco.com Work: 856 359-1425 |><___________) | Home Page:http://www.geocities.com/mjnemeth/ | Work Page:http://faraday.motown.lmco.com:3000/~nemethm/ | Work Page:http://ortfsb/~mnemeth/ |++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

2 1

[hobbit] Client Dies HP-UX 11.11 and 11.23 with no error
by Camp.external＠qimonda.com 15 Jun '06

15 Jun '06

It happened again. I tried adjusting the vmstat from 300 to 290 just as a guess, but no luck. I cannot find any cores, any logs anything that indicates anything going on. Is there some sort of debug mode I can turn on or tracing I can do to figure out why it is dying? -----Original Message----- From: Camp Neil (QNA Information Technology External) Sent: Wednesday, June 14, 2006 7:08 AM To: hobbit at hswn.dk Subject: RE: [hobbit] Client Dies HP-UX 11.11 and 11.23 with no error Nothing strange in the logs dir. The clientlaunch.log file shows that it is starting and loading the tasklist. Hobbitlaunch is not running. Yes, msg.txt exists but it does not have the hostname as part of the filename. Running the "bb" command does produce a usage message. This is so strange. It will startup with no problems, but after 5-15 minutes (not sure) it just completely dies. :-( -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Tuesday, June 13, 2006 5:03 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Client Dies HP-UX 11.11 and 11.23 with no error On Tue, Jun 13, 2006 at 12:47:43PM -0400, Camp.external at qimonda.com wrote: > > I am currently using 4.1.2p1. I have about 40 clients mixed HP-UX > servers. All are working except for two. The client dies and there is > no core, no error message to indicate why. One client is HP-UX 11.11 > and the other is 11.23. Both were compiled using gcc 4.1.1 and are 32 bit. > Any hints are suggestions about how I can troubleshoot this would be > greatly appreciated. First, check for strange stuff in the ~hobbit/client/logs/* files. Is hobbitlaunch running ? Is the file ~hobbit/client/tmp/msg.HOSTNAME.txt generated ? This is the first step, where data is collected and packed into a client message. Finally, check if the "bb" utility in ~hobbit/client/bin/bb works. Just try to run it - it should print out a usage message. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 1

MSGS Status Expire Time
by roland.graeub＠rtc.ch 15 Jun '06

15 Jun '06

Hello For the hobbit-client is there a option like the MSGEXPIRE in BB: MSGEXPIRE="30:60" # EXPIRE WARNINGS IN 30 MIN, PANICS IN 60 I see in Hobbit the MSGS column goes green after 30min, is there a option to change the MSGEXPIRE Settings in hobbit ? (Maybe oversight the option..) Fixs for the Clients and also the --source Option in hobbitping works fine . Thanks Henrik. Regards Roland

1 0

[hobbit] hobbit install under debian sarge?
by Todd.Costa＠state.ma.us 15 Jun '06

15 Jun '06

Hi Dan, I have been using Debian Sarge and Hobbit 4.1.2p1 successfully since last November. I used the default install for sarge and added the apache2 components during the build of the debian system. Then I needed to apt-get install the RRDTOOL, fping packages. Added the hobbit user, downloaded the hobbit-*.deb and installed that. Then had hobbit running at a base level before I mod'd the settings to get what I wanted. I thought it worked really well and no source grinding was needed. On another note, if you install the desktop components and use synaptic you can search the package db for all the components required. And like I said I only had to manually add 3 pieces after the initial install of debian for the hobbit server. Of course I added other tools to function like I want but minimally its doable from deb packages instead of trying to compile from source. Yet if that's how you want to do it, that's cool too. Look at the Debian Maintainers guide for the required packages needed to successfully grind with source. Of course there are other places to refer to for what is best but that's your choice. That's what I like about Debian, it is pretty much everything you need without alot of trouble IMHO, aside from the research. A few commands or clicks. Bang, you off and running. Good Luck. TMC -----Original Message----- From: hobbit-return-7510-Todd.Costa=state.ma.us at hswn.dk [mailto:hobbit-return-7510-Todd.Costa=state.ma.us at hswn.dk]On Behalf Of Dan Simoes Sent: Tuesday, June 13, 2006 7:30 PM To: hobbit at hswn.dk Subject: [hobbit] hobbit install under debian sarge? Has anyone gotten hobbit to install under vanilla sarge? I had to upgrade a previous machine to testing in order to get it to work, but I thought that was because of my port from ubuntu. I've tried both the 4.2 alfa and beta snapshots, and can't get either to build. They both fail here: hecking how to run the C++ preprocessor... /lib/cpp configure: error: C++ preprocessor "/lib/cpp" fails sanity check See `config.log' for more details. make[1]: *** [c-ares/Makefile] Error 1 make[1]: Leaving directory `/home/dan/hobbit-4.2-alfa-20060423/bbnet' make: *** [bbnet-build] Error 2 I do have cpp installed, so I'm not sure why it fails the sanity check. I also tried the .deb version of the beta. Once I located all the config files :), I got hobbit to start, but it didn't like the version of the ssl libraries and was punting on other things. Thanks. Dan

3 2

[hobbit] fping failing error code 98
by Al.Jeffcoat＠orhs.org 15 Jun '06

15 Jun '06

Aha... didn't think of that :) Here's the current... Filesystem Inodes IUsed IFree IUse% Mounted on /dev/sda2 35291136 458741 34832395 2% / /dev/sda1 26104 104 26000 1% /boot /dev/shm 222221 1 222220 1% /dev/shm We are currently testing 4.2 on a different server, and are planning on moving to that once it's out, so unless this continues, I'm not too concerned about it right now. Al -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Wednesday, June 14, 2006 5:58 PM To: hobbit at hswn.dk Subject: Re: [hobbit] fping failing error code 98 On Wed, Jun 14, 2006 at 05:49:00PM -0400, Jeffcoat, Al wrote: > > Looking at the space utilization for that server, which only runs hobbit > on the root file system, it hasn't gone over 8% utilization (8.7GB out > of 115GB), it's currently up from 7% in the last month :), so unlikely > that it was a space issue. How about inodes ? Hobbit can use an extraordinary amount of inodes because it stores lots of small files (for historical logs). "df -i" is often useful. Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk This e-mail message and any attached files are confidential and are intended solely for the use of the addressee(s) named above. If you are not the intended recipient, any review, use, or distribution of this e-mail message and any attached files is strictly prohibited. This communication may contain material protected by Federal privacy regulations, attorney-client work product, or other privileges. If you have received this confidential communication in error, please notify the sender immediately by reply e-mail message and permanently delete the original message. To reply to our email administrator directly, send an email to: postmaster at orlandoregional.org . If this e-mail message concerns a contract matter, be advised that no employee or agent is authorized to conclude any binding agreement on behalf of Orlando Regional Healthcare by e-mail without express written confirmation by an officer of the corporation. Any views or opinions presented in this e-mail are solely those of the author and do not necessarily represent those of Orlando Regional Healthcare.

1 0

[hobbit] fping failing error code 98
by Al.Jeffcoat＠orhs.org 14 Jun '06

14 Jun '06

Thanks for the response Henrik, The weird thing is that the files were created, and contained a mix of: IP is alive (0.## ms) IP is unreachable So it was able to ping some things, but not others. Looking at the space utilization for that server, which only runs hobbit on the root file system, it hasn't gone over 8% utilization (8.7GB out of 115GB), it's currently up from 7% in the last month :), so unlikely that it was a space issue. The morning it paged us at 4:15, that was the first thing I looked at, was did it create the file indicated in the hobbit log. I also cheked the df, and to see if there had been a router problem with the router that the server itself is plugged into. Our network engineers were unable to find any issues with that router. After the second "non-event", we decided to reboot to clear out what appeared to be defunct hobbit processes after 92 days of uptime. Not sure if these were related or not. Only time will tell. Another weird thing is that immediately after getting the pages and e-mails about the connection failures, we were getting pages and e-mails that everything had recovered, almost as if there was only a few seconds delay. In the time we've been running hobbit (and bb before), this is the first time something like this has happened. Al -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Wednesday, June 14, 2006 5:28 PM To: hobbit at hswn.dk Subject: Re: [hobbit] fping failing error code 98 On Wed, Jun 14, 2006 at 03:27:53PM -0400, Cortes, Manny wrote: > On two occasions within a week hobbit alerted that several servers lost > connectivity and then apparently recovered. Here is a sample of the > error in the bb-network.log: > > 2006-06-11 04:16:07 Execution of '/usr/sbin/fping -Ae' failed with > error-code 98 > > 2006-06-11 04:16:07 Cannot open fping output file > /hobbit/server/tmp/fping-stdout.2246 The error code basically means what it says: Hobbit couldn't create the output file it needs for fping output. In the newer versions it also prints out the system error-message which would have been helpful here, but you should look for a cause that prevents files from being created in this directory. Most likely cause is that the /hobbit/server/tmp/ filesystem is full. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk This e-mail message and any attached files are confidential and are intended solely for the use of the addressee(s) named above. If you are not the intended recipient, any review, use, or distribution of this e-mail message and any attached files is strictly prohibited. This communication may contain material protected by Federal privacy regulations, attorney-client work product, or other privileges. If you have received this confidential communication in error, please notify the sender immediately by reply e-mail message and permanently delete the original message. To reply to our email administrator directly, send an email to: postmaster at orlandoregional.org . If this e-mail message concerns a contract matter, be advised that no employee or agent is authorized to conclude any binding agreement on behalf of Orlando Regional Healthcare by e-mail without express written confirmation by an officer of the corporation. Any views or opinions presented in this e-mail are solely those of the author and do not necessarily represent those of Orlando Regional Healthcare.

2 1

CVS notes for snapshots?
by jonescr＠cisco.com 14 Jun '06

14 Jun '06

Henrik, Just wondering if you are using CVS for the snapshots and if so is there any chance that the CVS comments are useful and/or appropriate for public view. I was thinking it would be handy to know about the changes that are in each snapshot version, so those of us who are using snapshots can tell if its worth grabbing a newer one or not (bugfixes, new features, etc). -Charles

2 1