- Xymon - Xymon mailman web

hobbitd_alert - program crash
by tlp-hobbit＠holme-pedersen.dk 08 Nov '05

08 Nov '05

Hi All, Just configured some more alerts in my hobbit and I have a hobbid_alert program crash. I am runnning routermon and today I have tried to exclude if_stats from sending a SMS during the night. I have configured hobbit-alerts.cfg as following PAGE=net-nodes/routers IGNORE HOST=$ROUTERS TIME=*:1600:2359 SERVICE=if_stat IGNORE HOST=$ROUTERS TIME=*:0000:0800 SERVICE=if_stat MAIL admin at localhost Gdb gives the following -bash-2.05b$ gdb bin/hobbitd_alert tmp/core.26618 GNU gdb Red Hat Linux (6.1post-1.20040607.52rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `hobbitd_alert --checkpoint-file=/hobbit/hobbit/server/tmp/alert.chk --checkpoin'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libpcre.so.0...done. Loaded symbols for /lib/libpcre.so.0 Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0x00658cef in raise () from /lib/tls/libc.so.6 (gdb) bt #0 0x00658cef in raise () from /lib/tls/libc.so.6 #1 0x0065a4f5 in abort () from /lib/tls/libc.so.6 #2 0x08055aee in sigsegv_handler (signum=11) at sig.c:57 #3 <signal handler called> #4 0x0804da0b in find_repeatinfo (alert=0x9f94fe0, recip=0x9f945d0, create=0) at do_alert.c:1054 #5 0x0804ee44 in clear_interval (alert=0x9f94fe0) at do_alert.c:1602 #6 0x0804ab03 in main (argc=167333856, argv=0x0) at hobbitd_alert.c:495 page.log gives: 2005-11-08 19:55:55 Worker process died with exit code 134, terminating hobbitlaunch.log gives: 2005-11-08 19:55:55 Task bbpage terminated, status 1 Any clue as to what caused it. Regards, Thomas

1 0

Alerting during downtime window
by craig.boyce＠rodney.govt.nz 08 Nov '05

08 Nov '05

Hi, I have an issue where hobbit is sending alerts for hosts during the planned downtime window for the host. We reboot various windows servers during the night and randomly will be paged at 02:00. Has anyone seen this before. It seems to be worst after restarting the hobbit services. Thanks Craig Boyce ##################################################################################### Disclaimer: The information in this electronic mail message is confidential and may be legally privileged. It is intended solely for the Addressee.Access to this internet electronic mail message by anyone else is unauthorised. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it is prohibited and may be unlawful. If you have received this message in error please notify us immediately. Rodney District Council accepts no responsibility for any effects this email message or attachments has on the recipient network or computer system. #####################################################################################

3 2

Hobbit client external script debugging
by hobbit＠pvaughan.us 08 Nov '05

08 Nov '05

How do people who run the hobbit client debugging their external scripts? With BB I usually export BBHOME and run $BBHOME/etc/bbdef.sh from my current shell and I can run my external scripts in the forground and see what they're doing. I suppose that I could change my external scripts to run every minute or two and monitor the log files, but I'd rather run them as needed while working on them. Or I could keep around a BB client for each platform that I need to tweak scripts on. Is there another option that I've overlooked?

4 3

[hobbit] Clients reporting to both a BB server and Hobbit
by kmckinnis＠macrovision.com 08 Nov '05

08 Nov '05

Thanks Heinrik :) You rock The bbproxy sounds like a better way to go. I'd read about it in the docs, but wasn't completely clear on the application. Thanks again :) -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Monday, November 07, 2005 10:58 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Clients reporting to both a BB server and Hobbit Hi Kimberly, On Mon, Nov 07, 2005 at 05:41:53PM -0800, Kimberly McKinnis wrote: > I saw the recent thread regarding using bbproxy to replicate the > display, and would like to do something similar. However, ideally, > what I'd like is to use something like bbrelay to have the clients > report to both hobbit and bb, while I get hobbit fully set up. So you are going to run BB and Hobbit in parallel, on different servers, and just want to feed Hobbit with the data the flows into your current BB system - with as few changes as possible. > I know the alert > structure is a little different, and I'd like to have time to tweak > things and such instead of doing an abrupt cutover. Is it possible to > have the clients actually report to both servers, such that both bb > and hobbit will process the data (as bbnets or whatever). I think "BBRELAY:ip.of.hobbit.server" on you BB server will do what you want. I've never used BBRELAY myself, but the docs and the bbd source code points in that direction. There are two things you should be aware of with this. First, it will obvious add some load to your BB server. All incoming messages must be copied out to the Hobbit server, and BB does that by forking (twice) a child process for each incoming message. If your BB server is running with a high load, you should keep an eye on it to see if it can handle the extra load that BBRELAY puts on it. If that turns out to be a problem, then an alternative way of doing this is to use Hobbit's bbproxy tool on your BB server: Change BB to listen on port 1985 (the BBPORT setting in recent BB installs), and run bbproxy on port 1984 with it forwarding to the local BB on port 1985, and the remote Hobbit server. Second, the Hobbit server will be fed ALL status messages from the BB server - including the BB servers network test results. So perhaps you should start out with the [bbnet] task disabled in Hobbit, and only run the display part of Hobbit - if you do run network tests in both BB and Hobbit, your Hobbit server will get updates from both sources. If they happen to disagree on a status, you'll see it flapping between the BB-determined status and the Hobbit-determined status. And a final tip: Use a dummy script to handle alert e-mails while you test the Hobbit server - change the MAIL and MAILC settings in hobbitserver.cfg to run the dummy instead of the real "mail" command. It is not funny to get all alerts in duplicates... > I want BB to remain fully functional for the time being, > as I'm monitoring over 2000 machines with paging and ext and pg scripts > which kick off other things. That will be interesting, it is an installation about the same size as my own. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] Hobbit wiki?
by v.everett＠afgonline.com.au 08 Nov '05

08 Nov '05

Hi all Myself and TJ started contributing to the Wiki, but I suddenly found myself up to my neck in real work, and stopped. I assume TJ suffered a similar fate. It would be good to see more people updating the Wiki. Something else that might be useful - an FAQ. Many questions have been asked and answered (sometimes often) in the list. It would be good to put a FAQ together based on the Q&A from list. Instead of leaving this to one person, anybody wanting to contribute to the FAQ should "grab" a date range from the list, and notify everybody of the dates they have taken. Any QUESTION within their date range is then to be added to the Wiki FAQ - even if there is no answer. (answers to be included if available) Anybody can then update the FAQ and fill in the blanks. Regards Vernon ----- No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. -----Original Message----- From: Rob Munsch [mailto:rmunsch at solutionsforprogress.com] Sent: Tuesday, 8 November 2005 6:16 AM To: hobbit at hswn.dk Subject: Re: [hobbit] Hobbit wiki? We - or one of us, so's not to flood the poor guy - could ask him/her/it/them? User:Tjyang From Wikibooks *E-mail:* tj_yang at hotmail dot com. * System_Monitoring_with_Hobbit <http://en.wikibooks.org/wiki/System_Monitoring_with_Hobbit> wikibook. Pat Vaughan wrote: >I searching to make sure my Hobbit issues haven't already been >answered, I keep stumbling over a hobbit wiki at: > >http://en.wikibooks.org/wiki/System_Monitoring_with_Hobbit > >It's very very sparse... almost empty, and pretty out of date. Is >anyone actually working on this, or is it abandoned? > > >To unsubscribe from the hobbit list, send an e-mail to >hobbit-unsubscribe at hswn.dk > > > > -- Rob Munsch Systems Analyst, Solutions for Progress http://www.solutionsforprogress.com To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

3 2

Clients reporting to both a BB server and Hobbit
by kmckinnis＠macrovision.com 08 Nov '05

08 Nov '05

I saw the recent thread regarding using bbproxy to replicate the display, and would like to do something similar. However, ideally, what I'd like is to use something like bbrelay to have the clients report to both hobbit and bb, while I get hobbit fully set up. I know the alert structure is a little different, and I'd like to have time to tweak things and such instead of doing an abrupt cutover. Is it possible to have the clients actually report to both servers, such that both bb and hobbit will process the data (as bbnets or whatever). I googled hobbit and bbrelay but didn't come up with too much. Will bbrelay do what I want, or does it just forward the reports instead of processing it on both servers? I want BB to remain fully functional for the time being, as I'm monitoring over 2000 machines with paging and ext and pg scripts which kick off other things.

3 2

[hobbit] Clients reporting to both a BB server and Hobbit
by v.everett＠afgonline.com.au 08 Nov '05

08 Nov '05

Hi I never touched the BB-server. (It isn't under my control) I changed the clients. (A pain if you have many monitored clients) If you add the Hobbit server to the client bb-hosts file as a display server, all the nateive and correctly configured tests will start sending results to the Hobbit server. Like this. # cat bb-hosts 192.168.8.15 samwise # BBDISPLAY BBPAGER <--- the original BB server 192.168.8.1 webserve # http://webserve/ 192.168.8.2 appserv1 # 192.168.8.3 appserv2 # 192.168.8.4 dbserve # 192.168.8.6 devserve # 192.168.0.16 frodo # BBDISPLAY BBPAGER <--- added by me (our first hobbit server) 192.168.0.14 shire # BBDISPLAY BBPAGER <--- added by me (our new hobbit server) (We have 2 hobbit servers because I am busy migrating to a more stable platform) All tests that are "native" to BB will start sending results to all servers with the BBDISPLAY parameter in bb-hosts. Most of the external tests have this line which sends the status. $BB $BBDISP "status $MACHINE.$TEST $COLOR `date` - $STATUS $LINE" The $BBDISP varaible will be automatically populated with the BBDISPLAY servers from the bb-hosts file (See above) The less cleverly written tests might have a line like this. $BB 192.168.0.16 "status $MACHINE.$TEST $COLOR `date` - $STATUS $LINE" If you want to send you results to a second or even a third server, keep adding lines. $BB 192.168.0.16 "status $MACHINE.$TEST $COLOR `date` - $STATUS $LINE" $BB 192.168.0.14 "status $MACHINE.$TEST $COLOR `date` - $STATUS $LINE" This is a cute trick which is useful if you only want to send results to one hobbit/bb server and not all of them. As in my case, there is a BB server, which I am not to disrupt. However, you might also want to limit what gets reported on the "business user" display, and what gets reported to your own server. Run 2 servers, and limit output to the business one, and send the extra infor to your private one. It is very useful if you have jumpy non-tech people who phone you every time ANYTHING goes red. :-) Hope this helps. Regards Vernon ----- No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. -----Original Message----- From: Kimberly McKinnis [mailto:kmckinnis at macrovision.com] Sent: Tuesday, 8 November 2005 10:21 AM To: hobbit at hswn.dk Subject: RE: [hobbit] Clients reporting to both a BB server and Hobbit :) so my specific question is... to make my clients report to both servers I only add the hobbit server as a bbrelay in the bb server's bb-host file? I'm not understanding the steps I need to take to run them in parallel. At the moment, I have a hobbit server running completely seperately and just pinging hosts, no clients are reporting to it. -----Original Message----- From: Vernon Everett [mailto:v.everett at afgonline.com.au] Sent: Monday, November 07, 2005 6:02 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Clients reporting to both a BB server and Hobbit Hi The short answer is yes. We have a 3rd party (they provide Dc services) that use Big Brother. Since I joined the company, I started using Hobbit, but had to do so without disrupting their Big Brother. I have also started migrating some of our servers to Hobbit client. We now have BB-client and Hobbit client running on our servers, reporting to Hobbit in our offices, and Big Brother server at our data centre hosts. It gets a little confusing, but keeps things interesting :-) Do you have a more specific question? Regards Vernon ----- No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. -----Original Message----- From: Kimberly McKinnis [mailto:kmckinnis at macrovision.com] Sent: Tuesday, 8 November 2005 9:42 AM To: hobbit at hswn.dk Subject: [hobbit] Clients reporting to both a BB server and Hobbit I saw the recent thread regarding using bbproxy to replicate the display, and would like to do something similar. However, ideally, what I'd like is to use something like bbrelay to have the clients report to both hobbit and bb, while I get hobbit fully set up. I know the alert structure is a little different, and I'd like to have time to tweak things and such instead of doing an abrupt cutover. Is it possible to have the clients actually report to both servers, such that both bb and hobbit will process the data (as bbnets or whatever). I googled hobbit and bbrelay but didn't come up with too much. Will bbrelay do what I want, or does it just forward the reports instead of processing it on both servers? I want BB to remain fully functional for the time being, as I'm monitoring over 2000 machines with paging and ext and pg scripts which kick off other things. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

1 0

[hobbit] Clients reporting to both a BB server and Hobbit
by kmckinnis＠macrovision.com 08 Nov '05

08 Nov '05

:) so my specific question is... to make my clients report to both servers I only add the hobbit server as a bbrelay in the bb server's bb-host file? I'm not understanding the steps I need to take to run them in parallel. At the moment, I have a hobbit server running completely seperately and just pinging hosts, no clients are reporting to it. -----Original Message----- From: Vernon Everett [mailto:v.everett at afgonline.com.au] Sent: Monday, November 07, 2005 6:02 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Clients reporting to both a BB server and Hobbit Hi The short answer is yes. We have a 3rd party (they provide Dc services) that use Big Brother. Since I joined the company, I started using Hobbit, but had to do so without disrupting their Big Brother. I have also started migrating some of our servers to Hobbit client. We now have BB-client and Hobbit client running on our servers, reporting to Hobbit in our offices, and Big Brother server at our data centre hosts. It gets a little confusing, but keeps things interesting :-) Do you have a more specific question? Regards Vernon ----- No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. -----Original Message----- From: Kimberly McKinnis [mailto:kmckinnis at macrovision.com] Sent: Tuesday, 8 November 2005 9:42 AM To: hobbit at hswn.dk Subject: [hobbit] Clients reporting to both a BB server and Hobbit I saw the recent thread regarding using bbproxy to replicate the display, and would like to do something similar. However, ideally, what I'd like is to use something like bbrelay to have the clients report to both hobbit and bb, while I get hobbit fully set up. I know the alert structure is a little different, and I'd like to have time to tweak things and such instead of doing an abrupt cutover. Is it possible to have the clients actually report to both servers, such that both bb and hobbit will process the data (as bbnets or whatever). I googled hobbit and bbrelay but didn't come up with too much. Will bbrelay do what I want, or does it just forward the reports instead of processing it on both servers? I want BB to remain fully functional for the time being, as I'm monitoring over 2000 machines with paging and ext and pg scripts which kick off other things. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] Clients reporting to both a BB server and Hobbit
by v.everett＠afgonline.com.au 08 Nov '05

08 Nov '05

Hi The short answer is yes. We have a 3rd party (they provide Dc services) that use Big Brother. Since I joined the company, I started using Hobbit, but had to do so without disrupting their Big Brother. I have also started migrating some of our servers to Hobbit client. We now have BB-client and Hobbit client running on our servers, reporting to Hobbit in our offices, and Big Brother server at our data centre hosts. It gets a little confusing, but keeps things interesting :-) Do you have a more specific question? Regards Vernon ----- No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. -----Original Message----- From: Kimberly McKinnis [mailto:kmckinnis at macrovision.com] Sent: Tuesday, 8 November 2005 9:42 AM To: hobbit at hswn.dk Subject: [hobbit] Clients reporting to both a BB server and Hobbit I saw the recent thread regarding using bbproxy to replicate the display, and would like to do something similar. However, ideally, what I'd like is to use something like bbrelay to have the clients report to both hobbit and bb, while I get hobbit fully set up. I know the alert structure is a little different, and I'd like to have time to tweak things and such instead of doing an abrupt cutover. Is it possible to have the clients actually report to both servers, such that both bb and hobbit will process the data (as bbnets or whatever). I googled hobbit and bbrelay but didn't come up with too much. Will bbrelay do what I want, or does it just forward the reports instead of processing it on both servers? I want BB to remain fully functional for the time being, as I'm monitoring over 2000 machines with paging and ext and pg scripts which kick off other things. To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

1 0

Hobbit wiki?
by hobbit＠pvaughan.us 07 Nov '05

07 Nov '05

I searching to make sure my Hobbit issues haven't already been answered, I keep stumbling over a hobbit wiki at: http://en.wikibooks.org/wiki/System_Monitoring_with_Hobbit It's very very sparse... almost empty, and pretty out of date. Is anyone actually working on this, or is it abandoned?

3 2