June 2005 - Xymon - Xymon mailman web

Multiple Views
by Al.Jeffcoat＠orhs.org 22 Jun '05

22 Jun '05

Hello All, I've got a question... And I apologize ahead of time if it's been covered already. We have been running bb/hobbit for some time. First it was on UNIX only, because the windows admins didn't like it. Then our execs saw it, and liked it. They then mandated that all systems will be monitored by hobbit. Here's where the problem starts. Windows has been generating a lot of red events. The execs overreact to red events that are really not problems. We've tired to explain that just because something is red, doesn't mean that a system is down. The windows admins are tuning it down as best as they can, but it still happens. So my thought was to have two hobbit's, one that receives client data for our engineers to see and work with, and then another that just does the network tests, and this would be what our execs see. Both would be sitting on the same server, running in separate directories, and separate virtual servers. What I'm trying to get to is two views, an executive view, and a technical view. Has anyone done something like this? Is there a better way within hobbit itself? TIA __________________________________ Al Jeffcoat This e-mail message and any attached files are confidential and are intended solely for the use of the addressee(s) named above. If you are not the intended recipient, any review, use, or distribution of this e-mail message and any attached files is strictly prohibited. This communication may contain material protected by Federal privacy regulations, attorney-client work product, or other privileges. If you have received this confidential communication in error, please notify the sender immediately by reply e-mail message and permanently delete the original message. To reply to our email administrator directly, send an email to: postmaster at orlandoregional.org . If this e-mail message concerns a contract matter, be advised that no employee or agent is authorized to conclude any binding agreement on behalf of Orlando Regional Healthcare by e-mail without express written confirmation by an officer of the corporation. Any views or opinions presented in this e-mail are solely those of the author and do not necessarily represent those of Orlando Regional Healthcare.

4 3

[hobbit] System Log Monitoring
by Larry.Barber＠usda.gov 22 Jun '05

22 Jun '05

Enter the phrases you want to look for in the bb-msgtab file in your BB client's etc directory. Thanks, Larry Barber On Wed, 2005-06-22 at 09:26 -0500, callahant at tessco.com wrote: > Morning all, > Is there a way to monitor for certain key words that show up in > the > system logs? ie. I would like for hobbit to page me "iff" the words > "FAILOVER", "LOOP DEAD", and "LOOP DOWN" are detected in the > /var/logs/messages file on our Linux machines. > > Let me know if this is possible. > > Thanks, > Tom Callahan > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > > >

1 0

System Log Monitoring
by callahant＠tessco.com 22 Jun '05

22 Jun '05

Morning all, Is there a way to monitor for certain key words that show up in the system logs? ie. I would like for hobbit to page me "iff" the words "FAILOVER", "LOOP DEAD", and "LOOP DOWN" are detected in the /var/logs/messages file on our Linux machines. Let me know if this is possible. Thanks, Tom Callahan

1 0

hobbitd status-board not available
by tlp-hobbit＠holme-pedersen.dk 22 Jun '05

22 Jun '05

Running Hobbit 4.0.4 on RHEL linux in a kinda special way. I have 2 BBNET servers, one server is also the BBDISPLAY server. On the BBNET server without display I am running hobbit basicly only bbnet process. On this host I am also running bbproxy for my production BBDISPLAY and my test BBDISPLAY (third seperate server). Now the problem started when I decided to "upgrade" the hobbit BBNET only server to also be a BBDISPLAY server. I did this by starting hobbit on port 1986 (--listen=172.17.110.20:1986) along with the bbdisplay/histry/lard etc processes and then add a third bbdisplay server to my bbproxy configuration (--bbdisplay=172.17.110.20:1986). Hobbitd.log and hobbitlaunch.log are fine - no errors - but on my "primary" BBDISPLAY I now have the above line as status. I tried to add --debug to the hobbitd and bbdisplay configurations in hobbitlaunch.cfg but this crashed. Tried to disable the HEARTBEAT in hobbitlaunch but this did not solve the problem. If I stop hobbit the state is written to the tmp/hobbit.chk file and started again has the saved state. If this was not enough the "new" BBDISPLAY is making the headlines but no hosts. :-( Any help is appresiated. BR Thomas

2 2

Redundant Hobbit Servers
by mlowery＠alliedtechgroup.com 21 Jun '05

21 Jun '05

I'm interested in knowing what everyone is doing for redundancy. I currently have 2 hobbit servers and each one performs the same tests as the other. I find this to be a bit wasteful and am looking for the active/passive type of configuration that has been talked about on this list before. This configuration works fine, except for alerting. In order to not be overwhelmed by messages, I only have one hobbit server performing the alerting task, the other only sends alerts on the other hobbit host. I have considered using the "depends=" test, but then I have to maintain two separate bb-hosts files, rather than copying and pasting from one to the other. Is there a better way than what I'm doing? My goal is to have both servers configured the same, as much as possible, and have only one of them at a time send me alerts. I'd love to know what you guys are doing to get around these limits. I could easily have missed something in the newest update that solves this problem, but I haven't seen it yet. Thanks for your thoughts on this subject. Michael

3 2

[hobbit] Redundant Hobbit Servers
by Scott.Kelley＠disney.com 21 Jun '05

21 Jun '05

We are moving to running all our monitoring services in (VMWare) virtual machines. The vm's are backed up each night to a NAS share. If the physical server dies, no big deal I can just start the vm on another host connected to the same SAN. If the SAN dies (unlikely), I can restore the vm from the backup on some other host. We also run Sitescope, which alerts us if BigBrother/Hobbit dies (and vice versa). -- Scott Kelley, Disney Enterprise IT Platform Services -----Original Message----- From: hobbit-return-2800-Scott.Kelley=disney.com at hswn.dk [mailto:hobbit-return-2800-Scott.Kelley=disney.com at hswn.dk] On Behalf Of Lowery, Michael Sent: Tuesday, June 21, 2005 9:13 AM To: hobbit at hswn.dk Subject: [hobbit] Redundant Hobbit Servers I'm interested in knowing what everyone is doing for redundancy. I currently have 2 hobbit servers and each one performs the same tests as the other. I find this to be a bit wasteful and am looking for the active/passive type of configuration that has been talked about on this list before. This configuration works fine, except for alerting. In order to not be overwhelmed by messages, I only have one hobbit server performing the alerting task, the other only sends alerts on the other hobbit host. I have considered using the "depends=" test, but then I have to maintain two separate bb-hosts files, rather than copying and pasting from one to the other. Is there a better way than what I'm doing? My goal is to have both servers configured the same, as much as possible, and have only one of them at a time send me alerts. I'd love to know what you guys are doing to get around these limits. I could easily have missed something in the newest update that solves this problem, but I haven't seen it yet. Thanks for your thoughts on this subject. Michael To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] only alert if X number of hosts are already in error
by blysik＠shutterfly.com 20 Jun '05

20 Jun '05

> My best suggestion would be to use the bbcombotest tool to define > a pseudo "host" with the combined status of your host "pool". > > E.g. if you're monitoring http on 5 hosts, you could define a > combination test like this: > > Pool1.http=(hostA.http+hostB.http+hostC.http+hostD.http+hostE.http)>3 > > That would give you a red alert if 3 or fewer hosts in the pool were > green. And you could then trigger an alert based on that test result. Pretty unwieldy when you have large pools of servers, however. I just started writing a smart paging script which will keep track of downed hosts and decide whether or not to page. One question I have so far is: Does hobbit wait for an alerting script to return before continuing to evaluate other rules? -- Bruce Z. Lysik <blysik at shutterfly.com> Operations Engineer The information contained in this message (including any attachments) may be confidential. This message (including any attachments) is intended to be read only by the recipient(s) to whom it is addressed. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Shutterfly by telephone at (650) 610-5200 and delete or destroy any copy of this message (including any attachments).

3 2

[hobbit] Hobbitd_history crashing
by dstuffle＠deltafaucet.com 20 Jun '05

20 Jun '05

henrik at hswn.dk wrote: > On Tue, Jun 14, 2005 at 10:59:31AM -0500, Stuffle, David > wrote: >> Hobbit 4.0.4 >> Fedora Core 3 >> >> My hobbitd_history has crashed several times in the past >> few weeks. It goes red with "Fatal signal caught" then >> it goes purple. I have core files in the server/tmp >> directory. Here is the debug output you have requested >> in a previous post. Thanks! >> >> #3 0x0804d5de in sigsegv_handler (signum=11) at >> sig.c:57 #4 <signal handler called> #5 0x0804a242 in >> main (argc=1, argv=0xfef4a724) at hobbitd_history.c:194 > > I guess this can happen if a "disable" message does not > provide any cause, i.e. "disable foo.test 180" > > Does this patch fix it for you ? > > > Regards, > Henrik Henrik, After applying the patch, I am still getting the crashes. Here is the core file output. Thanks -bash-3.00$ gdb bin/hobbitd_history tmp/core.27019 GNU gdb Red Hat Linux (6.1post-1.20040607.41rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `hobbitd_history'. Program terminated with signal 6, Aborted. Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0x003ff7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2 (gdb) bt #0 0x003ff7a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2 #1 0x0043f955 in raise () from /lib/tls/libc.so.6 #2 0x00441319 in abort () from /lib/tls/libc.so.6 #3 0x0804d5f6 in sigsegv_handler (signum=11) at sig.c:57 #4 <signal handler called> #5 nldecode (msg=0x804e926 "(No reason given)") at encoding.c:250 #6 0x0804a9ac in main (argc=1, argv=0xfeec01b4) at hobbitd_history.c:195 (gdb) ~~~~~~~~~~~~~~ David Stuffle dstuffle at deltafaucet.com Delta Faucet Company (317) 571-4301 This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. Please note that any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. Finally, the recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.

1 0

what does the column "stop after" on "info page" mean ?
by xiao.xj＠neusoft.com 20 Jun '05

20 Jun '05

I am sorry for my first letter , I spell wrong word "DURATION >60" , what i mean indeed is "DURATION <60" . this is the correct one : I installed hobbit and find it is excellent! I was confused about the alert confiugre of "hobbit-alerts.cfg" , I configured the DURATION <60 ,I assume it will appear in the "stop after column " on the "info page", but I can't see it. Maybe I am wrong about the "stop after column" ,what does it mean ?

2 1

what does the column "stop after" on "info page" mean ?
by xiao.xj＠neusoft.com 20 Jun '05

20 Jun '05

I installed hobbit and find it is excellent! I was confused about the alert confiugre of "hobbit-alerts.cfg" , I configured the DURATION>60 ,I assume it will appear in the "stop after column " on the "info page", but I can't see it. Maybe I am wrong about the "stop after column" ,what does it mean ?

1 0