- Xymon - Xymon mailman web

Hobbit EMC Clariion Extention Problem
by linuxmasterjedi＠free.fr 23 Jan '08

23 Jan '08

Hello, I'm using Hobbit Monitor 4.2.0 with a plugin (EMC CLARiiON FC-4700 Hardware Agent) developped by Sabey to monitor 2 EMC SAN array. This plugin seems to work fine with my EMC CLARiiON CX3-40 except for one thing, look at the printscreen http://linuxmasterjedi.free.fr/Hobbit_EMC-Clariion-Ext_Problem.jpg SP A Port 2 Status green Link red SP A Port 3 Status green Link red SP B Port 2 Status green Link red SP B Port 3 Status green Link red red Enclosure SPE SPS A Cabling red Enclosure SPE SPS B Cabling are in red but this is normal! there is nothing connected on port 2 and 3. Is there a way to fix that somewhere ? Thanks by advance, LMJ

2 2

conn=worst
by MLowery＠netgainit.com 22 Jan '08

22 Jan '08

Hi, I've been trying to get the conn=worst,ip1,ip2 to work properly, but it doesn't seem to. When I tried editing line 1383 countasdown = 0 to countasdown = 1 in the bbtest-net.c file and recompiled, all of my !telnet tests started returning clear eventhough they are not dialup tests. I may have read some old information on how to fix this, can anyone help on this? I'm running 4.2.0. Thanks! Michael

1 0

[hobbit] Sending alerts to remote system running qpage
by Keller_Liora＠emc.com 22 Jan '08

22 Jan '08

Eric, It looks like some of the Hobbit log alerts can be long, like for ports/cpu alerts, it lists all the ports/cpu in the alert. Is there a way to have qpage only send the first few lines of the message and not the entire Hobbit message? Thanks, Liora -----Original Message----- From: Eric Meddaugh [mailto:etmsys at rit.edu] Sent: Tuesday, December 04, 2007 4:59 AM To: Keller, Liora Subject: RE: [hobbit] Sending alerts to remote system running qpage In the config.h file: /* Define as the name(s) of the default SNPP server. */ #define SNPP_SERVER "qpage1.rit.edu,qpage2.rit.edu" ---Eric -----Original Message----- From: Keller_Liora at emc.com [mailto:Keller_Liora at emc.com] Sent: Monday, December 03, 2007 16:10 To: Eric Meddaugh Subject: RE: [hobbit] Sending alerts to remote system running qpage Eric, Where did you change the qpage code to point to your qpage server? Thanks, Liora -----Original Message----- From: Eric Meddaugh [mailto:etmsys at rit.edu] Sent: Monday, December 03, 2007 9:42 AM To: Keller, Liora Subject: RE: [hobbit] Sending alerts to remote system running qpage Here it is again. ---Eric -----Original Message----- From: Keller_Liora at emc.com [mailto:Keller_Liora at emc.com] Sent: Monday, December 03, 2007 12:41 To: Eric Meddaugh Subject: RE: [hobbit] Sending alerts to remote system running qpage Eric, I was not able to see the attached pgape.pl script on hswn.dk website. Can you please email it to me please? Thanks, Liora

2 1

display holidays in MM/DD format, instead of DD/MM
by tomg＠mcclatchyinteractive.com 22 Jan '08

22 Jan '08

Is there any way to configure the holiday date format that appears in the Info column? I'd like to show the dates in MM/DD format instead of DD/MM, if possible. Thanks, Tom

2 2

core dumps after modifying allevents file
by achvila＠yahoo.co.uk 22 Jan '08

22 Jan '08

Hi All, My allevents file was nearing the 2GB mark but was 95% full of lines from two custom tests that changed state every 30 seconds or so. These were removed manually as trim history could not be used as we would loose valuable historic data. allevents file cannot exceed 2GB. The file was cat'ed out with a grep -v of the unwated tests, completed fine and now new allevents file is 141mb. Hobbit was stopped before the process started, a ps showed no hobbit processes running, above change was made, permissions were checked in all events to ensure they were the same, hobbit was then started. about 500 hosts are monitored with most of them running client side custom scripts, very shortly after startup core files were generated and hobbit either crashed or stopped itself. Below is the debug output from the core files and relevant log line entries round this time. The only way to get hobbit started back up and the hobbit status page displayed, was to firewall off the server so that all status messages were ignored (iptables used), stop hobbit, ensure all processes are gone and started again, waited a few minutes so that hobbit could do what it wanted, then the iptables rule was removed. After 10 mins all returned to normal and no more core files have been generated. Not sure if whilst hobbit is starting up, if it receives too many status updates, or any during startup it causes it to core dump as it is not ready? Any help would be greatly appreciated. ***************** CORE FILES **************** -rw------- 1 hobbit hobbit 23M Jan 22 09:36 core.27740 -rw------- 1 hobbit hobbit 23M Jan 22 09:37 core.28187 -rw------- 1 hobbit hobbit 23M Jan 22 09:38 core.28385 ********************** DEBUG OUTPUT ********************* # gdb ../bin/hobbitd core.27740 GNU gdb Red Hat Linux (6.3.0.0-1.138.el3rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `hobbitd --pidfile=/var/log/hobbit/hobbitd.pid --restart=/var/hobbit/server/tmp/'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libpcre.so.0...done. Loaded symbols for /lib/libpcre.so.0 Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0x00434eff in raise () from /lib/tls/libc.so.6 (gdb) bt #0 0x00434eff in raise () from /lib/tls/libc.so.6 #1 0x00436705 in abort () from /lib/tls/libc.so.6 #2 0x0805a006 in sigsegv_handler (signum=11) at sig.c:57 #3 <signal handler called> #4 0x0048701c in mempcpy () from /lib/tls/libc.so.6 #5 0x0047a6a2 in _IO_default_xsputn_internal () from /lib/tls/libc.so.6 #6 0x004535c7 in vfprintf () from /lib/tls/libc.so.6 #7 0x0046f4ec in vsprintf () from /lib/tls/libc.so.6 #8 0x0045a0dd in sprintf () from /lib/tls/libc.so.6 #9 0x0804df40 in generate_outbuf (outbuf=0xbffee4c4, outpos=0xbffee4c8, outsz=0xbffee4cc, hwalk=0x89793b0, lwalk=0x897b350, acklevel=-1) at hobbitd.c:2227 #10 0x0805074f in do_message (msg=0x8df5d10, origin=0x805c4fc "") at hobbitd.c:2848 #11 0x08053472 in main (argc=8, argv=0xbfff18e4) at hobbitd.c:4377 # gdb /var/hobbit/server/bin/hobbitd /var/hobbit/server/tmp/core.28187 GNU gdb Red Hat Linux (6.3.0.0-1.138.el3rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `hobbitd --pidfile=/var/log/hobbit/hobbitd.pid --restart=/var/hobbit/server/tmp/'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libpcre.so.0...done. Loaded symbols for /lib/libpcre.so.0 Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0x0093aeff in raise () from /lib/tls/libc.so.6 (gdb) bt #0 0x0093aeff in raise () from /lib/tls/libc.so.6 #1 0x0093c705 in abort () from /lib/tls/libc.so.6 #2 0x0805a006 in sigsegv_handler (signum=11) at sig.c:57 #3 <signal handler called> #4 0x0098d01c in mempcpy () from /lib/tls/libc.so.6 #5 0x009806a2 in _IO_default_xsputn_internal () from /lib/tls/libc.so.6 #6 0x009595c7 in vfprintf () from /lib/tls/libc.so.6 #7 0x009754ec in vsprintf () from /lib/tls/libc.so.6 #8 0x009600dd in sprintf () from /lib/tls/libc.so.6 #9 0x0804df40 in generate_outbuf (outbuf=0xbfff0f74, outpos=0xbfff0f78, outsz=0xbfff0f7c, hwalk=0x9352838, lwalk=0x93557a0, acklevel=-1) at hobbitd.c:2227 #10 0x0805074f in do_message (msg=0x9c27bb0, origin=0x805c4fc "") at hobbitd.c:2848 #11 0x08053472 in main (argc=8, argv=0xbfff4394) at hobbitd.c:4377 (gdb) quit # gdb /var/hobbit/server/bin/hobbitd /var/hobbit/server/tmp/core.28385 GNU gdb Red Hat Linux (6.3.0.0-1.138.el3rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Core was generated by `hobbitd --pidfile=/var/log/hobbit/hobbitd.pid --restart=/var/hobbit/server/tmp/'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libpcre.so.0...done. Loaded symbols for /lib/libpcre.so.0 Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0x00abfeff in raise () from /lib/tls/libc.so.6 (gdb) bt #0 0x00abfeff in raise () from /lib/tls/libc.so.6 #1 0x00ac1705 in abort () from /lib/tls/libc.so.6 #2 0x0805a006 in sigsegv_handler (signum=11) at sig.c:57 #3 <signal handler called> #4 0x00b1201c in mempcpy () from /lib/tls/libc.so.6 #5 0x00b056a2 in _IO_default_xsputn_internal () from /lib/tls/libc.so.6 #6 0x00ade5c7 in vfprintf () from /lib/tls/libc.so.6 #7 0x00afa4ec in vsprintf () from /lib/tls/libc.so.6 #8 0x00ae50dd in sprintf () from /lib/tls/libc.so.6 #9 0x0804df40 in generate_outbuf (outbuf=0xbfff3774, outpos=0xbfff3778, outsz=0xbfff377c, hwalk=0x9c863b0, lwalk=0x9c88350, acklevel=-1) at hobbitd.c:2227 #10 0x0805074f in do_message (msg=0xa678100, origin=0x805c4fc "") at hobbitd.c:2848 #11 0x08053472 in main (argc=8, argv=0xbfff6b94) at hobbitd.c:4377 (gdb) quit *************** LOG FILES ************** hobbitlaunch.log:2008-01-22 09:36:05 hobbitlaunch starting hobbitlaunch.log:2008-01-22 09:36:05 Loading tasklist configuration from /var/hobbit/server/etc/hobbitlaunch.cfg hobbitlaunch.log:2008-01-22 09:36:05 Loading hostnames hobbitlaunch.log:2008-01-22 09:36:05 Loading saved state hobbitlaunch.log:2008-01-22 09:36:06 Setting up network listener on 0.0.0.0:1984 hobbitlaunch.log:2008-01-22 09:36:06 Setting up signal handlers hobbitlaunch.log:2008-01-22 09:36:06 Setting up hobbitd channels hobbitlaunch.log:2008-01-22 09:36:06 Setting up logfiles hobbitlaunch.log:2008-01-22 09:36:10 Task hobbitd terminated by signal 6 hobbitlaunch.log:2008-01-22 09:36:10 Loading hostnames hobbitlaunch.log:2008-01-22 09:36:10 Task bbdisplay terminated by signal 15 hobbitlaunch.log:2008-01-22 09:36:10 Task bbnet terminated by signal 15 hobbitlaunch.log:2008-01-22 09:36:10 Task hobbitclient terminated by signal 15 hobbitlaunch.log:2008-01-22 09:36:10 Loading saved state hobbitlaunch.log:2008-01-22 09:36:11 Setting up network listener on 0.0.0.0:1984 hobbitlaunch.log:2008-01-22 09:36:11 Setting up signal handlers hobbitlaunch.log:2008-01-22 09:36:11 Setting up hobbitd channels hobbitlaunch.log:2008-01-22 09:36:11 Setting up logfiles hobbitlaunch.log:2008-01-22 09:37:12 Task hobbitd terminated by signal 6 hobbitlaunch.log:2008-01-22 09:37:12 Task bbdisplay terminated by signal 15 hobbitlaunch.log:2008-01-22 09:37:12 Loading hostnames hobbitlaunch.log:2008-01-22 09:37:12 Loading saved state hobbitlaunch.log:2008-01-22 09:37:12 Setting up network listener on 0.0.0.0:1984 hobbitlaunch.log:2008-01-22 09:37:12 Setting up signal handlers hobbitlaunch.log:2008-01-22 09:37:12 Setting up hobbitd channels hobbitlaunch.log:2008-01-22 09:37:12 Setting up logfiles hobbitlaunch.log:2008-01-22 09:38:14 Task hobbitd terminated by signal 6 hobbitlaunch.log:2008-01-22 09:38:14 Task bbdisplay terminated by signal 15 hobbitlaunch.log:2008-01-22 09:45:27 hobbitlaunch starting hobbitlaunch.log:2008-01-22 09:45:27 Loading tasklist configuration from /var/hobbit/server/etc/hobbitlaunch.cfg hobbitlaunch.log:2008-01-22 09:45:27 Loading hostnames hobbitlaunch.log:2008-01-22 09:45:27 Loading saved state hobbitlaunch.log:2008-01-22 09:45:27 Setting up network listener on 0.0.0.0:1984 hobbitlaunch.log:2008-01-22 09:45:27 Setting up signal handlers hobbitlaunch.log:2008-01-22 09:45:27 Setting up hobbitd channels hobbitlaunch.log:2008-01-22 09:45:27 Setting up logfiles bb-display.log:2008-01-22 09:37:12 2008-01-22 09:38:14 2008-01-22 09:45:47 Whoops ! bb failed to send message - timeout bb-display.log:2008-01-22 09:45:47 hobbitd status-board not available bb-display.log:2008-01-22 09:46:34 Whoops ! bb failed to send message - timeout bb-display.log:2008-01-22 09:47:21 Whoops ! bb failed to send message - timeout bb-display.log:2008-01-22 09:47:21 hobbitd status-board not available bb-display.log:2008-01-22 09:48:08 Whoops ! bb failed to send message - timeout bb-display.log:2008-01-22 09:48:55 Whoops ! bb failed to send message - timeout bb-display.log:2008-01-22 09:48:55 hobbitd status-board not available hobbitclient.log:2008-01-22 09:46:25 Whoops ! bb failed to send message - timeout hobbitclient.log:2008-01-22 09:51:26 Whoops ! bb failed to send message - timeout hobbitclient.log:2008-01-22 09:56:26 Whoops ! bb failed to send message - timeout hobbitd.log:2008-01-22 09:27:47 BOARDBUSY locked at 1, GETNCNT is 0, GETPID is 0, 0 clients hobbitd.log:2008-01-22 09:36:06 Setup complete hobbitd.log:2008-01-22 09:36:11 Setup complete hobbitd.log:2008-01-22 09:37:12 Setup complete hobbitd.log:2008-01-22 09:45:27 Setup complete Thanks -- Regards Dominic __________________________________________________________ Sent from Yahoo! Mail - a smarter inbox http://uk.mail.yahoo.com

1 0

Returning the state of an agregate service.
by lists2006.wayne＠gmail.com 22 Jan '08

22 Jan '08

Hi all I have 3 tests monitoring in one column. I want to have an AND condition where all the tests have to be true in order for the service to revert to green. At the moment the one server fails, I return a red, the next service works and the whole column gets returned to green. Is there any way to implement this without makeing 3 seperate columns? Cheers Wayne

3 3

bbd purple
by lists2006.wayne＠gmail.com 22 Jan '08

22 Jan '08

Hi all I'm adding some custom scritps to hobbit an bbd is now purple. I can't find any indication as to what would cause this. I've looked through the logs and all seems well. Any pointers as to what could be causing this? -- Regards Wayne Gemmell

2 9

Runtime 31 longer than time limit (20)
by javier.temponi＠selectv.com 22 Jan '08

22 Jan '08

Well after a few days I found the problem (I'm a bit new on hobbit yet), I set a -debug option in [bbnet] in the hobbitlaunch.cfg: [bbnet] ENVFILE /usr/local/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD bbtest-net --report --ping --checkresponse --report --debug LOGFILE $BBSERVERLOGS/bb-network.log And I checked the logs for something, and there was 30 seconds of DNS timeout trying to resolve a hostname, that it wasn't on the dns. 30 seconds is the default timeout for DNS resolution. I changed the dns timeout to 2 seconds and now is working like a charm :D Cheers Javier!! ________________________________ From: Javier Temponi Sent: Friday, 18 January 2008 4:58 PM To: 'hobbit at hswn.dk' Subject: Runtime 31 longer than time limit (20) Hi, I was looking for information about this issue but, apparently there is not :-( I'm running hobbit 4.2 using hobbitping poll 12 hosts. Some of those hosts are behind a 2Mbps link, and almost all the time that link is 3% busy. The rest of the hosts are in the same LAN as the hobbit server. I need to poll 12 hosts within 20 seconds intervals, but it take 30 seconds the complete process. I read that hobbitping is fastest than fping, and there is some Fping examples that show that 12 hosts would be ping in 20 seconds without any problem. I have changed the bbnet interval in the hobbitlaunch.cfg to 20 (or less, just to try) but here is what the log shows (/var/log/hobbit/bb-network.log): 2008-01-18 16:24:41 WARNING: Runtime 31 longer than time limit (20) 2008-01-18 16:25:11 WARNING: Runtime 30 longer than time limit (20) 2008-01-18 16:25:42 WARNING: Runtime 31 longer than time limit (20) 2008-01-18 16:26:12 WARNING: Runtime 30 longer than time limit (20) 2008-01-18 16:26:43 WARNING: Runtime 31 longer than time limit (20) 2008-01-18 16:27:13 WARNING: Runtime 30 longer than time limit (20) 2008-01-18 16:27:44 WARNING: Runtime 31 longer than time limit (20) 2008-01-18 16:28:14 WARNING: Runtime 30 longer than time limit (20) 2008-01-18 16:28:45 WARNING: Runtime 31 longer than time limit (20) 2008-01-18 16:29:15 WARNING: Runtime 30 longer than time limit (20) If any have any recommendation, or work around, how I can poll this hosts with 20 seconds interval, would be welcome! :D Thanks in advance!! Regards Javier

2 1

hobbitd error
by klomph＠nlr.nl 21 Jan '08

21 Jan '08

Dear experts, Very often I get the next error message in the hobbitd status display and de hobbitd.log file. Invalid timespec - expected 4 digits, got: 'Disk defragmentatie' I don't know which node is causing this error. Can anyone tell me where to look for the cause of the error ? I'm running with Hobbit Monitor 4.3.0-0.20070727<http://hobbitmon.sourceforge.net/> and I'm also using BBWIN 0.9 Thanks in advance, H. Klomp National Aerospace Laboratory Computer Infrastructure Development * +31 (0) 527 24 8419 * +31 (0) 6 54 994 705 * +31 (0) 527 24 8210 * klomph at nlr.nl<mailto:klomph at nlr.nl> * Voorsterweg 31 Postbus 153 8300 AD Emmeloord http://www.nlr.nl/

1 0

strange rrd results via ncv
by Craig_Whilding_TERM＠relay1.mentorg.com 21 Jan '08

21 Jan '08

I've had to reply to myself as hobbit mail isn't getting through to me for some reason. Gary or others do you know how I can get it to chart the exact vale that comes in then. It's a bit silly having a graph of 4.8 jobs etc. Also 4.5 is the average of 4 and 5 so it doesn't make much sense anyway, Also it's the data at the bottom of the graph that is really odd - queue max = 1.5m, running average 445.0m? Not sure where that data is coming from? Thanks, Craig ________________________________ From: Whilding, Craig Sent: 18 January 2008 15:39 To: 'hobbit at hswn.dk' Subject: strange rrd results via ncv We recently rolled out a sun grid engine platform and I'm now trying to gather performance/usage information from it (if someone already has a collection of scripts this would also help me immensely). I've written a perl script that passes job queue information to hobbit which outputs in the following format: Running jobs : 7 Queued jobs : 0 Xfering jobs : 0 Errorstate jobs : 0 This should be ideal for ncv and I have therefore added ginfo=ncv to TEST2RRD in hobbitserver.cfg as well as NCV_qinfo="Runningjobs:GAUGE,Queuedjobs:GAUGE,Xferingjobs:GAUGE,Errorsta tejobs:GAUGE" on its own line because this is fluctuating data and not a counter. The graph definition looks like this: [qinfo] TITLE Q Info YAXIS Jobs DEF:running=qinfo.rrd:Runningjobs:AVERAGE DEF:queued=qinfo.rrd:Queuedjobs:AVERAGE DEF:xfering=qinfo.rrd:Xferingjobs:AVERAGE DEF:errorstate=qinfo.rrd:Errorstatejobs:AVERAGE LINE2:running#0000FF:Running Jobs LINE2:queued#00CC33:Queued Jobs LINE2:xfering#FF0000:Xfering Jobs LINE2:errorstate#FFFF00:Errorstate Jobs COMMENT:\n GPRINT:running:LAST:Running jobs \: %5.1lf%s (cur) GPRINT:running:MAX: \: %5.1lf%s (max) GPRINT:running:MIN: \: %5.1lf%s (min) GPRINT:running:AVERAGE: \: %5.1lf%s (avg)\n GPRINT:queued:LAST:Queued jobs \: %5.1lf%s (cur) GPRINT:queued:MAX: \: %5.1lf%s (max) GPRINT:queued:MIN: \: %5.1lf%s (min) GPRINT:queued:AVERAGE: \: %5.1lf%s (avg)\n GPRINT:xfering:LAST:Xfering jobs \: %5.1lf%s (cur) GPRINT:xfering:MAX: \: %5.1lf%s (max) GPRINT:xfering:MIN: \: %5.1lf%s (min) GPRINT:xfering:AVERAGE: \: %5.1lf%s (avg)\n GPRINT:errorstate:LAST:Errorstate jobs \: %5.1lf%s (cur) GPRINT:errorstate:MAX: \: %5.1lf%s (max) GPRINT:errorstate:MIN: \: %5.1lf%s (min) GPRINT:errorstate:AVERAGE: \: %5.1lf%s (avg)\n As you can see from the attached graph there are some rather strange results coming out and the rrd file contains values such as 3.9/4.8 when you really can't have .x of a job and the output from the script only ever shows whole numbers as it should. Thanks for any help with what's going wrong. Regards, Craig Whilding IT Systems Contractor Mentor Graphics

2 1