April 2011 - Xymon - Xymon mailman web

conn stopped reporting (PURPLE)
by jkokino＠gmail.com 07 Apr '11

07 Apr '11

Hello And thank you all very much in advance for taking the time to read it :) I have XYMON 4.2.3 on Fedora 10 - its a vmware virtual machine. XYMON is in /usr/lib/xymonuser/server I get these kind of emails "Hobbit [232357] HOSTNAME:conn stopped reporting (PURPLE)" For a 2nd day now. I cannot determine a pattern and frequency yet, nor time-wise nor hostname-wise What happened? - I ran out of space. And then it turns out I ran out of inodes. What I did: 1. cd /var/log/ tar -zcvf xymon_logs_2011-april.tar.gz xymon cd xymon I deleted *.log files 2. I deleted the largest messages log file from Fedora, it was 2.1 GB. 3. inodes, full, df -i In my case: The directory /usr/lib/xymonuser/data/histlogs/ keeps huge amount of historical data about each hobbit client. I made tar.gz of everything in histlogs. I then did rm -rf for everything inside histlogs. Now 66% of inodes are free and I have ~6GB free disk space. All works fine except that I get "conn stopped reporting (PURPLE)". 4. To resolve "conn stopped reporting (PURPLE)" a. Stopped xymon b. Backup of "/usr/lib/xymonuser/server/tmp/" c. Delete all in "/usr/lib/xymonuser/server/tmp/" d. Restart fedora 10 f. Start xymon. Works all ok. d. I still get the emails :( I searched Internet and didnt anything else, apart from this: http://lists.xymon.com/archive/2008-February/017868.html - there are few posts like these, I am not sure how this is relevant to my case. sendmail queue is empty. Maybe all these messages are being generated because for a while it was not working, between steps 2 and 3 - I didnt figure out immediately that I am out of inodes. So xymon was mostly purple for many hosts and services. Thank you very much again Henrik - Thanks for this tool Take care all Thanks! Peto

2 3

update2: configure fails at RRD link
by tm＠freedom.com 07 Apr '11

07 Apr '11

sorry -- sent the wrong link: http://lists.xymon.com/oldarchive/2009/10/msg00143.html first error is : test-rrd.c:30: error: too few arguments to function 'rrd_graph' ________________________________________ From: Tim McCloskey Sent: Thursday, April 07, 2011 3:52 PM To: Lynn Osburn; xymon at xymon.com Subject: RE: update2: configure fails at RRD link Not really an answer to the link failure, but see http://lists.xymon.com/oldarchive/2008/08/msg00384.html. I remember having strange rrd build issues on some non xymon projects in the past but I don't have the specifics in front of me. Is xymon shipping with RRDtool these days? ________________________________________ From: xymon-bounces at xymon.com [xymon-bounces at xymon.com] On Behalf Of Lynn Osburn [losburn at thepinnaclegroup.com] Sent: Thursday, April 07, 2011 3:45 PM To: xymon at xymon.com Subject: [Xymon] update2: configure fails at RRD link librrd.so seems to be where the call to libz.so comes from # ldd /usr/local/rrdtool/lib/librrd.so|grep libz libz.so => /usr/local/lib/hpux32/libz.so libz.so => /usr/local/lib/hpux32/libz.so But again, given that path, it surely is odd that it can't find libz.so -----Original Message----- Update: It looks like the issue is Can't find dependent library "libz.so" That's odd, given the LD_LIBRARY_PATH includes it #ll /usr/local/lib/hpux32/libz.so -rwxr-xr-x 1 root 1307 275176 Apr 20 2010 /usr/local/lib/hpux32/libz.so Any ideas, folks? Thanks, -Lynn -----Original Message----- Installed RRD 1.4.5 with all prereqs on HPUX 11.31 RRD examples (in /usr/local/rrdtool/share/rrdtool/examples) all worked great to verify RRD install This being HP-UX, you'll also want to know the LD_LIBRARY_PATH LD_LIBRARY_PATH=/usr/local/lib:/usr/local/lib/hpux32:/usr/lib:/usr/local/rrdtool/lib and yes, using gmake and gcc However, when I start the xymon configure.server script, I get the following error: Checking for RRDtool ... test-rrd.c: In function 'main': test-rrd.c:30: error: too few arguments to function 'rrd_graph' gmake: *** [test-compile] Error 1 Not RRDtool 1.0.x, checking for 1.2.x Found RRDtool include files in /usr/local/rrdtool/include ERROR: RRDtool library files found in /usr/local/rrdtool/lib, but link fails. The error comes from xymon-4.3.2/build/Makefile.test-rrd test-link: @$(CC) $(CFLAGS) $(RRDDEF) $(RRDLIB) -o test-rrd test-rrd.o -lrrd $(PNGLIB) Any thoughts on how to determine more specifically why the link fails? _______________________________________________ Xymon mailing list Xymon at xymon.com http://lists.xymon.com/mailman/listinfo/xymon _______________________________________________ Xymon mailing list Xymon at xymon.com http://lists.xymon.com/mailman/listinfo/xymon

2 1

Xymon, external script question
by Phil.Crooker＠orix.com.au 07 Apr '11

07 Apr '11

Even better. Thanks, David. What a tool xymon is. I'm so impressed. P >>> David Baldwin 04/07/11 3:00 PM >>> Phil, > Hi Taylor, > > I'm new at xymon and am also looking at using the client data. > > I found the xymon command itself lets you query current status: > > # /usr/local/xymon/server/bin/xymon 127.0.0.1 "xymondlog > hostname.domain.com.memory" > > hostname.domain.com|memory|green||1301551188|1302151594|1302153394|0|0|10.10.10.1|-1|||Y| > green Thu Apr 7 14:46:28 EST 2011 - Memory OK > Memory Used Total Percentage > &green Physical 9905M 11881M 83% > &green Actual 514M 11881M 4% > &green Swap 0M 10239M 0% > > The above was run on the xymon server, hence the localhost address. It > appears to display the current service status page (on the webserver) in > text. So it would be pretty easy to parse out the physical memory and > compare that with a value you set in the script itself. > That gets you the status page which is what the server creates after it's processed the client message it receives. You can get the client section directly doing: # /usr/local/xymon/server/bin/xymon 127.0.0.1 "clientlog hostname.domain.com section=memory" [memory] memory Total Used physical: 2047 1020 virtual: 2046 890 page: 3948 1731 David. > cheers. > > > > >>>> On 4/7/2011 at 3:58 AM, in message > <2CB6F3BD6F4BE04EA34D80E087163D35E6073BB7 at tbmail01.tradebot.com>, > Taylor Lewick > wrote: >> Hi all, we manage several hundred hosts, and we've noticed when doing >> maintenance that requires shutdown/reboot that occasionally (seldom) > on >> restart one or more of the memory modules in a given host isn't > detected. >> Sometimes it requires reseating the memory, sometimes just a reboot, >> sometimes the memory is bad. Thus we have a need to write a script > that will >> check the amount of memory each host sees, and send an email/alert if > its >> below a given amount. >> >> So I thought why not make use of xymon and the memory test you get > for free. >> A large percentage of our hosts >60% have exactly 6 GB of memory, > but a large >> percentage does not. So I was wondering if there is a way to make > use of the >> hobbit-clients.cfg script where I could set alert thresholds for a > new >> external script. >> >> The default value for any host would be alert if less than 6.0 GB of > memory >> is detected, but I could set custom alerts for given hosts that have > more or >> less than this amount. >> >> I don't believe its possible to use hobbit-client.cfg file in this > way, but >> wanted to check with the list and hope I'm wrong. >> >> Thanks, >> Taylor > _______________________________________________ > Xymon mailing list > Xymon at xymon.com > http://lists.xymon.com/mailman/listinfo/xymon -- David Baldwin - IT Unit Australian Sports Commission www.ausport.gov.au Tel 02 62147830 Fax 02 62141830 PO Box 176 Belconnen ACT 2616 david.baldwin at ausport.gov.au Leverrier Street Bruce ACT 2617 ------------------------------------------------------------------------------------- Keep up to date with what's happening in Australian sport visit http://www.ausport.gov.au This message is intended for the addressee named and may contain confidential and privileged information. If you are not the intended recipient please note that any form of distribution, copying or use of this communication or the information in it is strictly prohibited and may be unlawful. If you receive this message in error, please delete it and notify the sender. -------------------------------------------------------------------------------------

1 0

core dump, Xymon 4.3.2, loadalerts.c:308, i686 Linux RedHat 5
by david.gore＠verizonbusiness.com 07 Apr '11

07 Apr '11

[xymon at xymon1 tmp]$ file core.30776 core.30776: ELF 32-bit LSB core file Intel 80386, version 1 (SYSV), SVR4-style, from 'xymond_alert' [xymon at xymon1 tmp]$ gdb ../bin/xymond_alert core.30776 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /home/xymon/server/bin/xymond_alert...done. Reading symbols from /lib/libpcre.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpcre.so.0 Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/ld-linux.so.2 Core was generated by `xymond_alert --checkpoint-file=/home/xymon/server/tmp/alert.chk --checkpoint-in'. Program terminated with signal 6, Aborted. #0 0x00485402 in __kernel_vsyscall () (gdb) bt #0 0x00485402 in __kernel_vsyscall () #1 0x0066bdf0 in raise () from /lib/libc.so.6 #2 0x0066d701 in abort () from /lib/libc.so.6 #3 0x0805ee13 in sigsegv_handler (signum=11) at sig.c:57 #4 <signal handler called> #5 0x006b2eca in strcmp () from /lib/libc.so.6 #6 0x08053e4f in preprocess (buf=<value optimized out>) at loadalerts.c:138 #7 0x08054272 in load_alertconfig (configfn=0x0, defcolors=56, defaultinterval=1800) at loadalerts.c:308 #8 0x0804aafa in main (argc=1918990080, argv=0xbff783a4) at xymond_alert.c:831 (gdb) quit [xymon at xymon1 tmp]$ uname -a Linux xymon1 2.6.18-238.5.1.el5 #1 SMP Mon Feb 21 05:53:18 EST 2011 i686 i686 i386 GNU/Linux [xymon at xymon1 tmp]$ ls -lrt core* -rw------- 1 xymon xymon 4014080 Apr 6 13:58 core.29948 -rw------- 1 xymon xymon 4014080 Apr 6 13:59 core.30244 -rw------- 1 xymon xymon 4014080 Apr 6 14:00 core.30371 -rw------- 1 xymon xymon 3956736 Apr 6 14:01 core.30418 -rw------- 1 xymon xymon 3956736 Apr 6 14:02 core.30432 -rw------- 1 xymon xymon 3956736 Apr 6 14:03 core.30776 Is there an easy way to verify your files in analysis.d when it refers to line numbers in the logs and you use multiple include files? David Gore (v965-3670) Network Management Systems (NMS) IMPACT Transport Team Lead - SCSA, SCNA Page: 1-800-PAG-eMCI pin 1406090 Vnet: 965-3676

2 4

Xymon 4.3.2 released
by henrik＠hswn.dk 07 Apr '11

07 Apr '11

Hi Nick, On Tue, 5 Apr 2011 13:22:21 -0400, Nick Camaldi <willowbrookmagic at hotmail.com> wrote: [...] > I inherited the Xymon Server from a former employee, who was using 4.3.0 > beta2 > he had the installation in /opt/admin/xymon/linux/4.3.0-beta2/ > The questions i have is this, I want to make sure i don't mess this up please post this question to the mailing list - there are a lot more people there who can help with this. I've taken the liberty of cc'ing the mailing list here. My quick answer would be: 0) Use a test system - Virtualbox and VMware Player are free, and let you setup a dedicated system for testing the new Xymon version without having to install new hardware. 1) Install the new Xymon version into a new directory. Dont bother with how the old directory layout was - create a setup that you believe is right. 2) Copy the configuration files over from the old setup. You can see in the docs/Renaming-430.txt directory what the mapping is between the old and the new files. There shouldn't be any config files other than those in the ~hobbit/server/etc/ directory, and perhaps some extensions in ~hobbit/server/ext/ 3) Change a couple of the clients on the servers you monitor so they send data to both the old system and the new test system. Just to make sure that client handling works OK. 4) When you're confident that the new setup works, shutdown the old Hobbit installation, copy the setup from your virtual server over to the production system, and everything should work. Regards, Henrik

2 1

Can you have multiple procs associated to one GROUP?
by greg.shea＠emc.com 07 Apr '11

07 Apr '11

Hi all, Is it possible to have multiple procs associated to one GROUP? In analysis.cfg, example shows: # You can also associate a GROUP id with a rule. The group-id is passed to # the alert module, which can then use it to control who gets an alert when # a failure occurs. E.g. the following associates the "httpd" process check # with the "web" group, and the "sshd" check with the "admins" group: # PROC httpd 5 GROUP=web # PROC sshd 1 GROUP=admins # In the alerts.cfg file, you could then have rules like # GROUP=web # MAIL webmaster at foo.com # GROUP=admins # MAIL root at foo.com is it possible to do: PROC monitor1 GROUP=monwatch PROC monitor2 GROUP=monwatch PROC monitor3 GROUP=monwatch and assign multiple unique procs to the same GROUP? Thanks in advance Greg Shea EMC Corporation

2 1

BBWin centralized support in 4.2?
by shane.presley＠gmail.com 07 Apr '11

07 Apr '11

We have an old version of the server (Hobbit version 4.2.0). Would that support BBWin centralized configuration, or does that require a later Xymon release? Thanks Shane

2 1

recommendation rrdtool version
by bb4＠richter-it.net 07 Apr '11

07 Apr '11

Hi XYmonians, which version of RRDtool is recommended or supported by XYmon version 4.3.2? Regards Torsten

2 1

badTEST question
by bb4＠richter-it.net 07 Apr '11

07 Apr '11

Hi XYmonians, I know I can have the badTEST feature for network tests as ssh or http but is it also possible to have it for the ports test? And if yes, where do I configure this? Regards Torsten

2 1

bbproxy max server
by olivier＠audry.fr 07 Apr '11

07 Apr '11

hello Henrik what do you think about increasing the value of MAX_SERVERS from 3 to 5 in bbproxy.c ? What kind of impact can we expect ? If you don't recommend to increase this can we run chained bbproxy ? Another point about bbproxy. You recommend to do this config : [bbproxy] ENVFILE /opt/hobbit/server/etc/hobbitserver-proxy.cfg CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=IP1,IP2,IP3 --report=$MACHINE.bbproxy --no-daemon --pidfile=$BBSERVERLOGS/bbproxy.pid --listen=IP0 LOGFILE $BBSERVERLOGS/bbproxy.log and not this one : [bbproxy] ENVFILE /opt/hobbit/server/etc/hobbitserver-proxy.cfg CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=127.0.0.1:1985,127.0.0.1:1986,127.0.0.1 --report=$MACHINE.bbproxy --no-daemon --pidfile=$BBSERVERLOGS/bbproxy.pid --listen=IP0:1984 LOGFILE $BBSERVERLOGS/bbproxy.log [bbproxyFORWARDER] ENVFILE /opt/hobbit/server/etc/hobbitserver-proxy.cfg CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=IP1 --no-daemon --pidfile=$BBSERVERLOGS/bbproxyFORWARDER.pid --listen=127.0.0.1:1985 LOGFILE $BBSERVERLOGS/bbproxyFORWARDER.log [bbproxyDEV] ENVFILE /opt/hobbit/server/etc/hobbitserver-proxy.cfg CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=IP2 --no-daemon --pidfile=$BBSERVERLOGS/bbproxyINOFYS.pid --listen=127.0.0.1:1986 LOGFILE $BBSERVERLOGS/bbproxyINFOSYS.log but in the first config when one server is not responding the message are delayed a long time and we got purples. So I put the second one in production. oau

2 1