June 2009 - Xymon - Xymon mailman web

[hobbit] Windows client on BBWIN 0.12 reports panic level disk error
by rob.macgregor＠gmail.com 04 Jun '09

04 Jun '09

I would point out that I'm not your personal support - keep the traffic on the list (as it says in my signature). On Thu, Jun 4, 2009 at 12:59, Meserole, Keith W. <km at keithm.us> wrote: > Thanks Rob, > > That's exactly what I thought but the numbers don't add up... I don't > define drive D values and the default panic level is set at 100mb. Client > data shows the following: Have you considered setting D to be ignored instead? -- Please keep list traffic on the list. Rob MacGregor Whoever fights monsters should see to it that in the process he doesn't become a monster. Friedrich Nietzsche

1 0

[hobbit] [re-post] xymon notifications
by joe＠tmsusa.com 03 Jun '09

03 Jun '09

T.J. Yang wrote: > Hi, joe > > We are running two xymon servers across WAN network also. > Here is a brief description how we did it. > > 1. xymon1 is the primpary one and xymon2 is the standby one which is dumb(not alerting). > 2. all the clients send xymon messags to both xymon1 and xymon2. > 3. on xymon2(standby), > 1. we have a cron entry to sync xymon1 config files every 5 minutes. > 2. there is a xymon2 hertbeat server side external module to check the health of xymon1. > if xymon1 is head or not healthy, this module will enable xymon2 with [bbpage] section enabled. > 3. heartbeat server side module will disable its alerting once xymon1 is back online. > > So we have a semi-auto fail-over architecture. but we need to take the lost of missing metrics information on xymon1 during its' down time. > > keeping two xymon server in sync on same LAN is easy using HA/clustering software. > but keeping two xyomn servers in sync on two WANs far away is not easy. I heard Sun's clustering software has new feature to enable clustering over WANs, but I haven't study this myself. > T.J. - Thanks for you insights. Your setup sounds like an engineering tour de force, but our needs are much simpler than that - no cluster is needed in our environment, the redundant xymon servers are providing all the reliability we need and more. In fact, a cluster would be hard to implement since the corresponding xymon servers are in separate networks, hundreds of miles apart. Our problem with xymon is all the duplicated alerts. If there were some way to get xymon to emulate big brother in this regard it would be ideal. The ideas posted here so far have merit, but I'm still trying to think through all the options to come up with the simplest way to suppress the duplicate alerts without introducing a new single point of failure. Joe

2 2

PROC mincount maxcount default
by bb＠buglecreek.com 03 Jun '09

03 Jun '09

Running Xymon 4.2.3 on RHEL5 and noticed that when listing a process in hobbit-clients.cfg like this: PROC sshd yellow I assumed, based on the man page that the defaults would be mincount 1 and maxcount -1 so the entry would be interpreted as: PROC sshd 1 -1 yellow But on the proc webpage it shows up as: sshd (found 3, req. none) To actually get it to require at least 1, I have to explicitly list the process in hobbit-clients.cfg like this: PROC sshd 1 -1 yellow Is this expected behavior? Maybe I am misinterpreting the man page?

1 0

[hobbit] Problem with external script and RRD-Graphs (xymon_mySQLtests.sh)
by TRBrand＠cvs.com 03 Jun '09

03 Jun '09

Cayo, Sorry it took so long to get back to you... I had to 'cleanup' some of the non-public code in the script and I added installation documentation... The attached script was originally based on bb-mysql.sh <http://www.deadcat.net/viewfile.php?fileid=29> but has been heavily modified for my environment. YMMV... ALso, I noticed that I had missed the following in the earlier reply: hobbitserver.cfg: Add ",mysql=ncv" to the TEST2RRD= line, eg: TEST2RRD="cpu=la,disk, ...,clock,lines,mysql=ncv" Please let me know of any improvements to the code or to the documentation. Thanks, Tom Tom Brand CVS/pharmacy IS Rx SysAdmin Store Support

1 0

zonestat.sh
by kkelly＠lifetouch.com 03 Jun '09

03 Jun '09

Can't get anything to show up on the server side. I have looked on the client side and it appears to be running. There are files in /opt/hobbit/tmp with the name of hobbit_zonestat.vuglzn04.(pid#) Nothing in the client logs showing any error. On the server side there is no data in /apps/xymon/data/rrd/(servername). Nothing in the logs. The hobbit_rrd appears to be running. Kevin Kelly Unix Administrator Lifetouch Inc 952-826-4192w 612-817-3049c ______________________________________________________________________ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email ______________________________________________________________________

2 2

xymon 4.2.3 & bb-hosts issue
by jkokino＠gmail.com 03 Jun '09

03 Jun '09

As expected - trivial, have forgotten to edit/change the IP address in hobbitserver.cfg, BBSERVERIP which is configured during configure, prior compiling xymon 4.2.3 On Sat, May 30, 2009 at 11:14 PM, Darko Jr. Gonzalez <jkokino at gmail.com>wrote: > Hello! > > I have one issue, it could be that is rather very simple, but I am not sure > where to look, so I would appreciate a hint, where to start to look for. > Someone may eventually experienced this, which is very likely :) > > I have Xymon 4.2.3 on Fedore 10. Fedora 10 is a guest OS in VMWare virtual > machine. It worked all fine. Now I moved the VMWare Fedore 10 guest image to > a different computer, in a different subnet. Now all I get read from the > bb-hosts file are the page labels defined over there. I get no devices, nor > I get the default SKXYMON device on the homepage. I changed the address of > the guest os, on a network level (ping, trace and etc) - everything is > working, I changed the IP of SKXYMON entry in bb-hosts, still it looks to me > that the hobbit process is not fetching the data that are sent to this > process. Or it fetches, but bb-hosts file for some reason is not read > properly? > > Do I have to configure xymon again, then recompile it? > (I saved bb-hosts file in my ~ folder). > > Thanks > > > /JD >

1 0

client/ext yum update notifier extension script
by s.seitz＠netz-haut.de 03 Jun '09

03 Jun '09

Hi there, I'm currently using hobbit/xymon to monitor our hostmachines. Most of them are Ubuntu/Debian. The debian guys wrote an extension (hobbit-plugins, /usr/lib/hobbit/client/ext/apt) to get informed about the availability of updates/security-updates via apt. As we're going to setup some new Machines with CentOS, I'ld like to ask if someone already did a similar extension script for yum/rpm? Cheers, Stephan -- Stephan Seitz Senior System Administrator *netz-haut* e.K. multimediale kommunikation zweierweg 22 97074 würzburg fon: +49 931 2876247 fax: +49 931 2876248 web: www.netz-haut.de <http://www.netz-haut.de/> registriergericht: amtsgericht würzburg, hra 5054

3 2

Xymon 4.2.3 rrd-data.log shows xstrdup: Cannot dup NULL string
by peter.welter＠gmail.com 03 Jun '09

03 Jun '09

Here I am with some new data, because the problem still exists. I know that the rrd-data-daemon crashes with the "xstrdup: Cannot dup NULL string" error. I have setup netapp.pl with $Hobbit_fd_lib::debug = 2; and fount that the systat output is different; don't know if it is the real cause of the crash...?! orwell:/usr/lib/hobbit/server/ext # cat /var/lib/hobbit/tmp/netapp.sysstat.DEBUG.camelot CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk FCP iSCSI FCP kB/s iSCSI kB/s in out read write read write age hit time ty util in out in out 29% 0 7976 0 7976 3147 5098 3872 3104 0 0 3 96% 12% T 8% 0 0 0 0 0 0 orwell:/usr/lib/hobbit/server/ext # cat /var/lib/hobbit/tmp/netapp.sysstat.DEBUG.noah CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk FCP iSCSI FCP kB/s in out read write read write age hit time ty util in out 8% 0 0 0 0 1 6 986 1988 0 0 >60 100% 13% T 9% 0 0 0 0 The other files (/var/lib/hobbit/tmp/netapp.xtstats.DEBUG.camelot) also show a change of output. The current beginning was previously the ending of the output file. So now it begins with : system:system:nfs_ops:3190/s system:system:cifs_ops:0/s system:system:http_ops:0/s system:system:fcp_ops:0/s system:system:iscsi_ops:0/s system:system:read_ops:619/s system:system:write_ops:144/s system:system:net_data_recv:4187KB/s system:system:net_data_sent:23328KB/s system:system:disk_data_read:5493KB/s system:system:disk_data_written:6156KB/s system:system:cpu_busy:10% system:system:avg_processor_busy:10% system:system:total_processor_busy:20% system:system:num_processors:2 system:system:time:1244021254s system:system:uptime:1048085s disk:2000001D:38B5ED6F:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000:total_transfers:8/s disk:2000001D:38B5ED6F:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000:user_read_chain:3.60 Were from our pre-7.3.1.1 filers, the output is: ..... disk:6BE7CF95:56AFA883:F30CAEF5:83103FAC:00000000:00000000:00000000:00000000:00000000:00000000:guarenteed_read_latency:0us disk:6BE7CF95:56AFA883:F30CAEF5:83103FAC:00000000:00000000:00000000:00000000:00000000:00000000:guarenteed_read_blocks:0/s disk:6BE7CF95:56AFA883:F30CAEF5:83103FAC:00000000:00000000:00000000:00000000:00000000:00000000:guarenteed_write_latency:0us disk:6BE7CF95:56AFA883:F30CAEF5:83103FAC:00000000:00000000:00000000:00000000:00000000:00000000:guarenteed_write_blocks:0/s disk:6BE7CF95:56AFA883:F30CAEF5:83103FAC:00000000:00000000:00000000:00000000:00000000:00000000:disk_busy:0% system:system:nfs_ops:0/s system:system:cifs_ops:0/s system:system:http_ops:0/s system:system:dafs_ops:0/s system:system:fcp_ops:0/s system:system:iscsi_ops:0/s system:system:net_data_recv:13KB/s system:system:net_data_sent:47KB/s system:system:disk_data_read:986KB/s system:system:disk_data_written:1988KB/s system:system:cpu_busy:8% system:system:avg_processor_busy:5% system:system:total_processor_busy:10% system:system:num_processors:2 system:system:time:1244021255s system:system:uptime:7436873s 2009/5/30 Peter Welter <peter.welter at gmail.com>: > Addendum: > Turning off 'netapp.pl' to all filers and selectively turning it on > again, it appears that there are no problems with On Tap 7.2.3 and > 7.2.4. The error does not show up and all trending (also for other > data-dependant trending) show no holes anymore. > > But these 7.3.1.1-filers are very important, so I have to turn the > monitoring on again on this NetApp-cluster. Will see if debugging the > perl script will give more relevant data. > > 2009/5/29 Peter Welter <peter.welter at gmail.com>: >> Hello all, >> >> Last friday may 22 at 8:20 we finished our upgrade from our >> NetApp-filers (version 7.2.3 to 7.3.1.1). These filers were (and are) >> monitored by Xymon in combination with the perl-netapp-client. >> Combined a great combo! >> >> However, since the upgrade I keep getting this error in >> /var/log/hobbit/rrd-data.log: >> ... >> 2009-05-22 08:22:00 xstrdup: Cannot dup NULL string >> 2009-05-22 08:22:00 Worker process died with exit code 6, terminating >> .... >> >> This error appears every 5 minutes. >> >> Only one graph-type is not trended anymore since the upgrade, the >> xtstatscolumn which deliver all statistics about each drive in the >> filer. (About +/- 20 graphs). Sometimes, it does trend some data but >> that is for a very short time, let's say 5 or 15 minutes. Then for >> hours, nothing. >> >> One filer has not been upgraded, but shows the same lack of trending. >> But that can be caused because I have set it up with MultiThreading >> (something that can be set using a parameter). >> >> Now I will change this to 1 (for each filer a seperate process) to see >> if the problem can be narrowed, so I'll update this problem later on >> this weekend. >> >> Regards, >> Peter >> >> PS I do not know if this has to do with either Xymon of netapp.pl, but >> since it is integrated into the Xymon-source (hobbitd/rrd/do_netapp.c) >> I think it should be posted here. >> >

1 0

Can't get msgs test to work with client in local mode
by markxr＠gmail.com 03 Jun '09

03 Jun '09

Hiya, I'm trying to get the msgs test to work with Hobbit (xymon 4.2.3) in local mode. I've got the following in my clientlaunch.cfg # The main client task [client] ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg CMD $HOBBITCLIENTHOME/bin/hobbitclient.sh --local LOGFILE $HOBBITCLIENTHOME/logs/hobbitclient.log INTERVAL 5m Which is supposed to run the client with --local mode. Other tests work. Hobbit reports the status as "clear" with the message "The client did not report any logfile data" no matter what is in /var/log/messages. I've got LOG /var/log/messages %error|ERROR In etc/localclient.cfg Other directives in localclient.cfg (for example PROC, or PORT) are respected and appear to work as documented. I think I've tracked down the problem to the $LOGFETCHCFG file never getting created. I don't quite understand the code, but I think it's supposed to fetch some config from the server into a file in =$BBTMP/logfetch.$MACHINEDOTS.cfg, which never gets created. This file is never created despite the server having the following in client-local.cfg: [linux] log:/var/log/messages:10240 ignore MARK The system is identifying itself as "linux". Any ideas? Regards Mark

1 0

[hobbit] Problem with external script and RRD-Graphs
by camorae＠googlemail.com 03 Jun '09

03 Jun '09

Hi Tom Brand, can you please send me your mysqlstat script? I realy need to fix this issue as fast as possible... til now I couldnt solve this. I hope with your script I can make it work.** TIA, Cayo de Moraes 2009/5/27 Brand, Thomas R. <TRBrand at cvs.com> > > After editing the hobbitserver.cfg and hobbitgraph.cfg i had some > confrontations with: > > > > how should i configure the parameters of the hobbitserver.cfg and > hobbitgraph.cfg if i want 3 diferent > > > graphs in one page, when the graph name has to be the same as the column > name? > > > > when trying to get the only graph into the browser i get only an 1x1 > Pixel graph... > > > > I can’t help with the multiple graphs on one page; I have mine set up for > one graph on the page. > > > > If you’re intererested, I can send you my version of bb-mysqlstat.sh > (heavily modified from the one available on Deadcat.net …. ) > > > > Here are the relevant parts from hobbitserver.cfg: > > > > > NCV_mysql="Threads:GAUGE,SlowQueries:GAUGE,OpenTables:GAUGE,FlushTables:NONE,Questions:NONE,Opens:NONE,AvgQuerysPerSecond:NONE,Uptime:NONE,FreeBufferPool:NONE" > > > > > GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql" > > > > > > Here is the stanza from my hobbitgraph.cfg for the mysql graphs: > > [mysql] > > TITLE MySQL Statistics > > YAXIS Number of > > DEF:threads=mysql.rrd:Threads:AVERAGE > > DEF:slow=mysql.rrd:SlowQueries:AVERAGE > > DEF:opentables=mysql.rrd:OpenTables:AVERAGE > > LINE2:threads#FF0000:Threads > > LINE2:slow#00CCCC:Slow Queries > > LINE2:opentables#FF00FF:Open Tables > > COMMENT:\n > > GPRINT:threads:LAST:Threads \: %5.1lf (cur) > > GPRINT:threads:MAX: \: %5.1lf (max) > > GPRINT:threads:MIN: \: %5.1lf (min) > > GPRINT:threads:AVERAGE: \: %5.1lf (avg)\n > > GPRINT:slow:LAST:Slow Queries\: %5.1lf (cur) > > GPRINT:slow:MAX: \: %5.1lf (max) > > GPRINT:slow:MIN: \: %5.1lf (min) > > GPRINT:slow:AVERAGE: \: %5.1lf (avg)\n > > GPRINT:opentables:LAST:Open Tables \: %5.1lf (cur) > > GPRINT:opentables:MAX: \: %5.1lf (max) > > GPRINT:opentables:MIN: \: %5.1lf (min) > > GPRINT:opentables:AVERAGE: \: %5.1lf (avg)\n > > > > > > The client side extension script sends up the information which is then > displayed as: > *Wed May 27 10:12:53 EDT 2009 - mySQL is OK* > > Threads : 10 > > Slow Queries : 1 > > Open Tables : 89 > > Flush Tables : 1 > > Questions : 83279 > > Opens : 94 > > AvgQuerysPerSecond : 2.455 > > Uptime : 33923 > > Free Buffer Pool : 62 > > > > > > > > > > Hope this helps, > > *Tom Brand* > > *CVS/pharmacy* > > *IS Rx SysAdmin Store Support* > > > ------------------------------ > > *From:* Cayo de Moraes [mailto:camorae at googlemail.com] > *Sent:* Wednesday, May 27, 2009 5:06 AM > *To:* hobbit at hswn.dk > *Subject:* [hobbit] Problem with external script and RRD-Graphs > > > > Hi guys, > > > im trying to monitor some mysql performances like slowqueries, threads, > queries per second, etc. trought an external script. So far i get all > results from the client (Big Brother-Client) unless the graphs. Using big > brother (server) i get 3 graphs (slowqueries, threads and queries per > second) but after migrating BB to Hobbit i cant get any graph anymore. I > already did all steps from "How to setup custom graphs" but its not working. > > Did i forget something / did something wrong or is it with the BB-Client > not possible? > > > > After editing the hobbitserver.cfg and hobbitgraph.cfg i had some > confrontations with: > > how should i configure the parameters of the hobbitserver.cfg and > hobbitgraph.cfg if i want 3 diferent graphs in one page, when the graph name > has to be the same as the column name? > > when trying to get the only graph into the browser i get only an 1x1 Pixel > graph... > > has anybody any idea?? > > TIA >

1 1