August 2006 - Xymon - Xymon mailman web

New version of beastat.pl netapp.pl and dbcheck.pl
by fduranti＠q8.it 24 Aug '06

24 Aug '06

Hi all... Those are just released on sourceforge at http://sourceforge.net/projects/hobbit-perl-cl/ Those are the Changelog: Beastat.pl v1.02 ---------------- 1.00 - Initial Release 1.01 - Display timing information at the bottom of the test - Updated some check for environment variable and put a defbbvar in the perl file for the default BBVAR directory. - $debug=1 will not report all the message to the standard output. If you want the entire content of message while debugging use $debug=2 - Changed the location of .cfg and .key file. Now they go in a directory called "beastat.pw" into the etc directory. You have to manually move the files into that directory if you are using the encrypted authentication. - Added an option to change the domain part of the name reported to bb/hobbit during the configuration(see README). - Change the Multithreading code. MultiThread = 0 (sequential run), = 1 (run as much process as the number of wls domains to test and wait the for the last one to exit), = n (with n>1, run a maximum of n different thread in parallel) 1.02 - Changed the check of TEST in bb-hosts to open the file for BB standard client instead of using a grep that could not workwith some OS. - Changed how data are read from the java client to understand better multiline on some errors or fields - Changed "<text>" into the message read from the java client into "-text-" because they'll not displayed by hobbit - Solved a bug with Attribute checking that was reporting errors in some conditions on the Health field - Changed the code to reformat data with word wrap using Text::Wrap - Added a "---- Full Status Report ----" line before reporting full data (useful to get data and report them in rrd files) - Added a flag to beastat.pl to choose between using bbhostgrep (preferred) or reading directly the bb-hosts file. - Corrected some bugs related to the "notest" setting for single tests - Added the possibility to include files in the configuration with a include parameters in the ini file (more info in the beastat.ini file) Netapp.pl v1.05 --------------- - Initial Release 1.00 - Corrected the launch of the bbhostgrep or grep command (bbhostgrep was always launched) - Check for the rsh command to work on the filer (return clear tests if it don't work) - Report Filer version in cpu column 1.01 - Corrected various condition where the script will exit without examining other hosts (if one host is down and after reporting error on the first host in not MULTITHREADING running) - Added graphs for temperature from environment in a separate column - Corrected the false reporting of "information condition" as error in the environment - Changed the quotas report to report volume directory on the left side and users on the right side. - Don't execute snap delta on data ontap version < 7.0 - If we are running Hobbit execute it with "bb hostname @" passing all data via stdin - Corrected a bug reporting data for CIFS with data ontap version < 7.0 - Changed some logic in the snapshot/inode/disk check and corrected some reporting bugs - Added default in the perl code to prevent errors for new columns added without change to the config file - Added check to sysconfig report for: spare disks not zeroed, no spare disk available, disk in prefail - state, disk failed (sysconfig -r and sysconfig -d), misconfiguration (sysreport -c) - Some bug fix on various functions 1.02 - Added check for snapmirror volume state 1.03 - Display timing information at the bottom of the test - Updated some check for environment variable and put a defbbvar in the perl file for the default BBVAR directory. - $debug=1 will not report all the message to the standard output. If you want the entire content of message while debugging use $debug=2 - Renamed the default configuration file from filerstats2bb.ini to netapp.ini you need to manually rename it before launching the new version of netapp.pl script - Change the Multithreading code. MultiThread = 0 (sequential run), = 1 (run as much process as the number of filers to test and wait the for the last one to exit), = n (with n>1, run a maximum of n different thread in parallel) 1.04 - netapp.ini file was missing from the distribution 1.05 - Changed the check of TEST in bb-hosts to open the file for BB standard client instead of using a grep that could not work with some OS. - Added a flag to netapp.pl to choose between using bbhostgrep (preferred) or reading directly the bb-hosts file. - Change to disk/inode/snapshot/qtree check to accept absolute free diskspace/free inode number instead of the % used. Check the netapp.ini file for instruction - Change to statistics check (sometimes they got errors if the command could not finish correctly) - Added a check for duplicate quota entry - Corrected some problems with environment check and SATA shelf reported as errors - Corrected some bugs related to the "notest" setting for single tests - Added the possibility to include files in the configuration with a include parameters in the ini file (more info in the netapp.ini file) Dbcheck.pl v1.03 ---------------- 1.00 - Initial Release 1.01 - Corrected a condition when if the dbtype was not defined the program will exit without further tests - The rollback check are now performed normally - Corrected a problem with Oracle rowcache reporting - Display timing information at the bottom of the test 1.02 - Updated some check for environment variable and put a defbbvar in the perl file for the default BBVAR directory. - Updated the extent check. I was using the wrong column name so the check was wrong. - $debug=1 will not report all the message to the standard output. If you want the entire content of message while debugging use $debug=2 - Change the Multithreading code. MultiThread = 0 (sequential run), = 1 (run as much process as the number of database to test and wait the for the last one to exit), = n (with n>1, run a maximum of n different thread in parallel) 1.03 - Changed the check of TEST in bb-hosts to open the file for BB standard client instead of using a grep that could not workwith some OS. - Added a flag to dbcheck.pl to choose between using bbhostgrep (preferred) or reading directly the bb-hosts file. - Lock check is now using gv$ tables to comply with RAC check - Change to invalid object check: there are now 2 parameters, invobjwarn and invobjignore. Those ara a list of ";" separated list of "type:user:object" to check. If the object are matched by invobjwarn they're reported as yellow warning, if they're matched by invobjignore they're reported as green. - Change to Tablespace check and parameters to accept absolute value (followed by k/m/g/t) instead of the % used. Check thedbcheck.ini file for instructions - Added the possibility to send all data regarding an instance in a single column instead of multiple column or to send thesingle and the multiple check. Check the dbcheck.ini file for instructions - Add of Request Failed and Last Request Failed Size to the data reported via MemReq - Add a parameters in the ini file to check GV$ tables for RAC instead of V$ tables to get data about locks, processes and sessions. Check dbcheck.ini and README for more information about RAC check. - Added some delay to medium (20 seconds) and slow (40 seconds) check before running them to avoid double data reporting tohobbit for rrd complaining about double data reporting. - Added a detail regarding SessionID and Object Locked in the locks check for Oracle - Corrected some bugs related to the "notest" setting for single tests - Added the possibility to include files in the configuration with a include parameters in the ini file (more info in the dbcheck.ini file) - Added lifetime of test in the last line of test output Francesco

3 2

hobbit 4.2.0 + a few patches
by Mike.Rowell＠Rightmove.co.uk 24 Aug '06

24 Aug '06

This is a new build on a fresh machine, being a Solaris 10 x86 (06/06) build. Every hour or so we see bbgen go yellow with status-board not available errors, I've run bbgen in -debug but the only error I'm seeing is the one reported, here is an excerpt of the debug log. 2006-08-23 18:47:16 load_state() 2006-08-23 18:47:16 Transport setup is: 2006-08-23 18:47:16 bbdportnumber = 1984 2006-08-23 18:47:16 bbdispproxyhost = NONE 2006-08-23 18:47:16 bbdispproxyport = 0 2006-08-23 18:47:16 Recipient listed as 'x.x.x.x' 2006-08-23 18:47:16 Standard BB protocol on port 1984 2006-08-23 18:47:16 Will connect to address 'x.x.x.x' port 1984 2006-08-23 18:47:16 Connect status is 0 2006-08-23 18:47:16 Sent 126 bytes 2006-08-23 18:47:16 Closing connection 2006-08-23 18:47:16 hobbitd status-board not available Page: , color=0, oldage=1, title=, pretitle=(NULL) Group: H1, pretitle: '(NULL)' Host: hobbit, ip: x.x.x.x, name: hobbit, color: 0, old: 1, anywaps: 0, wapcolor: -1 , pretitle: '(NULL)', noprop-y: ,hobbitd,, noprop-r: ,hobbitd,, noprop-p: (NULL), noprop-ack: (NULL) , waps: (NULL) I'm sort of stuck now, I've been debugging this for the last day and a bit whilst doing other things but can't really figure out where the problem is. Regards, Mike Rowell# ________________________________________________________________________ This email has been scanned for all viruses by the MessageLabs service. ________________________________________________________________________

2 2

nstab.html
by bb4＠richter-it.net 24 Aug '06

24 Aug '06

Hi Henrik, I was just playing around with the sidebar and ran into a problem. The source code of the nstab.html created by Hobbit 4.2 is this: ---------------------<SNIP>--------------------- <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML> <HEAD> <TITLE>Hobbit Alerts</TITLE> <META NAME="Generator" CONTENT="bbgen - generator for Hobbit"> <META HTTP-EQUIV="Refresh" CONTENT="60; URL=http://www.myserver.de/bb/nstab.html"> </HEAD> <BODY> <FONT SIZE="-2">Last updated:<BR>Thu Aug 24 09:12:10 2006<BR></FONT> <UL> <LI> <A TARGET="_content" HREF="/bb/hobbit-cgi/bb-hostsvc.sh?HOST=server1&SERVICE=sslcert"server1 (sslcert)></A> </LI> </UL> </BODY> </HTML> ---------------------<SNAP>--------------------- On the page I only can see the "Last updated: ..." and the dot for the list. But the link to the "HOST.SERVICE" combination is missing. IMHO the html code should read .... SERVICE=sslcert"server1 (sslcert)>server1 (sslcert)</A> instead of .... SERVICE=sslcert"server1 (sslcert)></A> Could this be a bug or did I something wrong with the configuration? Best regards Torsten

1 0

msgcache is unstable
by rolf.masfelder＠nector.de 24 Aug '06

24 Aug '06

hello, i'm running msgcache on a remote machine. For some houres it works fine, but at some point it stopps working. Here is a part of msgcache.log (msgcache is running with --debug) ... (houres of correkt processing) 2006-08-22 15:11:02 New connection 2006-08-22 15:11:02 -> oksender 2006-08-22 15:11:02 <- oksender(1-a) 2006-08-22 15:11:02 Got pullclient request: pullclient 1 log:/var/log/messages:10240 ignore MARK 2006-08-22 15:11:02 Saved client response: log:/var/log/messages:10240 ignore MARK 2006-08-22 15:12:13 New connection 2006-08-22 15:13:36 New connection 2006-08-22 15:13:37 -> oksender 2006-08-22 15:13:37 <- oksender(1-a) 2006-08-22 15:13:37 Got pullclient request: pullclient 1 log:/var/log/messages:10240 ignore MARK 2006-08-22 15:13:37 Saved client response: log:/var/log/messages:10240 ignore MARK 2006-08-22 15:13:43 New connection 2006-08-22 15:13:53 New connection 2006-08-22 15:16:13 New connection 2006-08-22 15:18:44 New connection 2006-08-22 15:19:00 New connection 2006-08-22 15:21:21 New connection 2006-08-22 15:23:44 New connection 2006-08-22 15:24:19 New connection 2006-08-22 15:27:34 New connection 2006-08-22 15:28:45 New connection ... it stopped sending results to the (polling) hobbit-server Some ideas? What can i do to get addtionel info's ? greetings (Great work henrik) -- Rolf Masfelder Tel.: 06321 355 207 FAX: 06321 355 224 Mobil: 0160 80 64 181 world: 0700 NECTORGMbh EMail: rolf.masfelder at nector.de http://www.nector.de

2 3

[hobbit] Setting client "class" for log file monitoring
by fduranti＠q8.it 23 Aug '06

23 Aug '06

Hi, i continue to have a problem with the class ... I've a class defined in the clientlocal.cfg that check for 2 files. [servcluster] log:/var/log/messages:10240 ignore MARK file:/prodQ8/appl/mounted file:/collQ8/appl/mounted clientversion:rhel3_2cpu_drbd I've 2 server defined in the bb-hosts that are the same and where the first file exists and the second one don't exist.. group-compress Internal Cluster 0.0.0.0 itromlx101 # ntpd ntp ssh !telnet vnc1 CLASS:servcluster 0.0.0.0 itromlx102 # ntpd ntp ssh !telnet vnc1 CLASS:servcluster And until here all is working... The file will be checked by the hobbit-client and the result will go to the server. Then I have this in the hobbit-clients.cfg HOST=itromlx102 FILE /prodQ8/appl/mounted red FILE /collQ8/appl/mounted yellow CLASS=servcluster FILE /prodQ8/appl/mounted red FILE /collQ8/appl/mounted yellow The CLASS directive here is completely ignored... The test is reported yellow on itromlx102 (as per HOST definition) but green on itromlx101. Going to itromlx101 in the file:/collQ8/appl/mounted i get [file:/collQ8/appl/mounted] ERROR: No such file or directory So the file don't exists but it's reported green Running hobbitd_client --debug --dump-config I get FILE /prodQ8/appl/mounted red CLASS=servcluster (line: 191) FILE /collQ8/appl/mounted yellow CLASS=servcluster (line: 192) I've tried to add --debug to the hobbitd_client but it seems that nothing regarding file check is in the clientdata.log ... Am i doing something wrong with class ? > -----Original Message----- > From: Henrik Stoerner [mailto:henrik at hswn.dk] > Sent: Wednesday, August 23, 2006 10:41 PM > To: hobbit at hswn.dk > Subject: Re: [hobbit] Setting client "class" for log file monitoring > > On Wed, Aug 23, 2006 at 01:05:25PM -0700, Bob Gordon wrote: > > On 8/23/06, Gary B. <gmbfly98 at gmail.com> wrote: > > > > > >> The client by default uses the "uname -s" output, which will be > > >> "linux". If you launch the client with > > >> ~hobbit/client/runclient.sh --os=rhel3 then it will use the > > >> [rhel3] setting. The list --os names is restricted > though, so for a > > >> more generic solution you can define your own "classes" > > >> and run the client with a "--class=MYCLASS" option; then it will > > >> use the [MYCLASS] section. > > > > > >Is there a way to make the "--class=MYCLASS" option permanent when > > >starting a client? That is, do you have to specify > --class everytime > > >you use "runclient.sh", such as stopping, starting, > restarting, etc? > > > > > > > And as a correllary to this, is there any way to set the > class option > > remotely? (I dont have access to several of the systems > the client is > > running on..) > > See the CLASS entry in the bb-hosts(5) man-page. > > > Henrik > > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > > >

1 0

Not seeing custom footer scripts in 4.2.0 -- What'd I do wrong?
by KauffmanT＠nibco.com 23 Aug '06

23 Aug '06

I just get the horizontal rule followed by the 'hobbit 4.2.0' logo in the lower right corner. For grins, I symlinked bb_footer to bulletin_footer -- and now I get *two* horizontal rules, with two logos. This worked in 4.03 and 4.1.2.p1, and I can't remember if I looked at it in the 4.2 alpha series. Tom Kauffman NIBCO, Inc CONFIDENTIALITY NOTICE: This email and any attachments are for the exclusive and confidential use of the intended recipient. If you are not the intended recipient, please do not read, distribute or take action in reliance upon this message. If you have received this in error, please notify us immediately by return email and promptly delete this message and its attachments from your computer system. We do not waive attorney-client or work product privilege by the transmission of this message.

2 1

a tiny logfile problem
by kolbjorn.barmen＠uninett.no 23 Aug '06

23 Aug '06

Due to the nature of the LOG entries in client-local.cfg I keep getting red dots evey now and then. [linux] log:/var/log/messages:10240 ignore MARK The number 10240 is the MAXDATA in bytes that will be cheked. The problem is that this results in uncomplete lines, and hence my IGNORE patterns does not always apply. For instance, on certain machines I log named queries, however I want Hobbit to ignore query errors, so I have a this in hobbit-client.cfg "IGNORE=%(named.*query|floppy|interrupt)" which mostly works. However, every now and then the msgs page for this host shows a "Full log" starting with "med[1327]: client xxx.xxx.xxx.xxx#1057: query: www.errorsafe.com IN A" where "med" is the end of "named" - this ofcourse sneaks past my IGNORE. Would it be possible for the clients to not report on uncomplete lines? I'm tempted to name this a bug, I'm just sorry I didnt catch this before 4.2.0 release, it's just that they pass along quite briefly. Btw.. funny host and domain names with "error" and "warn" and "critical".. :) -- Kolbjørn Barmen UNINETT Driftsenter

3 3

TRACK and graph
by plardinois＠be.tiauto.com 23 Aug '06

23 Aug '06

Hello, In order to show graphs for FILES and PROCS do I have to set anything else than the TRACK tag in hobbit-clients.cfg and the related entry in client-local.cfg ? Here is an example of my conf files : a) hobbit-clients.cfg HOST=machine.client TIME=W:0800:1900 DISK /boot 85 90 PROC cupsd 1 1 yellow "TEXT=cupsd" DIR /var TRACK DIR /tmp TRACK FILE /home/hobbit/thisfilemustnotexist NOEXIST TRACK LOG /var/LOG/messages COLOR=yellow PORT "LOCAL=%([.:]22)$" state=ESTABLISHED min=0 max=3 COLOR=yellow "TEXT=SSH Connections" b) client-local.cfg [machine.client] dir:/var dir:/home/hobbit/data file:/home/hobbit/thisfilemustnotexist log:/var/log/messages:25000 No graphs are displayed when I look for the FILES test... Thanks for your help. Regards, Pierre _____________________________ Pierre Lardinois Int. ICT Infrastructure Team TI Automotive The information contained in this transmission may contain privileged and confidential information. It is intended only for the use of the person(s) named above. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

2 1

TRACK and graph
by plardinois＠be.tiauto.com 23 Aug '06

23 Aug '06

Hello, ooops, I forgot to make the changes in the hobbitserver.cfg as stated in the release notes. :-/ Now the graphes are there.... hobbitserver.cfg ---------------- Several new status columns are being reported by the Hobbit client, and these have associated graphs. In order for them to show up correctly, you must change the two graph-settings: - TEST2RRD: Add ",files,procs=processes,ports,clock,lines" to the current setting. - GRAPHS: Add ",files,processes,ports,ifstat,clock,lines" to the current setting. Sorry for the inconvenience. Regards, Pierre The information contained in this transmission may contain privileged and confidential information. It is intended only for the use of the person(s) named above. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

1 0

shm problems
by D.Mostardi＠mdl.com 23 Aug '06

23 Aug '06

I'm having memory problems when launching Hobbit on Solaris 9. Initially the error in /var/log/hobbit/hobbitlaunch.log is "Could not attach shm Too many open files", and then later becomes "Could not attach shm Permission denied". If I then close all hobbit processes and look at /usr/bin/ipcs I see six shared-memory listings and six semaphore listings. I can clean these out with ipcrm, but then when I restart hobbit the same set of symptoms recur. I have appended some logs below, generated with the hobbitlaunch.cfg --debug switch on. No processes other than hobbitlaunch ever start up, and no log files other than hobbitlaunch.log appear. There are plenty of resources available on the Hobbit server (disk, RAM, swap). Thanks in advance for your consideration, David Mostardi Advisory Systems Manager Elsevier MDL 2440 Camino Ramon, Suite 300 San Ramon CA 94583 925.543.7350 www.mdl.com <www.mdl.com> ------------------------------------------------------ "Could not attach shm Too many open files" 2006-08-22 15:32:38 hobbitlaunch starting 2006-08-22 15:32:38 Loading tasklist configuration from /usr/local/bb/bb1.9i-btf/etc/hobbitlaunch.cfg 2006-08-22 15:32:38 Loading hostnames 2006-08-22 15:32:38 Opening file /usr/local/bb/bb1.9i-btf/etc/bb-hosts 2006-08-22 15:32:38 Opening file /usr/local/bb/bb1.9i-btf/etc/client-local.cfg 2006-08-22 15:32:38 Loading saved state 2006-08-22 15:32:38 Cannot access checkpoint file /usr/local/bb/bb1.9i-btf/tmp/hobbitd.chk for restore 2006-08-22 15:32:38 Setting up network listener on 0.0.0.0:1984 2006-08-22 15:32:38 Setting up signal handlers 2006-08-22 15:32:38 Setting up hobbitd channels 2006-08-22 15:32:38 Setting up status channel (id=1) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',1) 2006-08-22 15:32:38 ftok() returns: 0x1007F5B 2006-08-22 15:32:38 shmget() returns: 0x65 2006-08-22 15:32:38 Setting up stachg channel (id=2) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',2) 2006-08-22 15:32:38 ftok() returns: 0x2007F5B 2006-08-22 15:32:38 shmget() returns: 0x66 2006-08-22 15:32:38 Setting up page channel (id=3) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',3) 2006-08-22 15:32:38 ftok() returns: 0x3007F5B 2006-08-22 15:32:38 shmget() returns: 0x67 2006-08-22 15:32:38 Setting up data channel (id=4) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',4) 2006-08-22 15:32:38 ftok() returns: 0x4007F5B 2006-08-22 15:32:38 shmget() returns: 0x68 2006-08-22 15:32:38 Setting up notes channel (id=5) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',5) 2006-08-22 15:32:38 ftok() returns: 0x5007F5B 2006-08-22 15:32:38 shmget() returns: 0x69 2006-08-22 15:32:38 Setting up enadis channel (id=6) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',6) 2006-08-22 15:32:38 ftok() returns: 0x6007F5B 2006-08-22 15:32:38 shmget() returns: 0x6A 2006-08-22 15:32:38 Setting up client channel (id=7) 2006-08-22 15:32:38 calling ftok('/usr/local/bb/bb1.9i-btf',7) 2006-08-22 15:32:38 ftok() returns: 0x7007F5B 2006-08-22 15:32:38 shmget() returns: 0x4B7 2006-08-22 15:32:38 Could not attach shm Too many open files 2006-08-22 15:32:38 Cannot setup client channel 2006-08-22 15:32:43 Task hobbitd terminated, status 1 ------------------------------------------------------ "Could not attach shm Permission denied" 2006-08-22 15:28:15 Loading hostnames 2006-08-22 15:28:15 Opening file /usr/local/bb/bb1.9i-btf/etc/bb-hosts 2006-08-22 15:28:15 Opening file /usr/local/bb/bb1.9i-btf/etc/client-local.cfg 2006-08-22 15:28:15 Loading saved state 2006-08-22 15:28:15 Cannot access checkpoint file /usr/local/bb/bb1.9i-btf/tmp/hobbitd.chk for restore 2006-08-22 15:28:15 Setting up network listener on 0.0.0.0:1984 2006-08-22 15:28:15 Setting up signal handlers 2006-08-22 15:28:15 Setting up hobbitd channels 2006-08-22 15:28:15 Setting up status channel (id=1) 2006-08-22 15:28:15 calling ftok('/usr/local/bb/bb1.9i-btf',1) 2006-08-22 15:28:15 ftok() returns: 0x1007F5B 2006-08-22 15:28:15 shmget() returns: 0x1 2006-08-22 15:28:15 Could not attach shm Permission denied 2006-08-22 15:28:15 Cannot setup status channel 2006-08-22 15:28:20 Task hobbitd terminated, status 1

2 1