December 2006 - Xymon - Xymon mailman web

Help with disk monitoring
by ebailey＠transunion.com 11 Dec '06

11 Dec '06

Hello, I have recently inherited a sizable Hobbit environment so please have patience with my general ignorance of all things Hobbit. Our Hobbit works really well except for one notable exception and I can't figure out why. We have a series of boxes that run an application and for some reason these systems will not monitor the /opt file system and alert us when /opt goes over 90% even though these boxes have the same Hobbit setup like the others on the server side and the client side. The only difference I can see is that the /opt file system is mapped differently on these systems. Most systems use something like /dev/sda5 120G 82G 73% /opt But the problem systems use /dev/mapper/sysvg-opt 120G 82G 32G 73% /opt Also the file systems from these problem servers show up differently as well. The standard file system mounts are displayed without an issues but the LVM maps display the mount point but nothing else /dev/mapper/sysvg-opt /dev/mapper/sysvg-var /dev/cciss/c0d0p1 2016016 216060 1697544 12% / /dev/cciss/c0d0p2 3020172 950024 1916728 34% /usr The problem servers also have the follow error in the client side log Mon Dec 11 15:53:21 2006 bb-local.sh /opt/Big_Brother/bb/bin/bb-disk.sh: line 180: test: : integer expression expected Mon Dec 11 15:58:21 2006 bb-local.sh /opt/Big_Brother/bb/bin/bb-disk.sh: line 180: test: : integer expression expected Mon Dec 11 15:58:21 2006 bb-local.sh /opt/Big_Brother/bb/bin/bb-disk.sh: line 180: test: : integer expression expected Mon Dec 11 16:03:21 2006 bb-local.sh /opt/Big_Brother/bb/bin/bb-disk.sh: line 180: test: : integer expression expected >From bbdef.sh # # LOCAL CLIENT MONITORING CONFIGURATION FOR bb-local.sh # # WARNING AND PANIC LEVELS FOR LOCAL SYSTEM INFOMRAION # YOU CAN SET VALUES ON A SPECIFIC FILESYSTEM BY USING # THE etc/bb-dftab FILE # DFWARN=90 # (YELLOW) DISK % TO WARN DFPANIC=95 # (RED) DISK % TO PANIC export DFWARN DFPANIC The lines above and below line 180 of bb-disk.sh MARK="" if test "$DISKPCT" -ge "$DFWARNVAL" # ABOVE WARNING LEVEL then if test "$DISKPCT" -ge "$DFPANICVAL" # ABOVE PANIC, RED ALERT !!! then COLOR="red" MARK="PANIC" MARKLEVEL=$DFPANICVAL HIGHMARK="PANIC" GIFCOLOR="&red" REDLINE="${GIFCOLOR} ${DISKNAME} (${DISKPCT}%) has reached the defined disk space ${MARK} le vel (${MARKLEVEL}%) ${REDLINE}" else By default all servers are set to alert at 90% and 95% percent. Thanks in advance for everyone's help Ed Bailey ------------------------ CONFIDENTIALITY NOTICE This e-mail and any attachments contain information which may be confidential or privileged and exempt from disclosure under applicable law. If you are not the intended recipient, be aware that any disclosure, copying, distribution, or use of the contents of this information is without authorization and is prohibited. If you have received this email in error, please immediately notify us by returning it to the sender and delete this copy from your computer system. Thank you. ------------------------

2 2

Alerting on number of times a keyword appers in a logfile?
by jonescr＠cisco.com 11 Dec '06

11 Dec '06

Is this possible without an ext script? -Charles

4 5

[hobbit] Problem viewing "Critical Systems"
by Tom_D._Bullers＠omb.eop.gov 11 Dec '06

11 Dec '06

Here are the ScriptAlias settings from httpd.conf. They seem ok to me - I can't see what might be wrong with them. This directory: /home/s-hob1/hobbit/cgi-bin/ is where the nkview.sh script lives that it is complaining about. The driectory is ScriptAliased below in the 2nd stanza. I am restarting Apache after a change to httpd.conf. I am running Apache on port 10001. In my previos email I mentioned port 1000 but meant 10001. Again the error occurs when I select "Critical Systems" from the views prompt. Does the ScriptAlias directive look correct? Are there log files I can look at to get more detailed info? I'm not getting much out of the Apache logs and I can't find hobbit logs. Thanks much. -tom Alias /s-hob/ "/home/s-hob1/hobbit/server/www/" <Directory "/home/s-hob1/hobbit/server/www"> Options Indexes FollowSymLinks Includes MultiViews Order allow,deny Allow from all </Directory> ScriptAlias /s-hob-cgi/ "/home/s-hob1/hobbit/cgi-bin/" <Directory "/home/s-hob1/hobbit/cgi-bin"> AllowOverride None Options ExecCGI Includes Order allow,deny Allow from all </Directory> ScriptAlias /s-hob-seccgi/ "/home/s-hob1/hobbit/cgi-secure/" <Directory "/home/s-hob1/hobbit/cgi-secure"> AllowOverride None Options ExecCGI Includes Order allow,deny Allow from all # Password file where users with access to these scripts are kept. # Create it with "htpasswd -c /home/s-hob1/hobbit/server/etc/hobbitpasswd USERNAME" # Add more users / change passwords with "htpasswd /home/s-hob1/hobbit/server/etc/hobbitpasswd USERNAME" # # You can also use a group file to restrict admin access to members of a # group, instead of anyone who is logged in. In that case you must setup # the "hobbitgroups" file, and change the "Require" settings to require # a specific group membership. See the Apache docs for more details. AuthUserFile /home/s-hob1/hobbit/server/etc/hobbitpasswd AuthGroupFile /home/s-hob1/hobbit/server/etc/hobbitgroups AuthType Basic AuthName "Hobbit Administration" # "valid-user" restricts access to anyone who is logged in. Require valid-user # "group admins" restricts access to users who have logged in, AND # are members of the "admins" group in hobbitgroups. # Require group admins </Directory> ~~~~~~~~~~~~~~~~~~~~~~ Tom Bullers Systems Administrator Phone: (202)395-5678 mailto:tom_bullers at omb.eop.gov > -----Original Message----- > From: Henrik Stoerner [mailto:henrik at hswn.dk] > Sent: Monday, December 11, 2006 11:36 AM > To: hobbit at hswn.dk > Subject: Re: [hobbit] Problem viewing "Critical Systems" > > On Mon, Dec 11, 2006 at 11:20:43AM -0500, Bullers, Tom D. wrote: > > > I get the the same error, but with this browser it's a bit > more descriptive - > > "The file hobbit-nkview.sh" is of type application/x-sh, > and Mozilla does not know how to handle this file type. The > file is lcoated at: http://hostname:1000 > > > > What should Mozilla do with this file?" > > > > It seems that Apache is trying to send the .sh file instead > of executing it and forwarding the output. > > What's the full URL for that link you're clicking on ? > "http://hostname:1000" doesn't look right, there must be > something more > than that. > > Check your Apache setup for the ScriptAlias settings. The results you > get indicate that the directory with the hobbit-nkview.sh is > considered > a normal document directory by Apache, instead of a script (CGI) > directory. > > > Regards, > Henrik > > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > > > >

1 0

Files and Process Test
by tmelcher＠saionline.com 11 Dec '06

11 Dec '06

Would there be a way to a tie the files and a procs test together? I need to monitor a Process but only alarm if the process doesnt exist(isnt runing) and a specific file does exist. Thanks Trent Trent Melcher Unix/Linux Systems Administrator Securities America Financial Corporation (402) 399-9111 x2774 tmelcher at saionline.com Securities America, Inc., a Registered Broker/Dealer, Member NASD/SIPC. Advisory services offered through Securities America Advisors, Inc., an SEC Registered Investment Advisory The text of this communication is confidential, and use by any person who is not the intended recipient is prohibited. Any person who receives this communication in error is requested to immediately destroy the text of this communication without copying or further dissemination. Your cooperation is appreciated.

1 0

[hobbit] Problem viewing "Critical Systems"
by Tom_D._Bullers＠omb.eop.gov 11 Dec '06

11 Dec '06

Greg, I tried another test that allows me to connect directly to the display host without using a tunnel. I get the the same error, but with this browser it's a bit more descriptive - "The file hobbit-nkview.sh" is of type application/x-sh, and Mozilla does not know how to handle this file type. The file is lcoated at: http://hostname:1000 What should Mozilla do with this file?" It seems that Apache is trying to send the .sh file instead of executing it and forwarding the output. This does seem like an Apache config issue but I've made the changes suggested in the installation. Can you give me any other hints? Thanks. -tom ~~~~~~~~~~~~~~~~~~~~~~ Tom Bullers Systems Administrator Phone: (202)395-5678 mailto:tom_bullers at omb.eop.gov > -----Original Message----- > From: Bullers, Tom D. > Sent: Monday, December 11, 2006 11:04 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] Problem viewing "Critical Systems" > > > Yes I am doing some tricks - I should have mentioned it. > > My test environment requires that I ssh tunnel through my > localhost to the remote machine on the defined network port. > I can see how this is foiling the cgi's. > > I thought I was having apache/cgi problems. > > I'll see what I can do about improving accessibility in my > test environment. > > Thanks much. > > > -tom > > > > > ~~~~~~~~~~~~~~~~~~~~~~ > Tom Bullers > Systems Administrator > Phone: (202)395-5678 > mailto:tom_bullers at omb.eop.gov > > > -----Original Message----- > > From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] > > Sent: Monday, December 11, 2006 10:10 AM > > To: hobbit at hswn.dk > > Subject: RE: [hobbit] Problem viewing "Critical Systems" > > > > There is some required Apache setup to allow the Hobbit CGI > scripts to > > run correctly. Look in the etc directory on your Hobbit > server. But > > the problem may be related to the fact that IE is trying to run on > > "localhost" (the machine with the > > browser) instead of the display host? Are you doing some sort of > > virtual machine tricks? > > > > GLH > > > > > > ________________________________ > > > > From: Bullers, Tom D. [mailto:Tom_D._Bullers at omb.eop.gov] > > Sent: Monday, December 11, 2006 9:00 AM > > To: hobbit at hswn.dk > > Subject: [hobbit] Problem viewing "Critical Systems" > > > > > > > > Hi, > > > > New to the list here and new to Hobbit so sorry about the naïve > > nature of the request. > > > > I've just installed Hobbit 4.2 and am running insto > some errors in > > the Web interface. Most pages seem to load fine but when I select > > "views" and "critical systems" I'm presented with this > error. I get a > > similar error in Firefox. > > > > > > > > > > I've attched a screenshot, but it says "IE cannot download > > hobbit-nkview.sh from localhost" > > > > I wasn't able to find very descriptive logs. Only > apache reports a > > 500 error > > > > > > Do y'all have any suggestions? Thanks a lot. > > > > > > -tom > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~ > > Tom Bullers > > Systems Administrator > > Phone: (202)395-5678 > > mailto:tom_bullers at omb.eop.gov > > > > > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > > > >

3 2

[hobbit] Problem viewing "Critical Systems"
by Tom_D._Bullers＠omb.eop.gov 11 Dec '06

11 Dec '06

Yes I am doing some tricks - I should have mentioned it. My test environment requires that I ssh tunnel through my localhost to the remote machine on the defined network port. I can see how this is foiling the cgi's. I thought I was having apache/cgi problems. I'll see what I can do about improving accessibility in my test environment. Thanks much. -tom ~~~~~~~~~~~~~~~~~~~~~~ Tom Bullers Systems Administrator Phone: (202)395-5678 mailto:tom_bullers at omb.eop.gov > -----Original Message----- > From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] > Sent: Monday, December 11, 2006 10:10 AM > To: hobbit at hswn.dk > Subject: RE: [hobbit] Problem viewing "Critical Systems" > > There is some required Apache setup to allow the Hobbit CGI > scripts to run correctly. Look in the etc directory on your > Hobbit server. But the problem may be related to the fact > that IE is trying to run on "localhost" (the machine with the > browser) instead of the display host? Are you doing some > sort of virtual machine tricks? > > GLH > > > ________________________________ > > From: Bullers, Tom D. [mailto:Tom_D._Bullers at omb.eop.gov] > Sent: Monday, December 11, 2006 9:00 AM > To: hobbit at hswn.dk > Subject: [hobbit] Problem viewing "Critical Systems" > > > > Hi, > > New to the list here and new to Hobbit so sorry about > the naïve nature of the request. > > I've just installed Hobbit 4.2 and am running insto > some errors in the Web interface. Most pages seem to load > fine but when I select "views" and "critical systems" I'm > presented with this error. I get a similar error in Firefox. > > > > > I've attched a screenshot, but it says "IE cannot > download hobbit-nkview.sh from localhost" > > I wasn't able to find very descriptive logs. Only > apache reports a 500 error > > > Do y'all have any suggestions? Thanks a lot. > > > -tom > > > > > ~~~~~~~~~~~~~~~~~~~~~~ > Tom Bullers > Systems Administrator > Phone: (202)395-5678 > mailto:tom_bullers at omb.eop.gov > >

1 0

huge number of logs - different ignores
by Schrittenlocher＠rz.uni-frankfurt.de 11 Dec '06

11 Dec '06

Hi, I have a huge number of logs - names are changing often - whose name correspond all to "/raid0/log/*/*err I get them into msg with the following rule in client-local.cfg: log:`find /raid0/log -name \*err -size +2c -exec ls -1 {} \;`:10240 My problem: I need different ignores for each of those logs. Any way to achieve that? Thanks for help to you all and thanks for hobbit, Henrik Rolf -- Mit freundlichen Gruessen Rolf Schrittenlocher HRZ/BDV, Senckenberganlage 31, 60054 Frankfurt Tel: (49) 69 - 798 28908 Fax: (49) 69 798 2881 LBS: lbs-f at mlist.uni-frankfurt.de Persoenlich: schritte at rz.uni-frankfurt.de

1 0

Problem viewing "Critical Systems"
by Tom_D._Bullers＠omb.eop.gov 11 Dec '06

11 Dec '06

Hi, New to the list here and new to Hobbit so sorry about the naïve nature of the request. I've just installed Hobbit 4.2 and am running insto some errors in the Web interface. Most pages seem to load fine but when I select "views" and "critical systems" I'm presented with this error. I get a similar error in Firefox. I've attched a screenshot, but it says "IE cannot download hobbit-nkview.sh from localhost" I wasn't able to find very descriptive logs. Only apache reports a 500 error Do y'all have any suggestions? Thanks a lot. -tom ~~~~~~~~~~~~~~~~~~~~~~ Tom Bullers Systems Administrator Phone: (202)395-5678 mailto:tom_bullers at omb.eop.gov

2 1

Graphing help with multiple physical & logical CPUS
by shea_greg＠emc.com 11 Dec '06

11 Dec '06

Hi all, I have a script that returns data from a host on the utilization of physical and logical CPUS. The data is returned as an NCV like below: PCPU0 : 5.44 PCPU1 : 0.10 Physical CPU 0 utilization is 5.44% Physical CPU 1 utilization is 0.10% In my hobbitserver.cfg file I've added "pcpu=ncv" to the TEST2RRD line and my ncv line should handled up to 8 CPUS NCV_pcpu="PCPU0:GAUGE,PCPU1:GAUGE,PCPU2:GAUGE,PCPU3:GAUGE,PCPU4:GAUGE,PC PU5:GAUGE,PCPU6:GAUGE,PCPU7:GAUGE" I didn't add this to the GRAPHS line because I'm stuck at the RRD defs part in hobbitgraph.cfg. I don't want a separate RRD def for each physcial CPU, but I do want both (or 8) CPUS to show up on the graph. The same for the logical CPUS. Any ideas?? Thanks -Grs- Gregory R Shea EMC Corporation

2 2

[hobbit] Configuration database backend.
by pwilliamson＠mandtbank.com 11 Dec '06

11 Dec '06

>>> tmelcher at saionline.com 12/08/06 5:10 PM >>> > -----Original Message----- > From: PAUL WILLIAMSON [mailto:pwilliamson at mandtbank.com] > Sent: Friday, December 08, 2006 3:58 PM > To: henrik at hswn.dk; hobbit at hswn.dk > Subject: Re: [hobbit] Configuration database backend. > > I use cfengine to distribute my host files to my different > machines. I have 8 machines. Having a database to manage > configuration would be a mistake IMHO. > > Paul Agreed, a database would be overkill in an environment that small. Ours is getting large and with the potential of 1000's of servers and 50 - 100 administrators, the hobbit-alerts.cfg file and hobbit-clients.cfg file are getting unmanageable. Ecspecialy as admins come and go, hard to figure out who entries for emails addresses and pager notifications is current. Clumping them into groups has helped but its still getting cumbersome. Trent Melcher Unix/Linux Systems Administrator Securities America Financial Corporation (402) 399-9111 x2774 tmelcher at saionline.com Small? I don't think I was clear - that's 8 server machines - not clients. I've got about 10k clients feeding it. The 8 machines are a combination of server, pager and display machines. Paul

1 0