October 2008 - Xymon - Xymon mailman web

[hobbit] no iostat rrds?
by craig＠cookitservices.com 13 Mar '09

13 Mar '09

iostat graphs on Solaris in hobbit are broken. http://www.hswn.dk/hobbiton/2007/07/msg00335.html Even after these patches there seems to be a parsing issue on some filesystems. ie. some filesystems get a solid graph line, some filesystems are a broken line. "Random" data seems to be missing from the rrd's. I have not located where the bug is yet though. Craig Cook

3 3

tftp monitor
by tleavitt＠unameits.com 27 Feb '09

27 Feb '09

Couldn't quickly find a FAQ on this, didn't see anything on deadcat.net either... I to monitor whether a TFTP server on the internal net here is up and running. What do I need to do to make this happen? Thomas

7 6

Hobbit constantly coring
by kevin.walsh＠criticalpath.net 18 Feb '09

18 Feb '09

An HTML attachment was scrubbed... URL: <http://lists.xymon.com/pipermail/xymon/attachments/20080612/e3887ea7/attach…>

2 1

http network test
by ralphmitchell＠gmail.com 06 Feb '09

06 Feb '09

I've got a few instances of a.b.c.d www.server.com # http://www.server.com/ and the http column shows up just fine, including the time the test took and a nice graph. The question I was just asked is, is it possible to specify "max response time", so that if the time shown is greater than N seconds I get a red flag?? I don't see a way to set that in the man pages for either bb-hosts or hobbit-client.cfg. Thanks, Ralph Mitchell

6 11

RRD log errors
by rmcgraw＠purdue.edu 12 Jan '09

12 Jan '09

Every five minutes and I am getting the following in the rrd-status.log. Host peano is: Hostname: peano.math.purdue.edu OS: Red Hat Enterprise Linux AS release 4 (Nahant Update 6) Linux peano.math.purdue.edu 2.6.9-67.0.1.ELsmp x86_64 I searched the archive and did not find any information about this. My graphs look ok. Any ideas? Robert 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/la.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/procs.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/users.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/clock.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/disk,root.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/disk,boot.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/disk,var.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/memory.real.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/memory.swap.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) 2008-06-04 13:20:59 RRD error updating /local/hobbit420/data/rrd/peano.math.purdue.edu/memory.actual.rrd from 128.210.3.244: illegal attempt to update using time 1212600059 when last update time is 1212600059 (minimum one second step) -------------------------------------------------------------------- Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw at purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street West Lafayette, IN 47907-2067

6 6

Memory and CPU usage by a process
by vadud3＠gmail.com 21 Nov '08

21 Nov '08

Anyone worked on collecting data and generating rrd and graph for a particular process? I am trying to collect it for all the java processes on one system, which is easy for solaris, and then generate rrd and create graph. With little perl scripts, as provided in rrdtool website, I can generate the rrds as well using the data but how do I tell hobbit server to do the graph? I want to do it all in the server may be by modifying the `ps' script on the client to show the `RSS' column Thanks -- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu

1 1

[hobbit] hobbitlaunch segfault / timewarp happend again
by dddugan＠iastate.edu 13 Nov '08

13 Nov '08

I recently brought up a new client that has trouble keeping accurate time...so I began encountering this time warp issue. As pointed out by Henrik in January, it is definitely an infinite loop where errprintf() calls getcurrenttime() to get its timestamp. The attached patch modifies the functions in errormsg.c to use time() instead of getcurrenttime(). That avoids any recursion-infinite loop problems, and logs or prints errors with the system's actual time instead of a Hobbit-adjusted-for-sanity time. In the absence of accurate time, I think it would be best to log in the system's time so that you can correlate Hobbit logs with other system logs. Working for me so far, but use at your own risk. Comments? Cheers. Darin Dugan dddugan at iastate.edu -----Original Message----- From: Alexander Keller [mailto:hobbit at alexkeller.de] Sent: Friday, March 21, 2008 10:22 AM To: hobbit at hswn.dk Subject: Re: [hobbit] hobbitlaunch segfault / timewarp happend again Hi, unfortunately nobody answered to my posting, so I did a quick'n dirty hack to prevent timewarp segfaults in hobbitlaunch. Just comment out the errprintf-statement in lib/timefunc.c: if (timewarphappened) { /* * Tell the world about it. * Must do this AFTER changing timewarp and lastresult, * or we will start an endless loop triggering a stack * overflow because errprintf() calls getcurrenttime(). */ /* * **** prevent segfault: do not log time warp. **** * errprintf("Time warp detected: Adjusting returned clock by %d seconds\n", timewarp); */ } This is not a real solution, but it works for me. Maybe there is somebody out, who can fix this issue properly :-) Regards Alexander > Hi Henrik, > in january I reported a segfault with hobbitlaunch/timefunc.c. You quickly > provided a patch... > Now I'm having a new error - see core dump: > /opt/hobbit/client# gdb bin/hobbitlaunch core > GNU gdb 6.4-debian > Copyright 2005 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you are > welcome to change it and/or distribute copies of it under certain conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "i486-linux-gnu"...Using host libthread_db > library "/lib/tls/i686/cmov/libthread_db.so.1". > Core was generated by `./bin/hobbitlaunch --config=./etc/clientlaunch.cfg > --log=./logs/clientlaunch.lo'. > Program terminated with signal 11, Segmentation fault. > warning: Can't read pathname for load map: Input/output error. > Reading symbols from /usr/lib/libz.so.1...done. > Loaded symbols for /usr/lib/libz.so.1 > Reading symbols from /lib/tls/i686/cmov/libc.so.6...done. > Loaded symbols for /lib/tls/i686/cmov/libc.so.6 > Reading symbols from /lib/ld-linux.so.2...done. > Loaded symbols for /lib/ld-linux.so.2 > #0 errprintf (fmt=0x6b <Address 0x6b out of bounds>) at errormsg.c:42 > 42 time_t now = getcurrenttime(NULL); > (gdb) bt > #0 errprintf (fmt=0x6b <Address 0x6b out of bounds>) at errormsg.c:42 > #1 0x0804f125 in getcurrenttime (retparm=0x0) at timefunc.c:73 > #2 0x0804b9e0 in errprintf (fmt=0x6b <Address 0x6b out of bounds>) at > errormsg.c:42 > #3 0x0804f125 in getcurrenttime (retparm=0x0) at timefunc.c:73 > #4 0x0804b9e0 in errprintf (fmt=0x6b <Address 0x6b out of bounds>) at > errormsg.c:42 > #5 0x0804f125 in getcurrenttime (retparm=0x0) at timefunc.c:73 > #6 0x0804b9e0 in errprintf (fmt=0x6b <Address 0x6b out of bounds>) at > errormsg.c:42 > #7 0x0804f125 in getcurrenttime (retparm=0x0) at timefunc.c:73 > #8 0x0804b9e0 in errprintf (fmt=0x6b <Address 0x6b out of bounds>) at > errormsg.c:42 > #9 0x0804f125 in getcurrenttime (retparm=0x0) at timefunc.c:73 > #10 0x0804b9e0 in errprintf (fmt=0x6b <Address 0x6b out of bounds>) at > errormsg.c:42 > [...] > I can reproduce the error with "ntpdate" using a misconfigured ntp server > (2 min in the past): > 1. start hobbit client "runclient.sh start" > 2. sync time with "ntpdate <misconfigured-time-server>" > 3. get a core dump > Regards, > Alexander To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

3 2

ping intervals
by gleonard＠progrexion.com 13 Nov '08

13 Nov '08

I have some servers that it is critical that I know they are down within at the most a minute to two minutes... hobbit polls every 5min if I remember right? How do I decrease the polling intervals so I can catch these connection problems quicker? Thanks in advance... Gavin Leonard [cid:image001.gif at 01C8B6EA.EB59EA00] Director, Systems-Network Engineering T 801-828-1735 F 801-828-1704 E gleonard at progrexion.com<mailto:gleonard at progrexion.com> Research | Marketing | Sales Generation www.progrexion.com<http://www.progrexion.com/> This email and its contents are confidential. If you are not the intended recipient, delete this email and do not use or disclose the information within this email or its attachments. Thank you.

3 2

Devmon causing core dumps
by Vernon.Everett＠woodside.com.au 31 Oct '08

31 Oct '08

Hi all Devmon was causing the hobbitd_rrd module to crash and burn. Now this could be a bug, but it could also be a PEBKAC. I am hoping somebody can assist either way. I added a Cisco 2851 to Hobbit, using devmon. Now here is the possible PEBKAC Since Devmon doesn't have templates for the 2851, I used the template for the Cisco 2811. (Network guru told me they are pretty much the same, except for a few extra bells and whistles on the 2851.) The data for the device started appearing in Hobbit, and all looked good. Devmon even created the rrd files for the new Cisco device. However, the hobbitd_rrd module started core dumping, and the Hobbit server page started displaying red for hobbitd_rrd with the crash detected message. See core data below. Took the new Cisco device out of Hobbit, and cores stopped, and life was good again. Is there a significant enough difference between the 2851 and the 2811 to cause this, or are we looking at a genuine bug? I am leaning towards a bug, because even if the collected data was complete rubbish, should it cause the module to core? Regards Vernon My Linux guy reckons this is the important stuff from the core. uname -a Linux las006 2.6.18-92.1.1.el5 #1 SMP Thu May 22 09:01:47 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux cat /etc/redhat-release Red Hat Enterprise Linux Client release 5.2 (Tikanga) gdb -c core.8550 /usr/lib/hobbit/server/bin/hobbitd_rrd GNU gdb Red Hat Linux (6.5-37.el5_2.1rh) Copyright (C) 2006 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu"...Using host libthread_db library "/lib64/libthread_db.so.1". Reading symbols from /usr/lib64/librrd.so.2...done. Loaded symbols for /usr/lib64/librrd.so.2 Reading symbols from /usr/lib64/libpng12.so.0...done. Loaded symbols for /usr/lib64/libpng12.so.0 Reading symbols from /lib64/libpcre.so.0...done. Loaded symbols for /lib64/libpcre.so.0 Reading symbols from /lib64/libc.so.6...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /usr/lib64/libfreetype.so.6...done. Loaded symbols for /usr/lib64/libfreetype.so.6 Reading symbols from /usr/lib64/libz.so.1...done. Loaded symbols for /usr/lib64/libz.so.1 Reading symbols from /usr/lib64/libart_lgpl_2.so.2...done. Loaded symbols for /usr/lib64/libart_lgpl_2.so.2 Reading symbols from /lib64/libm.so.6...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Core was generated by `hobbitd_rrd --rrddir=/var/lib/hobbit/rrd --debug'. Program terminated with signal 6, Aborted. #0 0x0000003db7a30155 in raise () from /lib64/libc.so.6 (gdb) bt #0 0x0000003db7a30155 in raise () from /lib64/libc.so.6 #1 0x0000003db7a31bf0 in abort () from /lib64/libc.so.6 #2 0x00000000004119f3 in sigsegv_handler (signum=<value optimized out>) at sig.c:57 #3 <signal handler called> #4 0x0000003db7a77ac0 in strcat () from /lib64/libc.so.6 #5 0x000000000040462a in do_devmon_rrd (hostname=0x2ada311e2806 "PERIR205", testname=0x2ada311e280f "if_load", msg=<value optimized out>, tstamp=<value optimized out>) at rrd/do_devmon.c:87 #6 0x000000000040b656 in update_rrd (hostname=0x2ada311e2806 "PERIR205", testname=0x2ada311e280f "if_load", msg=0x2ada311e2842 "status PERIR205.if_load green Fri Oct 31 10:31:39 2008", tstamp=1225416699, sender=<value optimized out>, ldef=0xfeffffffffffff00) at do_rrd.c:372 #7 0x000000000040261d in main (argc=<value optimized out>, argv=0x7fff7a088318) at hobbitd_rrd.c:153 (gdb) NOTICE: This email and any attachments are confidential. They may contain legally privileged information or copyright material. You must not read, copy, use or disclose them without authorisation. If you are not an intended recipient, please contact us at once by return email and then delete both messages and all attachments.

3 4

[hobbit] client data wont report to 2nd server
by sigurdur＠raforninn.is 31 Oct '08

31 Oct '08

Hi Kevin. I don't think that there should be anything wrong with having two different versions of hobbit.. however I haven't tried it myself. This is a long shot, but hey .... Did you check /etc/default/hobbit-client ? Regards, Sigurður Guðbrandsson ________________________________ From: Hanrahan, Kevin [mailto:Kevin.Hanrahan at elavon.com] Sent: 30. október 2008 13:40 To: 'hobbit at hswn.dk' Subject: RE: [hobbit] client data wont report to 2nd server Hi Sigurður, Thanks for the reply. I was not clear in describing my problem and I also left out what might be a key piece of info. I have the following: Client A reports to server A Client B reports to server B I wanted to have client B report to server A and B The piece I forgot to mention was : Server A is running Hobbit 4.0 RC5 Server B is running Hobbit 4.2 does this matter? Is there a compatability problem with the newest client and an old version of Hobbit server? kh From: Sigurður Guðbrandsson [mailto:sigurdur at raforninn.is] Sent: Thursday, October 30, 2008 5:33 AM To: hobbit at hswn.dk Subject: RE: [hobbit] client data wont report to 2nd server Hello Kevin. As I understand your problem, you want one central server that contains everything that other servers in your organization monitor. (Useful when you have multiple clients on different sites that do not have access straight to the internet or the main hobbit server) This is something that I had to do a lot of investigation and testing to get it to function properly. The solution is a right mixture of hobbitd and bbproxy by using two ports on the server. Let me go into more detail. First the theory: You should have two ports open on the server, one for the bbproxy that will send out messages to two servers, localhost and the remote server. I chose 1984 (default) and 1985. So when the bbproxy receives a message from a client, it forwards it to the local host AND the external server, however there is one problem with this, all the network tests (done locally) get screwed up! The solution to this would be to have a different configuration file for those tests. Second, configuration settings: Start by copying your hobbitserver.cfg to another file, hobbitserverproxy.cfg, this enables the network tests to know where to send information. (The file should only have one ip address in BBSERVERIP, the eth0 IP. It should have the BBPORT 1984, it should contain BBDISP as $BBSERVERIP and BBDISPLAYS should be empty.) Now, on to editing the original hobbitserver.cfg. BBSERVERIP should be "127.0.0.1", BBPORT should be 1985, BBDISP should be "0.0.0.0" and BBDISPLAYS should be "$BBSERVERIP 12.34.56.78" (the ip of your external hobbit server). Now edit hobbitlaunch.cfg In the section [hobbitd], you should add '-listen=127.0.0.1:1985' to the CMD. The ENVFILE should stay the same. In the section [bbproxy], you should comment out the DISABLED line. Change the ENVFILE to the hobbitserverproxy.cfg file. Change the CMD and add '--bbdisplay=127.0.0.1:1985,12.34.56.78' (the ip of your external hobbit server) after the '--hobbitd' option. In the sections [bbnet] and [bbretest] you should change ENVFILE to hobbitserverproxy.cfg. Third, restarting hobbit: /etc/init.d/hobbitd restart Easy as pie :-) Hope you can use this information.. With regards, Sigurður Guðbrandsson ________________________________ From: Hanrahan, Kevin [mailto:Kevin.Hanrahan at elavon.com] Sent: 29. október 2008 12:26 To: 'hobbit at hswn.dk' Subject: RE: [hobbit] client data wont report to 2nd server yes, both client and server From: Ralph Mitchell [mailto:ralphmitchell at gmail.com] Sent: Tuesday, October 28, 2008 5:32 PM To: hobbit at hswn.dk Subject: Re: [hobbit] client data wont report to 2nd server On Tue, Oct 28, 2008 at 4:05 PM, Hanrahan, Kevin <Kevin.Hanrahan at elavon.com> wrote: Hi all, I am trying to add a 2nd server to have the clients report to. I edited hobbitclient.cfg to be as such: BBDISP="0.0.0.0" # IP address of the Hobbit server BBDISPLAYS="192.168.1.1 192.168.1.2" # IP of multiple Hobbit servers. BBDISP must be "0.0.0.0". the first server gets all the client data but the 2nd server only gets the data from the tests in the "ext" directory....the stuff called out in clientlaunch.cfg. Things like disk, memory, cpu, etc never get to the 2nd server. What did I miss? Did you bounce Hobbit?? Ralph Mitchell ----------------------------------------- Note: The information contained in this e-mail and in any attachments is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. The recipient should check this e-mail and any attachments for the presence of viruses. Sender accepts no liability for any damages caused by any virus transmitted by this e-mail. If you have received this e-mail in error, please notify us immediately by replying to the message and delete the e-mail from your computer. Elavon (formerly NOVA Information Systems)

1 0