February 2005 - Xymon - Xymon mailman web

Program crashed - Fatal Signal Caught
by mlowery＠alliedtechgroup.com 17 Feb '05

17 Feb '05

Ok, I re-downloaded RC2, un-tarred, re-configured, did make and make install, I still get the "program crashed fatal signal caught" on the bbtest page and all network tests are still purple. Any idea what I need to do to get back to the working hobbit I had before I tried to apply the patch? Thanks, Michael Lowery -----Original Message----- From: Lowery, Michael Sent: Wednesday, February 16, 2005 5:18 PM To: hobbit at hswn.dk Subject: RE: [hobbit] trying to get netapp filer data into larrd graphs Ok, after following the instructions, I get this on the BBTEST page: - Program crashed Fatal signal caught! Now all the network tests have gone purple... What did I do wrong? Michael Lowery -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Wednesday, February 16, 2005 4:30 PM To: hobbit at hswn.dk Subject: Re: [hobbit] trying to get netapp filer data into larrd graphs On Wed, Feb 16, 2005 at 11:18:28PM +0100, Henrik Stoerner wrote: > > Here is what the status message looks like from the ciscocpu script: > > > > @@status#28646|1108591336.263764|10.10.10.22||WAN.jvbs-router.atg.com|cp > > u|1108593136|green||green|1108550383|0||0| > > status WAN,jvbs-router,atg,com.cpu green Wed Feb 16 16:02:16 CST 2005 > > <br>CPU 5 min average: 4% > > Wouldn't be hard to add support for this in the standard hobbitd_larrd > handler. I've added a couple of lines to the "cpu" handler in hobbitd_larrd, and from your message I think it should make it work. I also added the lines that should make the Netapp cpu-reports work. I've attached a small patch for this (also available at http://www.hswn.dk/beta/cpu-reports.patch) apply with GNU patch using "cd hobbit-4.0-RC2; patch -p0 </tmp/cpu-reports.patch" then rebuild with "make" and "make install" and restart Hobbit. If graphs appear after 10-15 minutes, it worked. Let me know if it's OK. Regards, Henrik (off to bed now) To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 2

hobbit_larrd dumps
by lars.ebeling＠duni.se 17 Feb '05

17 Feb '05

Hi # file core core: core file from 'hobbitd_larrd' - received SIGABRT # regards Lars

1 0

[hobbit] TOP in Cpu test
by Kevin＠ewormhole.com 17 Feb '05

17 Feb '05

Thank you sir! -----Original Message----- From: Larry.Barber at usda.gov [mailto:Larry.Barber at usda.gov] Sent: Wednesday, February 16, 2005 3:23 PM To: hobbit at hswn.dk Subject: Re: [hobbit] TOP in Cpu test Put the following in bbsys.local on the client machines: TOP="/usr/bin/top" TOPARGS="-b -n 1" # may need tweaking, depending on OS export TOP TOPARGS Thanks, Larry Barber On Wed, 2005-02-16 at 14:01 -0600, Kevin.Hanrahan at novainfo.com wrote: > Can someone tell me how to get the "top" output in the CPU test? > > Thanks > > Kevin > > Note: The information contained in this email and in any attachments > is intended only for the person or entity to which it is addressed and > may contain confidential and/or privileged material. Any review, > retransmission, dissemination or other use of, or taking of any action > in reliance upon, this information by persons or entities other than > the intended recipient is prohibited. The recipient should check this > email and any attachments for the presence of viruses. Sender accepts > no liability for any damages caused by any virus transmitted by this > email. If you have received this email in error, please notify us > immediately by replying to the message and delete the email from your > computer. This e-mail is and any response to it will be unencrypted > and, therefore, potentially unsecure. Thank you. NOVA Information > Systems, Inc. > To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] trying to get netapp filer data into larrd graphs
by mlowery＠alliedtechgroup.com 16 Feb '05

16 Feb '05

It is on the same line. Thanks for the help! Michael -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Wednesday, February 16, 2005 4:18 PM To: hobbit at hswn.dk Subject: Re: [hobbit] trying to get netapp filer data into larrd graphs On Wed, Feb 16, 2005 at 04:09:47PM -0600, Lowery, Michael wrote: > Thanks for the pointer! It makes some sense to me. But I have the > ciscocpu external script reporting its output under the cpu column, will > that have any effect on what I'm trying to accomplish? I mean if I > create a custom rrd script for this, will it interfere with my > windows/unix hosts cpu graphs that are already being generated? The way hobbitd_larrd works, then the external scripts can only be invoked for status messages that it does not know how to handle. Since "cpu" is well-known and handled internally in hobbitd_larrd, a script cannot be used to process "cpu" status messages. > Do I need to configure it to report under its own column? If you want to do it with a script: Yes. > Here is what the status message looks like from the ciscocpu script: > > @@status#28646|1108591336.263764|10.10.10.22||WAN.jvbs-router.atg.com|cp > u|1108593136|green||green|1108550383|0||0| > status WAN,jvbs-router,atg,com.cpu green Wed Feb 16 16:02:16 CST 2005 > <br>CPU 5 min average: 4% Wouldn't be hard to add support for this in the standard hobbitd_larrd handler. Is that "CPU 5 min average" on a line by itself, or is it just your mail program that added a newline between the "status ..." and "<br>CPU 5 min average..." ? Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 1

[hobbit] trying to get netapp filer data into larrd graphs
by mlowery＠alliedtechgroup.com 16 Feb '05

16 Feb '05

Thanks for the pointer! It makes some sense to me. But I have the ciscocpu external script reporting its output under the cpu column, will that have any effect on what I'm trying to accomplish? I mean if I create a custom rrd script for this, will it interfere with my windows/unix hosts cpu graphs that are already being generated? Do I need to configure it to report under its own column? Here is what the status message looks like from the ciscocpu script: @@status#28646|1108591336.263764|10.10.10.22||WAN.jvbs-router.atg.com|cp u|1108593136|green||green|1108550383|0||0| status WAN,jvbs-router,atg,com.cpu green Wed Feb 16 16:02:16 CST 2005 <br>CPU 5 min average: 4% Thanks! Michael Lowery -----Original Message----- From: Tom Georgoulias [mailto:tgeorgoulias at nandomedia.com] Sent: Wednesday, February 16, 2005 3:32 PM To: hobbit at hswn.dk Subject: Re: [hobbit] trying to get netapp filer data into larrd graphs Lowery, Michael wrote: > On a similar note, I'm trying to get the ciscocpu.pl/.sh script to also > present the data to larrd. But I don't really have a clue as how to > accomplish this, so if someone feels that they would like to help, let > me know. I will be equally grateful for those who can provide links and > or hints that can help me get this done. Did you look at the "custom rrd data" section in the hobbitd_larrd manpage? It may be easier to do than you think. THere is no perl involved (assuming your ciscocpu script is already running on the hobbit server and displaying the data (but not the graphs)) and an example shell script is provided. Tom To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 2

[hobbit] hobbitgraph doesn't understand "suse"
by Larry.Barber＠usda.gov 16 Feb '05

16 Feb '05

Great!, that took care of it. Thanks, Larry Barber On Wed, 2005-02-16 at 16:04 -0600, henrik at hswn.dk wrote: > On Wed, Feb 16, 2005 at 04:23:09PM -0500, Larry.Barber at usda.gov > wrote: > > I'm getting errors like this in larrd-status.log: > > > > 2005-02-16 15:13:13 Host 'elnx105' reports netstat for an unknown > OS > > > > The corresponding message is: > > > > green Wed Feb 16 15:18:12 CST 2005 <netstat> > > suse > > OK, I looked at the BB 1.9e and it seems that it has separate OS > names for SuSE, Red Hat, Debian and Mandrake. Hobbit already knows > about Debian and Red Hat, so you can just add a couple of lines > to lib/misc.c to make it recognize "suse" and "mandrake" also: > > Around line 48 of hobbit-4.0-RC2/lib/misc.c add these two lines: > > else if (strcasecmp(osname, "suse") == 0) result = > OS_LINUX; > else if (strcasecmp(osname, "mandrake") == 0) result = > OS_LINUX; > > Rebuild it with "make; make install", restart Hobbit and it should be > OK. > > I'll add this for the next release. > > > Henrik > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > > >

1 0

[hobbit] hobbitgraph doesn't understand "suse"
by henrik＠hswn.dk 16 Feb '05

16 Feb '05

On Wed, Feb 16, 2005 at 04:23:09PM -0500, Larry.Barber at usda.gov wrote: > I'm getting errors like this in larrd-status.log: > > 2005-02-16 15:13:13 Host 'elnx105' reports netstat for an unknown OS > > The corresponding message is: > > green Wed Feb 16 15:18:12 CST 2005 <netstat> > suse OK, I looked at the BB 1.9e and it seems that it has separate OS names for SuSE, Red Hat, Debian and Mandrake. Hobbit already knows about Debian and Red Hat, so you can just add a couple of lines to lib/misc.c to make it recognize "suse" and "mandrake" also: Around line 48 of hobbit-4.0-RC2/lib/misc.c add these two lines: else if (strcasecmp(osname, "suse") == 0) result = OS_LINUX; else if (strcasecmp(osname, "mandrake") == 0) result = OS_LINUX; Rebuild it with "make; make install", restart Hobbit and it should be OK. I'll add this for the next release. Henrik

1 0

[hobbit] trying to get netapp filer data into larrd graphs
by mlowery＠alliedtechgroup.com 16 Feb '05

16 Feb '05

On a similar note, I'm trying to get the ciscocpu.pl/.sh script to also present the data to larrd. But I don't really have a clue as how to accomplish this, so if someone feels that they would like to help, let me know. I will be equally grateful for those who can provide links and or hints that can help me get this done. **I am willing to learn how to do it...** But I'm not yet fully versed in scripting and know nothing about perl. Michael Lowery -----Original Message----- From: Tom Georgoulias [mailto:tgeorgoulias at nandomedia.com] Sent: Wednesday, February 16, 2005 2:52 PM To: hobbit mailing list Subject: [hobbit] trying to get netapp filer data into larrd graphs I'm using the filerstats2bb script from deadcat.net to get from my Netapp filers and displaying it in hobbit. This is what is displayed on the status page: conn, cpu, disk, info, inode, qtree, trends, user_quota The data displayed is accurate, but the only graph that works is conn. The rest are severely broken. I checked the rrd directory and the only files that existed were: memory.real.rrd memory.swap.rrd tcp.conn.rrd Not sure why memory* exist at all, but they do and are empty. I would like to fix this, starting with CPU. I'm hoping that what I learn here can be used when I attempt to create custom graphs for user_quota & qtree with the custom RRD feature described in hobbitd_larrd. The rest of this message concerns only the load average/CPU graph problem, since I figure this ought to work without any modification. For example, this is the contents of a status summary displayed on the CPU status page: == Wed Feb 16 14:59:46 EST 2005 - CPU Utilization on filerA.nandomedia.com is OK. Uptime: 63 days, 06:57:54.29, load=1 LOAD AVG on filerA.nandomedia.com is 1 == Underneath the status message, a link for "hobbit graph la" instead of a real graph. There is data in the usual places in hobbit/data/hist/ cat hobbit/data/hist/filerA,nandomedia,com.cpu <snip> Sat Feb 12 16:32:47 2005 purple 1108243967 140478 Mon Feb 14 07:34:05 2005 green 1108384445 1050 Mon Feb 14 07:51:35 2005 purple 1108385495 304 Mon Feb 14 07:56:39 2005 green 1108385799 cat hobbit/data/hist/filerA.nandomedia.com | grep cpu <snip> cpu 1108128065 1108073455 54610 gr pu 1 cpu 1108243967 1108128065 115902 pu gr 2 cpu 1108384445 1108243967 140478 gr pu 1 cpu 1108385495 1108384445 1050 pu gr 2 cpu 1108385799 1108385495 304 gr pu 1 So why isn't the data being pulled from the status report messages and put into an rrd file to larrd can use it? Tom To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 1

hobbitgraph doesn't understand "suse"
by Larry.Barber＠usda.gov 16 Feb '05

16 Feb '05

I'm getting errors like this in larrd-status.log: 2005-02-16 15:13:13 Host 'elnx105' reports netstat for an unknown OS The corresponding message is: green Wed Feb 16 15:18:12 CST 2005 <netstat> suse Ip: 23283298 total packets received 0 forwarded 0 incoming packets discarded 22999200 incoming packets delivered 26771180 requests sent out Icmp: 14673 ICMP messages received 0 input ICMP message failed. ICMP input histogram: destination unreachable: 17 echo requests: 14656 14662 ICMP messages sent 0 ICMP messages failed ICMP output histogram: destination unreachable: 6 echo replies: 14656 Tcp: 138902 active connections openings 798503 passive connection openings 0 failed connection attempts 57034 connection resets received 90 connections established 23262079 segments received 26756470 segments send out 14189 segments retransmited 0 bad segments received. 45075 resets sent Udp: 39 packets received 6 packets to unknown port received. 0 packet receive errors 45 packets sent TcpExt: 4214327 invalid SYN cookies received ArpFilter: 0 740267 TCP sockets finished time wait in fast timer 78 time wait sockets recycled by time stamp 160 packets rejects in established connections because of timestamp 254969 delayed acks sent 2037 delayed acks further delayed because of locked socket Quick ack mode was activated 5294 times 12623844 packets directly received from backlog 3266594 packets header predicted 8502 packets header predicted and directly queued to user TCPPureAcks: 10978507 TCPHPAcks: 4380035 TCPRenoRecovery: 1 TCPSackRecovery: 0 TCPSACKReneging: 0 TCPFACKReorder: 0 TCPSACKReorder: 0 TCPRenoReorder: 0 TCPTSReorder: 0 TCPFullUndo: 0 TCPPartialUndo: 0 TCPDSACKUndo: 0 TCPLossUndo: 160 TCPLoss: 0 TCPLostRetransmit: 0 TCPRenoFailures: 1 TCPSackFailures: 0 TCPLossFailures: 0 TCPFastRetrans: 2 TCPForwardRetrans: 0 TCPSlowStartRetrans: 23 TCPTimeouts: 2637 TCPRenoRecoveryFail: 0 TCPSackRecoveryFail: 0 TCPSchedulerFailed: 0 TCPRcvCollapsed: 0 TCPDSACKOldSent: 3444 TCPDSACKOfoSent: 0 TCPDSACKRecv: 134 TCPDSACKOfoRecv: 0 TCPAbortOnSyn: 0 TCPAbortOnData: 44026 TCPAbortOnClose: 868 TCPAbortOnMemory: 0 TCPAbortOnTimeout: 109 TCPAbortOnLinger: 0 TCPAbortFailed: 0 TCPMemoryPressures: 0 TCPShortIcmp: 0 Message received from 165.221.94.21 Status unchanged in 7 days, 22 hours, 42 minutes It would appear that it is being confused by "suse" as the OS name. I am getting similar errors for vmstat. Thanks, Larry Barber

1 0

[hobbit] TOP in Cpu test
by Larry.Barber＠usda.gov 16 Feb '05

16 Feb '05

Put the following in bbsys.local on the client machines: TOP="/usr/bin/top" TOPARGS="-b -n 1" # may need tweaking, depending on OS export TOP TOPARGS Thanks, Larry Barber On Wed, 2005-02-16 at 14:01 -0600, Kevin.Hanrahan at novainfo.com wrote: > Can someone tell me how to get the "top" output in the CPU test? > > Thanks > > Kevin > > Note: The information contained in this email and in any attachments > is intended only for the person or entity to which it is addressed and > may contain confidential and/or privileged material. Any review, > retransmission, dissemination or other use of, or taking of any action > in reliance upon, this information by persons or entities other than > the intended recipient is prohibited. The recipient should check this > email and any attachments for the presence of viruses. Sender accepts > no liability for any damages caused by any virus transmitted by this > email. If you have received this email in error, please notify us > immediately by replying to the message and delete the email from your > computer. This e-mail is and any response to it will be unencrypted > and, therefore, potentially unsecure. Thank you. NOVA Information > Systems, Inc. >

1 0