- Xymon - Xymon mailman web

How to debug hobbit-clients.cfg file when trying to ignore a filesystem
by quentin.white＠endeavour-capital.com 10 Aug '06

10 Aug '06

Fixed it!! Found the client was being started with the "--local" option and hence using the ~hobbit/client/etc/localclient.cfg" file for the limits - not the servers. Doh! -----Original Message----- From: Quentin White Sent: 10 August 2006 12:40 PM To: 'hobbit at hswn.dk' Subject: How to debug hobbit-clients.cfg file when trying to ignore a filesystem I have an situation where one of my Linux client servers has a 99% filesystem that I want to ignore (/iscsi) but I cannot get Hobbit(version 4.2-beta-20060605) to do so!! The alert is : /iscsi (99% used) has reached the PANIC level (95%) Filesystem 1024-blocks Used Available Capacity Mounted on /dev/sdc1 197131940 184823364 2294864 99% /iscsi In the hobbit-clients.cfg, I have the following lines: HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 MEMSWAP 101 101 DISK /iscsi 101 101 Running this command ../bin/bbcmd hobbitd_client --dump-config | fgrep ld-sybase gives me the following. 2006-08-10 12:21:57 Using default environment file /usr/local/hobbit/server/etc/hobbitserver.cfg MEMSWAP 101 101 HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 (line: 403) DISK /iscsi 101% 101% 0 -1 red HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 (line: 404) But it doesn't ignore it !!!!! Running the same command with the "--test" option fails. With core dump (does this will all servers) 2006-08-10 12:23:07 Using default environment file /usr/local/hobbit/server/etc/hobbitserver.cfg Hostname (.=end, ?=dump, !=reload) []: ld-sybase01 Hosttype (.=end, ?=dump, !=reload) []: server Test (cpu, mem, disk, proc, log, port): cpu Load: Yellow at 7.00, red at 10.00 Uptime: From boot until 5m ,and after uptime Hostname (.=end, ?=dump, !=reload) [ld-sybase01]: Hosttype (.=end, ?=dump, !=reload) [server]: server Test (cpu, mem, disk, proc, log, port): disk Filesystem: /iscsi Segmentation Fault (core dumped) Running the gdb command on the core file as per the "Known issues" page yields this: #0 0x0001def8 in get_disk_thresholds (hinfo=0x4e548, classname=0x0, fsname=0xffbfcfe0 "/iscsi", warnlevel=0xffbfcbac, paniclevel=0xffbfcba8, abswarn=0xffbfcba4, abspanic=0xffbfcbb0, group=0x0) at client_config.c:1240 #1 0x00019628 in testmode (configfn=0x0) at hobbitd_client.c:1312 #2 0x0001a5f0 in main (argc=-8192, argv=0x2a800) at hobbitd_client.c:1509 How can I debug this? Thanks, Quentin _________________________________________________________________ _________________________________________________________________ The information in this email is provided for the addressee's information purposes only and is not as an offer or solicitation for the purchase or sale of any financial instrument. This message may contain confidential or privileged information. You must delete and not use it if you are not the intended recipient. The information may not be passed on or reproduced without Endeavour Capital LLP's written consent. Email transmission across the internet is not secure and the information contained in this email may not be complete or error-free. Accordingly you should not act or rely on the correctness of such information. All liability of Endeavour Capital LLP and its associated companies for any loss or damage resulting from such reliance or other e-mail use is excluded to the fullest extent permitted by law. To the extent this communication is issued to persons in the United Kingdom and constitutes a financial promotion, or an invitation or inducement to participate in a collective investment scheme (within the meaning of the Financial Services and Markets Act 2000), it is issued to and directed at persons who are either intermediate customers or market counterparties for the purposes of the FSA Conduct of Business Sourcebook, and no other person should act or rely upon it. Endeavour Capital LLP is authorised and regulated by the Financial Services Authority. This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email

1 0

Build error
by rsmrcina＠wi.rr.com 10 Aug '06

10 Aug '06

When building the 4.2 release on SLES9, I get the following during 'make install' processing. Am I missing a pre-req package? Has that changed since the RC releases? make[1]: Entering directory `/home/hobbit/hobbit-4.2.0/bbnet' ranlib c-ares/.libs/libcares.a || echo "ranlib failure - ignored" cp c-ares/.libs/libcares.a . cc -I./c-ares -c -o dns.o dns.c dns.c:24:22: libbbgen.h: No such file or directory In file included from dns.c:26: dns.h:36: error: parse error before "strbuffer_t" In file included from dns.c:27: dns2.h:16: error: parse error before "strbuffer_t" dns2.h:16: warning: no semicolon at end of struct or union dns2.h:18: error: parse error before '}' token dns2.h:18: warning: data definition has no type or storage class dns.c:60: error: parse error before "dnscache" dns.c:60: warning: data definition has no type or storage class dns.c: In function `prepare_dnscache': dns.c:68: error: `name_compare' undeclared (first use in this function) dns.c:68: error: (Each undeclared identifier is reported only once dns.c:68: error: for each function it appears in.) dns.c: In function `find_dnscache': dns.c:75: error: `RbtIterator' undeclared (first use in this function) dns.c:75: error: parse error before "handle" dns.c:86: error: `handle' undeclared (first use in this function) dns.c: In function `add_url_to_dns_queue': dns.c:187: error: `bburl_t' undeclared (first use in this function) dns.c:187: error: parse error before "bburl" dns.c:191: error: `bburl' undeclared (first use in this function) dns.c: At top level: dns.c:285: error: parse error before "strbuffer_t" dns.c: In function `dns_test_server': dns.c:296: error: `responses' undeclared (first use in this function) dns.c:297: error: `walk' undeclared (first use in this function) dns.c:302: error: `serverip' undeclared (first use in this function) dns.c:317: error: `hostname' undeclared (first use in this function) dns.c:321: error: `newtest' undeclared (first use in this function) dns.c:321: error: parse error before ')' token dns.c:341: warning: assignment makes pointer from integer without a cast dns.c:342: error: `banner' undeclared (first use in this function) make[1]: *** [dns.o] Error 1 -- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007

1 1

Arguments passed to hobbitclient.sh
by jason.kruse＠teldta.com 10 Aug '06

10 Aug '06

Looking through the hobbitclient.sh while creating a patch to update my systems I noticed that the arguments passed from within the clientlaunch.sh script, other than -local, are ignored. Passing $* to the hobbitd_client call will fix this issue. Jason

1 0

How to debug hobbit-clients.cfg file when trying to ignore a filesystem
by quentin.white＠endeavour-capital.com 10 Aug '06

10 Aug '06

I have an situation where one of my Linux client servers has a 99% filesystem that I want to ignore (/iscsi) but I cannot get Hobbit(version 4.2-beta-20060605) to do so!! The alert is : /iscsi (99% used) has reached the PANIC level (95%) Filesystem 1024-blocks Used Available Capacity Mounted on /dev/sdc1 197131940 184823364 2294864 99% /iscsi In the hobbit-clients.cfg, I have the following lines: HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 MEMSWAP 101 101 DISK /iscsi 101 101 Running this command ../bin/bbcmd hobbitd_client --dump-config | fgrep ld-sybase gives me the following. 2006-08-10 12:21:57 Using default environment file /usr/local/hobbit/server/etc/hobbitserver.cfg MEMSWAP 101 101 HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 (line: 403) DISK /iscsi 101% 101% 0 -1 red HOST=ld-sybase01.endeavour-capital.com,ld-sybase01 (line: 404) But it doesn't ignore it !!!!! Running the same command with the "--test" option fails. With core dump (does this will all servers) 2006-08-10 12:23:07 Using default environment file /usr/local/hobbit/server/etc/hobbitserver.cfg Hostname (.=end, ?=dump, !=reload) []: ld-sybase01 Hosttype (.=end, ?=dump, !=reload) []: server Test (cpu, mem, disk, proc, log, port): cpu Load: Yellow at 7.00, red at 10.00 Uptime: From boot until 5m ,and after uptime Hostname (.=end, ?=dump, !=reload) [ld-sybase01]: Hosttype (.=end, ?=dump, !=reload) [server]: server Test (cpu, mem, disk, proc, log, port): disk Filesystem: /iscsi Segmentation Fault (core dumped) Running the gdb command on the core file as per the "Known issues" page yields this: #0 0x0001def8 in get_disk_thresholds (hinfo=0x4e548, classname=0x0, fsname=0xffbfcfe0 "/iscsi", warnlevel=0xffbfcbac, paniclevel=0xffbfcba8, abswarn=0xffbfcba4, abspanic=0xffbfcbb0, group=0x0) at client_config.c:1240 #1 0x00019628 in testmode (configfn=0x0) at hobbitd_client.c:1312 #2 0x0001a5f0 in main (argc=-8192, argv=0x2a800) at hobbitd_client.c:1509 How can I debug this? Thanks, Quentin _________________________________________________________________ _________________________________________________________________ The information in this email is provided for the addressee's information purposes only and is not as an offer or solicitation for the purchase or sale of any financial instrument. This message may contain confidential or privileged information. You must delete and not use it if you are not the intended recipient. The information may not be passed on or reproduced without Endeavour Capital LLP's written consent. Email transmission across the internet is not secure and the information contained in this email may not be complete or error-free. Accordingly you should not act or rely on the correctness of such information. All liability of Endeavour Capital LLP and its associated companies for any loss or damage resulting from such reliance or other e-mail use is excluded to the fullest extent permitted by law. To the extent this communication is issued to persons in the United Kingdom and constitutes a financial promotion, or an invitation or inducement to participate in a collective investment scheme (within the meaning of the Financial Services and Markets Act 2000), it is issued to and directed at persons who are either intermediate customers or market counterparties for the purposes of the FSA Conduct of Business Sourcebook, and no other person should act or rely upon it. Endeavour Capital LLP is authorised and regulated by the Financial Services Authority. This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email

3 3

[hobbit] Hobbit Monitor version 4.2 released
by peterjakobs＠myrealbox.com 10 Aug '06

10 Aug '06

Great job Henrik! I am trying to understand the client-local.cfg. I see now all types of linux in the file, but how does the client decide which one to take? if he uses the uname -s then it will be always linux? or not. And if you use a [hostname] section he does not read the [linux] section any more? Peter Jakobs ps. Release notes say that the DOWNTIME in bb-hosts can now be applied to individual test. The man page of bb-hosts doesn't say so. As far as I tried it, it should contain a test(s)

2 1

Hobbit 4.2 client in local mode - "Status received from 127.0.0.1"
by frederic.mangeant＠steria.com 10 Aug '06

10 Aug '06

Hi again Henrik I've installed a few 4.2 clients in local mode, and all works fine except that I get "Status received from 127.0.0.1" at the bottom of each page. Is there a way to have the real IP address of the sender ? My server is still running 4.1.2p1, maybe this has something to do... Thanks ! -- Frédéric Mangeant Steria EDC Sophia-Antipolis

1 0

Backup of Hobbit data and config files
by plardinois＠be.tiauto.com 10 Aug '06

10 Aug '06

Hello, Can someone tell me what directories / files that have to be backed up in order to save data and config files to prevent a crash ? Is it necessary to copy the whole data directory ? Currently, we have about 8 GB on the data directory (about 1500 hosts). Are these existing automated solutions (nothing found on deadcat so far...) ? I'd be glad to receive some tips/tricks on how you perform your own backups. Thank you for your support. Regards, Pierre _____________________________ Pierre Lardinois Int. ICT Infrastructure Team TI Automotive The information contained in this transmission may contain privileged and confidential information. It is intended only for the use of the person(s) named above. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

2 1

[hobbit] AIX 5.2 clientdata problem (was: Note: Hobbit 4.2 re lease planned for Thursday Aug. 1 0.)
by CHRIS.MORRIS＠RWEnpower.com 10 Aug '06

10 Aug '06

Hi Henrik, No other indications of any problems on the webpage or in other logfiles and no core files produced. I think this may be a problem on this specific box - I'll do some more "testing" Thanks, Chris > -----Original Message----- > From: henrik at hswn.dk [SMTP:henrik at hswn.dk] > Sent: Wednesday, August 09, 2006 7:41 PM > To: hobbit at hswn.dk > Subject: Re: [hobbit] AIX 5.2 clientdata problem (was: Note: Hobbit > 4.2 re lease planned for Thursday Aug. 1 0.) > > On Wed, Aug 09, 2006 at 03:17:30PM +0100, Morris, Chris (Shared Services) > wrote: > > Hi Henrik, > > > > Our child has failed and will not talk to us: Channel clichg, PID 27932, > > cause Bad file number > > "Bad file number" ?! But that file handle was given to us just a few > lines further up in the code without any errors being flagged. > > Are there any indications that any of the hobbitd_* modules have > crashed? Core files in the ~hobbit/server/tmp/ directory, red/purple > hobbitd_something statuses on the webserver ? I think you would have > said so if there were any. > > Do any of the other hobbitd modules (ie any of the other logfiles) > report anything similar ? Or is it only that one logfile? > > I haven't heard about anything like this from others, so I'm reasonably > certain this is not a general problem. > > > Regards, > Henrik > > > To unsubscribe from the hobbit list, send an e-mail to > hobbit-unsubscribe at hswn.dk > **************************************************************************** The information contained in this email is intended only for the use of the intended recipient at the email address to which it has been addressed. If the reader of this message is not an intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination or copying of the message or associated attachments is strictly prohibited. If you have received this email in error, please contact the sender by return email or call 01793 877777 and ask for the sender and then delete it immediately from your system.Please note that neither RWE npower nor the sender accepts any responsibility for viruses and it is your responsibility to scan attachments (if any). *****************************************************************************

1 0

Note: Hobbit 4.2 release planned for Thursday Aug. 10.
by henrik＠hswn.dk 10 Aug '06

10 Aug '06

Unless some major showstopper arrives within 24 hours, the 4.2 release will be available Thursday morning around 8 AM UTC. In other words, this is your last chance to report bugs that must be fixed before the final release. The "ps" handling bugs should all be fixed now in the latest snapshot and all-in-one patch (dated 2006-08-08 21:13 UTC). A list of the bugs that have been fixed during the RC testing can be found at the beta-patches page, http://www.hswn.dk/hobbitsw/betapatches/ I would like to express my sincere admiration and thanks to the people who have taken the trouble of testing Hobbit for this release; your input and help in troubleshooting the problems has really made this release a lot better than it was 4 weeks ago. Thanks, Henrik

7 9

[hobbit] Hobbit on Solaris 10 x86
by Vernon.Everett＠dpi.wa.gov.au 10 Aug '06

10 Aug '06

Hi I have had this problem as well. I know, it a horribly vague problem description, but there is not much else to report. I was also getting messages truncated and a yellow on hobbitd. When I tried to change them in the config files, nothing changes. The truncated size remained the same, hobbitd remains yellow, and tests remain purple. I then edited the hobbitd_buffer.c and increased the size limits, did a recompile, and it's been great ever since. Probably not a good thing to do considering my wealth of ignorance regarding C, but as they say in the military, if it works, it's a good idea. Cheers Vernon ________________________________ From: Jerry Yu [mailto:jjj863 at gmail.com] Sent: Thursday, 10 August 2006 3:37 AM To: hobbit at hswn.dk Subject: Re: [hobbit] Hobbit on Solaris 10 x86 Mike, I had similar symptoms on CentOS/RHL. It turns out a oversized [ports] section caused truncation of message thus [files] [msgs] [procs] may fail to get their data due to truncation. Check whether your 'hobbitd' turns YELLOW at the same time. If so, 'client data' for hobbitd history page will have lines saying this that oversized and truncated. On 8/9/06, Jason Lee <jason.lee at flytxt.com> wrote: Hi Mike, I don't know about your problem, but, We're running lots of hobbit clients and servers on Solaris 10 x86 without any problems. This includes running the full hobbit client inside Solaris 10 zones. Jason. ________________________________ From: Mike Rowell [mailto:Mike.Rowell at Rightmove.co.uk] Sent: 09 August 2006 13:47 To: hobbit at hswn.dk Subject: [hobbit] Hobbit on Solaris 10 x86 At the moment I'm seeing some rather strange things from clients and indeed a server running on solaris 10 x86. Occasionally and without pattern they will go purple, logging into the server and checking the logs indicate that there is no problem at all.. I've setup a new hobbit server on a new Solaris 10 x86 server and have seen in the last 48hours it's gone purple at least 3 times, the only client on this server is the server itself so it's not a load issue. The clients going purple are on our live monitoring solution, I have tried them in both local and nonlocal mode but with similar results every now and again they will go purple for no reason. I've added -debug to the hobbitd lines in an effort to debug the problem but as yet I havn't found anything, has anyone else come across any similar issues? Regards, Mike Rowell ________________________________________________________________________ This email has been scanned for all viruses by the MessageLabs service. ________________________________________________________________________

1 0