July 2005 - Xymon - Xymon mailman web

[hobbit] RE : [hobbit] Hobbit doesn't graph lvm drives
by nfigaro＠effigie.fr 05 Jul '05

05 Jul '05

I should have checked thisfile first : 2005-07-05 15:10:59 RRD error updating /var/lib/hobbit/rrd/baeva01/disk.rrd from 99.54.30.204: illegal attempt to update using time 1120569059 when last update time is 1120569059 (minimum one second step) The rrd were migrated from bigbrother using the moverrd.sh script. But I don't know why the upodate uses the same time than the last update time. NF -----Message d'origine----- De : Henrik Stoerner [mailto:henrik at hswn.dk] Envoyé : mardi 5 juillet 2005 15:11 À : hobbit at hswn.dk Objet : [hobbit] RE : [hobbit] Hobbit doesn't graph lvm drives On Tue, Jul 05, 2005 at 03:01:22PM +0200, FIGARO Nicolas wrote: > Here is a list of the files in the hobbit data directory : > > hobbit at HOSTNAME:~hobbit/server >ls -al > ~hobbit/data/rrd/HOSTNAME/disk*.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,boot.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,data.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,home.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,log.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,root.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,tmp.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,usr,local.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,usr.rrd > -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,var.rrd > > I switched from big brother to hobbit this morning at 11 am. Looks OK - did you migrate these over from your BB setup ? Any messages in the /var/log/hobbit/larrd-status.log file ? Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

1 0

[hobbit] Hobbit doesn't graph lvm drives
by nfigaro＠effigie.fr 05 Jul '05

05 Jul '05

Here is a list of the files in the hobbit data directory : hobbit at HOSTNAME:~hobbit/server >ls -al ~hobbit/data/rrd/HOSTNAME/disk*.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,boot.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,data.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,home.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,log.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,root.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,tmp.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,usr,local.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,usr.rrd -rw-rw-r-- 1 hobbit hobbit 38532 Jul 5 11:06 ~hobbit/data/rrd/HOSTNAME/disk,var.rrd I switched from big brother to hobbit this morning at 11 am. NF -----Message d'origine----- De : Henrik Stoerner [mailto:henrik at hswn.dk] Envoyé : mardi 5 juillet 2005 14:44 À : hobbit at hswn.dk Objet : Re: [hobbit] Hobbit doesn't graph lvm drives I tried cut'n'paste of your status report into my system here, and it generates the RRD files for all of the filesystems just fine. What files do you have in the ~hobbit/data/rrd/HOSTNAME/ directory ? Do you have the disk status column on the Hobbit webpage ? Your status message does look a bit odd - the "Disk partitions on prdxxbk,mgen,fij" normally has the hostname with dots instead of commas. I wonder if this is just an old client, or there is some other oddity causing this. It shouldn't affect the graphs, though. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

2 1

Hobbit doesn't graph lvm drives
by nfigaro＠effigie.fr 05 Jul '05

05 Jul '05

Hi, I installed hobbit (4.0.4-1) on a fedora core 2 linux box using the rpm, and I can't see rrd graphes for my local partitions : Tue Jul 5 12:59:38 CEST 2005 - *Disk partitions on prdxxbk,mgen,fij OK /dev/mapper/Volume00-LogVol00 1032088 748420 231240 77% / /dev/hda1 253775 6447 234226 3% /boot /dev/mapper/Volume01-LogVol02 3023760 837008 2033152 30% /data /dev/mapper/Volume01-LogVol00 1032088 689388 290272 71% /home /dev/mapper/Volume01-LogVol03 1935192 1531400 305488 84% /log /dev/mapper/Volume00-LogVol03 2967320 38668 2777920 2% /tmp /dev/mapper/Volume00-LogVol02 4031680 3289552 537328 86% /usr /dev/mapper/Volume00-LogVol01 1032088 308320 671340 32% /usr/local /dev/mapper/Volume01-LogVol01 2064208 288624 1670728 15% /var I don't know where the device names are defined or can be modified. The graph are fines for other unix hosts and aix hosts too (As I don't have any other linux boxes, I can't compare). Has anyone ever had the same problem ? Nicolas Figaro

2 1

Could you please include moverrd.sh in the rpm ?
by nfigaro＠effigie.fr 05 Jul '05

05 Jul '05

Hi, I installed hobbit 4.0.4-1 rpm on a fedora core 2 to upgrade from a bb server, but I needed to decompress the source to have the moverrd.sh script. Could you please include the script in the rpm ? (the documentationindicates clearly the script is in the source archive, but it could be easier if it was included with the rpm). Thanks Nicolas Figaro

1 0

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

Yes. That's the first thing Henrik asked me to disable,. -----Original Message----- From: Stefan Loos [mailto:stefan_loos at hotmail.com] Sent: Monday, 4 July 2005 4:36 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Status Unavailable You're running the hobbit server without the HEARTBEAT option - right? _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

1 0

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

Nope! Hashed out the [larrdcolumn] and [infocolumn] sections. Had a look. Saw your shared mem segments. Didn't even look for semaphores. Decided a reboot is probably easier. Hobbit started on its own. It looked promising, and then after about 2 minutes, back to its usual crap. Green background. Header & footer only :-( -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Monday, 4 July 2005 4:10 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Status Unavailable Hi Vernon, could you try disabling the [larrdcolumn] and [infocolumn] tasks in your hobbitlaunch.cfg ? These are no longer used, and I suspect that the code in hobbitd that handles these messages is somewhat flaky. If hobbitd refuses to stop, you'll have to do it with a "kill -9". When you do that, please check that there are no ressources left allocated by hobbitd: login as the hobbit user run "ipcs -m" and "ipcs -s" If you see something like hobbit at osiris:~$ ipcs -m ------ Shared Memory Segments -------- key shmid owner perms bytes nattch status 0x01020b1f 482148354 hobbit 600 102400 2 0x02020b1f 482181123 hobbit 600 102400 2 0x03020b1f 482213892 hobbit 600 102400 2 0x04020b1f 482246661 hobbit 600 102400 2 0x05020b1f 482279430 hobbit 600 102400 1 0x06020b1f 482312199 hobbit 600 102400 1 hobbit at osiris:~$ ipcs -s ------ Semaphore Arrays -------- key semid owner perms nsems 0x01020b1f 3276801 hobbit 600 3 0x02020b1f 3309570 hobbit 600 3 0x03020b1f 3342339 hobbit 600 3 0x04020b1f 3375108 hobbit 600 3 0x05020b1f 3407877 hobbit 600 3 0x06020b1f 3440646 hobbit 600 3 then it hasn't cleaned up properly and you should either reboot the box or use "ipcrm -m <shmid>" and "ipcrm -s <semid>" to delete these. Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

2 1

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

Hi Stefan Did you ever get your Hobbit up and running again? -----Original Message----- From: Stefan Loos [mailto:stefan_loos at hotmail.com] Sent: Monday, 4 July 2005 3:04 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Status Unavailable Hello Vernon, I think you see the same problem that I reported to Hendrid in May (bbdisplay problems after adding some hosts). The only difference is that my hobbit server runs normal as long as no other hosts are added to bb-hosts. I wanted to find out if its a OS problem (we use RedHat Enterprise 3) and installed hobbit on a SuSE system. It shows the same problems.... Regards, Stefan _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

3 2

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

I think mine started after I removed a test, but I am not sure. It might have happened before. -----Original Message----- From: Stefan Loos [mailto:stefan_loos at hotmail.com] Sent: Monday, 4 July 2005 3:04 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Status Unavailable Hello Vernon, I think you see the same problem that I reported to Hendrid in May (bbdisplay problems after adding some hosts). The only difference is that my hobbit server runs normal as long as no other hosts are added to bb-hosts. I wanted to find out if its a OS problem (we use RedHat Enterprise 3) and installed hobbit on a SuSE system. It shows the same problems.... Regards, Stefan >From: "Vernon Everett" <v.everett at afgonline.com.au> >Reply-To: hobbit at hswn.dk >To: <hobbit at hswn.dk> >Subject: RE: [hobbit] Status Unavailable >Date: Mon, 4 Jul 2005 14:48:12 +0800 > >Never actually checked that. >Nope, hobbitd refuses to die. > >You got any ideas? > > > >-----Original Message----- >From: Stefan Loos [mailto:stefan_loos at hotmail.com] >Sent: Monday, 4 July 2005 2:43 PM >To: hobbit at hswn.dk >Subject: RE: [hobbit] Status Unavailable > >And can you stop the hobbit server with hobbit.sh or is one process >still running after that? > >_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > >NOTICE: This message and any attachments are confidential and may contain copyright material >of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the >addressee and any other named recipient. If you are not the intended recipient, any use, >distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached >to this message is not waived or lost by reason of the mistaken transmission or delivery to any >unintended party. If you have received this message in error, please notify the author immediately or >contact Australian Finance Group on +61 8 9420 7888. > > >To unsubscribe from the hobbit list, send an e-mail to >hobbit-unsubscribe at hswn.dk > > To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

1 0

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

Yes. Quite often. ---snip--- 2005-07-04 14:09:17 Whoops ! bb failed to send message - timeout 2005-07-04 14:09:17 Could not get the Hobbit statuslog-list 2005-07-04 14:09:50 Whoops ! bb failed to send message - timeout 2005-07-04 14:09:50 hobbitd status-board not available 2005-07-04 14:10:49 Whoops ! bb failed to send message - timeout 2005-07-04 14:10:49 hobbitd status-board not available 2005-07-04 14:11:49 Whoops ! bb failed to send message - timeout 2005-07-04 14:11:49 hobbitd status-board not available 2005-07-04 14:12:52 Whoops ! bb failed to send message - timeout 2005-07-04 14:12:52 hobbitd status-board not available 2005-07-04 14:13:50 Whoops ! bb failed to send message - timeout 2005-07-04 14:13:50 hobbitd status-board not available 2005-07-04 14:14:50 Whoops ! bb failed to send message - timeout 2005-07-04 14:14:50 hobbitd status-board not available 2005-07-04 14:16:22 Whoops ! bb failed to send message - timeout 2005-07-04 14:16:22 hobbitd status-board not available 2005-07-04 14:16:22 WARNING: Runtime 61 longer than BBSLEEP (60) 2005-07-04 14:16:52 Whoops ! bb failed to send message - timeout 2005-07-04 14:16:52 hobbitd status-board not available 2005-07-04 14:17:52 Whoops ! bb failed to send message - timeout 2005-07-04 14:17:52 hobbitd status-board not available 2005-07-04 14:18:52 Whoops ! bb failed to send message - timeout 2005-07-04 14:18:52 hobbitd status-board not available 2005-07-04 14:19:52 Whoops ! bb failed to send message - timeout 2005-07-04 14:19:52 hobbitd status-board not available 2005-07-04 14:21:26 Whoops ! bb failed to send message - timeout 2005-07-04 14:21:26 hobbitd status-board not available 2005-07-04 14:21:26 WARNING: Runtime 61 longer than BBSLEEP (60) 2005-07-04 14:21:59 Whoops ! bb failed to send message - timeout 2005-07-04 14:21:59 hobbitd status-board not available ---snip--- -----Original Message----- From: Stefan Loos [mailto:stefan_loos at hotmail.com] Sent: Monday, 4 July 2005 2:16 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Status Unavailable Hello Vernon, can you tell me, if there is anything like "hobbitd status board not available" in the bb-display.log? Regards, Stefan >From: "Vernon Everett" <v.everett at afgonline.com.au> >Reply-To: hobbit at hswn.dk >To: <hobbit at hswn.dk> >Subject: RE: [hobbit] Status Unavailable >Date: Fri, 1 Jul 2005 16:56:38 +0800 > >Hi Henrik > >It should be idle. All the system does is run hobbit. :-) > >Hobbitd is currently dead in the water. > [root at pengo log]# strace -p 3025 > Process 3025 attached - interrupt to quit > futex(0x40141b20, FUTEX_WAIT, 2, NULL > >And it's been like this a while. >When I did the kill -6 I got this. > [root at pengo log]# strace -p 3025 > Process 3025 attached - interrupt to quit > futex(0x40141b20, FUTEX_WAIT, 2, NULL) = -1 EINTR (Interrupted >system call) > --- SIGABRT (Aborted) @ 0 (0) --- > Process 3025 detached >Which I suppose was expected :-) > >I restarted it, and got this. > [root at pengo etc]# strace -p 9223 > Process 9223 attached - interrupt to quit > semop(32769, 0xbfffe3a0, 1 >Nope, there is nothing I forgot to cut and paste. >That really was it. > >And this shit just gets stranger and stranger. >It isn't dumping core. >I hit it with a kill -6 and nothing happens. >I then thought maybe we were both mistaken, and had the command wrong or >my linux was defaulted to not core, so I started vi in a session and did >a kill -6 on that. That dumped?! >Hobbit isn't dumping. > >I rebooted and tried again. >I managed to get a nice strace output - see attached - but still no damn >core. > >OK, I added debug, and restarted. >When I went to check the logs, I found this in hobbitlaunch.log. >---snip--- >2005-07-01 16:37:21 Loading tasklist configuration from >/usr/lib/hobbit/server/etc/hobbitlaunch.cfg >2005-07-0 1 16:37:21 Loading hostnames >2005-07-01 16:37:21 Loading saved state >2005-07-01 16:37:21 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:21 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:21 Task hobbitd started with PID 4761 >2005-07-01 16:37:26 Task hobbitd terminated, status 1 >2005-07-01 16:37:26 Loading hostnames >2005-07-01 16:37:26 Loading saved state >2005-07-01 16:37:26 Task hobbitd started with PID 4765 >2005-07-01 16:37:26 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:26 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:26 Task hobbitd terminated, status 1 >2005-07-01 16:37:31 Loading hostnames >2005-07-01 16:37:31 Loading saved state >2005-07-01 16:37:31 Task hobbitd started with PID 4770 >2005-07-01 16:37:31 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:31 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:31 Task hobbitd terminated, status 1 >2005-07-01 16:37:36 Task hobbitd started with PID 4774 >2005-07-01 16:37:36 Loading hostnames >2005-07-01 16:37:36 Loading saved state >2005-07-01 16:37:36 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:36 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:36 Task hobbitd terminated, status 1 >2005-07-01 16:37:41 Task hobbitd started with PID 4778 >2005-07-01 16:37:41 Loading hostnames >2005-07-01 16:37:41 Loading saved state >2005-07-01 16:37:41 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:41 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:41 Task hobbitd terminated, status 1 >2005-07-01 16:37:46 Task hobbitd started with PID 4783 >2005-07-01 16:37:46 Loading hostnames >2005-07-01 16:37:46 Loading saved state >2005-07-01 16:37:46 Setting up network listener on 0.0.0.0:1984 >2005-07-01 16:37:46 Cannot bind to listen socket (Address already in >use) >2005-07-01 16:37:46 Task hobbitd terminated, status 1 >---snip--- > >Looks like a clue. >I will add the output of netstat -a > >Got the hobbitd.log file for you too. > >Let me know if there is anything else I can get you. > >Regards > Vernon > >P.S. Your cold one is quickly becoming many cold ones if you ever get to >Perth > > > > > >-----Orig inal Message----- >From: Henrik Stoerner [mailto:henrik at hswn.dk] >Sent: Friday, 1 July 2005 3:38 PM >To: hobbit at hswn.dk >Subject: Re: [hobbit] Status Unavailable > >On Fri, Jul 01, 2005 at 03:25:30PM +0800, Vernon Everett wrote: > > Thanks for helping on this. > > I rebooted this morning. Could the memory leak still effect me in that > > > short time? > >Probably not. Just wanted to rule out this possibility. > > > No "failed allocation" in dmesg output. > > Do you want the full output? > >No, I dont think that is necessary. > > > [root at pengo log]# vmstat 4 20 > >And your system is mostly idle with no swap or disk activity. > > > [hobbit at pengo hobbit]$ server/bin/bb 127.0.0.1 "hobbitdboard" > > 2005-07-01 15:21:45 Whoops ! bb failed to send message - timeout > >Could you try running "strace -p <process-ID of the hobbitd process>" >for a minute or two and send me the output, then do a "kill -6 ><process-id>" and mail me the core-file from ~hobbit/server/tmp/ >together with the ~hobbit/server/bin/hobbitd file ? > >Also, after this try adding a "--debug" to the hobbitd commandline in >hobbitlaunch.cfg. Let it run for a while and then mail me the >hobbitd.log file. > >This bug sounds a bit nasty, I think .... > > >Regards, >Henrik > > &g t;To unsubscribe from the hobbit list, send an e-mail to >hobbit-unsubscribe at hswn.dk > > >_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > >NOTICE: This message and any attachments are confidential and may contain copyright material >of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the >addressee and any other named recipient. If you are not the intended recipient, any use, >distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached >to this message is not waived or lost by reason of the mistaken transmission or delivery to any >unintended party. If you have received this message in error, please notify the author immediately or >contact Australian Finance Group on +61 8 9420 7888. > > >To unsubscribe from the hobbit list, send an e-mail to >hobbit-unsubscribe at hswn.dk > > To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

2 1

[hobbit] Status Unavailable
by v.everett＠afgonline.com.au 04 Jul '05

04 Jul '05

Hi Henrik It should be idle. All the system does is run hobbit. :-) Hobbitd is currently dead in the water. [root at pengo log]# strace -p 3025 Process 3025 attached - interrupt to quit futex(0x40141b20, FUTEX_WAIT, 2, NULL And it's been like this a while. When I did the kill -6 I got this. [root at pengo log]# strace -p 3025 Process 3025 attached - interrupt to quit futex(0x40141b20, FUTEX_WAIT, 2, NULL) = -1 EINTR (Interrupted system call) --- SIGABRT (Aborted) @ 0 (0) --- Process 3025 detached Which I suppose was expected :-) I restarted it, and got this. [root at pengo etc]# strace -p 9223 Process 9223 attached - interrupt to quit semop(32769, 0xbfffe3a0, 1 Nope, there is nothing I forgot to cut and paste. That really was it. And this shit just gets stranger and stranger. It isn't dumping core. I hit it with a kill -6 and nothing happens. I then thought maybe we were both mistaken, and had the command wrong or my linux was defaulted to not core, so I started vi in a session and did a kill -6 on that. That dumped?! Hobbit isn't dumping. I rebooted and tried again. I managed to get a nice strace output - see attached - but still no damn core. OK, I added debug, and restarted. When I went to check the logs, I found this in hobbitlaunch.log. ---snip--- 2005-07-01 16:37:21 Loading tasklist configuration from /usr/lib/hobbit/server/etc/hobbitlaunch.cfg 2005-07-01 16:37:21 Loading hostnames 2005-07-01 16:37:21 Loading saved state 2005-07-01 16:37:21 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:21 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:21 Task hobbitd started with PID 4761 2005-07-01 16:37:26 Task hobbitd terminated, status 1 2005-07-01 16:37:26 Loading hostnames 2005-07-01 16:37:26 Loading saved state 2005-07-01 16:37:26 Task hobbitd started with PID 4765 2005-07-01 16:37:26 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:26 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:26 Task hobbitd terminated, status 1 2005-07-01 16:37:31 Loading hostnames 2005-07-01 16:37:31 Loading saved state 2005-07-01 16:37:31 Task hobbitd started with PID 4770 2005-07-01 16:37:31 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:31 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:31 Task hobbitd terminated, status 1 2005-07-01 16:37:36 Task hobbitd started with PID 4774 2005-07-01 16:37:36 Loading hostnames 2005-07-01 16:37:36 Loading saved state 2005-07-01 16:37:36 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:36 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:36 Task hobbitd terminated, status 1 2005-07-01 16:37:41 Task hobbitd started with PID 4778 2005-07-01 16:37:41 Loading hostnames 2005-07-01 16:37:41 Loading saved state 2005-07-01 16:37:41 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:41 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:41 Task hobbitd terminated, status 1 2005-07-01 16:37:46 Task hobbitd started with PID 4783 2005-07-01 16:37:46 Loading hostnames 2005-07-01 16:37:46 Loading saved state 2005-07-01 16:37:46 Setting up network listener on 0.0.0.0:1984 2005-07-01 16:37:46 Cannot bind to listen socket (Address already in use) 2005-07-01 16:37:46 Task hobbitd terminated, status 1 ---snip--- Looks like a clue. I will add the output of netstat -a Got the hobbitd.log file for you too. Let me know if there is anything else I can get you. Regards Vernon P.S. Your cold one is quickly becoming many cold ones if you ever get to Perth -----Original Message----- From: Henrik Stoerner [mailto:henrik at hswn.dk] Sent: Friday, 1 July 2005 3:38 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Status Unavailable On Fri, Jul 01, 2005 at 03:25:30PM +0800, Vernon Everett wrote: > Thanks for helping on this. > I rebooted this morning. Could the memory leak still effect me in that > short time? Probably not. Just wanted to rule out this possibility. > No "failed allocation" in dmesg output. > Do you want the full output? No, I dont think that is necessary. > [root at pengo log]# vmstat 4 20 And your system is mostly idle with no swap or disk activity. > [hobbit at pengo hobbit]$ server/bin/bb 127.0.0.1 "hobbitdboard" > 2005-07-01 15:21:45 Whoops ! bb failed to send message - timeout Could you try running "strace -p <process-ID of the hobbitd process>" for a minute or two and send me the output, then do a "kill -6 <process-id>" and mail me the core-file from ~hobbit/server/tmp/ together with the ~hobbit/server/bin/hobbitd file ? Also, after this try adding a "--debug" to the hobbitd commandline in hobbitlaunch.cfg. Let it run for a while and then mail me the hobbitd.log file. This bug sounds a bit nasty, I think .... Regards, Henrik To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ NOTICE: This message and any attachments are confidential and may contain copyright material of Australian Finance Group Limited or a third party. It is intended solely for the purpose of the addressee and any other named recipient. If you are not the intended recipient, any use, distribution, disclosure or copying of this message is strictly prohibited. The confidentiality attached to this message is not waived or lost by reason of the mistaken transmission or delivery to any unintended party. If you have received this message in error, please notify the author immediately or contact Australian Finance Group on +61 8 9420 7888.

2 1