ipcs output:

228 = hobbit at cilantro /opt/home/hobbit >ipcs IPC status from <running system> as of Wed Jun 11 15:21:58 PDT 2008 T ID KEY MODE OWNER GROUP Message Queues: Shared Memory: m 20992 0x100780d --rw------- hobbit staff m 10241 0x200780d --rw------- hobbit staff m 5122 0x300780d --rw------- hobbit staff m 4 0x500780d --rw------- hobbit staff m 5 0x600780d --rw------- hobbit staff m 519 0x800780d --rw------- hobbit staff m 8 0x900780d --rw------- hobbit staff Semaphores: s 2686976 0x100780d --ra------- hobbit staff s 1376257 0x200780d --ra------- hobbit staff s 655362 0x300780d --ra------- hobbit staff s 4 0x500780d --ra------- hobbit staff s 5 0x600780d --ra------- hobbit staff s 65543 0x800780d --ra------- hobbit staff s 8 0x900780d --ra------- hobbit staff

From: Menton, Stephen Sent: Wednesday, June 11, 2008 2:07 PM To: 'hobbit at hswn.dk' Subject: RE: [hobbit] Hobbit 4.2.0 failing to start properly

some system info on settings ... *

• Streams Tunables
• 9 maximum number of pushes allowed (NSTRPUSH) 65536 maximum stream message size (STRMSGSZ) 1024 max size of ctl part of message (STRCTLSZ)
• IPC Messages
• 2048 max message size (MSGMAX) 4096 max bytes on queue (MSGMNB) 50 message queue identifiers (MSGMNI) 40 system message headers (MSGTQL)
• IPC Semaphores
• 50 semaphore identifiers (SEMMNI) 300 semaphores in system (SEMMNS) 150 undo structures in system (SEMMNU) 125 max semaphores per id (SEMMSL) 50 max operations per semop call (SEMOPM) 50 max undo entries per process (SEMUME) 32767 semaphore maximum value (SEMVMX) 16384 adjust on exit max value (SEMAEM)
• IPC Shared Memory
• 16777216 max shared memory segment size (SHMMAX) 1 min shared memory segment size (SHMMIN) 512 shared memory identifiers (SHMMNI) 64 max attached shm segments per process (SHMSEG)
• Time Sharing Scheduler Tunables
• 60 maximum time sharing user priority (TSMAXUPRI) SYS system class name (SYS_NAME)

223 = hobbit at cilantro /opt/home/hobbit/server/etc >ulimit -a time(seconds) unlimited file(blocks) unlimited data(kbytes) unlimited stack(kbytes) 8192 coredump(blocks) unlimited nofiles(descriptors) 1024 vmemory(kbytes) unlimited

From: Menton, Stephen Sent: Wednesday, June 11, 2008 1:18 PM To: hobbit at hswn.dk Subject: [hobbit] Hobbit 4.2.0 failing to start properly

Things start, pages are generated (albeit incompletely), occasionally even some alerts get sent... but then everything dies, slowly.

/var/log/hobbit >tail hobbitlaunch.log 2008-06-11 13:06:50 Setting up local listener 2008-06-11 13:06:50 Setting up signal handlers 2008-06-11 13:06:50 Setting up hobbitd channels 2008-06-11 13:06:50 FATAL: hobbitd sees clientcount 1, should be 0 Check for hanging hobbitd_channel processes or stale semaphores 2008-06-11 13:06:50 Cannot setup data channel 2008-06-11 13:06:50 Task hobbitd terminated, status 1 2008-06-11 13:06:50 Task bbnet terminated by signal 15 2008-06-11 13:06:50 Loading hostnames 2008-06-11 13:06:50 Loading saved state

/var/log/hobbit >tail -n 8 page.log 2008-06-11 13:06:42 Could not get shm of size 262144: No such file or directory 2008-06-11 13:06:42 Channel not available 2008-06-11 13:06:47 Could not get shm of size 262144: No such file or directory 2008-06-11 13:06:47 Channel not available 2008-06-11 13:07:50 Could not get shm of size 262144: No such file or directory 2008-06-11 13:07:50 Channel not available 2008-06-11 13:07:58 Could not get shm of size 262144: No such file or directory 2008-06-11 13:07:58 Channel not available

Help? Everything was working fine earlier...

stephen