Just as a side note --- disabling ghost matching (changed to drop) made it stop crashing — however this isn't a desirable setting

From: <Clark>, Sean Clark <Sean.Clark at twcable.com<mailto:Sean.Clark at twcable.com>> Date: Thursday, July 3, 2014 at 2:52 PM To: "xymon at xymon.com<mailto:xymon at xymon.com>" <xymon at xymon.com<mailto:xymon at xymon.com>> Subject: [Xymon] xymond core dumping (probably more for JC) Address out of bounds

JC – I installed the trunk version of xymond from terabithia – that fixed my core dump in all the deployments I had but one

This one, it’s core dumping every 1-2 minutes (same OS/libraries/kernels as all the other hosts – CentOS 5.10, latest kernel)

It dumps here:

#6 0x0805619c in do_message (msg=0x3099c5c8, origin=0x8073d92 “", can_respond=1) at xymond.c:4025

( response = newstrbuffer(lastboardsize); )

Here are all the symbols I could get:

#6 0x0805619c in do_message (msg=0x3099c5c8, origin=0x8073d92 "", can_respond=1) at xymond.c:4025 hosthandle = <value optimized out> lwalk = <value optimized out> firstlog = <value optimized out> trendstest = {name = 0x7b <Address 0x7b out of bounds>, clientsave = 5} infotest = {name = 0x1e1000 "", clientsave = 131080} logfields = 0x3052f888 havehostfilter = 0 fields = 0x18068567 "hostname,testname" response = <value optimized out> infologrec = {host = 0x2bbe58a0, test = 0xbff1b6f0, origin = 0x0, color = 0, oldcolor = 0, activealert = 0, histsynced = 0, downtimeactive = 0, flapping = 0, oldflapcolor = 0, currflapcolor = 0, testflags = 0x0, grouplist = 0x0, sender = '\000' <repeats 15 times>, lastchange = 0x2afffbd8, logtime = 0, validtime = 0, enabletime = 0, acktime = 0, redstart = 0, yellowstart = 0, maxackedcolor = 0, message = 0x8073d92 "", msgsz = 0, dismsg = 0x0, ackmsg = 0x0, cookie = 0x0, cookieexpires = 0, metas = 0x0, modifiers = 0x0, acklist = 0xb0ada5, statuschangecount = 0, next = 0xb0ada5} rrdlogrec = {host = 0x2bbe58a0, test = 0xbff1b6f8, origin = 0x0, color = 0, oldcolor = 0, activealert = 0, histsynced = 0, downtimeactive = 0, flapping = 0, oldflapcolor = 0, currflapcolor = 0, testflags = 0x0, grouplist = 0x0, sender = '\000' <repeats 15 times>, lastchange = 0x2afffbd8, logtime = 0, validtime = 0, enabletime = 0, acktime = 0, redstart = 0, yellowstart = 0, maxackedcolor = 0, message = 0x8073d92 "", msgsz = 0, dismsg = 0x0, ackmsg = 0x0, cookie = 0x0, cookieexpires = 0, metas = 0x0, modifiers = 0x0, acklist = 0x0, statuschangecount = 0, next = 0xbff1b58c} logfilter = 0x3099c5a8 acklevel = -1 h = <value optimized out> t = <value optimized out> log = <value optimized out> color = <value optimized out> downcause = <value optimized out> sender = "10.25.9.133\000\000\000\000" grouplist = <value optimized out> now = 1404413120 timeroffset = <value optimized out> nesting = 1 lastboardsize = 25771930 lastboardsize = 0 lastboardsize = 490 #7 0x0805ac98 in main (argc=12, argv=0x3) at xymond.c:5825 seltmo = {tv_sec = 0, tv_usec = 50000} fdread = {__fds_bits = {529408, 0 <repeats 31 times>}} maxfd = <value optimized out> backfeeddata = <value optimized out> fdwrite = {__fds_bits = {0 <repeats 32 times>}} n = 0 childstat = 10534789 bfqexiting = <value optimized out> cwalk = 0x3099c5c8 now = 1404413120 connhead = 0x172d7a18 conntail = 0x3099c5c8 listenip = 0x8073eb7 "0.0.0.0" listenport = 1984 hostsfn = 0x83ad660 "!/etc/xymon/hosts.cfg" restartfn = 0x83ad5b0 "\003" logfn = 0x83ad600 "/var/log/xymon/xymond.log" checkpointinterval = 300 do_purples = 1 nextpurpleupdate = 1404413457 laddr = {sin_family = 2, sin_port = 49159, sin_addr = {s_addr = 0}, sin_zero = "\000\000\000\000\000\000\000"} lsocket = 3 opt = 1 listenq = 8192 argi = 12 tv = {tv_sec = 1404412785, tv_usec = 794754} tz = {tz_minuteswest = 240, tz_dsttime = 0} daemonize = 0 pidfile = 0x83ad560 "/var/log/xymon/xymond.pid" sa = {__sigaction_handler = {sa_handler = 0x8049c80 <sig_handler>, sa_sigaction = 0x8049c80 <sig_handler>}, sa_mask = {__val = {0 <repeats 32 times>}}, sa_flags = 0, sa_restorer = 0} conn_timeout = 30 envarea = 0x0 create_backfeedqueue = 0 nexttcpcheck = 1404413121 tcpcheckinterval = 1

Any ideas on what I should try next for this guy?

-Sean

This E-mail and any of its attachments may contain Time Warner Cable proprietary information, which is privileged, confidential, or subject to copyright belonging to Time Warner Cable. This E-mail is intended solely for the use of the individual or entity to which it is addressed. If you are not the intended recipient of this E-mail, you are hereby notified that any dissemination, distribution, copying, or action taken in relation to the contents of and attachments to this E-mail is strictly prohibited and may be unlawful. If you have received this E-mail in error, please notify the sender immediately and permanently delete the original and any copy of this E-mail and any printout.