[re-post] xymon notifications
We've been running big brother for some years, and we monitor several hundred servers in 2 data centers.
We are currently running a pilot of xymon (4.3.0 svn), and just as with big brother, we have redundant monitoring servers. A xymon server in california monitors hosts in both california and arizona, and a xymon server in arizona monitors hosts in both data centers as well.
For the most part, xymon is performing well, but it is a bit of an annoyance with xymon that we get duplicate notifications, as each xymon server sends it's own notifications for every event.
Big brother sends a single notification for each event, as controlled by the alerting failover.
Is there any way to suppress the duplicate notifications from xymon?
Joe
On Wed, May 27, 2009 at 2:03 PM, J Sloan <joe at tmsusa.com> wrote:
We've been running big brother for some years, and we monitor several hundred servers in 2 data centers.
We are currently running a pilot of xymon (4.3.0 svn), and just as with big brother, we have redundant monitoring servers. A xymon server in california monitors hosts in both california and arizona, and a xymon server in arizona monitors hosts in both data centers as well.
For the most part, xymon is performing well, but it is a bit of an annoyance with xymon that we get duplicate notifications, as each xymon server sends it's own notifications for every event.
Big brother sends a single notification for each event, as controlled by the alerting failover.
Is there any way to suppress the duplicate notifications from xymon?
I don't think xymon has failover yet. How are you sending the alerts?? If you're using a script, you could make the script on the backup server run a check against the primary. If it fails, allow the backup to send out the notifications. Not perfect, but it could at least reduce the duplicates.
Ralph Mitchell
Ralph Mitchell wrote:
On Wed, May 27, 2009 at 2:03 PM, J Sloan <joe at tmsusa.com <mailto:joe at tmsusa.com>> wrote:
We've been running big brother for some years, and we monitor several hundred servers in 2 data centers. We are currently running a pilot of xymon (4.3.0 svn), and just as with big brother, we have redundant monitoring servers. A xymon server in california monitors hosts in both california and arizona, and a xymon server in arizona monitors hosts in both data centers as well. For the most part, xymon is performing well, but it is a bit of an annoyance with xymon that we get duplicate notifications, as each xymon server sends it's own notifications for every event. Big brother sends a single notification for each event, as controlled by the alerting failover. Is there any way to suppress the duplicate notifications from xymon?I don't think xymon has failover yet. How are you sending the alerts?? If you're using a script, you could make the script on the backup server run a check against the primary. If it fails, allow the backup to send out the notifications. Not perfect, but it could at least reduce the duplicates.
We're using the mail facility - for instance:
$LXADM=MAIL joe TIME=W:0800:1800 REPEAT=30m
$LXDNS=%(emerald|ebony|mulholland|plifsp01|plifsp10).*
HOST=$LXDNS $LXADM RECOVERED
Joe
Hi, joe
We are running two xymon servers across WAN network also. Here is a brief description how we did it.
- xymon1 is the primpary one and xymon2 is the standby one which is dumb(not alerting).
- all the clients send xymon messags to both xymon1 and xymon2.
- on xymon2(standby),
- we have a cron entry to sync xymon1 config files every 5 minutes.
- there is a xymon2 hertbeat server side external module to check the health of xymon1. if xymon1 is head or not healthy, this module will enable xymon2 with [bbpage] section enabled.
- heartbeat server side module will disable its alerting once xymon1 is back online.
So we have a semi-auto fail-over architecture. but we need to take the lost of missing metrics information on xymon1 during its' down time.
keeping two xymon server in sync on same LAN is easy using HA/clustering software. but keeping two xyomn servers in sync on two WANs far away is not easy. I heard Sun's clustering software has new feature to enable clustering over WANs, but I haven't study this myself.
Hope this help
T.J. Yang
Date: Wed, 27 May 2009 12:03:34 -0700 From: joe at tmsusa.com To: hobbit at hswn.dk Subject: [hobbit] [re-post] xymon notifications
We've been running big brother for some years, and we monitor several hundred servers in 2 data centers.
We are currently running a pilot of xymon (4.3.0 svn), and just as with big brother, we have redundant monitoring servers. A xymon server in california monitors hosts in both california and arizona, and a xymon server in arizona monitors hosts in both data centers as well.
For the most part, xymon is performing well, but it is a bit of an annoyance with xymon that we get duplicate notifications, as each xymon server sends it's own notifications for every event.
Big brother sends a single notification for each event, as controlled by the alerting failover.
Is there any way to suppress the duplicate notifications from xymon?
Joe
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
Hotmail® has ever-growing storage! Don’t worry about storage limits. http://windowslive.com/Tutorial/Hotmail/Storage?ocid=TXT_TAGLM_WL_HM_Tutoria...
participants (3)
-
joe@tmsusa.com
-
ralphmitchell@gmail.com
-
tj_yang@hotmail.com