[hobbit] Alerts Help

tim.grzechowski.osv＠fedex.com

1 Aug 2008 1 Aug '08

7:49 p.m.

With this hobbit naming issue coming up it looks like I asked a question at the wrong time. ;)

This may be much easier. could somebody cut'n'paste part of their hobbit-alerts.cfg here that uses email for alerts. If you have some with subpages that would be most excellent.

Thanks and everyone have a great weekend!

/tg

From: Tim Grzechowski [mailto:tim.grzechowski.osv at fedex.com] Sent: Thursday, July 31, 2008 4:57 PM To: hobbit at hswn.dk Subject: [hobbit] Alerts Help

I just cannot figure how to set up alerts.

Maybe I can save you lots of reading. All I am trying to do at this time I am just looking to set up basic paging to an email (list) address.

I will want to break it down to subpages for fabric servers, DB servers, web servers and weblogic server.

But. here is what I am working with now. For now I have, or so I thought, narrowed it down to the most basic of configuration and still cannot get it to work.

hobbit-alerts.cfg (added to the bottom of the file).

HOST=*

    MAIL root at localhost     SERVICE=conn    color=yellow

    MAIL root at localhost     SERVICE=cONN    color=red

    MAIL root at localhost     SERVICE=conn    color=purple

When I run bbcmd with just --test I get the following:

[root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test tstfabric121.ce.fedex.com procs

2008-07-31 16:48:03 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg

00024059 2008-07-31 16:48:03 send_alert tstfabric121.ce.fedex.com:procs state Paging

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 125

00024059 2008-07-31 16:48:03 *** Match with 'HOST=*' ***

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 126

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=conn color=yellow' (service not in include list)

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 127

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=cONN color=red' (service not in include list)

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 128

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=conn color=purple' (service not in include list)

With --debug too I get this:

[root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test --debug tstfabric121.ce.fedex.com procs

2008-07-31 16:48:43 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg

2008-07-31 16:48:43 Host not found in bb-hosts - assuming it is on the top page

00024284 2008-07-31 16:48:43 send_alert --debug:tstfabric121.ce.fedex.com state Paging

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug:tstfabric121.ce.fedex.com:' against rule line 125

00024284 2008-07-31 16:48:43 *** Match with 'HOST=*' ***

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug:tstfabric121.ce.fedex.com:' against rule line 126

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=conn color=yellow' (service not in include list)

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug:tstfabric121.ce.fedex.com:' against rule line 127

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=cONN color=red' (service not in include list)

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug:tstfabric121.ce.fedex.com:' against rule line 128

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=conn color=purple' (service not in include list)

Now the host, tstfabric121.ce.fedex.com, is in the bb-host file. And, in fact, is the hobbit server.

Also, so long as I am burning bandwidth, I am not understanding how the page/subpage work into this? I do have subpage's set up in my bb-hosts file.

Thanks.

Show replies by date

josh＠imaginenetworksllc.com

1 Aug 1 Aug

7:57 p.m.

HOST=%.*\.imaginenetworksllc\.com MAIL 9375731337 at txt.att.net COLOR=RED DURATION>2m REPEAT=60 RECOVERED FORMAT=SMS

HOST=* MAIL josh at imaginenetworksllc.com COLOR=RED DURATION>15m REPEAT=60 RECOVERED

This will...

text message my phone for servers that are *.imaginenetworksllc.com after being red for 2 minutes and repeat every hour and email when it goes green or blue

and the for the remaining hosts I will get an email after 15m of being red and repeater every hour, plus an email when it goes green or blue.

Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373

Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer

On Fri, Aug 1, 2008 at 3:49 PM, Tim Grzechowski < tim.grzechowski.osv at fedex.com> wrote:

...

With this hobbit naming issue coming up it looks like I asked a question at the wrong time. ;)

This may be much easier… could somebody cut'n'paste part of their hobbit-alerts.cfg here that uses email for alerts. If you have some with subpages that would be most excellent.

Thanks and everyone have a great weekend!

/tg

*From:* Tim Grzechowski [mailto:tim.grzechowski.osv at fedex.com] *Sent:* Thursday, July 31, 2008 4:57 PM *To:* hobbit at hswn.dk *Subject:* [hobbit] Alerts Help

I just cannot figure how to set up alerts.

Maybe I can save you lots of reading… All I am trying to do at this time I am just looking to set up basic paging to an email (list) address.

I will want to break it down to subpages for fabric servers, DB servers, web servers and weblogic server.

But… here is what I am working with now. For now I have, or so I thought, narrowed it down to the most basic of configuration and still cannot get it to work.

hobbit-alerts.cfg (added to the bottom of the file).

HOST=*
    MAIL root at localhost     SERVICE=conn    color=yellow

    MAIL root at localhost     SERVICE=cONN    color=red

    MAIL root at localhost     SERVICE=conn    color=purple
When I run bbcmd with just --test I get the following:

[root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test tstfabric121.ce.fedex.com procs

2008-07-31 16:48:03 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg

00024059 2008-07-31 16:48:03 send_alert tstfabric121.ce.fedex.com:procs state Paging

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 125

00024059 2008-07-31 16:48:03 *** Match with 'HOST=*' ***

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 126

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=conn color=yellow' (service not in include list)

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 127

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=cONN color=red' (service not in include list)

00024059 2008-07-31 16:48:03 Matching host:service:page 'tstfabric121.ce.fedex.com:procs:' against rule line 128

00024059 2008-07-31 16:48:03 Failed 'MAIL root at localhost SERVICE=conn color=purple' (service not in include list)

With --debug too I get this:

[root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test --debug tstfabric121.ce.fedex.com procs

2008-07-31 16:48:43 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg

2008-07-31 16:48:43 Host not found in bb-hosts - assuming it is on the top page

00024284 2008-07-31 16:48:43 send_alert --debug:tstfabric121.ce.fedex.comstate Paging

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug: tstfabric121.ce.fedex.com:' against rule line 125

00024284 2008-07-31 16:48:43 *** Match with 'HOST=*' ***

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug: tstfabric121.ce.fedex.com:' against rule line 126

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=conn color=yellow' (service not in include list)

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug: tstfabric121.ce.fedex.com:' against rule line 127

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=cONN color=red' (service not in include list)

00024284 2008-07-31 16:48:43 Matching host:service:page '--debug: tstfabric121.ce.fedex.com:' against rule line 128

00024284 2008-07-31 16:48:43 Failed 'MAIL root at localhost SERVICE=conn color=purple' (service not in include list)

Now the host, tstfabric121.ce.fedex.com, is in the bb-host file. And, in fact, is the hobbit server.

Also, so long as I am burning bandwidth, I am not understanding how the page/subpage work into this? I do have subpage's set up in my bb-hosts file.

Thanks.

tim.grzechowski.osv＠fedex.com

9:16 p.m.

I added the following to hobbit-alerts.cfg:

 HOST=*

      MAIL root at localhost COLOR=yellow,purple,red

But when I run the bbcmd test the last line is what is throwing me off.

 [root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test

tstfabric121.ce.fedex.com conn

 2008-08-01 16:11:12 Using default environment file

/usr/lib/hobbit/server/etc/hobbitserver.cfg

 00024148 2008-08-01 16:11:12 send_alert tstfabric121.ce.fedex.com:conn

state Paging

 00024148 2008-08-01 16:11:12 Matching host:service:page

'tstfabric121.ce.fedex.com:conn:' against rule line 125

 00024148 2008-08-01 16:11:12 *** Match with 'HOST=*' ***

 00024148 2008-08-01 16:11:12 Matching host:service:page

'tstfabric121.ce.fedex.com:conn:' against rule line 126

 00024148 2008-08-01 16:11:12 *** Match with 'MAIL root at localhost

COLOR=yellow,purple,red' ***

 00024148 2008-08-01 16:11:12 Mail alert with command 'mail -s "Hobbit

[12345] tstfabric121.ce.fedex.com:conn CRITICAL (RED)" root at localhost'

  [root at tstfabric121 etc]#

That line is throwing me off. The fact that it says "CRITCAL (RED)". As that host is all green that line would lead me to believe that the test is not working as expected and is going to email a CRITCAL (RED) email. Correct?

/tg

omar＠basis.is

9:33 p.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

hobbitd_alert --test is for simulating various different conditions. It doesn't reflect the current status of the tests. You can pass extra parameters to specify the color, duration, group and time.

*** from the manpage ***

--test HOST SERVICE [options] Shows which alert rules matches the given HOST/SERVICE combination. Useful to debug configuration problems, and see what rules are used for an alert.

The possible options are: --color=COLORNAME The COLORNAME parameter is the color of the alert: red, yellow or purple. --duration=SECONDS The SECONDS parameter is the duration of the alert in seconds. --group=GROUPNAME The GROUPNAME paramater is a groupid string from the hobbit-clients.cfg file. --time=TIMESTRING The TIMESTRING parameter is the time-of-day for the alert, expressed as an absolute time in the epoch format (seconds since Jan 1 1970). This is easily obtained with the GNU date utility using the "+%s" output format.

Also instead of HOST=* you can use PAGE=pagename if you've seperated your hosts into subpages in bbhosts.

PAGE=Production COLOR=red EXSERVICE=%(cpu|memory|msgs) DURATION>6 MAIL root at localhost

Cheers, Omar

On fös 1.ágú 2008 21:16, Tim Grzechowski wrote:

...

I added the following to hobbit-alerts.cfg:
 HOST=*

      MAIL root at localhost COLOR=yellow,purple,red
But when I run the bbcmd test the last line is what is throwing me off.
 [root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test
tstfabric121.ce.fedex.com conn
 2008-08-01 16:11:12 Using default environment file
/usr/lib/hobbit/server/etc/hobbitserver.cfg
 00024148 2008-08-01 16:11:12 send_alert
tstfabric121.ce.fedex.com:conn state Paging
 00024148 2008-08-01 16:11:12 Matching host:service:page
'tstfabric121.ce.fedex.com:conn:' against rule line 125
 00024148 2008-08-01 16:11:12 *** Match with 'HOST=*' ***

 00024148 2008-08-01 16:11:12 Matching host:service:page
'tstfabric121.ce.fedex.com:conn:' against rule line 126
 00024148 2008-08-01 16:11:12 *** Match with 'MAIL root at localhost
COLOR=yellow,purple,red' ***
 *00024148 2008-08-01 16:11:12 Mail alert with command 'mail -s
"Hobbit [12345] tstfabric121.ce.fedex.com:conn CRITICAL (RED)" root at localhost'* a few [root at tstfabric121 etc]#

That line is throwing me off. The fact that it says “CRITCAL (RED)”. As that host is all green that line would lead me to believe that the test is not working as expected and is going to email a CRITCAL (RED) email. Correct?

/tg

-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIk4ElO5lNk+Yy9cgRAqMdAKDMBsqno6aqHnqI7PviJg5jaX4MwgCaArKy vAWwZR8S+EgYs5sNC+tuZ/A= =qKeG -----END PGP SIGNATURE-----

josh＠imaginenetworksllc.com

9:42 p.m.

Click the info button for a host that matches an alert rule, it is easier to read that way.

On 8/1/08, Omar Hermannsson <omar at basis.is> wrote:

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1

hobbitd_alert --test is for simulating various different conditions. It doesn't reflect the current status of the tests. You can pass extra parameters to specify the color, duration, group and time.

*** from the manpage ***

--test HOST SERVICE [options] Shows which alert rules matches the given HOST/SERVICE combination. Useful to debug configuration problems, and see what rules are used for an alert.

The possible options are: --color=COLORNAME The COLORNAME parameter is the color of the alert: red, yellow or purple. --duration=SECONDS The SECONDS parameter is the duration of the alert in seconds. --group=GROUPNAME The GROUPNAME paramater is a groupid string from the hobbit-clients.cfg file. --time=TIMESTRING The TIMESTRING parameter is the time-of-day for the alert, expressed as an absolute time in the epoch format (seconds since Jan 1 1970). This is easily obtained with the GNU date utility using the "+%s" output format.

Also instead of HOST=* you can use PAGE=pagename if you've seperated your hosts into subpages in bbhosts.

PAGE=Production COLOR=red EXSERVICE=%(cpu|memory|msgs) DURATION>6 MAIL root at localhost

Cheers, Omar

On fös 1.ágú 2008 21:16, Tim Grzechowski wrote:

...
I added the following to hobbit-alerts.cfg:
 HOST=*

      MAIL root at localhost COLOR=yellow,purple,red
But when I run the bbcmd test the last line is what is throwing me off.
 [root at tstfabric121 etc]# ../bin/bbcmd hobbitd_alert --test
tstfabric121.ce.fedex.com conn
 2008-08-01 16:11:12 Using default environment file
/usr/lib/hobbit/server/etc/hobbitserver.cfg
 00024148 2008-08-01 16:11:12 send_alert
tstfabric121.ce.fedex.com:conn state Paging
 00024148 2008-08-01 16:11:12 Matching host:service:page
'tstfabric121.ce.fedex.com:conn:' against rule line 125
 00024148 2008-08-01 16:11:12 *** Match with 'HOST=*' ***

 00024148 2008-08-01 16:11:12 Matching host:service:page
'tstfabric121.ce.fedex.com:conn:' against rule line 126
 00024148 2008-08-01 16:11:12 *** Match with 'MAIL root at localhost
COLOR=yellow,purple,red' ***
 *00024148 2008-08-01 16:11:12 Mail alert with command 'mail -s
"Hobbit [12345] tstfabric121.ce.fedex.com:conn CRITICAL (RED)" root at localhost'* a few [root at tstfabric121 etc]#

That line is throwing me off. The fact that it says "CRITCAL (RED)". As that host is all green that line would lead me to believe that the test is not working as expected and is going to email a CRITCAL (RED) email. Correct?

/tg
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIk4ElO5lNk+Yy9cgRAqMdAKDMBsqno6aqHnqI7PviJg5jaX4MwgCaArKy vAWwZR8S+EgYs5sNC+tuZ/A= =qKeG -----END PGP SIGNATURE-----

To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

-- Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373

Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer

JMSmith＠stvincenthealth.com

7:57 p.m.

All you need in server/etc/hobbit-alerts.cfg is something like this:

HOST=integration MAIL john at dear.com COLOR=yellow,purple,red

Don't worry about what the page/subpage or whatever. Just the hostname as defined in bb-hosts.

Jim Smith

SVHS

Little Rock, AR

From: Tim Grzechowski [mailto:tim.grzechowski.osv at fedex.com] Sent: Friday, August 01, 2008 2:50 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Alerts Help