urlplus.pl http/https monitoring extension script
I've partially completed the end-to-end transaction monitoring part of urlplus.pl. Currently, it only works with a 2-part test: content check initial page, submit content, content check resulting page. I haven't yet completed it beyond 2 pages. I've also been re-prioritized, so I'm not sure when I'll get around to getting it to work past 2 pages. But in any case, I've also cleaned up some of the code, making it a little more user-friendly to modify for their own needs.
On Jan 28, 2008 10:54 AM, Gary Baluha <gumby3203 at gmail.com> wrote:
We are in the process of replacing several sitescope monitors with Hobbit, and I have found some of the built-in Hobbit http checks inadequate. As a result, I have been working on an extension script which at its core is essentially a wrapper for curl. However, it provides for more robust user-customization than is easily possible with Hobbit's built-in tests. It is still a work-in-progress, but I believe it has matured enough to be worth posting on The Shire. I wrote it using perl, but I have a feeling that some point in the future it may need to be converted to C (mostly for the speed). However, it seems to work pretty good for me now.
The main feature I required from this script was the addition of a per-host customizable timeout period. Some of the hosts I'm testing take up to a minute to return back any data, and this is considered normal. However, I didn't want to bump up the timeout for _all_ hosts. Admittedly, this script uses an additional configuration file and doesn't completely integrate with the bb-hosts file, but it works for me and helps keep the bb-hosts file clean. I'd be interested in what other people think of this script, which is the main reason I'm contributing it now. I have attached it to this post (I haven't yet subscribed to theshire-developers, so I'm not able to upload it myself yet).
On Feb 6, 2008 1:40 PM, Gary Baluha <gumby3203 at gmail.com> wrote:
I've partially completed the end-to-end transaction monitoring part of urlplus.pl. Currently, it only works with a 2-part test: content check initial page, submit content, content check resulting page. I haven't yet completed it beyond 2 pages. I've also been re-prioritized, so I'm not sure when I'll get around to getting it to work past 2 pages. But in any case, I've also cleaned up some of the code, making it a little more user-friendly to modify for their own needs.
Can I interest you in a diff that adds proxy userid/password?? Most of the checks I do go through a proxy that requires authentication. And then there are some occasions when I use a *different* proxy that doesn't require authentication at all - I suppose that would mean moving the proxy url out to the config file, or maybe pick the proxy via p1/p2/P1/P2??
Ralph Mitchell
Cool, thanks! I only just looked over the diff file, but so far it looks pretty good. You did a good job at keeping the same formatting I used too, which is nice :-) Only one thing was missed: you didn't add your initials and a comment to the revision history section ;-)
Regarding the proxy, I think it would be a good idea to have the proxy url in the config file. But I think in general, the config file could use a little overhauling, as some of the monitors I set up have long urls and especially with the "post" type, long post content as well. It makes the single-line format a bit unwieldy to edit. I'll have to come up with something when I get a chance.
On Feb 6, 2008 4:17 PM, Ralph Mitchell <ralphmitchell at gmail.com> wrote:
On Feb 6, 2008 1:40 PM, Gary Baluha <gumby3203 at gmail.com> wrote:
I've partially completed the end-to-end transaction monitoring part of urlplus.pl. Currently, it only works with a 2-part test: content check initial page, submit content, content check resulting page. I haven't yet completed it beyond 2 pages. I've also been re-prioritized, so I'm not sure when I'll get around to getting it to work past 2 pages. But in any case, I've also cleaned up some of the code, making it a little more user-friendly to modify for their own needs.
Can I interest you in a diff that adds proxy userid/password?? Most of the checks I do go through a proxy that requires authentication. And then there are some occasions when I use a *different* proxy that doesn't require authentication at all - I suppose that would mean moving the proxy url out to the config file, or maybe pick the proxy via p1/p2/P1/P2??
Ralph Mitchell
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
On Feb 7, 2008 8:44 AM, Gary Baluha <gumby3203 at gmail.com> wrote:
Cool, thanks! I only just looked over the diff file, but so far it looks pretty good. You did a good job at keeping the same formatting I used too, which is nice :-) Only one thing was missed: you didn't add your initials and a comment to the revision history section ;-)
Oooops... :)
Regarding the proxy, I think it would be a good idea to have the proxy url in the config file. But I think in general, the config file could use a little overhauling, as some of the monitors I set up have long urls and especially with the "post" type, long post content as well. It makes the single-line format a bit unwieldy to edit. I'll have to come up with something when I get a chance.
I can think of at least two other things I'd like to see in the config file:
COLUMN - There could be multiple different checks on a given server. For example: we have a bunch of servers running Tomcat on ports 8001 & 9001. One port set is always offline (and disabled-until-OK in Hobbit) The client occasionally asks to switch clusters, usually at inconvenient (for me) times, so I check both port sets all the time. A single test hitting both ports would always show red...
per-host authentication - to handle the occasions where a browser would pop up an authentication box because the server responds with "401 Unauthorized" & "WWW-Authenticate: Basic realm="xxxx" headers. That would be "curl -u userid:passwd".
I think you're going to end up with multi-line entries per host...
Ralph Mitchell
participants (2)
-
gumby3203@gmail.com
-
ralphmitchell@gmail.com