Hi,
Some time ago I promised information about aix monitoring and possible updates to hobbit. We are going to use hobbit for monitoring, but most of the monitor scripts for AIX will be integrated in a custom written perl library that is also used for making and monitoring backups. And I can not publish the full library (I wrote it myself, but my boss will not be happy if I do this) and so I also can not publish the monitor scripts :(
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time.
Stef
Hi,
Stef Coene wrote :
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time.
I made a patch that lets you choose between "one rrd file with multiple datasources in it per status "or "one rrd per datasource with one DS in each file ".
Just specify "SPLITNCV_foo" instead of "NCV_foo" in you config file.
I posted it on the list on "28 Dec 2006 19:36:08 +0100" :
http://www.hswn.dk/hobbiton/2006/12/msg00357.html
Note that you must apply the all-in-one patch before, or at the very least the ncv-ignoretext patch.
-- Charles Goyard - cgoyard at cvf.fr - (+33) 1 45 38 01 31
On Wednesday 17 January 2007 12:22, Charles Goyard wrote:
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time.
I made a patch that lets you choose between "one rrd file with multiple datasources in it per status "or "one rrd per datasource with one DS in each file ".
Just specify "SPLITNCV_foo" instead of "NCV_foo" in you config file. I once changed the BigBrother scripts so you can control messages in the message that are used for rrd. It's like ncv, but much more powerfull. I also hide it with html code. So you get something like: <!--RRD EBCT EBCT1 20585056.0512--> This was picked up by the larrd script. I also changed the script creates the graphs so I had a "fall-back" entry (I called it blanco) that I used to create graphs from any rrd file I wanted: /cgi-bin/larrd-grapher.cgi?host=server&service=blanco&part=EBCT,EBCT1
I posted it on the list on "28 Dec 2006 19:36:08 +0100" : http://www.hswn.dk/hobbiton/2006/12/msg00357.html Ok, I missed this one ;)
Note that you must apply the all-in-one patch before, or at the very least the ncv-ignoretext patch.
The biggest problem we have is that we are going to combine lots of different scripts (monitoring, trending, capacity planning, ...) in 1 tool. And the first usable version needs to be finished before end february. So, once we have something, we can change what we want. The idea is that we have 1 server / customer (this can be a vmware image or a dedicated server) that we can use for deployment, monitoring, trending, alerting, inventory, .... We have most of the stuff, but we need to "glue" them together. Hobbit for monitoring is clear ;), but we also needs a framework for trending.
The second problem is the fact that I want to distribute the same client and scripts to all my servers. So the clienlaunch config file needs a parameter where I can specify on which server I want to run the tests (in the old BigBrother days, there was a config file for this). I don't think this is hard to do, but my C knowledge is really that bad that I don't even try to do this :(
Stef
On Wed, Jan 17, 2007 at 01:02:21PM +0100, Stef Coene wrote:
The second problem is the fact that I want to distribute the same client and scripts to all my servers. So the clienlaunch config file needs a parameter where I can specify on which server I want to run the tests (in the old BigBrother days, there was a config file for this). I don't think this is hard to do, but my C knowledge is really that bad that I don't even try to do this :(
Try this modification for hobbitlaunch; it adds an "ONHOST" setting to hobbitlaunch.cfg, so a task will be disabled unless the local hostname matches this expression. E.g. if you have a task that should only run on hosts whose hostname begins with "web", then
[webchecks] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg CMD $BBHOME/ext/webchecks.sh INTERVAL 5m ONHOST ^web
Regards, Henrik
On Wednesday 17 January 2007 13:54, Henrik Stoerner wrote:
On Wed, Jan 17, 2007 at 01:02:21PM +0100, Stef Coene wrote:
The second problem is the fact that I want to distribute the same client and scripts to all my servers. So the clienlaunch config file needs a parameter where I can specify on which server I want to run the tests (in the old BigBrother days, there was a config file for this). I don't think this is hard to do, but my C knowledge is really that bad that I don't even try to do this :(
Try this modification for hobbitlaunch; it adds an "ONHOST" setting to hobbitlaunch.cfg, so a task will be disabled unless the local hostname matches this expression. E.g. if you have a task that should only run on hosts whose hostname begins with "web", then
[webchecks] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg CMD $BBHOME/ext/webchecks.sh INTERVAL 5m ONHOST ^web Pff. Help. It's not working. But that's not why I'm saying help. I'm saying help because I know that all the changes I need are easy to implement, but my C knowledge is 0, nada, zero :(( (implementing this in perl will take me 2 minutes)
Stef
On Wednesday 17 January 2007 15:40, Stef Coene wrote:
Pff. Help. It's not working. But that's not why I'm saying help. I'm saying help because I know that all the changes I need are easy to implement, but my C knowledge is 0, nada, zero :(( (implementing this in perl will take me 2 minutes) Update: it is working.
That's one of my problems solved:)
Stef
On Wednesday 17 January 2007 10:38, Stef Coene wrote:
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time. Just wondering, how hard would it be to create an extra channel for trending? So you can use the bb client to send "numbers" to the hobbit server together with some extra control information.
bb <bb server> trends <server name> <rrd file name> <ds name> <number> <options> ...
<rrd file name> is the name of the rrd file. <ds name> is the name you want to store in the rrd file <number> is the number you want to store in the rrd file <options> can be used to specify rrd settings (for instance type GAUGE)
Maybe you can also specify somehow that you want to use 1 rrd for multiple counters.
This can be very powerfull because you can put any number in a rrd file.
Stef
Stef Coene wrote :
Just wondering, how hard would it be to create an extra channel for trending? So you can use the bb client to send "numbers" to the hobbit server together with some extra control information.
bb <bb server> trends <server name> <rrd file name> <ds name> <number> <options>
It's a bad idea, because you hook the underlying data storage format into the protocol.
You can always add something like that :
hobbitd_channel --channel=status --log=/var/log/hobbit/rrd-customengine-status.log hobbitd_rrdcustomengine --rrddir=/usr/local/hobbit/data/rrd hobbitd_channel --channel=data --log=/var/log/hobbit/rrd-customengine-data.log hobbitd_rrdcustomengine --rrddir=/usr/local/hobbit/data/rrd
It's up to the reader to write the hobbitd_rrdcustomengine program (can be Perl, Shell, whatever suits you).
-- Charles Goyard - cgoyard at cvf.fr - (+33) 1 45 38 01 31
On Wed, Jan 17, 2007 at 02:16:49PM +0100, Charles Goyard wrote:
Stef Coene wrote :
Just wondering, how hard would it be to create an extra channel for trending? So you can use the bb client to send "numbers" to the hobbit server together with some extra control information.
bb <bb server> trends <server name> <rrd file name> <ds name> <number> <options>
It's a bad idea, because you hook the underlying data storage format into the protocol.
True, but I can see it being useful for custom trends tracking. The "NCV" module also has a heavy coupling between the way the client formats the raw data, and how it gets stored in the RRD files.
I would do it differently (because I hate having to update clients), but I won't insist that people shouldn't aim at their own feet when pulling the trigger :-)
Anyway, a reasonable implementation takes less than 100 lines of code. It compiles, and with a bit of luck it may even work! Apply the attached patch with
cd hobbit-4.2.0 patch -p0 </tmp/trends.patch
Then run "make" and install (at least) the new hobbitd/hobbitd_rrd binary and restart Hobbit.
Regards, Henrik
On Wednesday 17 January 2007 15:27, Henrik Stoerner wrote:
True, but I can see it being useful for custom trends tracking. The "NCV" module also has a heavy coupling between the way the client formats the raw data, and how it gets stored in the RRD files.
I would do it differently (because I hate having to update clients), but I won't insist that people shouldn't aim at their own feet when pulling the trigger :-) The "problem" with the ncv module is that I want to use hobbit to create graphs. Lots of graphs (you would be surprised how many usefull counters an oracle database has). This is too complex to handly it with the ncv worker module.
Stef
On Wed, Jan 17, 2007 at 02:04:29PM +0100, Stef Coene wrote:
On Wednesday 17 January 2007 10:38, Stef Coene wrote:
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time. Just wondering, how hard would it be to create an extra channel for trending? So you can use the bb client to send "numbers" to the hobbit server together with some extra control information.
bb <bb server> trends <server name> <rrd file name> <ds name> <number> <options>
You wouldn't need a dedicated channel for this, you can use the "data" type message.
I've made a very quick implementation that takes this input
data SERVERNAME.trends
[file1.rrd] DS:set1:GAUGE:600:0:U 10 DS:set2:DERIVE:600:0:U 20
[file2.rrd] DS:anotherset1:COUNTER:600:0:U 12345
and then generates/updates the two RRD files. file1.rrd has two datasets ("set1" and "set2") with the values "10" and "20", and file2.rrd has one dataset "anotherset1" with the value "12345".
Would that fulfill your needs ?
Regards, Henrik
On Wednesday 17 January 2007 15:05, Henrik Stoerner wrote:
You wouldn't need a dedicated channel for this, you can use the "data" type message.
I've made a very quick implementation that takes this input Can you send me your program? I suppose this is a program that reads the data channel and picks up the .trends messages ?
data SERVERNAME.trends
[file1.rrd] DS:set1:GAUGE:600:0:U 10 DS:set2:DERIVE:600:0:U 20
[file2.rrd] DS:anotherset1:COUNTER:600:0:U 12345
and then generates/updates the two RRD files. file1.rrd has two datasets ("set1" and "set2") with the values "10" and "20", and file2.rrd has one dataset "anotherset1" with the value "12345".
Would that fulfill your needs ? Maybe. The problem is that I know what I want the result to be, but I don't know how to get there. So I'm trying different things.
Stef
On Wednesday 17 January 2007 15:05, Henrik Stoerner wrote:
On Wed, Jan 17, 2007 at 02:04:29PM +0100, Stef Coene wrote:
On Wednesday 17 January 2007 10:38, Stef Coene wrote:
Same for trending, hobbit is not powerfull enough for our needs. And we don't have the C knowledge to change hobbit. One of the problems is that there is 1 rrd file / check. But we have checks where the number on 1 page we want to graph can change over time.
Just wondering, how hard would it be to create an extra channel for trending? So you can use the bb client to send "numbers" to the hobbit server together with some extra control information.
bb <bb server> trends <server name> <rrd file name> <ds name> <number> <options>
You wouldn't need a dedicated channel for this, you can use the "data" type message. update: found the "program" in your other mail.
Stef
participants (3)
-
cgoyard＠cvf.fr
-
henrik＠hswn.dk
-
stef.coene＠docum.org