I'm trying to do my first custom graph, using data collected from a custom script.
The script collects data fine, and successfully updates hobbit at it's regular five minute increments. The data as sent looks like this:
five : 17 ten : 24 fifteen : 30 twenty : 42 thirty : 62 fortyfive : 81 sixty : 108 ninety : 166 onetwenty : 218 oneeighty : 349 The column name is 'recent'. Here's BBHOSTS: group-only recent|pending|stuck Maestro 0.0.0.0 maestro_alarm_cases # prefer noconn recent pending stuck NAME:"Alarm Cases"
and hobbitserver.cfg: TEST2RRD="cpu=la,disk,inode,qtree,memory,<more stuff>,ports,clock,lines,recent=ncv" NCV_recent="five:GAUGE,ten:GAUGE,fifteen:GAUGE,twenty:GAUGE,thirty:GAUGE ,fortyfive:GAUGE,sixty:GAUGE,ninety:GAUGE,onetwenty:GAUGE,oneeighty:GAUG E"
I stopped/started hobbit server. I've been watching the 'recent' column update regularly every five minutes, for at least 45 minutes now. But there doesn't appear to be any RRD data file for this 'recent' test: find /development/hobbit/data/rrd -name "*recent*" -print The above 'find' command finds nothing related to 'recent' (although there are plenty of OTHER test's RRD files in that directory - default tests - just not my custom test) I must have missed something simple. I've gone over the hobbit webserver's HTML help on "Custom Graphs" several times, but can't find the cause of my error.
I'm still not getting any RRD data being populated after the following changes:
(1) Added "recent" to the GRAPHS line in hobbitserver.cfg. I thought this line was only for putting things in the trends column, but I added 'recent' to it anyway.
(2) Changed my NCV_recent line in hobbitserver.cfg to "*:GAUGE" rather than individually listing each dataset.
(3) Restarted hobbit.
(4) Changed my status messages to not have any spaces in them They were like this e.g., "five<space>:<space>27 Now they are like this e.g., "five:27"
Still no RRD database file being generated. I'm looking in the ....../data/rrd directory for some file named like *recent*.rrd
The messages I'm sending from my custom script are status messages, and they show up on the regular webpage displays, updated every five minutes. It looks like the rrd process is running too:
hobbit at stars-dev <mailto:hobbit at stars-dev> -> ps -ef | grep status hobbit 593 587 0 21:52 ? 00:00:00 hobbitd_channel --channel=status --log=/development/hobbit/logs/rrd-status.log hobbitd_rrd --rrddir=/development/hobbit/data/rrd
I looked through the ...../logs/rrd-status.log and rrd-data.log files and there is no mention of 'recent' in there.
Any ideas on where I should look next to debug this? Thanks in advance for any help or guidance.
From: Haertig, David F (Dave) [mailto:haertig at avaya.com] Sent: Tuesday, May 29, 2007 11:46 AM To: hobbit at hswn.dk Subject: [hobbit] Custom graphs: RRD database won't populate
I'm trying to do my first custom graph, using data collected from a custom script.
The script collects data fine, and successfully updates hobbit at it's regular five minute increments. The data as sent looks like this:
five : 17 ten : 24 fifteen : 30 twenty : 42 thirty : 62 fortyfive : 81 sixty : 108 ninety : 166 onetwenty : 218 oneeighty : 349 The column name is 'recent'. Here's BBHOSTS: group-only recent|pending|stuck Maestro 0.0.0.0 maestro_alarm_cases # prefer noconn recent pending stuck NAME:"Alarm Cases"
and hobbitserver.cfg: TEST2RRD="cpu=la,disk,inode,qtree,memory,<more stuff>,ports,clock,lines,recent=ncv" NCV_recent="five:GAUGE,ten:GAUGE,fifteen:GAUGE,twenty:GAUGE,thirty:GAUGE ,fortyfive:GAUGE,sixty:GAUGE,ninety:GAUGE,onetwenty:GAUGE,oneeighty:GAUG E"
I stopped/started hobbit server. I've been watching the 'recent' column update regularly every five minutes, for at least 45 minutes now. But there doesn't appear to be any RRD data file for this 'recent' test: find /development/hobbit/data/rrd -name "*recent*" -print The above 'find' command finds nothing related to 'recent' (although there are plenty of OTHER test's RRD files in that directory - default tests - just not my custom test) I must have missed something simple. I've gone over the hobbit webserver's HTML help on "Custom Graphs" several times, but can't find the cause of my error.
Haertig, David F (Dave) wrote:
I'm still not getting any RRD data being populated after the following changes:
(1) Added "recent" to the GRAPHS line in hobbitserver.cfg. I thought this line was only for putting things in the trends column, but I added 'recent' to it anyway.
(2) Changed my NCV_recent line in hobbitserver.cfg to "*:GAUGE" rather than individually listing each dataset.
(3) Restarted hobbit.
(4) Changed my status messages to not have any spaces in them They were like this e.g., "five<space>:<space>27 Now they are like this e.g., "five:27"
Still no RRD database file being generated. I'm looking in the ....../data/rrd directory for some file named like *recent*.rrd
The messages I'm sending from my custom script are status messages, and they show up on the regular webpage displays, updated every five minutes. It looks like the rrd process is running too:
hobbit at stars-dev <mailto:hobbit at stars-dev>-> ps -ef | grep status hobbit 593 587 0 21:52 ? 00:00:00 hobbitd_channel --channel=status --log=/development/hobbit/logs/rrd-status.log hobbitd_rrd --rrddir=/development/hobbit/data/rrd
I looked through the ...../logs/rrd-status.log and rrd-data.log files and there is no mention of 'recent' in there.
Any ideas on where I should look next to debug this? Thanks in advance for any help or guidance.
*From:* Haertig, David F (Dave) [mailto:haertig at avaya.com] *Sent:* Tuesday, May 29, 2007 11:46 AM *To:* hobbit at hswn.dk *Subject:* [hobbit] Custom graphs: RRD database won't populate
I'm trying to do my first custom graph, using data collected from a custom script.
The script collects data fine, and successfully updates hobbit at it's regular five minute increments. The data as sent looks like this:
five : 17 ten : 24 fifteen : 30 twenty : 42 thirty : 62 fortyfive : 81 sixty : 108 ninety : 166 onetwenty : 218 oneeighty : 349
The column name is 'recent'. Here's BBHOSTS:
group-only recent|pending|stuck Maestro 0.0.0.0 maestro_alarm_cases # prefer noconn recent pending stuck NAME:"Alarm Cases"
and hobbitserver.cfg:
TEST2RRD="cpu=la,disk,inode,qtree,memory,<more stuff>,ports,clock,lines,recent=ncv"
NCV_recent="five:GAUGE,ten:GAUGE,fifteen:GAUGE,twenty:GAUGE,thirty:GAUGE,fortyfive:GAUGE,sixty:GAUGE,ninety:GAUGE,onetwenty:GAUGE,oneeighty:GAUGE"
I stopped/started hobbit server. I've been watching the 'recent' column update regularly every five minutes, for at least 45 minutes now.
But there doesn't appear to be any RRD data file for this 'recent' test:
find /development/hobbit/data/rrd -name "*recent*" -print
The above 'find' command finds nothing related to 'recent' (although there are plenty of OTHER test's RRD files in that directory - default tests - just not my custom test)
I must have missed something simple. I've gone over the hobbit webserver's HTML help on "Custom Graphs" several times, but can't find the cause of my error.
Double-check your settings using the documentation from your Hobbit installation at http|https://$BBSERVERWWWNAME/$BBSERVERWWWURL/help/howtograph.html
or use Henrik's:
http://www.hswn.dk/hobbit/help/howtograph.html
Dominique UNIL - University of Lausanne
Thanks for the reply. Unfortunately, I've already been through that documentation over and over.
But I think I stumbled onto the answer by just blindly guessing and changing things around.
I changed my custom script to send in "green" status messages rather than "clear", and what do you know, an RRD datafile was created.
My custom script was sending in data with an indication of "clear". This is what I normally use for tests I'm working on that are sending data, but I haven't applied any red/yellow condition checking yet. i.e., This is my way of saying "Here's some raw data to view on a web page, but without any interpretation applied to it yet". I can't remember what the original intent of "clear" was, I stole that color for my own use years ago when I started with Big Brother. I imagine Hobbit was applying the original meaning of "clear", whatever it was, and therefore not moving the data to an RRD file. Maybe this hobbit operation is by design, and that's fine with me, ... it would be nice if the documentation on how to create custom graphs mentioned it however.
Thanks!
-----Original Message----- From: Dominique Frise [mailto:Dominique.Frise at unil.ch] Sent: Wednesday, May 30, 2007 1:00 AM To: hobbit at hswn.dk Subject: Re: [hobbit] Custom graphs: RRD database won't populate
Haertig, David F (Dave) wrote:
I'm still not getting any RRD data being populated after the following changes:
(1) Added "recent" to the GRAPHS line in hobbitserver.cfg. I thought this line was only for putting things in the trends column, but I added 'recent' to it anyway.
(2) Changed my NCV_recent line in hobbitserver.cfg to "*:GAUGE" rather
than individually listing each dataset.
(3) Restarted hobbit.
(4) Changed my status messages to not have any spaces in them They were like this e.g., "five<space>:<space>27 Now they are like this e.g., "five:27"
Still no RRD database file being generated. I'm looking in the ....../data/rrd directory for some file named like *recent*.rrd
The messages I'm sending from my custom script are status messages, and they show up on the regular webpage displays, updated every five minutes. It looks like the rrd process is running too:
hobbit at stars-dev <mailto:hobbit at stars-dev>-> ps -ef | grep status hobbit 593 587 0 21:52 ? 00:00:00 hobbitd_channel --channel=status --log=/development/hobbit/logs/rrd-status.log hobbitd_rrd --rrddir=/development/hobbit/data/rrd
I looked through the ...../logs/rrd-status.log and rrd-data.log files and there is no mention of 'recent' in there.
Any ideas on where I should look next to debug this? Thanks in advance for any help or guidance.
-- *From:* Haertig, David F (Dave) [mailto:haertig at avaya.com] *Sent:* Tuesday, May 29, 2007 11:46 AM *To:* hobbit at hswn.dk *Subject:* [hobbit] Custom graphs: RRD database won't populate
I'm trying to do my first custom graph, using data collected from a custom script.
The script collects data fine, and successfully updates hobbit at it's
regular five minute increments. The data as sent looks like this:
five : 17 ten : 24 fifteen : 30 twenty : 42 thirty : 62 fortyfive : 81 sixty : 108 ninety : 166 onetwenty : 218 oneeighty : 349
The column name is 'recent'. Here's BBHOSTS:
group-only recent|pending|stuck Maestro 0.0.0.0 maestro_alarm_cases # prefer noconn recent pending stuck NAME:"Alarm Cases"
and hobbitserver.cfg:
TEST2RRD="cpu=la,disk,inode,qtree,memory,<more stuff>,ports,clock,lines,recent=ncv"
NCV_recent="five:GAUGE,ten:GAUGE,fifteen:GAUGE,twenty:GAUGE,thirty:GAUGE ,fortyfive:GAUGE,sixty:GAUGE,ninety:GAUGE,onetwenty:GAUGE,oneeighty:GAUG E"
I stopped/started hobbit server. I've been watching the 'recent'
column update regularly every five minutes, for at least 45 minutes now.
But there doesn't appear to be any RRD data file for this 'recent'
test:
find /development/hobbit/data/rrd -name "*recent*" -print
The above 'find' command finds nothing related to 'recent' (although there are plenty of OTHER test's RRD files in that directory - default
tests - just not my custom test)
I must have missed something simple. I've gone over the hobbit webserver's HTML help on "Custom Graphs" several times, but can't find the cause of my error.
Double-check your settings using the documentation from your Hobbit installation at http|https://$BBSERVERWWWNAME/$BBSERVERWWWURL/help/howtograph.html
or use Henrik's:
http://www.hswn.dk/hobbit/help/howtograph.html
Dominique UNIL - University of Lausanne
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
I need to look at my custom graphs with a higher resolution (shorter timeframe) than the default "Last 48 hours".
I tried the changes below in hobbitgraph.cfg (appended ":start=end-4h" to the DEF entries), but this didn't make any difference. I was attempting to get a "Last 4 hours" display.
... [recent] TITLE Incoming Cases YAXIS Count DEF:five=recent.rrd:five:AVERAGE:start=end-4h DEF:ten=recent.rrd:ten:AVERAGE:start=end-4h DEF:fifteen=recent.rrd:fifteen:AVERAGE:start=end-4h DEF:twenty=recent.rrd:twenty:AVERAGE:start=end-4h ...
I also tried "end=start+4h", not expecting that to give me what I wanted, but as a test to see if I could get a four hour window displayed. This directive appeared to be ignored as well. The display always shows "Last 48 hours".
David,
Not sure if this helps you, but I change my graphs to reflect 24h, 7d, 30d, and 365d using this info below:
I don't know if that could be done in a config file, but it certainly can be done by altering the source. Take a look at hobbitd/hobbitgraph.c. Near the top there's a bunch of defines that tell rrdtool how to select the data: #define HOUR_GRAPH "e-48h" #define DAY_GRAPH "e-12d" #define WEEK_GRAPH "e-48d" #define MONTH_GRAPH "e-576d" "e-48h" means "end-of-data minus 48 hours", which is the start of the range, the end of the range being the end of the data. Change those numbers to whatever suits you best - i.e. e-24h, e-7d, e-30d & e-365d. You'll also want to look further down for blocks like this: if (strcmp(val, "hourly") == 0) { period = HOUR_GRAPH; persecs = 48*60*60; gtype = strdup(val); glegend = "Last 48 Hours"; } and fix those up. I guess that would be: persecs = 24*60*60; and glegend = "Last 24 Hours"; for the 24 hour graph. Similarly for DAY_GRAPH, WEEK_GRAPH & MONTH_GRAPH. Go back up to the main source directory and re-run make, then copy hobbitd/hobbitgraph.cgi over to hobbit's server/bin directory. Seems to work fine for me - I might even keep it like this... :) Ralph Mitchell
Regards,
David
-----Original Message----- From: Haertig, David F (Dave) [mailto:haertig at avaya.com] Sent: Wednesday, May 30, 2007 2:18 PM To: hobbit at hswn.dk Subject: [hobbit] Custom graphs: Changing default "Last 48 hours" timeframe
I need to look at my custom graphs with a higher resolution (shorter timeframe) than the default "Last 48 hours".
I tried the changes below in hobbitgraph.cfg (appended ":start=end-4h" to the DEF entries), but this didn't make any difference. I was attempting to get a "Last 4 hours" display.
... [recent] TITLE Incoming Cases YAXIS Count DEF:five=recent.rrd:five:AVERAGE:start=end-4h DEF:ten=recent.rrd:ten:AVERAGE:start=end-4h DEF:fifteen=recent.rrd:fifteen:AVERAGE:start=end-4h DEF:twenty=recent.rrd:twenty:AVERAGE:start=end-4h ...
I also tried "end=start+4h", not expecting that to give me what I wanted, but as a test to see if I could get a four hour window displayed. This directive appeared to be ignored as well. The display always shows "Last 48 hours".
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
I'll not be using the files, ports, or procs client-side tests, which show up by default with grey icons (different icons for fetchdata clients than for regular ones, too).
Can anyone tell me a way to disappear those columns from the display and save me a trace-trip through hobbitcgi.cfg and beyond?
If none of your servers are using them, look into the group compress option in bb-hosts.
=G=
-----Original Message----- From: Hobbit User [mailto:hobbit at epperson.homelinux.net] Sent: Wednesday, May 30, 2007 2:39 PM To: hobbit at hswn.dk Subject: [hobbit] Removing unused client test columns?
I'll not be using the files, ports, or procs client-side tests, which show up by default with grey icons (different icons for fetchdata clients than for regular ones, too).
Can anyone tell me a way to disappear those columns from the display and save me a trace-trip through hobbitcgi.cfg and beyond?
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
On Wed, May 30, 2007 at 02:38:30PM -0400, Hobbit User wrote:
I'll not be using the files, ports, or procs client-side tests, which show up by default with grey icons (different icons for fetchdata clients than for regular ones, too).
See the hobbitd_client manpage for the "--no-clear-X" options.
Also, NOCOLUMNS in bb-hosts can be used (see the bb-hosts manpage).
Regards, Henrik
On Wed, May 30, 2007 17:05, Henrik Stoerner wrote:
On Wed, May 30, 2007 at 02:38:30PM -0400, Hobbit User wrote:
I'll not be using the files, ports, or procs client-side tests, which [snip]
See the hobbitd_client manpage for the "--no-clear-X" options.
Also, NOCOLUMNS in bb-hosts can be used (see the bb-hosts manpage).
Thanks, I'd missed both of those. "--no-clear-xxx" would do for files and ports, but I don't see a "no-clear-procs" option, so have not pursued that way. "NOCOLUMNS" looks like the right way to do it from a manageability standpoint (central config). Had to bang it over the head a little to get it to actually drop the columns. bb 127.0.0.1 "drop host columname" didn't do it, so I removed host from bb-hosts, did "drop host", then added it back to bb-hosts. All OK now.
Thanks for the help, sorry for not Reading The Fine Manual thoroughly.
Thanks. I can handle the C modifications. Looks like the default graphing options are hardcoded, and apply to all graphs. The defaults seem a bit odd ... I like your 24h, 7d, 30d, 365d ones better. I assume the 576d original max default value goes hand-in-hand with some hardcoded default used to set up the RRD data file.
While it might be nice to change the graphs with config settings rather than code changes, it sure is convenient the way Hobbit does all the setup for you without you really having to learn much about rrdtools. If I had to pick flexibility or convenience in this matter, I'd vote for keeping Hobbit's convenience the way it is.
Don't know if I'll actually go and modify the C code. It would be very easy to do, but it complicates future Hobbit upgrades, especially if support of what I do is inherited by someone else later, and that person doesn't happen to be a coder.
Thanks!
-----Original Message----- From: David Gilmore [mailto:david at stenhouseconsulting.com] Sent: Wednesday, May 30, 2007 12:26 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Custom graphs: Changing default "Last 48 hours" timeframe
David,
Not sure if this helps you, but I change my graphs to reflect 24h, 7d, 30d, and 365d using this info below:
I don't know if that could be done in a config file, but it certainly can be done by altering the source. Take a look at hobbitd/hobbitgraph.c. Near the top there's a bunch of defines that tell rrdtool how to select the data: #define HOUR_GRAPH "e-48h" #define DAY_GRAPH "e-12d" #define WEEK_GRAPH "e-48d" #define MONTH_GRAPH "e-576d" "e-48h" means "end-of-data minus 48 hours", which is the start of the range, the end of the range being the end of the data. Change those numbers to whatever suits you best - i.e. e-24h, e-7d, e-30d & e-365d. You'll also want to look further down for blocks like this: if (strcmp(val, "hourly") == 0) { period = HOUR_GRAPH; persecs = 48*60*60; gtype = strdup(val); glegend = "Last 48 Hours"; } and fix those up. I guess that would be: persecs = 24*60*60; and glegend = "Last 24 Hours"; for the 24 hour graph. Similarly for DAY_GRAPH, WEEK_GRAPH & MONTH_GRAPH. Go back up to the main source directory and re-run make, then copy hobbitd/hobbitgraph.cgi over to hobbit's server/bin directory. Seems to work fine for me - I might even keep it like this... :) Ralph Mitchell
Regards,
David
-----Original Message----- From: Haertig, David F (Dave) [mailto:haertig at avaya.com] Sent: Wednesday, May 30, 2007 2:18 PM To: hobbit at hswn.dk Subject: [hobbit] Custom graphs: Changing default "Last 48 hours" timeframe
I need to look at my custom graphs with a higher resolution (shorter timeframe) than the default "Last 48 hours".
I tried the changes below in hobbitgraph.cfg (appended ":start=end-4h" to the DEF entries), but this didn't make any difference. I was attempting to get a "Last 4 hours" display.
... [recent] TITLE Incoming Cases YAXIS Count DEF:five=recent.rrd:five:AVERAGE:start=end-4h DEF:ten=recent.rrd:ten:AVERAGE:start=end-4h DEF:fifteen=recent.rrd:fifteen:AVERAGE:start=end-4h DEF:twenty=recent.rrd:twenty:AVERAGE:start=end-4h ...
I also tried "end=start+4h", not expecting that to give me what I wanted, but as a test to see if I could get a four hour window displayed. This directive appeared to be ignored as well. The display always shows "Last 48 hours".
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
On Wed, May 30, 2007 at 12:58:01PM -0600, Haertig, David F (Dave) wrote:
Thanks. I can handle the C modifications. Looks like the default graphing options are hardcoded, and apply to all graphs.
They are, but you they are just defaults. The webpage that calls these modules can set their own start/end times for the graphs, and the current snapshot (preliminary next version) has an enhanced web UI for the trends page that lets you choose whatever default(s) you prefer.
The defaults seem a bit odd ...
They happen to match how the data is stored in the RRD files, something Hobbit has inherited from the LARRD add-on for Big Brother.
Regards, Henrik
On 5/30/07, Henrik Stoerner <henrik at hswn.dk> wrote:
The defaults seem a bit odd ...
They happen to match how the data is stored in the RRD files, something Hobbit has inherited from the LARRD add-on for Big Brother.
576 data points in the RRA, 576 pixels in the graph -- maintains a one-to-one ratio to avoid "blocking" in the graph. 576 because that was to biggest the graph could be and have it fit "comfortably" on an 800x600 display (back in 2001).
Scott
On Wednesday 30 May 2007, Haertig, David F (Dave) wrote:
Thanks for the reply. Unfortunately, I've already been through that documentation over and over.
But I think I stumbled onto the answer by just blindly guessing and changing things around.
I changed my custom script to send in "green" status messages rather than "clear", and what do you know, an RRD datafile was created.
My custom script was sending in data with an indication of "clear". This is what I normally use for tests I'm working on that are sending data, but I haven't applied any red/yellow condition checking yet. i.e., This is my way of saying "Here's some raw data to view on a web page, but without any interpretation applied to it yet". I can't remember what the original intent of "clear" was, I stole that color for my own use years ago when I started with Big Brother. I imagine Hobbit was applying the original meaning of "clear", whatever it was, and therefore not moving the data to an RRD file. Maybe this hobbit operation is by design, and that's fine with me, ... it would be nice if the documentation on how to create custom graphs mentioned it however. You are only allowed to send red/yellow/green as status. The other colors are "internal" to hobbit.
Stef
participants (9)
-
david@stenhouseconsulting.com
-
Dominique.Frise@unil.ch
-
Galen.Johnson@sas.com
-
haertig@avaya.com
-
henrik@hswn.dk
-
hobbit@epperson.homelinux.net
-
ralphmitchell@gmail.com
-
scott@PacketPushers.com
-
stef.coene@docum.org