Custom RRD graphs

ger＠fwi.ie

29 Nov 2006 29 Nov '06

8:12 p.m.

Hi folks,

I have created a custom script for capturing CPU utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly.

An initial rrd file gets created but the data does not get input into it.

I have created a rrd-ext sript which is running and is capturing the incomming status data and by looking at the /tmp files I can see that the echo outputs are being generated correctly every 5 mintes.

----> rrd-ext.sh

HOSTNAME="$1" TESTNAME="$2" FNAME="$3"

if [ "$TESTNAME" = "acpu" ] then echo "date" >> /tmp/hobbit.$HOSTNAME.$TESTNAME echo "$FNAME" >> /tmp/hobbit.$HOSTNAME.$TESTNAME # Analyze the message we got # ACPU=grep "connected" $FNAME | awk '{print $14}' ACPU=grep "The 5" $FNAME | cut -d"(" -f2 | cut -d"." -f1 # The RRD dataset definitions echo "DS:acpu:GAUGE:600:0:100" # The filename echo "acpu.rrd" # The data echo "$ACPU" echo "$ACPU" >> /tmp/hobbit.$HOSTNAME.$TESTNAME fi

The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ?

Any help or pointers appreciated.

Output that this produces is below showing that it is getting the data correctly from the status input.

---> /tmp/hobbit.$HOSTNAME.$TESTNAME

Wed Nov 29 19:54:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_13879 14 Wed Nov 29 19:59:05 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_26569 25 Wed Nov 29 20:04:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_2788 17 Wed Nov 29 20:09:12 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_11944 9

Ger.

Show replies by date

bgmilne＠staff.telkomsa.net

30 Nov 30 Nov

3:38 p.m.

New subject: [hobbit] Custom RRD graphs

On Wednesday 29 November 2006 22:12, Ger Maguire wrote:

...

Hi folks,

I have created a custom script for capturing CPU utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly.

In general, the cpu test is parsed by hobbit, for which Hobbit needs to know the format. If you can fake the format to be like something Hobbit already supports, then you can use the "cpu testname".

...

An initial rrd file gets created but the data does not get input into it.

I have created a rrd-ext sript which is running and is capturing the incomming status data and by looking at the /tmp files I can see that the echo outputs are being generated correctly every 5 mintes.

IMHO, it would be much easier to use the ncv module to do this. Please see Help->Custom Graphs on the Hobbit web interface for more information on how to do this.

Regards, Buchan

-- Buchan Milne ISP Systems Specialist - Monitoring/Authentication Team Leader B.Eng,RHCE(803004789010797),LPIC-2(LPI000074592)

ger＠fwi.ie

7:44 p.m.

New subject: [hobbit] Custom RRD graphs

Guys, When creating custom scripts, has anyone just used rrdcreate and rrdtool update to directly output the data to the rrd files ?

If the the tests are all residing on the one machine and not polling data from other clients is it an easier way to update the graphs as I just can't get the status script to update for me ?

Thanks, Ger.

From: Ger Maguire [mailto:ger at fwi.ie] Sent: 29 November 2006 20:13 To: hobbit at hswn.dk Subject: [hobbit] Custom RRD graphs

Hi folks,

I have created a custom script for capturing CPU utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly.

An initial rrd file gets created but the data does not get input into it.

----> rrd-ext.sh

HOSTNAME="$1" TESTNAME="$2" FNAME="$3"

The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ?

Any help or pointers appreciated.

Output that this produces is below showing that it is getting the data correctly from the status input.

---> /tmp/hobbit.$HOSTNAME.$TESTNAME

Ger.

greg.hubbard＠eds.com

7:55 p.m.

New subject: [hobbit] Custom RRD graphs

Why bother when Hobbit will use your echo output to do that?

But there is more to graphing than simply creating the RRD files. Next you have to create graph definitions that will use your new files, and these graphs have to work. Then you can add your new graphs to the Hobbit server so they will show up with the associated test (TEST2RRD variable) and/or in the trends display.

You say you see the data being echoed -- are the RRD files not getting created/updated? Did you add your rrd-ext to the right place on the server? Did you add it to hobbit-rrd for both data and status messages?

(or whatever, I am going from dim memory)

GLH

From: Ger Maguire [mailto:ger at fwi.ie] 
Sent: Thursday, November 30, 2006 1:44 PM
To: hobbit at hswn.dk
Subject: RE: [hobbit] Custom RRD graphs


Guys, When creating custom scripts, has anyone just used

rrdcreate and rrdtool update to directly output the data to the rrd files ? If the the tests are all residing on the one machine and not polling data from other clients is it an easier way to update the graphs as I just can't get the status script to update for me ? Thanks, Ger.

From: Ger Maguire [mailto:ger at fwi.ie] 
Sent: 29 November 2006 20:13
To: hobbit at hswn.dk
Subject: [hobbit] Custom RRD graphs


Hi folks,
 
I have created a custom script for capturing CPU utilisation

from a device and updated all the relevant files but I cannot get my rrd files to update correctly. An initial rrd file gets created but the data does not get input into it. I have created a rrd-ext sript which is running and is capturing the incomming status data and by looking at the /tmp files I can see that the echo outputs are being generated correctly every 5 mintes. ----> rrd-ext.sh HOSTNAME="$1" TESTNAME="$2" FNAME="$3" if [ "$TESTNAME" = "acpu" ] then echo "date" >> /tmp/hobbit.$HOSTNAME.$TESTNAME echo "$FNAME" >> /tmp/hobbit.$HOSTNAME.$TESTNAME # Analyze the message we got # ACPU=grep "connected" $FNAME | awk '{print $14}' ACPU=grep "The 5" $FNAME | cut -d"(" -f2 | cut -d"." -f1 # The RRD dataset definitions echo "DS:acpu:GAUGE:600:0:100" # The filename echo "acpu.rrd" # The data echo "$ACPU" echo "$ACPU" >> /tmp/hobbit.$HOSTNAME.$TESTNAME fi The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ? Any help or pointers appreciated. Output that this produces is below showing that it is getting the data correctly from the status input. ---> /tmp/hobbit.$HOSTNAME.$TESTNAME Wed Nov 29 19:54:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_13879 14 Wed Nov 29 19:59:05 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_26569 25 Wed Nov 29 20:04:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_2788 17 Wed Nov 29 20:09:12 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_11944 9

Ger.

ger＠fwi.ie

8:16 p.m.

New subject: [hobbit] Custom RRD graphs

I think I have gone through all the steps and have poured over the docs and manpages

So far:

1 Created custom script outputing data to hobbit using status switch

$BBHOME/bin/bb $BBDISP "status $HOST.$TEST $COLOUR $OUTPUT"

2 Created rrd-ext script and have it getting data as per below (numeric vale for catching a % value)

3 Modified hobbitserver.cfg

Added acpu test to TEST2RRD="cpu=la,disk, ... ,acpu"

Added acpu test to GRAPHS="la,disk, ... ,acpu"

4 Modified hobbitlaunch.cfg

[rrdstatus] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD hobbitd_channel --channel=status --log=$BBSERVERLOGS/rrd-status.log hobbitd_rrd --rrddir=$BBVAR/rrd --extra-script=/usr/lib/hobbit/server/ext/rrd-ext.sh --extra-tests=acpu

I haven't modified [rrddata] as I'm sending the data in using the status command but I'll stick it in and see if it makes a difference.

Added the test itself to hobbitlaunch to run every 5 mins, all works ok pages update in hobbit

[acpu] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD $BBHOME/ext/acpu.sh INTERVAL 5m

5 Modified hobbitgraph.cfg with the following

[acpu] TITLE CPU Utilisation YAXIS % Load DEF:acpu=acpu.rrd:acpu:AVERAGE AREA:acpu#00CC00:Utilisation GPRINT:acpu:LAST: \: %5.1lf%s (cur) GPRINT:acpu:MAX: \: %5.1lf%s (max) GPRINT:acpu:MIN: \: %5.1lf%s (min) GPRINT:acpu:AVERAGE: \: %5.1lf%s (avg)\n

The rrd files get created in the correct place and the pages in hobbit show the graph but there is just no data being displayed and the timestamp on the acpu.rrd files is showing they are not being updated.

This is where I'm stumped, the log files don't show any relevant info or messages to point me to anything thats wrong.

I'm running it on debian sarge distro using the .deb package from sourceforge.

Ger.

From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] Sent: 30 November 2006 19:55 To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

Why bother when Hobbit will use your echo output to do that?

(or whatever, I am going from dim memory)

GLH

From: Ger Maguire [mailto:ger at fwi.ie] Sent: Thursday, November 30, 2006 1:44 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

Guys, When creating custom scripts, has anyone just used rrdcreate and rrdtool update to directly output the data to the rrd files ?

If the the tests are all residing on the one machine and not polling data from other clients is it an easier way to update the graphs as I just can't get the status script to update for me ?

Thanks, Ger.

From: Ger Maguire [mailto:ger at fwi.ie] Sent: 29 November 2006 20:13 To: hobbit at hswn.dk Subject: [hobbit] Custom RRD graphs

Hi folks,

I have created a custom script for capturing CPU utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly.

An initial rrd file gets created but the data does not get input into it.

----> rrd-ext.sh

HOSTNAME="$1" TESTNAME="$2" FNAME="$3"

The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ?

Any help or pointers appreciated.

Output that this produces is below showing that it is getting the data correctly from the status input.

---> /tmp/hobbit.$HOSTNAME.$TESTNAME

Ger.

greg.hubbard＠eds.com

8:35 p.m.

New subject: [hobbit] Custom RRD graphs

Sounds good -- you have almost written a tutorial on how to add custom graphs

So what is in your temp file? I usually write this stuff to a log file.

GLH

From: Ger Maguire [mailto:ger at fwi.ie] Sent: Thursday, November 30, 2006 2:17 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

I think I have gone through all the steps and have poured over

the docs and manpages So far: 1 Created custom script outputing data to hobbit using status switch $BBHOME/bin/bb $BBDISP "status $HOST.$TEST $COLOUR $OUTPUT"

2 Created rrd-ext script and have it getting data as per below

(numeric vale for catching a % value) 3 Modified hobbitserver.cfg Added acpu test to TEST2RRD="cpu=la,disk, ... ,acpu"

Added acpu test to GRAPHS="la,disk, ... ,acpu"
 
 

4 Modified hobbitlaunch.cfg

[rrdstatus]
        ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg
        NEEDS hobbitd
        CMD hobbitd_channel --channel=status

--log=$BBSERVERLOGS/rrd-status.log hobbitd_rrd --rrddir=$BBVAR/rrd --extra-script=/usr/lib/hobbit/server/ext/rrd-ext.sh --extra-tests=acpu

I haven't modified [rrddata] as I'm sending the data in using

the status command but I'll stick it in and see if it makes a difference.

Added the test itself to hobbitlaunch to run every 5 mins, all

works ok pages update in hobbit [acpu] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD $BBHOME/ext/acpu.sh INTERVAL 5m

5 Modified hobbitgraph.cfg with the following
 
[acpu]
        TITLE CPU Utilisation
        YAXIS % Load
        DEF:acpu=acpu.rrd:acpu:AVERAGE
        AREA:acpu#00CC00:Utilisation
        GPRINT:acpu:LAST: \: %5.1lf%s (cur)
        GPRINT:acpu:MAX: \: %5.1lf%s (max)
        GPRINT:acpu:MIN: \: %5.1lf%s (min)
        GPRINT:acpu:AVERAGE: \: %5.1lf%s (avg)\n
 
 
The rrd files get created in the correct place and the pages in

hobbit show the graph but there is just no data being displayed and the timestamp on the acpu.rrd files is showing they are not being updated. This is where I'm stumped, the log files don't show any relevant info or messages to point me to anything thats wrong. I'm running it on debian sarge distro using the .deb package from sourceforge. Ger.

From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] 
Sent: 30 November 2006 19:55
To: hobbit at hswn.dk
Subject: RE: [hobbit] Custom RRD graphs


Why bother when Hobbit will use your echo output to do that?
 
But there is more to graphing than simply creating the RRD

files. Next you have to create graph definitions that will use your new files, and these graphs have to work. Then you can add your new graphs to the Hobbit server so they will show up with the associated test (TEST2RRD variable) and/or in the trends display. You say you see the data being echoed -- are the RRD files not getting created/updated? Did you add your rrd-ext to the right place on the server? Did you add it to hobbit-rrd for both data and status messages? (or whatever, I am going from dim memory) GLH

	From: Ger Maguire [mailto:ger at fwi.ie] 
	Sent: Thursday, November 30, 2006 1:44 PM
	To: hobbit at hswn.dk
	Subject: RE: [hobbit] Custom RRD graphs
	
	
	Guys, When creating custom scripts, has anyone just used

	From: Ger Maguire [mailto:ger at fwi.ie] 
	Sent: 29 November 2006 20:13
	To: hobbit at hswn.dk
	Subject: [hobbit] Custom RRD graphs
	
	
	Hi folks,
	 
	I have created a custom script for capturing CPU

utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly. An initial rrd file gets created but the data does not get input into it. I have created a rrd-ext sript which is running and is capturing the incomming status data and by looking at the /tmp files I can see that the echo outputs are being generated correctly every 5 mintes. ----> rrd-ext.sh HOSTNAME="$1" TESTNAME="$2" FNAME="$3" if [ "$TESTNAME" = "acpu" ] then echo "date" >> /tmp/hobbit.$HOSTNAME.$TESTNAME echo "$FNAME" >> /tmp/hobbit.$HOSTNAME.$TESTNAME # Analyze the message we got # ACPU=grep "connected" $FNAME | awk '{print $14}' ACPU=grep "The 5" $FNAME | cut -d"(" -f2 | cut -d"." -f1 # The RRD dataset definitions echo "DS:acpu:GAUGE:600:0:100" # The filename echo "acpu.rrd" # The data echo "$ACPU" echo "$ACPU" >> /tmp/hobbit.$HOSTNAME.$TESTNAME fi The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ? Any help or pointers appreciated. Output that this produces is below showing that it is getting the data correctly from the status input. ---> /tmp/hobbit.$HOSTNAME.$TESTNAME Wed Nov 29 19:54:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_13879 14 Wed Nov 29 19:59:05 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_26569 25 Wed Nov 29 20:04:07 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_2788 17 Wed Nov 29 20:09:12 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_11944 9 Ger.

ger＠fwi.ie

8:49 p.m.

New subject: [hobbit] Custom RRD graphs

Sorry Greg, which temp file, brain is getting a bit fried here :-)

The /tmp log file which the rrd-ext.sh is outputting to is showing which means the data is comming in from the BB status command every time the scripts run.

Thu Nov 30 20:31:35 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_400 18 Thu Nov 30 20:36:36 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_9081 17 Thu Nov 30 20:38:35 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_13633 13 Thu Nov 30 20:43:35 GMT 2006 /usr/lib/hobbit/server/tmp/rrd_msg_24605 14

Ger.

From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] Sent: 30 November 2006 20:35 To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

Sounds good -- you have almost written a tutorial on how to add custom graphs

So what is in your temp file? I usually write this stuff to a log file.

GLH

From: Ger Maguire [mailto:ger at fwi.ie] Sent: Thursday, November 30, 2006 2:17 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

I think I have gone through all the steps and have poured over the docs and manpages

So far:

1 Created custom script outputing data to hobbit using status switch

$BBHOME/bin/bb $BBDISP "status $HOST.$TEST $COLOUR $OUTPUT"

2 Created rrd-ext script and have it getting data as per below (numeric vale for catching a % value)

3 Modified hobbitserver.cfg

Added acpu test to TEST2RRD="cpu=la,disk, ... ,acpu"

Added acpu test to GRAPHS="la,disk, ... ,acpu"

4 Modified hobbitlaunch.cfg

I haven't modified [rrddata] as I'm sending the data in using the status command but I'll stick it in and see if it makes a difference.

Added the test itself to hobbitlaunch to run every 5 mins, all works ok pages update in hobbit

[acpu] ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD $BBHOME/ext/acpu.sh INTERVAL 5m

5 Modified hobbitgraph.cfg with the following

This is where I'm stumped, the log files don't show any relevant info or messages to point me to anything thats wrong.

I'm running it on debian sarge distro using the .deb package from sourceforge.

Ger.

From: Hubbard, Greg L [mailto:greg.hubbard at eds.com] Sent: 30 November 2006 19:55 To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

Why bother when Hobbit will use your echo output to do that?

(or whatever, I am going from dim memory)

GLH

From: Ger Maguire [mailto:ger at fwi.ie] Sent: Thursday, November 30, 2006 1:44 PM To: hobbit at hswn.dk Subject: RE: [hobbit] Custom RRD graphs

Guys, When creating custom scripts, has anyone just used rrdcreate and rrdtool update to directly output the data to the rrd files ?

If the the tests are all residing on the one machine and not polling data from other clients is it an easier way to update the graphs as I just can't get the status script to update for me ?

Thanks, Ger.

From: Ger Maguire [mailto:ger at fwi.ie] Sent: 29 November 2006 20:13 To: hobbit at hswn.dk Subject: [hobbit] Custom RRD graphs

Hi folks,

I have created a custom script for capturing CPU utilisation from a device and updated all the relevant files but I cannot get my rrd files to update correctly.

An initial rrd file gets created but the data does not get input into it.

----> rrd-ext.sh

HOSTNAME="$1" TESTNAME="$2" FNAME="$3"

The value I want to graph is simply a cpu % counter, have I got the above values and setting correct for this ?

Any help or pointers appreciated.

Output that this produces is below showing that it is getting the data correctly from the status input.

---> /tmp/hobbit.$HOSTNAME.$TESTNAME

Ger.

7146

Age (days ago)

7147

Last active (days ago)

List overview

Download

6 comments

3 participants

participants (3)

bgmilne＠staff.telkomsa.net
ger＠fwi.ie
greg.hubbard＠eds.com