I've now successfully created dozens of custom graphs, but even still, if I haven't done it in a while, it always takes me a while to get it working again to add new ones. You may have done some of this already, but here is a checklist of some items to test (roughly in order):

1. The script that is generating the data is outputting letter-for-letter what you think it is [it looks like this is correct in your case]
2. The proper NCV entries (if appropriate; I've only made NCV graphs) are made in hobbitserver.cfg [again, this looks good]
3. The two hobbitd_rrd processes have been restarted (kill -9 on them works; hobbit restarts them automatically)
4. The RRD file is being generated [in your case, check] a) When in doubt, it doesn't hurt to delete the RRD files and let hobbit recreate them if you see some weirdness in them
5. The appropriate entry is made in hobbitgraph.cfg
6. If you're getting "hobbit graph ncv:<blah>", it usually means that there is some typo or bad reference in the hobbitgraph.cfg definition for the graph

The most common problem I've run into is human error on my part in making a typo in the hobbitgraph.cfg file. It looks like in your case, it is probably because the data doesn't appear to be getting into the RRD file properly. The fact that you're getting the "hobbit graph ncv:<blah>" on the graph page means you're mostly there. Keep in mind that hobbitgraph.cfg is case-sensitive. The nice thing is, changes made to this file are immediate, so as soon as you make a change, you can see the effect in the graph.

Also, you don't need unique "<name>"s in the "DEF:<name>" line, so in your example above, you could use "DEF:lat . . ." for all of the 3 graphs defined. These variables are limited in scope to the graph definition they are used with.

Hi,

I've tried a few times to get the custom graphs to work, but have had no joy getting them to work. Invariably, I get the data into the rrd, but the graph is never drawn.

Here is a sample of the data I send to hobbit:

---> Fri Mar 23 10:39:23 EDT 2007 - TIB RV Latency monitoring

latency : 3.291

Status unchanged in 1 days,12 hours, 9 minutes Status message received from 146.121.201.35 <---

My TEST2RRD line has "...,GCM=ncv,RTE=ncv,SWAP=ncv"

My GRAPHS line has "...,GCM,RTE,SWAP"

I have 3 lines for NCV:

NCV_GCM="latency:GAUGE" NCV_RTE="latency:GAUGE" NCV_SWAP="latency:GAUGE"

I generate RRD's for each of my tests, and it looks like there is data, but not exactly as in the example in on Henrik's web site:

<!-- Round Robin Database Dump --><rrd> <version> 0003 </version> <step> 300 </step> <!-- Seconds --> <lastupdate> 1174661992 </lastupdate> <!-- 2007-03-23 10:59:52 EDT -->

    <ds>
            <name> latency </name>
            <type> GAUGE </type>
            <minimal_heartbeat> 600 </minimal_heartbeat>
            <min> 0.0000000000e+00 </min>
            <max> NaN </max>

            <!-- PDP Status -->
            <last_ds> UNKN </last_ds>
            <value> 1.0409800000e+03 </value>
            <unknown_sec> 0 </unknown_sec>
    </ds>

<!-- Round Robin Archives --> <rra> <cf> AVERAGE </cf> <pdp_per_row> 1 </pdp_per_row> <!-- 300 seconds -->

            <params>
            <xff> 5.0000000000e-01 </xff>
            </params>
            <cdp_prep>
                    <ds>
                    <primary_value> 3.7080000000e+00

</primary_value> <secondary_value> 3.4782000000e+00 </secondary_value> <value> NaN </value> <unknown_datapoints> 0 </unknown_datapoints> </ds> </cdp_prep> <database> <!-- 2007-03-21 11:00:00 EDT / 1174489200 --> <row><v> NaN </v></row> <!-- 2007-03-21 11:05:00 EDT / 1174489500 --> <row><v> NaN </v></row> .. .. <!-- 2007-03-23 10:05:00 EDT / 1174658700 --> <row><v> 3.1933733333e+00 </v></row> <!-- 2007-03-23 10:10:00 EDT / 1174659000 --> <row><v> 3.6878266667e+00 </v></row> <!-- 2007-03-23 10:15:00 EDT / 1174659300 --> <row><v> 3.6010800000e+00 </v></row> <!-- 2007-03-23 10:20:00 EDT / 1174659600 --> <row><v> 3.1187333333e+00 </v></row> <!-- 2007-03-23 10:25:00 EDT / 1174659900 --> <row><v> 3.3115000000e+00 </v></row> <!-- 2007-03-23 10:30:00 EDT / 1174660200 --> <row><v> 3.6026266667e+00 </v></row> <!-- 2007-03-23 10:35:00 EDT / 1174660500 --> <row><v> 3.7042866667e+00 </v></row> <!-- 2007-03-23 10:40:00 EDT / 1174660800 --> <row><v> 3.6735733333e+00 </v></row> <!-- 2007-03-23 10:45:00 EDT / 1174661100 --> <row><v> 3.7481866667e+00 </v></row> <!-- 2007-03-23 10:50:00 EDT / 1174661400 --> <row><v> 3.1970000000e+00 </v></row> <!-- 2007-03-23 10:55:00 EDT / 1174661700 --> <row><v> 3.7080000000e+00 </v></row> </database> </rra>

I have the following in my hobbitgrpah.cfg:

[GCM] TITLE GCM Latency Monitor YAXIS Micro Seconds (uSec) DEF:lat=GCM.rrd:latency:AVERAGE LINE2:lat#00CCCC:uSeconds COMMENT:\n GPRINT:lat:LAST:Latency \: %5.11f%s (cur) GPRINT:lat:MAX: \: %5.11f%s (max) GPRINT:lat:MIN: \: %5.11f%s (min) GPRINT:lat:AVERAGE: \: %5.11f%s (avg)\n

[RTE] TITLE RTE Latency Monitor YAXIS Micro Seconds (uSec) DEF:latency=RTE.rrd:latency:AVERAGE LINE2:latency#00CCCC:uSeconds COMMENT:\n GPRINT:latency:LAST:Latency \: %5.11f%s (cur) GPRINT:latency:MAX: \: %5.11f%s (max) GPRINT:latency:MIN: \: %5.11f%s (min) GPRINT:latency:AVERAGE: \: %5.11f%s (avg)\n [SWAP] TITLE SWAP Latency Monitor YAXIS Micro Seconds (uSec) DEF:foo=SWAP.rrd:latency:AVERAGE LINE2:foo#00CCCC:uSeconds COMMENT:\n GPRINT:foo:LAST:Latency \: %5.11f%s (cur) GPRINT:foo:MAX: \: %5.11f%s (max) GPRINT:foo:MIN: \: %5.11f%s (min) GPRINT:foo:AVERAGE: \: %5.11f%s (avg)\n

No matter which way I configure it the graphs do not generate, but instead I get a small box that says:

"hobbit graph ncv:GCM"

I am currently running on a BL25P blade, RHAS4, rrdtool 1.2.15, hobbit 4.3.0-20061124.

I monitor several hundred hosts with no problem (Thanks Henrik!), but have never been able to get this to work. Any help is appreciated...

Larry

<HTML><BODY><P><hr size=1></P><br> <P><STRONG><br> *******************************************************************<br> *<br> <br> This e-mail is intended only for the addressee named above.<br> As this e-mail may contain confidential or privileged information,<br> if you are not the named addressee, you are not authorized<br> to retain, read, copy or disseminate this message or any part of<br> it.<br> <br> *******************************************************************<br> *<br> </STRONG></P></BODY></HTML>

To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

Thanks Gary,

I've tried deleting and rebooting several times. No joy. I just edited the hobbitgraph.cfg in vim, and noticed that the COMMENT lines had leading spaces, and all other lines had leading tabs. Looks like it did not make a difference though.

I tried to run the hobbitgraph.cgi on the command line, but I don't quite understand how to pass it the correct command line arguments.

Thanks, Larry

-----Original Message-----
From: Gary Baluha [mailto:gumby3203 at gmail.com] 
Sent: Friday, March 23, 2007 1:55 PM
To: hobbit at hswn.dk
Subject: Re: [hobbit] Custom Graph


I've now successfully created dozens of custom graphs, but even

still, if I haven't done it in a while, it always takes me a while to get it working again to add new ones. You may have done some of this already, but here is a checklist of some items to test (roughly in order):

1) The script that is generating the data is outputting

letter-for-letter what you think it is [it looks like this is correct in your case] 2) The proper NCV entries (if appropriate; I've only made NCV graphs) are made in hobbitserver.cfg [again, this looks good] 3) The two hobbitd_rrd processes have been restarted (kill -9 on them works; hobbit restarts them automatically) 4) The RRD file is being generated [in your case, check] a) When in doubt, it doesn't hurt to delete the RRD files and let hobbit recreate them if you see some weirdness in them 5) The appropriate entry is made in hobbitgraph.cfg 6) If you're getting "hobbit graph ncv:<blah>", it usually means that there is some typo or bad reference in the hobbitgraph.cfg definition for the graph

The most common problem I've run into is human error on my part

in making a typo in the hobbitgraph.cfg file. It looks like in your case, it is probably because the data doesn't appear to be getting into the RRD file properly. The fact that you're getting the "hobbit graph ncv:<blah>" on the graph page means you're mostly there. Keep in mind that hobbitgraph.cfg is case-sensitive. The nice thing is, changes made to this file are immediate, so as soon as you make a change, you can see the effect in the graph.

Also, you don't need unique "<name>"s in the "DEF:<name>" line,

so in your example above, you could use "DEF:lat . . ." for all of the 3 graphs defined. These variables are limited in scope to the graph definition they are used with.

	Hi,
	
	I've tried a few times to get the custom graphs to work,

but have had no joy getting them to work. Invariably, I get the data into the rrd, but the graph is never drawn. Here is a sample of the data I send to hobbit: ---> Fri Mar 23 10:39:23 EDT 2007 - TIB RV Latency monitoring

	latency : 3.291
	
	Status unchanged in 1 days,12 hours, 9 minutes
	Status message received from 146.121.201.35
	<---
	
	My TEST2RRD line has "...,GCM=ncv,RTE=ncv,SWAP=ncv" 
	
	My GRAPHS line has "...,GCM,RTE,SWAP"
	
	I have 3 lines for NCV:
	
	NCV_GCM="latency:GAUGE"
	NCV_RTE="latency:GAUGE"
	NCV_SWAP="latency:GAUGE"
	
	
	I generate RRD's for each of my tests, and it looks like

there is data, but not exactly as in the example in on Henrik's web site: <!-- Round Robin Database Dump --><rrd> <version> 0003 </version> <step> 300 </step> <!-- Seconds --> <lastupdate> 1174661992 </lastupdate> <!-- 2007-03-23 10:59:52 EDT --> <ds> <name> latency </name> <type> GAUGE </type> <minimal_heartbeat> 600 </minimal_heartbeat> <min> 0.0000000000e+00 </min> <max> NaN </max> <!-- PDP Status --> <last_ds> UNKN </last_ds> <value> 1.0409800000e+03 </value> <unknown_sec> 0 </unknown_sec> </ds> <!-- Round Robin Archives --> <rra> <cf> AVERAGE </cf> <pdp_per_row> 1 </pdp_per_row> <!-- 300 seconds --> <params> <xff> 5.0000000000e-01 </xff> </params> <cdp_prep> <ds> <primary_value> 3.7080000000e+00 </primary_value> <secondary_value> 3.4782000000e+00 </secondary_value> <value> NaN </value> <unknown_datapoints> 0 </unknown_datapoints> </ds> </cdp_prep> <database> <!-- 2007-03-21 11:00:00 EDT / 1174489200 --> <row><v> NaN </v></row> <!-- 2007-03-21 11:05:00 EDT / 1174489500 --> <row><v> NaN </v></row> .. .. <!-- 2007-03-23 10:05:00 EDT / 1174658700 --> <row><v> 3.1933733333e+00 </v></row> <!-- 2007-03-23 10:10:00 EDT / 1174659000 --> <row><v> 3.6878266667e+00 </v></row> <!-- 2007-03-23 10:15:00 EDT / 1174659300 --> <row><v> 3.6010800000e+00 </v></row> <!-- 2007-03-23 10:20:00 EDT / 1174659600 --> <row><v> 3.1187333333e+00 </v></row> <!-- 2007-03-23 10:25:00 EDT / 1174659900 --> <row><v> 3.3115000000e+00 </v></row> <!-- 2007-03-23 10:30:00 EDT / 1174660200 --> <row><v> 3.6026266667e+00 </v></row> <!-- 2007-03-23 10:35:00 EDT / 1174660500 --> <row><v> 3.7042866667e+00 </v></row> <!-- 2007-03-23 10:40:00 EDT / 1174660800 --> <row><v> 3.6735733333e+00 </v></row> <!-- 2007-03-23 10:45:00 EDT / 1174661100 --> <row><v> 3.7481866667e+00 </v></row> <!-- 2007-03-23 10:50:00 EDT / 1174661400 --> <row><v> 3.1970000000e+00 </v></row> <!-- 2007-03-23 10:55:00 EDT / 1174661700 --> <row><v> 3.7080000000e+00 </v></row> </database> </rra> I have the following in my hobbitgrpah.cfg: [GCM] TITLE GCM Latency Monitor YAXIS Micro Seconds (uSec) DEF:lat=GCM.rrd:latency:AVERAGE LINE2:lat#00CCCC:uSeconds COMMENT:\n GPRINT:lat:LAST:Latency \: %5.11f%s (cur) GPRINT:lat:MAX: \: %5.11f%s (max) GPRINT:lat:MIN: \: %5.11f%s (min) GPRINT:lat:AVERAGE: \: %5.11f%s (avg)\n [RTE] TITLE RTE Latency Monitor YAXIS Micro Seconds (uSec) DEF:latency=RTE.rrd:latency:AVERAGE LINE2:latency#00CCCC:uSeconds COMMENT:\n GPRINT:latency:LAST:Latency \: %5.11f%s (cur) GPRINT:latency:MAX: \: %5.11f%s (max) GPRINT:latency:MIN: \: %5.11f%s (min) GPRINT:latency:AVERAGE: \: %5.11f%s (avg)\n [SWAP] TITLE SWAP Latency Monitor YAXIS Micro Seconds (uSec) DEF:foo=SWAP.rrd:latency:AVERAGE LINE2:foo#00CCCC:uSeconds COMMENT:\n GPRINT:foo:LAST:Latency \: %5.11f%s (cur) GPRINT:foo:MAX: \: %5.11f%s (max) GPRINT:foo:MIN: \: %5.11f%s (min) GPRINT:foo:AVERAGE: \: %5.11f%s (avg)\n No matter which way I configure it the graphs do not generate, but instead I get a small box that says: "hobbit graph ncv:GCM" I am currently running on a BL25P blade, RHAS4, rrdtool 1.2.15, hobbit 4.3.0-20061124. I monitor several hundred hosts with no problem (Thanks Henrik!), but have never been able to get this to work. Any help is appreciated... Larry <HTML><BODY><P><hr size=1></P><br> <P><STRONG><br>

*******************************************************************<br> *<br> <br> This e-mail is intended only for the addressee named above.<br> As this e-mail may contain confidential or privileged information,<br> if you are not the named addressee, you are not authorized<br> to retain, read, copy or disseminate this message or any part of<br> it.<br> <br>

*******************************************************************<br> *<br> </STRONG></P></BODY></HTML> To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

This e-mail is intended only for the addressee named above. As this e-mail may contain confidential or privileged information, if you are not the named addressee, you are not authorized to retain, read, copy or disseminate this message or any part of it.

Running tcpdump it looks like I am not getting any orca data on the hobbit server. I am seeing data from other tests.

tcpdump -s 1500 -w capturefile tcp port 1984 and host hobbitclient

John

Sherman, Larry, GCM wrote:

I think the TEST2RRD line should read "...,orca=ncv" instead of just orca. However, I've been trying to get NCV graphing to work for while now, and have not had a lot of luck.

Really interested to hear how the orca works, and how you get it going.

Larry

-----Original Message----- From: John Glowacki [mailto:johng at idttechnology.com] Sent: Thursday, March 22, 2007 10:32 AM To: hobbit at hswn.dk Subject: [hobbit] orcahobbit

On 4.2 with the latest allinone patch I am trying get it to display some orca data. Trying to start with ncv. I see the client collecting data. On the server side I don't see anything in the logs related to orca and no orca rrd file is being created. I may not be looking in the right place. Do I need to write a script go collect the data?

clientlaunch.cfg: [orcadata]

DISABLED

    ENVFILE $HOBBITCLIENTHOME/etc/hobbitclient.cfg
    CMD $HOBBITCLIENTHOME/bin/orcahobbit

--orca=/var/orcallator/data/orcallator --debug LOGFILE $HOBBITCLIENTHOME/logs/hobbitclient.log INTERVAL 5m

I am seeing debug data on the client in the hobbitclient.log. data wsweb1.orca timestamp:1174567564 locltime:08:46:04 uptime:56953 state_D:0 state_N:0 <snip> pagesfree:38533 pageslock:9990 pagestotl:62543

hobbitserver.cfg: TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tc p, dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind, sendmail,mailq,nmailq=mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbpr oxy, hobbitd,files,procs=processes,ports,clock,lines,slab=ncv,orca=ncv" GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat, tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache , bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobb itd,clock,lines,slab,orca" NCV_orca="pagesfree:GAUGE"

hobbitgraph.cfg: [orca] TITLE Orca info YAXIS Bytes DEF:pagesfree=orca.rrd:pagesfree:AVERAGE LINE2:pagesfree#00CCCC:pagesfree COMMENT:\n GPRINT:pagesfree:LAST:Pages Free \: %5.1lf%s (cur) GPRINT:pagesfree:MAX: \: %5.1lf%s (max) GPRINT:pagesfree:MIN: \: %5.1lf%s (min) GPRINT:pagesfree:AVERAGE: \: %5.1lf%s (avg)\n

hobbitlaunch.cfg: CMD hobbitd_channel --channel=status --log=$BBSERVERLOGS/rrd-status.log hobbitd_rrd --rrddir=$BBVAR/rrd --debug CMD hobbitd_channel --channel=data --log=$BBSERVERLOGS/rrd-data.log hobbitd_rrd --rrddir=$BBVAR/rrd --debug CMD hobbitd_channel --channel=client --log=$BBSERVERLOGS/clientdata.log hobbitd_client --debug

To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk

---

---

This e-mail is intended only for the addressee named above. As this e-mail may contain confidential or privileged information, if you are not the named addressee, you are not authorized to retain, read, copy or disseminate this message or any part of it.

---

To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk