urgent rrd help needed - im desperate!
Ok, i've been working on this for 6+ hours, and am totally stuck. Here is the script on the client:
====================================
#!/bin/sh
BB=/usr/local/hobbit/client/bin/bb BBDISP=xxx.xxx.xxx.xxx MACHINE=xxxxxx
sar -P ALL 1 1 | grep -E "^[0-9]|^( *)" | grep -v \- | grep -v cpu | cut -c 9-> /tmp/hobbit_sar.$$ 2>&1; mv /tmp/hobbit_sar.$$ /tmp/hobbit_sar.tmp </dev/null > /dev/null
while read aline; do
CPUNUM=echo $aline | awk '{print $1}'
PUSR=echo $aline | awk '{print $2}'
PSYS=echo $aline | awk '{print $3}'
PWIO=echo $aline | awk '{print $4}'
PIDL=echo $aline | awk '{print $5}'
echo "cpu"$CPUNUM"pcntusr : $PUSR" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntsys : $PSYS" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntwio : $PWIO" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntidl : $PIDL" >> /tmp/hobbit_sar"$CPUNUM".msg
$BB $BBDISP "status $MACHINE.sar,"$CPUNUM" green date
cat /tmp/hobbit_sar"$CPUNUM".msg
"
rm /tmp/hobbit_sar"$CPUNUM".msg
done < /tmp/hobbit_sar.tmp
rm /tmp/hobbit_sar.tmp
========================================
It sends the data just fine. (output from sh -x)
BB=/usr/local/hobbit/client/bin/bb
BBDISP=167.76.113.220
MACHINE=stlfan3
sar -P ALL 1 1
grep -E ^[0-9]|^( *)
grep -v -
grep -v cpu
cut -c 9-
1> /tmp/hobbit_sar.20750 2>& 1
mv /tmp/hobbit_sar.20750 /tmp/hobbit_sar.tmp
0< /dev/null 1> /dev/null
0< /tmp/hobbit_sar.tmp
read aline
- awk {print $1}
echo 0 2 8 1 89 CPUNUM=0
- awk {print $2}
echo 0 2 8 1 89 PUSR=2
- awk {print $3}
echo 0 2 8 1 89 PSYS=8
- awk {print $4}
echo 0 2 8 1 89 PWIO=1
- awk {print $5}
echo 0 2 8 1 89 PIDL=89
echo cpu0pcntusr : 2
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntsys : 8
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntwio : 1
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntidl : 89
1>> /tmp/hobbit_sar0.msg
date
cat /tmp/hobbit_sar0.msg
/usr/local/hobbit/client/bin/bb --debug 167.76.113.220 status stlfan3.sar,0 gr een Fri Mar 17 11:58:59 EST 2006
cpu0pcntusr : 2 cpu0pcntsys : 8 cpu0pcntwio : 1 cpu0pcntidl : 89
2006-03-17 11:58:59 Transport setup is: 2006-03-17 11:58:59 bbdportnumber = 1984 2006-03-17 11:58:59 bbdispproxyhost = NONE 2006-03-17 11:58:59 bbdispproxyport = 0 2006-03-17 11:58:59 Recipient listed as 'xxx.xx.xxx.xxx' 2006-03-17 11:58:59 Standard BB protocol on port 1984 2006-03-17 11:58:59 Will connect to address xxx.xx.xxx.xxx port 1984 2006-03-17 11:58:59 Connect status is 0 2006-03-17 11:58:59 Sent 121 bytes 2006-03-17 11:58:59 Closing connection
- rm /tmp/hobbit_sar0.msg
- read aline
<and so on, incrementing cpu numbers as expected.>
On the hobbit server, I want this to work like "disk" where there are multiple file systems under one disk column. I manually created the RRD's (again for a custom time step)
-rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,0.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,1.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,2.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,3.rrd
The DS names in the rrd dump look fine: <ds> <name> cpu0pcntusr </name> <type> GAUGE </type> for example.
Note this all doesn't work if the files are just "sar0.rrd, sar1rrd etc..." without the ,'s
Unfortunately, on the web page, it gives me 3 columns, a sar,0 sar,1 sar,2 Which is nitpicky, but if I can just have a "sar" column with the others under it would be great (like the disk problem). Here is the REAL problem.
Looking at the sar,0 button for example, I see the data update there, HOWEVER, NONE of the /usr/local/hobbit/data/rrd/xxxx/sar,#.rrd files ever get updated!!! In addition, there isn't even a link for a graph in the page.
No errors in /var/log/hobbit/rrd*, or any others that I have looked at on the client or server. Here are the .cfg files. I have tried many variations, these are just how they are now:
hobbitserver.cfg - here are the lines that I have "sar" in:
TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,sar,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,HiFlowNet="ncv",sock="ncv",qmeter="ncv",rtt="ncv"
Note, I have tried sar="ncv", sar,sar0,sar1, etc.. maybe I havn't tried the right variation :-(
GRAPHS="la,disk,inode,qtree,memory,users,vmstat,iostat,tcp.http,tcp,netstat,mrtg::1,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,ncv,HiFlowNet,sock,rtt,sar,sar0,sar1,sar2,sar3"
again, tried many variations.. and also again, maybe I havn't tried the right one.
bb-hosts: only tried putting "xxx.xxx.xxx.xxx xxx # conn sar that didn't help
hobbitgraph.cfg:
[sar] FNPATTERN sar(.*).rrd TITLE CPU sar YAXIS % DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntusr:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntsys:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntwio:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntidl:AVERAGE LINE2:p at RRDIDX@#@COLOR@:@RRDPARAM@ -u 100 -l 0 GPRINT:p at RRDIDX@:LAST: \: %5.1lf (cur) GPRINT:p at RRDIDX@:MAX: \: %5.1lf (max) GPRINT:p at RRDIDX@:MIN: \: %5.1lf (min) GPRINT:p at RRDIDX@:AVERAGE: \: %5.1lf (avg)\n
If anyone has anything else they need to see, let me know. I need to get this working quickly, and am at the end of my rope! I've done other custom graph's with custom RRD's, and never had this problem before.
By the way, the host is sending other custom data just fine with no problems.
Thanks for any help!
-Jeff
Jeff Newman wrote:
Ok, i've been working on this for 6+ hours, and am totally stuck. Here is the script on the client:
====================================
#!/bin/sh
BB=/usr/local/hobbit/client/bin/bb BBDISP=xxx.xxx.xxx.xxx MACHINE=xxxxxx
sar -P ALL 1 1 | grep -E "^[0-9]|^( *)" | grep -v \- | grep -v cpu | cut -c 9-> /tmp/hobbit_sar.$$ 2>&1; mv /tmp/hobbit_sar.$$ /tmp/hobbit_sar.tmp </dev/null > /dev/null
while read aline; do CPUNUM=
echo $aline | awk '{print $1}'PUSR=echo $aline | awk '{print $2}'PSYS=echo $aline | awk '{print $3}'PWIO=echo $aline | awk '{print $4}'PIDL=echo $aline | awk '{print $5}'echo "cpu"$CPUNUM"pcntusr : $PUSR" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntsys : $PSYS" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntwio : $PWIO" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntidl : $PIDL" >> /tmp/hobbit_sar"$CPUNUM".msg
$BB $BBDISP "status $MACHINE.sar,"$CPUNUM" green
datecat /tmp/hobbit_sar"$CPUNUM".msg" rm /tmp/hobbit_sar"$CPUNUM".msg done < /tmp/hobbit_sar.tmp rm /tmp/hobbit_sar.tmp========================================
It sends the data just fine. (output from sh -x)
BB=/usr/local/hobbit/client/bin/bb
BBDISP=167.76.113.220
MACHINE=stlfan3
sar -P ALL 1 1
grep -E ^[0-9]|^( *)
grep -v -
grep -v cpu
cut -c 9-
1> /tmp/hobbit_sar.20750 2>& 1
mv /tmp/hobbit_sar.20750 /tmp/hobbit_sar.tmp
0< /dev/null 1> /dev/null
0< /tmp/hobbit_sar.tmp
read aline
- awk {print $1}
echo 0 2 8 1 89 CPUNUM=0
- awk {print $2}
echo 0 2 8 1 89 PUSR=2
- awk {print $3}
echo 0 2 8 1 89 PSYS=8
- awk {print $4}
echo 0 2 8 1 89 PWIO=1
- awk {print $5}
echo 0 2 8 1 89 PIDL=89
echo cpu0pcntusr : 2
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntsys : 8
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntwio : 1
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntidl : 89
1>> /tmp/hobbit_sar0.msg
date
cat /tmp/hobbit_sar0.msg
/usr/local/hobbit/client/bin/bb --debug 167.76.113.220 status stlfan3.sar,0 gr een Fri Mar 17 11:58:59 EST 2006
cpu0pcntusr : 2 cpu0pcntsys : 8 cpu0pcntwio : 1 cpu0pcntidl : 89
2006-03-17 11:58:59 Transport setup is: 2006-03-17 11:58:59 bbdportnumber = 1984 2006-03-17 11:58:59 bbdispproxyhost = NONE 2006-03-17 11:58:59 bbdispproxyport = 0 2006-03-17 11:58:59 Recipient listed as 'xxx.xx.xxx.xxx' 2006-03-17 11:58:59 Standard BB protocol on port 1984 2006-03-17 11:58:59 Will connect to address xxx.xx.xxx.xxx port 1984 2006-03-17 11:58:59 Connect status is 0 2006-03-17 11:58:59 Sent 121 bytes 2006-03-17 11:58:59 Closing connection
- rm /tmp/hobbit_sar0.msg
- read aline
<and so on, incrementing cpu numbers as expected.>
On the hobbit server, I want this to work like "disk" where there are multiple file systems under one disk column. I manually created the RRD's (again for a custom time step)
-rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,0.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,1.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,2.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,3.rrd
The DS names in the rrd dump look fine: <ds> <name> cpu0pcntusr </name> <type> GAUGE </type> for example.
Note this all doesn't work if the files are just "sar0.rrd, sar1rrd etc..." without the ,'s
Unfortunately, on the web page, it gives me 3 columns, a sar,0 sar,1 sar,2 Which is nitpicky, but if I can just have a "sar" column with the others under it would be great (like the disk problem). Here is the REAL problem.
Looking at the sar,0 button for example, I see the data update there, HOWEVER, NONE of the /usr/local/hobbit/data/rrd/xxxx/sar,#.rrd files ever get updated!!! In addition, there isn't even a link for a graph in the page.
No errors in /var/log/hobbit/rrd*, or any others that I have looked at on the client or server. Here are the .cfg files. I have tried many variations, these are just how they are now:
hobbitserver.cfg - here are the lines that I have "sar" in:
TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,sar,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,HiFlowNet="ncv",sock="ncv",qmeter="ncv",rtt="ncv"
Note, I have tried sar="ncv", sar,sar0,sar1, etc.. maybe I havn't tried the right variation :-(
GRAPHS="la,disk,inode,qtree,memory,users,vmstat,iostat,tcp.http,tcp,netstat,mrtg::1,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,ncv,HiFlowNet,sock,rtt,sar,sar0,sar1,sar2,sar3"
again, tried many variations.. and also again, maybe I havn't tried the right one.
bb-hosts: only tried putting "xxx.xxx.xxx.xxx xxx # conn sar that didn't help
hobbitgraph.cfg:
[sar] FNPATTERN sar(.*).rrd TITLE CPU sar YAXIS % DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntusr:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntsys:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntwio:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntidl:AVERAGE LINE2:p at RRDIDX@#@COLOR@:@RRDPARAM@ -u 100 -l 0 GPRINT:p at RRDIDX@:LAST: \: %5.1lf (cur) GPRINT:p at RRDIDX@:MAX: \: %5.1lf (max) GPRINT:p at RRDIDX@:MIN: \: %5.1lf (min) GPRINT:p at RRDIDX@:AVERAGE: \: %5.1lf (avg)\n
If anyone has anything else they need to see, let me know. I need to get this working quickly, and am at the end of my rope! I've done other custom graph's with custom RRD's, and never had this problem before.
By the way, the host is sending other custom data just fine with no problems.
Thanks for any help!
-Jeff
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
Have you looked at the sar script on deadcat?...it's really very nice...it has some minor issues but works great. It might need tweaking for hobbit but I don't think it will.
=G=
Ya, I tried for about 4-6 hours to get it to work, even tried following the steps that someone previously sent in to the hobbit list. I could get it to send data, but I couldn't get the graphing portion working.
As for the problem I posted, I think I figured out what I need to do. I need to have a parsing script on the server end to parse the data into seperate RRD's. That way, I can send from the client side a test with the name "sar" (then I will only have 1 sar column) and let the server side create the sar#.rrd. Hopefully I don't have problems on the hobbitgraph.cfg end.
-Jeff
On 3/17/06, Galen Johnson <gjohnson at trantor.org> wrote:
Jeff Newman wrote:
Ok, i've been working on this for 6+ hours, and am totally stuck. Here is the script on the client:
====================================
#!/bin/sh
BB=/usr/local/hobbit/client/bin/bb BBDISP=xxx.xxx.xxx.xxx MACHINE=xxxxxx
sar -P ALL 1 1 | grep -E "^[0-9]|^( *)" | grep -v \- | grep -v cpu | cut -c 9-> /tmp/hobbit_sar.$$ 2>&1; mv /tmp/hobbit_sar.$$ /tmp/hobbit_sar.tmp </dev/null > /dev/null
while read aline; do CPUNUM=
echo $aline | awk '{print $1}'PUSR=echo $aline | awk '{print $2}'PSYS=echo $aline | awk '{print $3}'PWIO=echo $aline | awk '{print $4}'PIDL=echo $aline | awk '{print $5}'echo "cpu"$CPUNUM"pcntusr : $PUSR" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntsys : $PSYS" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntwio : $PWIO" >> /tmp/hobbit_sar"$CPUNUM".msg echo "cpu"$CPUNUM"pcntidl : $PIDL" >> /tmp/hobbit_sar"$CPUNUM".msg
$BB $BBDISP "status $MACHINE.sar,"$CPUNUM" green
datecat /tmp/hobbit_sar"$CPUNUM".msg" rm /tmp/hobbit_sar"$CPUNUM".msg done < /tmp/hobbit_sar.tmp rm /tmp/hobbit_sar.tmp========================================
It sends the data just fine. (output from sh -x)
BB=/usr/local/hobbit/client/bin/bb
BBDISP=167.76.113.220
MACHINE=stlfan3
sar -P ALL 1 1
grep -E ^[0-9]|^( *)
grep -v -
grep -v cpu
cut -c 9-
1> /tmp/hobbit_sar.20750 2>& 1
mv /tmp/hobbit_sar.20750 /tmp/hobbit_sar.tmp
0< /dev/null 1> /dev/null
0< /tmp/hobbit_sar.tmp
read aline
- awk {print $1}
echo 0 2 8 1 89 CPUNUM=0
- awk {print $2}
echo 0 2 8 1 89 PUSR=2
- awk {print $3}
echo 0 2 8 1 89 PSYS=8
- awk {print $4}
echo 0 2 8 1 89 PWIO=1
- awk {print $5}
echo 0 2 8 1 89 PIDL=89
echo cpu0pcntusr : 2
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntsys : 8
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntwio : 1
1>> /tmp/hobbit_sar0.msg
echo cpu0pcntidl : 89
1>> /tmp/hobbit_sar0.msg
date
cat /tmp/hobbit_sar0.msg
/usr/local/hobbit/client/bin/bb --debug 167.76.113.220 status stlfan3.sar,0 gr een Fri Mar 17 11:58:59 EST 2006
cpu0pcntusr : 2 cpu0pcntsys : 8 cpu0pcntwio : 1 cpu0pcntidl : 89
2006-03-17 11:58:59 Transport setup is: 2006-03-17 11:58:59 bbdportnumber = 1984 2006-03-17 11:58:59 bbdispproxyhost = NONE 2006-03-17 11:58:59 bbdispproxyport = 0 2006-03-17 11:58:59 Recipient listed as 'xxx.xx.xxx.xxx' 2006-03-17 11:58:59 Standard BB protocol on port 1984 2006-03-17 11:58:59 Will connect to address xxx.xx.xxx.xxx port 1984 2006-03-17 11:58:59 Connect status is 0 2006-03-17 11:58:59 Sent 121 bytes 2006-03-17 11:58:59 Closing connection
- rm /tmp/hobbit_sar0.msg
- read aline
<and so on, incrementing cpu numbers as expected.>
On the hobbit server, I want this to work like "disk" where there are multiple file systems under one disk column. I manually created the RRD's (again for a custom time step)
-rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,0.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,1.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,2.rrd -rw-r--r-- 1 hobbit hobbit 22121176 Mar 17 10:31 sar,3.rrd
The DS names in the rrd dump look fine: <ds> <name> cpu0pcntusr </name> <type> GAUGE </type> for example.
Note this all doesn't work if the files are just "sar0.rrd, sar1rrd etc..." without the ,'s
Unfortunately, on the web page, it gives me 3 columns, a sar,0 sar,1 sar,2 Which is nitpicky, but if I can just have a "sar" column with the others under it would be great (like the disk problem). Here is the REAL problem.
Looking at the sar,0 button for example, I see the data update there, HOWEVER, NONE of the /usr/local/hobbit/data/rrd/xxxx/sar,#.rrd files ever get updated!!! In addition, there isn't even a link for a graph in the page.
No errors in /var/log/hobbit/rrd*, or any others that I have looked at on the client or server. Here are the .cfg files. I have tried many variations, these are just how they are now:
hobbitserver.cfg - here are the lines that I have "sar" in:
TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,sar,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,HiFlowNet="ncv",sock="ncv",qmeter="ncv",rtt="ncv"
Note, I have tried sar="ncv", sar,sar0,sar1, etc.. maybe I havn't tried the right variation :-(
GRAPHS="la,disk,inode,qtree,memory,users,vmstat,iostat,tcp.http,tcp,netstat,mrtg::1,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,ncv,HiFlowNet,sock,rtt,sar,sar0,sar1,sar2,sar3"
again, tried many variations.. and also again, maybe I havn't tried the right one.
bb-hosts: only tried putting "xxx.xxx.xxx.xxx xxx # conn sar that didn't help
hobbitgraph.cfg:
[sar] FNPATTERN sar(.*).rrd TITLE CPU sar YAXIS % DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntusr:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntsys:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntwio:AVERAGE DEF:p at RRDIDX@=@RRDFN@:cpu at RRDIDX@pcntidl:AVERAGE LINE2:p at RRDIDX@#@COLOR@:@RRDPARAM@ -u 100 -l 0 GPRINT:p at RRDIDX@:LAST: \: %5.1lf (cur) GPRINT:p at RRDIDX@:MAX: \: %5.1lf (max) GPRINT:p at RRDIDX@:MIN: \: %5.1lf (min) GPRINT:p at RRDIDX@:AVERAGE: \: %5.1lf (avg)\n
If anyone has anything else they need to see, let me know. I need to get this working quickly, and am at the end of my rope! I've done other custom graph's with custom RRD's, and never had this problem before.
By the way, the host is sending other custom data just fine with no problems.
Thanks for any help!
-Jeff
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
Have you looked at the sar script on deadcat?...it's really very nice...it has some minor issues but works great. It might need tweaking for hobbit but I don't think it will.
=G=
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
participants (2)
-
gjohnson＠trantor.org
-
jeffnewman75＠gmail.com