Representing disk data for graphing
I'm interested in changing the way that I report disk utilization for mainframe based operating systems (VM and VSE) so that it can be graphed by RRD. The basic message format seems right, but the graph is not coming out properly. Here is the message text:
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted asgreen /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes? Or is it possibly the decimal points in the percentages?
The graph is coming up with a single data point called 2006.
Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
Sorry, folks, I answered this myself. It was the icon that was causing the problem.
But a graph entry for '2006' is still coming up.
Rich Smrcina wrote:
I'm interested in changing the way that I report disk utilization for mainframe based operating systems (VM and VSE) so that it can be graphed by RRD. The basic message format seems right, but the graph is not coming out properly. Here is the message text:
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted as green /dev/0124 14400 720 13680 5.0% /440RES/DRCT green /dev/0124 36000 0 36000 0.0% /440RES/TDISK green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes? Or is it possibly the decimal points in the percentages?
The graph is coming up with a single data point called 2006.
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
I need to justify the need of migrating from BB to Hobbit. Here is the wiki version of comparison.
http://en.wikibooks.org/wiki/System_Monitoring_with_Hobbit/User_Guide#Hobbit...
Please comment, corrrect and enhance the comparison if you can.
Thanks for your time.
T.J. Yang
Rich Smrcina a écrit :
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted as green /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes?
Yes, hobbit gets the column number of the "capacity" and "Mounted" words, and gets the figures on the same column after. So you have to add a "color" heading in order to have the same number of columns on the header and the data.
Or is it possibly the decimal points in the percentages?
Hobbit seems to user long unsigned numbers for these, but it may be a problem too.
-- Charles Goyard - cgoyard at cvf.fr - (+33) 1 45 38 01 31
Interesting idea, thanks!
Charles Goyard wrote:
Rich Smrcina a écrit :
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted as green /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes?
Yes, hobbit gets the column number of the "capacity" and "Mounted" words, and gets the figures on the same column after. So you have to add a "color" heading in order to have the same number of columns on the header and the data.
Or is it possibly the decimal points in the percentages?
Hobbit seems to user long unsigned numbers for these, but it may be a problem too.
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
Or is it possibly the decimal points in the percentages?
Hobbit seems to user long unsigned numbers for these, but it may be a problem too.
Ooops, it's converted to int, with the decimal part stripped off.
-- Charles Goyard - cgoyard at cvf.fr - (+33) 1 45 38 01 31
Charles,
I tried an asterisk as a column header and the word 'color'. Both times the graphs did not appear (just the still mysterious '2006' data point).
Charles Goyard wrote:
Yes, hobbit gets the column number of the "capacity" and "Mounted" words, and gets the figures on the same column after. So you have to add a "color" heading in order to have the same number of columns on the header and the data.
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
OK, it doesn't appear to be related to the column header.
When I removed the code I added for the column header experiment, I mistakenly left 'color' in the column header, but removed the icon from the detail. The graphs re-appeared with the header there, but the percentage was back in the 5th column where they would be in a Unix-style display.
Rich Smrcina wrote:
Charles,
I tried an asterisk as a column header and the word 'color'. Both times the graphs did not appear (just the still mysterious '2006' data point).
Charles Goyard wrote:
Yes, hobbit gets the column number of the "capacity" and "Mounted" words, and gets the figures on the same column after. So you have to add a "color" heading in order to have the same number of columns on the header and the data.
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
On 2006-10-11, Charles Goyard <cgoyard at cvf.fr> wrote:
Rich Smrcina a écrit :
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted as green /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes?
Yes, hobbit gets the column number of the "capacity" and "Mounted" words, and gets the figures on the same column after. So you have to add a "color" heading in order to have the same number of columns on the header and the data.
Or is it possibly the decimal points in the percentages?
Hobbit seems to user long unsigned numbers for these, but it may be a problem too.
Is it documented somewhere the column format for the data to be automatically converted to graphs by hobbit?
Mike
I don't know, we are mimicking the format of a Unix disk report as best as we can.
Mike wrote:
Is it documented somewhere the column format for the data to be automatically converted to graphs by hobbit?
Mike
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
Notice that the third (3rd) token in the first line of the message is "2006". The amount of disk space that is used is also the third token on each usage line. I suspect that the parsing script is getting fooled. Is this your own script? If so, you should use &green (or &yellow and &red) and Hobbit will replace it with a proper status "dot."
GLH
-----Original Message----- From: Rich Smrcina [mailto:rsmrcina at wi.rr.com] Sent: Wednesday, October 11, 2006 7:52 AM To: hobbit at hswn.dk Subject: [hobbit] Representing disk data for graphing
I'm interested in changing the way that I report disk utilization for mainframe based operating systems (VM and VSE) so that it can be graphed by RRD. The basic message format seems right, but the graph is not coming out properly. Here is the message text:
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted asgreen /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes? Or is it possibly the decimal points in the percentages?
The graph is coming up with a single data point called 2006.
Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
I verified that the routine parsing the data for the graphs is picking the third token on the first line. I changed the first line to look like the Unix equivalent (the date format, etc) and it is consistently picking the third item.
The '2006' is becoming the name of the data point and the value being graphed is zero.
I'm just sending the data (there is no back end routine or extra script involved), I'm letting Hobbit to the parsing.
Adding the icon (I do use &color, when I cut and pasted it from Firefox 'green' came out) is messing up the parsing such that no graph data is produced.
Hubbard, Greg L wrote:
Notice that the third (3rd) token in the first line of the message is "2006". The amount of disk space that is used is also the third token on each usage line. I suspect that the parsing script is getting fooled. Is this your own script? If so, you should use &green (or &yellow and &red) and Hobbit will replace it with a proper status "dot."
GLH
-----Original Message----- From: Rich Smrcina [mailto:rsmrcina at wi.rr.com] Sent: Wednesday, October 11, 2006 7:52 AM To: hobbit at hswn.dk Subject: [hobbit] Representing disk data for graphing
I'm interested in changing the way that I report disk utilization for mainframe based operating systems (VM and VSE) so that it can be graphed by RRD. The basic message format seems right, but the graph is not coming out properly. Here is the message text:
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted asgreen /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes? Or is it possibly the decimal points in the percentages?
The graph is coming up with a single data point called 2006.
Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
Yes, the "&color" now counts as a token, so any grep/awk/sed (or equivalent) is going to be off by one. Is this information included in the overall data blast from the Hobbit client? If so, you might consider tacking the colors at the END of each line and see if the Hobbit parser starts working again.
For reference, here is something from a Solaris system:
Wed Oct 11 12:19:50 CDT 2006 - Filesystems OK Filesystem kbytes used avail capacity Mounted on swap 18665136 107640 18557496 1% /tmp /dev/vx/dsk/rootvol 9210413 1561203 7557106 18% / /dev/vx/dsk/var 8263373 1775692 6405048 22% /var /dev/vx/dsk/opt2 34291077 2384649 31563518 8% /opt2 /dev/vx/dsk/home 1021735 614185 346246 64% /export/home
Notice that the filesystem is token 1, the usage is token 2, and available space is token 3, etc., etc.
These are just ideas. I've written 7 or 8 custom tests of my own with my own RRD parsing at the end, so I quickly became acquainted with the need for agreement between the "pitcher" and the "catcher".
GLH
-----Original Message----- From: Rich Smrcina [mailto:rsmrcina at wi.rr.com] Sent: Wednesday, October 11, 2006 12:02 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Representing disk data for graphing
I verified that the routine parsing the data for the graphs is picking the third token on the first line. I changed the first line to look like the Unix equivalent (the date format, etc) and it is consistently picking the third item.
The '2006' is becoming the name of the data point and the value being graphed is zero.
I'm just sending the data (there is no back end routine or extra script involved), I'm letting Hobbit to the parsing.
Adding the icon (I do use &color, when I cut and pasted it from Firefox 'green' came out) is messing up the parsing such that no graph data is produced.
Hubbard, Greg L wrote:
Notice that the third (3rd) token in the first line of the message is "2006". The amount of disk space that is used is also the third token
on each usage line. I suspect that the parsing script is getting fooled. Is this your own script? If so, you should use &green (or &yellow and &red) and Hobbit will replace it with a proper status "dot."
GLH
-----Original Message----- From: Rich Smrcina [mailto:rsmrcina at wi.rr.com] Sent: Wednesday, October 11, 2006 7:52 AM To: hobbit at hswn.dk Subject: [hobbit] Representing disk data for graphing
I'm interested in changing the way that I report disk utilization for mainframe based operating systems (VM and VSE) so that it can be graphed by RRD. The basic message format seems right, but the graph is not coming out properly. Here is the message text:
11 Oct 2006 07:45:23 Disk/SFS Utilization OK
Filesystem kbytes used avail capacity Mounted asgreen /dev/0124 14400 720 13680 5.0% /440RES/DRCT
green /dev/0124 36000 0 36000 0.0% /440RES/TDISK
green /dev/0124 128160 32168 95992 25.1% /440RES/SPOOL
green /dev/0124 96480 2112 94368 2.2% /440RES/PAGE
green /dev/0102 216000 17636 198364 8.2% /PAGSP1/SPOOL
green /dev/0102 2187360 0 2187360 0.0% /PAGSP1/PAGE
green /VMSYS/group2 120088 5268 114820 4.4% /SFS/VMSYS green /VMSYSU/group2 4280 488 3792 11.4% /SFS/VMSYSU green /VMSYSU/group3 71896 0 71896 0.0% /SFS/VMSYSU
The 'green' indicator on the left is a green icon put there to easily spot an offender. Is that messing up the parsing of the message for graphing purposes? Or is it possibly the decimal points in the percentages?
The graph is coming up with a single data point called 2006.
Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
Indeed. I got a suggestion to add the &clear icon to the heading and now it works. Unfortunately I now get one very crowded graph, otherwise good progress.
Thanks for your help!
Hubbard, Greg L wrote:
Yes, the "&color" now counts as a token, so any grep/awk/sed (or equivalent) is going to be off by one. Is this information included in the overall data blast from the Hobbit client? If so, you might consider tacking the colors at the END of each line and see if the Hobbit parser starts working again.
For reference, here is something from a Solaris system:
Wed Oct 11 12:19:50 CDT 2006 - Filesystems OK Filesystem kbytes used avail capacity Mounted on swap 18665136 107640 18557496 1% /tmp /dev/vx/dsk/rootvol 9210413 1561203 7557106 18% / /dev/vx/dsk/var 8263373 1775692 6405048 22% /var /dev/vx/dsk/opt2 34291077 2384649 31563518 8% /opt2 /dev/vx/dsk/home 1021735 614185 346246 64% /export/home
Notice that the filesystem is token 1, the usage is token 2, and available space is token 3, etc., etc.
These are just ideas. I've written 7 or 8 custom tests of my own with my own RRD parsing at the end, so I quickly became acquainted with the need for agreement between the "pitcher" and the "catcher".
GLH
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
Oops, I spoke too soon. It did not work with the icons as I thought. I'm back to no icons and four data points per graph (which looks good) and the mysterious third token on the first line data point.
Rich Smrcina wrote:
Indeed. I got a suggestion to add the &clear icon to the heading and now it works. Unfortunately I now get one very crowded graph, otherwise good progress.
Thanks for your help!
Hubbard, Greg L wrote:
Yes, the "&color" now counts as a token, so any grep/awk/sed (or equivalent) is going to be off by one. Is this information included in the overall data blast from the Hobbit client? If so, you might consider tacking the colors at the END of each line and see if the Hobbit parser starts working again.
For reference, here is something from a Solaris system:
Wed Oct 11 12:19:50 CDT 2006 - Filesystems OK Filesystem kbytes used avail capacity Mounted on swap 18665136 107640 18557496 1% /tmp /dev/vx/dsk/rootvol 9210413 1561203 7557106 18% / /dev/vx/dsk/var 8263373 1775692 6405048 22% /var /dev/vx/dsk/opt2 34291077 2384649 31563518 8% /opt2 /dev/vx/dsk/home 1021735 614185 346246 64% /export/home
Notice that the filesystem is token 1, the usage is token 2, and available space is token 3, etc., etc.
These are just ideas. I've written 7 or 8 custom tests of my own with my own RRD parsing at the end, so I quickly became acquainted with the need for agreement between the "pitcher" and the "catcher".
GLH
-- Rich Smrcina VM Assist, Inc. Phone: 414-491-6001 Ans Service: 360-715-2467 rich.smrcina at vmassist.com
Catch the WAVV! http://www.wavv.org WAVV 2007 - Green Bay, WI - May 18-22, 2007
participants (5)
-
cgoyard＠cvf.fr
-
greg.hubbard＠eds.com
-
mikee＠mikee.ath.cx
-
rsmrcina＠wi.rr.com
-
tj_yang＠hotmail.com