Creating a fake, or combination, client
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
I have tried creating a new client in the data files ans symbolically linking the other RRD files into its data directory, but cannot persude the graphs to appear in the trends web page.
Thanks for your time,
|\/|artin
NetOps TAC T:+44 20 7863 5218 Group: +49 69 56607 0412 F: +44 20 7863 5210
The message is intended for the named addressee only and may not be disclosed to or used by anyone else, nor may it be copied in any way.
The contents of this message and its attachments are confidential and may also be subject to legal privilege. If you are not the named addressee and/or have received this message in error, please advise us by e-mailing security at colt.net and delete the message and any attachments without retaining any copies.
Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses.
No contracts can be created or varied on behalf of COLT Telecommunications, its subsidiaries or affiliates ("COLT") and any other party by email Communications unless expressly agreed in writing with such other party.
Please note that incoming emails will be automatically scanned to eliminate potential viruses and unsolicited promotional emails. For more information refer to www.colt.net or contact us on +44(0)20 7390 3900.
On 11/6/07, Ward, Martin <Martin.Ward at colt.net> wrote:
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
Hmm. You could probably create a host and set up a noconn test to some random IP like 10.0.0.1 (i.e. in bb-hosts: 10.0.0.1 fake-host # noconn). Regardless of what host (or fake host, if you do that), you will need to create a new RRD trend to that host.
You can create an RRD graph (by modifying hobbit-graph.cfg) that gets its data from multiple RRD files. These files are usually created in a directory for each host, and I don't know if you can just create a symlink to those or not. But assuming that works, you should be all set in creating a single graph that plots all the other data using a single scale.
I think you would want to add the following to hobbitserver.cfg: GRAPHS="<whatever is already there>,custom-postfix"
And then hobbit-graph.cfg would look something like this: [custom-postfix] . . . DEF:hosta:HostA.rrd:AVERAGE DEF:hostb:HostB.rrd:AVERAGE . . .
I have tried creating a new client in the data files ans symbolically
linking the other RRD files into its data directory, but cannot persude the graphs to appear in the trends web page.
Thanks for your time,
|\/|artin
Hi Martin,
I do a similar thing with our Citrix servers, where I have a "Farm" host to hold a summary of the total number of connections across all servers.
I do this by running a script from hobbitlaunch on the server, and summing up the results of the individual Citrix servers using hobbitdboard. After parsing the results, I send a single message for the "Farm" host in the same format as the individual host messages and Hobbit magically makes the graph for me :-)
It's not too flash, but here are all the bits and pieces which make it work. I hope they may help you in making a similar script for a postfix farm.
BB-HOSTS ENTRIES :
127.0.0.1 citrix-farm # COMMENT:"Farm Totals" testip
noconn noinfo notrends 192.168.1.101 citrix-01 # 192.168.1.102 citrix-02 #
SHELL SCRIPT /opt/hobbit/bin/citrix-totals.sh :
#!/bin/sh
TFIL=/tmp/`basename $0`.$$
/opt/hobbit/server/bin/bb localhost "hobbitdboard
host=citrix-[0-9][0-9] test=citrix fields=msg" | gsed 's/\\n/\n/g' >
${TFIL}
LINE=grep -v 'users active' ${TFIL}
CSUM=grep "users active" ${TFIL} | awk ' { sum += $1; } END { print sum; } '
if [ -z "${CSUM}" ]
then
CSUM=0
fi
/opt/hobbit/server/bin/bb localhost "status citrix-farm.citrix
green date
${CSUM} users active
${LINE}"
rm ${TFIL}
HOBBITLAUNCH.CFG ENTRY:
[citrix-totals]
ENVFILE /opt/hobbit/server/etc/hobbitserver.cfg
NEEDS hobbitd
CMD /opt/hobbit/bin/citrix-totals.sh
LOGFILE $BBSERVERLOGS/logs/citrix-totals.log
INTERVAL 5m
The paths for the binaries etc would obviously need massaging to suit your installation. Good luck!
Andy.
From: Ward, Martin [mailto:Martin.Ward at colt.net] Sent: Wednesday, 7 November 2007 1:11 a.m. To: hobbit at hswn.dk Subject: [hobbit] Creating a fake, or combination, client
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
I have tried creating a new client in the data files ans symbolically linking the other RRD files into its data directory, but cannot persude the graphs to appear in the trends web page.
Thanks for your time,
|\/|artin
NetOps TAC T:+44 20 7863 5218 Group: +49 69 56607 0412 F: +44 20 7863 5210
#####################################################################################
This email is intended for the person to whom it is addressed only. If you are not the intended recipient, do not read, copy or use the contents in any way. The opinions expressed may not necessarily reflect those of ZESPRI Group of Companies ('ZESPRI').
While every effort has been made to verify the information contained herein, ZESPRI does not make any representations as to the accuracy of the information or to the performance of any data, information or the products mentioned herein. ZESPRI will not accept liability for any losses, damage or consequence, however, resulting directly or indirectly from the use of this e-mail/attachments. #####################################################################################
On 11/6/07, Andy France <Andy at zespri.com> wrote:
Hi Martin,
I do a similar thing with our Citrix servers, where I have a "Farm" host to hold a summary of the total number of connections across all servers.
I do this by running a script from hobbitlaunch on the server, and summing up the results of the individual Citrix servers using hobbitdboard. After parsing the results, I send a single message for the "Farm" host in the same format as the individual host messages and Hobbit magically makes the graph for me :-)
If you want to reuse the data in the existing RRD files, assuming a symlink to them works as I previously described, you can probably just create a script similar to below and have it output a dummy value. The main purpose of the script would then just be to associate a column with the dummy host, that you can then build a graph for using existing RRD files.
It's not too flash, but here are all the bits and pieces which make it
work. I hope they may help you in making a similar script for a postfix farm.
*BB-HOSTS ENTRIES :*
127.0.0.1 citrix-farm # COMMENT:"Farm Totals" testip noconn noinfo notrends 192.168.1.101 citrix-01 # 192.168.1.102 citrix-02 #
*SHELL SCRIPT* /opt/hobbit/bin/citrix-totals.sh :
#!/bin/sh
TFIL=/tmp/
basename $0.$$/opt/hobbit/server/bin/bb localhost "hobbitdboard host=citrix-[0-9][0-9] test=citrix fields=msg" | gsed 's/\\n/\n/g' > ${TFIL}
LINE=
grep -v 'users active' ${TFIL}CSUM=
grep "users active" ${TFIL} | awk ' { sum += $1; } END { print sum; } 'if [ -z "${CSUM}" ] then CSUM=0 fi
/opt/hobbit/server/bin/bb localhost "status citrix-farm.citrix green
date${CSUM} users active
${LINE}"
rm ${TFIL}
*HOBBITLAUNCH.CFG ENTRY:*
[citrix-totals] ENVFILE /opt/hobbit/server/etc/hobbitserver.cfg NEEDS hobbitd CMD /opt/hobbit/bin/citrix-totals.sh LOGFILE $BBSERVERLOGS/logs/citrix-totals.log INTERVAL 5m
The paths for the binaries etc would obviously need massaging to suit your installation. Good luck!
Andy.
*From:* Ward, Martin [mailto:Martin.Ward at colt.net] *Sent:* Wednesday, 7 November 2007 1:11 a.m. *To:* hobbit at hswn.dk *Subject:* [hobbit] Creating a fake, or combination, client
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
I have tried creating a new client in the data files ans symbolically linking the other RRD files into its data directory, but cannot persude the graphs to appear in the trends web page.
Thanks for your time,
|\/|artin
NetOps TAC T:+44 20 7863 5218 Group: +49 69 56607 0412 F: +44 20 7863 5210
#####################################################################################
This email is intended for the person to whom it is addressed only. If you are not the intended recipient, do not read, copy or use the contents in any way. The opinions expressed may not necessarily reflect those of ZESPRI Group of Companies ('ZESPRI').
While every effort has been made to verify the information contained herein, ZESPRI does not make any representations as to the accuracy of the information or to the performance of any data, information or the products mentioned herein. ZESPRI will not accept liability for any losses, damage or consequence, however, resulting directly or indirectly from the use of this e-mail/attachments.
#####################################################################################
On Tuesday 06 November 2007, Ward, Martin wrote:
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
I have tried creating a new client in the data files ans symbolically linking the other RRD files into its data directory, but cannot persude the graphs to appear in the trends web page. You can create a custom cluster aware client that runs on the servers. The client uses an other client node to report.
An other possibility is to create in the rrd directory a new directory and create symlinks in this directory so each server has a symbolic link in this directory for the rrd that has the needed info. Give each symlink an other name. I use this to collect information of the CPU usage of lpars running on the same hardware box. So I created a new directory and created symlinks to the vmstat.rrd files I need. So in that directory I have a symlink named server-vmstat.rrd that points to ../server/vmstat.rrd. And that for each server running on that hardware box. To create the graphs, I added a new stanza to hobbitgraphs.cfg that parses the *-vmstat.rrd files. To access these graphs, you have to play with the url. The host parameter is the name of the created directory and the service is the name of added stamza. You don't a link from a hobbit page to this graph, but I already had a "handy-url-page" where I added a link to this graph.
Stef
On Tuesday 06 November 2007 14:11:12 Ward, Martin wrote:
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
No, not if you: 1)Have "multi" definitions for the graph you want 2)You specify multiple server names in the graph url, or use the Reports->Metrics Report feature. I prefer adding the server names in the graph url, as I can reload it to have it update (whereas using the Metrics Report requires you to go back and select a new date range).
You may want to try this with one of the existing tests that has "multi" support, mem, cpu have them by default.
Regards, Buchan
On Wednesday 07 November 2007, Buchan Milne wrote:
On Tuesday 06 November 2007 14:11:12 Ward, Martin wrote:
Hi all,
I am a newbie to Hobbit and have inherited a working system. I have a good idea of how it all hangs together but now I want to produce certain graphs and cannot figure out how.
I have a cluster of mail servers that run Postfix; each of these clients is monitored within Hobbit. In the Trends link for each client I have graphs showing the various mail queues (incoming, deferred etc) and this data is stored in RRD files on the Hobbit server.
Is there a way within Hobbit of creating a false or meta- client that can have a graph with data from all of these RRD files? Particularly I would like a graph that has all the incoming mail queue sizes on it with one line per server. I already have this information in lots of different RRD files but would like to have them all in one graph. I can create a graph outside of Hobbit to do this, but within the monitoring system it restricts the RRD files it will display data from to those in the data directory of the selected client (in the Trends link).
If you want to create a graph from multiple rrds, I would suggest using the 3rd party tool called drraw (http://web.taranis.org/drraw/).
participants (6)
-
Andy@zespri.com
-
bgmilne@staff.telkomsa.net
-
gumby3203@gmail.com
-
Martin.Ward@colt.net
-
s_aiello@comcast.net
-
stef.coene@docum.org