Tens... of thousands... wow. That's alot. Alot alot. That will definitely push Devmon to limits that we haven't even dreamed of yet.
Right now we are polling ~800 devices with Devmon, and we are running at about 75% load (for a 60 second poll period) using 7 polling nodes. I can only imagine how manning polling nodes it will take you to achive the same polling interval (if you figure about 100 devices per node, thats 100 nodes for 10k devices. Yikes!)
Most of the load (80-90% of it) is spent running template calculations, which right now is done on a single thread. I thought, earlier on in the design, that most time-intensive portion of the polling cycle was going to be the SNMP data collection portion.
It looks like I'm going to have to farm the template code out to the forked processes, if I want to get any more speed out of this puppy. I've had the idea rolling around in the back of my head for a while now, but I've been very good at ignoring it, as it will involve rewriting a large chunk of code. (Not again!)
Let me know how the template building goes. I did all of the template documentation in a single night, so it might be a bit lacking :) (Suggestions for change are welcome). Once you get your templates done, send 'em my way too and I'll roll them into the distro.
-Eric
-----Original Message----- From: Dan Vande More [mailto:bigdan at gmail.com] Sent: Thu 2/23/2006 4:38 PM To: hobbit at hswn.dk Subject: Re: [hobbit] Devmon : a bbxsnmp.pl & routermon replacement
Amazing. I was just ruminating this morning about the sad shape of bb-xsnmp and how it wasn't integrated very well, didn't thread, and ill-maintaned. I especially like the idea of clusting it, though I'm not prepared to do that just yet. I do however, have tens of thousands of devices to monitor, so the potential exists for me to use it.
Anyway, I'm diving into it as we speak, unfortunately, you don't have templates for any of my devices (Foundry serverirons, cisco 7609s, Ironport C600s, etc) so it's gonna take some work:)
Thanks for this promising add-on.
-Dan
p.s. It didn't make the /var/run/devmon/ dir by default.
On 2/23/06, Schwimmer, Eric E *HS <EES2Y at hscmail.mcc.virginia.edu> wrote:
Hi everybody,
I've been working on a little project for the past 6 months or so, one that is designed to replace bbxsnmp.pl, routermon, and other similar SNMP data collectors for the Hobbit and BigBrother monitoring systems.
In my (extremely biased) opinion, it is one of the better SNMP data collectors out there.
Just a few key highlights:
. Fast: Uses psuedo non-blocking SNMP queries (basically forked snmp)
. Scalable: If you want to poll many remote devices very quickly, you can configure Devmon to work in a clustered configuration across multiple machines.
. Easily managed: After the initial configuration, all host management is done by editing your display server's bb-hosts file.
. Very customizable: Via the Devmon template system, a savvy sysadmin can use Devmon to monitor virtually any type of SNMP capable device.
The project went up on SourceForge as of about 30 minutes ago; it's web page is at: http://devmon.sf.net
You can download it form there, leave a message in the forums, join the mailing list, etc. I'm hoping that this will be the only Devmon message that goes out to the Hobbit list; if you have any questions or comments for me, please please please either send them to me personally, or, preferably, join the Devmon mailing list and post your questions there.
And last, but not least, I'd like to thank Henrik once again for his excellent work on Hobbit, as Devmon wouldn't be very useful without it! :)
-Eric Schwimmer Network Engineer UVA HSCS Network Engineering
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk
To unsubscribe from the hobbit list, send an e-mail to hobbit-unsubscribe at hswn.dk