[hobbit] bbtest-net output & poll time
those 1000 IP's were found in less than one millisecond - that would be quite a feat if any DNS was involved.
Thanks. I was seeing two conflicting data points and didn't know which to believe.
specifically the "Tests Loaded" section. Does 20 seconds seem reasonable for a bb-hosts file our our size?
No, it seems a bit much. My main server has about 1500 hosts in it, and spends 4 seconds loading that file (actually, it is split into about 30 files). If you look at the "bbgen" status, what's the time reported for the "Load bbhosts done" line ?
From bbgen: Load bbhosts done 1112648694.989501 0.178303
I'll try and fiddle with the format of our bb-hosts file and see if I can get anything to float to the surface.
Any particular reason you want to get below 60 seconds ? Are you aware that Hobbit has a "re-test" script that performs more frequent tests on hosts that go down ? When a network test begins to fail, Hobbit puts that host on "frequent-test" list meaning that for up to 30 minutes that host will be tested once a minute rather than once every 5 minutes; so recoveries should be picked up faster.
We'll, the opinion from "on high" here is that the sooner we know something is having problems, the sooner we can fix it. Thats the main reason. I guess the second reason would be bragging rights ;)
Thanks! -Eric
On Mon, Apr 04, 2005 at 05:09:47PM -0400, Schwimmer, Eric E *HS wrote:
specifically the "Tests Loaded" section. Does 20 seconds seem reasonable for a bb-hosts file our our size?
No, it seems a bit much. My main server has about 1500 hosts in it, and spends 4 seconds loading that file (actually, it is split into about 30 files). If you look at the "bbgen" status, what's the time reported for the "Load bbhosts done" line ?
From bbgen: Load bbhosts done 1112648694.989501 0.178303
OK, that's interesting - because it means that the code that does the basic parsing of the file is pretty fast, and the code that handles the network test setup is awfullly slow.
I hadn't noticed that before, but I looked at my own servers now and there is a difference between the time for loading the bb-hosts file for just bbgen and for bbtest-net (1 second vs. 4 seconds in my case). I wonder why ... it something I'll need to look at one day.
Henrik
oops.. havent seen that
on my hobbit bbgen report : Load bbhosts done 1112650273.999850 0.659456
versus 56s in bbtest's report..
-- olivier
Selon Henrik Stoerner <henrik at hswn.dk>:
On Mon, Apr 04, 2005 at 05:09:47PM -0400, Schwimmer, Eric E *HS wrote:
specifically the "Tests Loaded" section. Does 20 seconds seem reasonable for a bb-hosts file our our size?
No, it seems a bit much. My main server has about 1500 hosts in it, and spends 4 seconds loading that file (actually, it is split into about 30 files). If you look at the "bbgen" status, what's the time reported for the "Load bbhosts done" line ?
From bbgen: Load bbhosts done 1112648694.989501 0.178303
OK, that's interesting - because it means that the code that does the basic parsing of the file is pretty fast, and the code that handles the network test setup is awfullly slow.
I hadn't noticed that before, but I looked at my own servers now and there is a difference between the time for loading the bb-hosts file for just bbgen and for bbtest-net (1 second vs. 4 seconds in my case). I w
On Mon, Apr 04, 2005 at 05:09:47PM -0400, Schwimmer, Eric E *HS wrote:
No, it seems a bit much. My main server has about 1500 hosts in it, and spends 4 seconds loading that file (actually, it is split into about 30 files). If you look at the "bbgen" status, what's the time reported for the "Load bbhosts done" line ?
From bbgen: Load bbhosts done 1112648694.989501 0.178303
I tried playing around with this, and there is a bug. It adds the hostnames to the DNS resolver queue, and since you have more than 500 hosts the DNS resolver does kick in and tries to do DNS lookups of those hostnames.
I think this little patch should do wonders for your runtime.
Regards, Henrik
participants (3)
-
EES2Y＠hscmail.mcc.virginia.edu
-
henrik＠hswn.dk
-
olivier＠qalpit.com