...

(I added an ntp check which wasn't showing up, and after I stopped hobbit I noticed a few spawned ntpdate processes sticking around. Probably unrelated.)

No, it's quite possible that you've found the real problem.

Adding the ntp test causes bbtest-net to run "ntpdate". If that command hangs, bbtest-net will stall waiting for it to complete. So if ntpdate never completes, your network tests will stop being updated because it is waiting forever for this command to complete.

That makes sense. What options does hobbit use for ntpdate to check an ntp server? I want to run it by hand and see what happens.

-- Bruce Z. Lysik <blysik at shutterfly.com> Operations Engineer

The information contained in this message (including any attachments) may be confidential. This message (including any attachments) is intended to be read only by the recipient(s) to whom it is addressed. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or Shutterfly by telephone at (650) 610-5200 and delete or destroy any copy of this message (including any attachments).