| Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/21/10 7:58 AM | I have read the FAQs and checked for similar issues: YES My site's URL is: http://dandelionsalad.wordpress.com Description (including timeline of any changes made): A bit of context: I am a systems administrator at Automattic, Inc, the company beh |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/21/10 8:06 AM | PS: I'm sure there are measures against race conditions in the bot's queuing logic in the first place, but I thought I'd also mention that there was no high-rate re-queuing coming from our end via sitemap pings for this site. |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | JohnMu | 6/21/10 8:09 AM | Hi Stephdau Thanks for posting -- I'll pass it on to the team here to review. If this is just for one site, using Webmaster Tools would probably be the best way to solve this problem, but it might be useful for our engineers to take a look to see wh |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/21/10 8:40 AM | Thanks John, I appreciate the forward to the engineering team. We're big fans of the Google bot and I had never seen it behave that way for a single site (coming from many different IPs, all concurrently). Here are sample log line spawning 2 second |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/21/10 9:06 AM | PPS: Just realized that I did not mention that the issue is currently over and mostly happened between 10 AM and 12 PM GMT. |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | dandelionsalad | 6/21/10 6:15 PM | stephdau, what is this all about? The url you posted is my blog on http://wordpress.com, it certainly is not yours. |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | RedCardinal | 6/22/10 4:49 AM | @dandelionsalad please read the opening post from stephdau: |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | Steven Lockey | 6/22/10 5:27 AM | However he should of asked permission before posting a client's URL really ;) Not that it'll do any harm but it would of been polite. I can confirm the URL in question resolves to one of the Googlebot servers (the tracert took me through Google int |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/22/10 5:42 AM | @dandelionsalad: Yes, as RedCardinal pointed out, I'm one of the systems administrators who maintains the servers your blog runs on. The reason I posted it, with all sensitive or private info removed from the logs, was to ensure that your blog (and t |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | ColinMcDermott | 6/22/10 7:52 AM | WordPress rules! WoopWoop! Sorry, I couldnt help myself. |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | dandelionsalad | 6/22/10 12:16 PM | Thanks for clarifying this, stephdau, much appreciated. I love Wordpress.com! And am very pleased with all that you do to keep it running smoothly every day. I'm sorry I misunderstood what you first wrote here. |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | stephdau | 6/22/10 1:13 PM | @dandelionsalad: Oh absolutely, I would have been concerned too. Glad you're enjoying the service. We like making our users happy. :) |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | dandelionsalad | 6/22/10 1:41 PM | @stephdau, I just didn't have a clue what this was all about. Thanks again for letting me know and all your work to keep everything behind the scenes going so well for all the bloggers on Wordpress.com. I must say that all of the times I have conta |
| Re: Simili-DoS from Google Bot (from dozens of legitimate IPs, concurrently). | marcje | 6/23/10 10:46 PM | Hmm, smells like caffeine :) |