Categories: Webmaster Tools :

Googlebot can't access your site - Server connectivity - Unreachable page

Showing 1-268 of 268 messages
Googlebot can't access your site - Server connectivity - Unreachable page Hotconductor 4/25/13 7:01 AM
Yes I've read the FAQs and searched the help center. 

I am having a very strange issue..  Googlebot says it cannot access my site due to 'server connectivity' issues.  I am hosting with hostgator and my server has had no downtime in 67 days, and there is no ongoing maintenance.  The issue is further complicated by the fact that one minute googlebot can crawl my site, and then next it can't!

To answer a few questions that I would ask others in this situation...

1.  It is not a robots.txt issue.  I have removed/replaced my old robots.txt and .htaccess files just incase, but it made no difference.  Webmaster tools shows no errors with robots.txt fetch.  All green checks.  =)

2. DNS is green.  The site is up, no issues accessing it as a user or administrator.  Apparently ONLY Googlebot is having intermitent issues.  If it is just a Google server glitch then I really hope that I am not alone in this.  If the DNS was generating issues as well

3.  When Googlebot crawls my site it ranges from two results...

A. Success - This happens instantly and off/on.  Failure at 5am, success at 5:05am, then failure again at 5:07am.  It is ridiculous.  When success happens it is instant.

B. Unreachable page - When Googlebot fails it takes a long time (5-7 seconds) before revealing a failure.  The ONLY bit of information contained in the unreachable page result is the download time: 15000 milliseconds

So to summarize... Ever since around 1am last night, Googlebot has been getting a 33.3% failure rate at connecting with my site.  100% uptime, no issues accessing the site on my end or via support at Hostgator.

I appreciate any help you can lend.  Hostgator essentially says "we can't see any problems" and I cannot find a single thing wrong (all plugins disabled, no problems on my end or via web).  Googlebot is the only user that has an issue!
Re: Googlebot can't access your site - Server connectivity - Unreachable page Robbo 4/25/13 8:38 AM


Hi

Thanks for providing relevant details.

From what you say, I think that three main possibilities are  likely:

1.  Merely transient errors - something happened momentarily that prevented google from getting an appropriate response.
(NB.  You said ' Ever since around 1am last night, Googlebot has been getting a 33.3% failure rate at connecting with my site.'
If you mean that you have only experienced this error in the last day or so, I think it too early to identify a traceable "cause".

2.  You mentioned your "hosting" but if your domain registration is provided separately from your hosting, there could be a problem with DNS outside your hosting.

3.  If the error persists for some longer time (days/weeks) it may be that your hosting company firewall is blocking SOME google IPs and not others.   This is sometimes done accidentally or deliberately temporarily and then mistakenly forgotten.  It can even happen automatically if they have in place a system that blocks IPs simply because they making "excessive" requests/demands.



Also note that if the "errors" only started occurring in the last day or so, it may take some time for the issue to be reported in Webmaster Tools.

Suggested actions:

--- keep under review for a longer time; 

--- use Fetch as Google to check ability to access the site; 

--- take care not to misinterpret the results.   e.g. google typically requests robots.txt up to once a day;  therefore if there was a problem accessing your robots.txt some hours ago, it could still affect FaG now.  i.e. if FaG does not recognize that it is OK to crawl at this time, it may defer to another day.  That does NOT mean there is still a problem right now.



Re: Googlebot can't access your site - Server connectivity - Unreachable page Gamechup 4/25/13 8:54 AM
I have the exact same issue.

My site www.gamechup.com shows unreachable in Fetch as Google and the only problem shown there is 15000 milliseconds. This happened a few hours ago and the hosting provider says it's all fine in their end.

Please help this is affecting my indexing.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Hotconductor 4/25/13 9:05 AM
Thank you for your response.  I honestly do not think there was or is any issue related to to the robots access.  The file has been wide open, and still is.  Webmaster tools has shown that aspect to be green without any issue.  It is purely under the 'server connectivity' tab.

Fetch as Googlebot is still doing the same thing...  instant access without issue (success) and failed access due to 'server connectivity' issues.

Regarding DNS, the domain is through godaddy, but they are not showing any issues at this time.

I will definitely keep an eye on it!  Hopefully this is just a glitch and will resolve itself soon!
Re: Googlebot can't access your site - Server connectivity - Unreachable page Robbo 4/25/13 9:50 AM


Also note that "server connectivity" includes things that do not indicate misconfiguration in the DNS or the hosting of the domain.

For example, a "timeout" due to the server being overloaded at that time. 


I'm sure we have all faced situations where a site fails to respond, but then seems to come to life again a few minutes later.


Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/25/13 1:19 PM
I'm having the same issue with my site. Never had this problem in all the years I've had my site. Is it site-specific.... or something else we should know about?

Re: Googlebot can't access your site - Server connectivity - Unreachable page hhcc 4/25/13 5:06 PM
Hi, Same for me, it start yesterday and i have received an email form WMT saying that 50% of the googlebot queries have fail, i double check, everything and it seems ok,
I just like to confirm that is a WMT bug that will not affect my scoring at google.
Any comment will be appreciate.

Re: Googlebot can't access your site - Server connectivity - Unreachable page Kurt.P 4/25/13 5:23 PM
Joining in here. Just got this email/error as well today. We've changed absolutely nothing (server config, robots.txt, sitemap, etc.). Traffic to the site doesn't appear to be abnormally high. Seems odd that this error would just pop up.
Re: Googlebot can't access your site - Server connectivity - Unreachable page trport 4/25/13 5:31 PM
Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 1492 errors while attempting to connect to your site. Your site's overall connection failure rate is 41.0%.

I received that message a few minutes ago. Traffic seems normal, there doesn't appear to be anything obviously wrong. The only change I made in the past day was to add a meta tag to my vBulletin forum to force IE 10 browsers to view it in IE 9:
<meta http-equiv="X-UA-Compatible" content="IE=9" />
Re: Googlebot can't access your site - Server connectivity - Unreachable page um6890069 4/25/13 6:24 PM
Just to chip in, I got one today as well from the 23rd. It's very likely valid though as there may have been some issues on that date.


Re: Googlebot can't access your site - Server connectivity - Unreachable page Petrarch 4/25/13 6:32 PM
I have the same issue, I had 217 / 18644 failures on the 23rd and 1646/3107 failures on the 24th.  Looking at the past 90 days of logs it looks like there are between 2000 and 35000 attempts each day, with 0 failures before the 23rd, so the number of requests being lower doesn't seem like an issue, but the failures are.

Using the "Fetch as Google" in webmaster tools I find that requesting the exact same page sometimes works, sometimes fails timing out at 14999ms.

I would assume the problem is on Google's end because of this and because I have not made any changes recently.  Also this problem seems to be striking several people here all at the same time.  But if Google could say something about it it would be a relief, since I am sure no one wants to have their sites removed from the index if there is nothing wrong.
Re: Googlebot can't access your site - Server connectivity - Unreachable page um6890069 4/25/13 6:45 PM
Might want to start a new thread as this one is Answered :)
Re: Googlebot can't access your site - Server connectivity - Unreachable page pancakeprince 4/25/13 6:48 PM
We're getting the same exact behavior you are all describing. Hopefully its just a google glitch. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Mike Piontek 4/25/13 7:03 PM
I just got an email about the same thing. It doesn't make any sense.
  • It's timing out after 15000ms with a 50% failure rate. While I run a manual check (through Fetch as Google) I'm loading the site in my browser and everything is fine and fast. Pingdom.com is showing consistent response times from multiple countries with an average of 380ms.
  • I haven't touched anything on this site in months.
  • I don't see anything that could be blocking Googlebot.
  • I have another site on the same server, with a very similar setup, and Google has had zero problems accessing it. The other site gets a lot of traffic and I've had no complaints from actual people. So I don't think this is a case of the server being overloaded.
  • http://dnscheck.pingdom.com doesn't show any DNS issues aside from an SOA email error: "DNSCheck failed to deliver email to the email address listed as the one responsible for the zone." I don't really understand this, but surely an admin email address warning has nothing to do with the availability of the site.
It's bizarre how little information they give you about the error. I guess I have no choice but to ignore it for now, but it'd be nice to know what's going on.
Re: Googlebot can't access your site - Server connectivity - Unreachable page soquinn 4/25/13 7:10 PM
Same issue, on 9 sites out of the blue... something must be happening on googles side? Any indications out there?
Re: Googlebot can't access your site - Server connectivity - Unreachable page um6890069 4/25/13 7:10 PM
I asked someone on the same server as I am to check his WMT's and he had no notification.
Re: Googlebot can't access your site - Server connectivity - Unreachable page KyleSD 4/25/13 7:19 PM
Same issue.  I recieved the email at 5:30PST today, showing 26.6% server failure rate for 4/24. I never had any failures before, and did not make any changes to the site.  Analytics shows no drop in traffic, nor any increase in page-load-time.  I've contacted my hosting company, Rackspace, to see if they can point out any issue, but after reading these posts, it really is starting to seem like an anomaly on Google's side.  Hopefully we can get a response from them soon, and rest easy tonight.

Perhaps unrelated, I noticed a HUGE jump in the number of Indexed Pages in webmaster tools last week (jumped 80k to 160k, with no corresponding increase in number of crawled pages). Anybody else see that?  ...just looking for patterns here.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Sebastian Q. 4/25/13 7:42 PM
We're getting the same exact behavior you are all describing. Hopefully its just a google glitch. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Angela Pallatto Hockabout 4/25/13 8:15 PM
I'm having the same problem with my website. So relieved that it's not me. I've found that if I purged my cache that the issue would resolve. I also noticed that within the last day or so that I had accidentally increased the number of tags on my site, so I removed them completely and purged the cache and the site is now searchable. I don't know if I'm totally going overkill, but I used the opportunity to delete duplicate urls anyway. Fingers crossed that it resolves itself.
(unknown) 4/25/13 8:16 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page sysdomatic 4/25/13 8:16 PM
This issue is happening to some of our sites as well. 

I don't believe that this is a Godaddy issue - all of our domains are hosted at Godaddy, and this is only impacting some of our sites. 

Googlebot continues to visit our sites, according to our logs - however, when I try Fetch as Google, it gives me an "unreachable" error. 

We use multiple web hosts - we are only getting the message from sites that are hosted on one web host. However, as I said, Googlebot continues to visit the site, so I don't believe that it is a server issue. I have checked .htaccess, etc
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 4/25/13 8:48 PM
It's very likely to be a firewall block for one or some IPs that belong to Googlebot.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Matt_Cutts 4/25/13 8:55 PM
Hey everyone, please don't worry about this message at this point. Enough people are getting this message that I suspect it's an issue on our end.

I've got an email out to our webmaster tools team, and we'll figure out what's going on. Thanks,
Matt
(unknown) 4/25/13 8:57 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page sysdomatic 4/25/13 9:06 PM
What host is everyone using? My sites that are hosted by Liquidweb.com are giving me this issue. If people are using a different host and getting this error message, we should be able to cross off our web hosts as the source of the problem. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 4/25/13 9:08 PM
Could it be due to many hosters tightening the firewall to reduce the incidence of http://www.zdnet.com/wordpress-attack-highlights-30-million-targets-7000014256/ ?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Andy Garcia 4/25/13 9:08 PM
I got the same message. My host is hostgator.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Andy Garcia 4/25/13 9:12 PM
I've already contacted hostgator and they say they can't find any issue with the server
(unknown) 4/25/13 9:15 PM <This message has been deleted.>
(unknown) 4/25/13 9:16 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page peter.ollodart 4/25/13 11:32 PM
I am having the same exact problem. Came out of nowhere. Host gator, network solutions and godaddy for the domains. Never ever had this before.www.psicompany.com. Hopefully able to resolve soon. Tech support at hostgator says everything is fine. Also not able to reproduce when accessing the site directly.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dragos M. 4/26/13 12:12 AM
Same issue on my website, errors start showing up from 23 April, I've checked everything but couldn't find any problem. Would our website suffer in rankings because of this errors even if it's something on Google's end?
Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/26/13 12:35 AM
I'm not with Hostgator. My host is a company called Create.net and have received the message in Webmaster tools.

In Webmaster Tool this problem started on the 23 April where googlebot encountered 14 errors and 1,130 attempts at my site!

Then on the 24 April, I received:

Googlebot encountered 170 errors while attempting to connect to your site. Your site's overall connection failure is 49.7%
(That's 170 errors, and 342 attempts by Google on that day)
Re: Googlebot can't access your site - Server connectivity - Unreachable page AhmetDeniz 4/26/13 12:52 AM
I'm not using hostgator. Same issue on my website, I've checked server. software etc. but couldn't find any problem.
Re: Googlebot can't access your site - Server connectivity - Unreachable page AlexStone 4/26/13 1:08 AM
I am so thankful this wasn't just me. I host my sites with Servint, and this began happening late night on April 23rd. I pulled an all nighter, racked my brain, and bugged the hell out of my hosting company before ending up here. This has been a nightmare. It's caused about 60-70% of our Google News articles to not be indexed within G News as well.

I'm hoping they get this issue resolved by the weekend as our search traffic has suffered quite a bit.
Re: Googlebot can't access your site - Server connectivity - Unreachable page srivathsan 4/26/13 1:32 AM
Joining in.. facing similar issues. Exact same problem as yours. I'm also on hostgator. Checked with their support team and all is fine on their end. waiting for it to resolve. The website hasn't faced any similar issues in 4 years. Found this thread too late :( Made few changes to robots.txt thinking the fault is on my site. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Ewdi 4/26/13 1:36 AM
Yup, I got the same issue since late 23rd and 24th. Servers are in Softlayer.
Re: Googlebot can't access your site - Server connectivity - Unreachable page srivathsan 4/26/13 1:50 AM
did you check the matt cutts reply? I guess the problem is with them.
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 4/26/13 1:53 AM
Hi guys
It would be useful to have your site's URLs so that we can double-check things accordingly. If you're seeing this, and haven't posted your site's URL, it would be great if you could do that.

Thanks!
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page Ewdi 4/26/13 1:57 AM
Hi John


all on separate machines


Re: Googlebot can't access your site - Server connectivity - Unreachable page srivathsan 4/26/13 1:57 AM
I'm facing problem on both my websites - www.madrasgeek.com and www.mobigizmos.com - Few hours back, updated my robots.txt file too. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Mike.Ba 4/26/13 2:16 AM
Hi John

I have bungalowrenovations.com on Hostgator.

Thanks
Mike 
Re: Googlebot can't access your site - Server connectivity - Unreachable page khn483 4/26/13 2:54 AM
Hi John,

Please check popscreen.com

Thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/26/13 3:01 AM
 
Re: Googlebot can't access your site - Server connectivity - Unreachable page AhmetDeniz 4/26/13 3:06 AM
Hi John

I have www.kurumsal.web.tr on softlayer.

Thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page Michael Sobrevega 4/26/13 3:06 AM
im having the same problem. Its one the 24th of may as well. Could this be something on google's end?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Michael Sobrevega 4/26/13 3:15 AM
Hi John,

My site is www.mii-gamer.com, i am on hostgator
Re: Googlebot can't access your site - Server connectivity - Unreachable page Trumplier 4/26/13 3:22 AM
Re: Googlebot can't access your site - Server connectivity - Unreachable page MrMoriarity 4/26/13 3:32 AM
rawcliffesinc.com for us.

Thanks

Re: Googlebot can't access your site - Server connectivity - Unreachable page Adam Weinger 4/26/13 3:39 AM
Same problem for www.doublethedonation.com on Host Gator.

Thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page hodaraadam 4/26/13 3:54 AM
Same problem here for www.justsurfrax.com also hostagtor, says unreachable page when I fetch with google both, and hostgator says its all fine.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Sebastian Q. 4/26/13 4:07 AM
Thx Matt 

Yesterday we were all day to solve the problem

This is also affecting www.nocturnar.com subdomain. This is what we have
done so far with my sysadmin:

1) DNS are ok: http://intodns.com/nocturnar.com ,
http://dnscheck.pingdom.com/?domain=nocturnar.com

2) HTTP response is ok, for everybody, except for GoogleBot:
http://host-tracker.com/check_res_ajx/12920326-0/ ,
http://internetsupervision.com/scripts/urlcheck/check.aspx?lan=en-US&checkurl=www.nocturnar.com&email=%5BEnter+Your+Email+Address%5D

We have also:

3) Check for robots.txt and .htaccess configuratiosn, both are fine.
4) Check for php files modifications, not found any, every file is fine.
5) Verified iptables firewall and it's not blocking any ips.
6) Removed mod_security rules.
7) Verified dns and httpd configuration at server level, both are fine
and have been working fine since months ago.
8) Tried switching from Apache2 + Mod_php to Nginx with PHP-FPM as
daemon, issue still happening on both different platforms.
9) Check all network configurations on the server (network cables, nic,
network configuration, switches, download speeds, and on), all is OK.
10) Found: that at least in my case, it is just happening to
www.nocturnar.com, because nocturnar.com works perfectly while we try to
explore as GoogleBot using WMTools.

I'm hosted at 198.143.158.2 / SingleHop Datacenter.

Thanks,
Sebastián.-
Re: Googlebot can't access your site - Server connectivity - Unreachable page Simon-Mc 4/26/13 4:41 AM
http://thelogocompany.net
Re: Googlebot can't access your site - Server connectivity - Unreachable page Adrian Danila 4/26/13 4:41 AM
Same problem for www.iconspedia.com
Re: Googlebot can't access your site - Server connectivity - Unreachable page Pankaj Agent 4/26/13 5:39 AM
Me too having same Problem.....My Website www.rushinformation.com is Hosted on Big Rock....
http://www.rushinformation.com/: Googlebot can't access your site
Apr 24, 2013

Over the last 24 hours, Googlebot encountered 55 errors while attempting to connect to your site. Your site's overall connection failure rate is 45.5%
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dominik Horn 4/26/13 5:40 AM
Hi John,

I got a message as well. My website is http://www.media-affin.de
I run WordPress on this site. There where no mails for other projects on the same server.
Re: Googlebot can't access your site - Server connectivity - Unreachable page mahmod sowwan 4/26/13 5:40 AM
same problem

also no answer to all my reconsideration request fro more than 2 month 
can you check it matt

regards 

 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dominik Horn 4/26/13 5:43 AM
Hi John,

I got the same message for http://www.media-affin.de
I run WordPress on this website.
Re: Googlebot can't access your site - Server connectivity - Unreachable page JessicaLevenson 4/26/13 5:51 AM
Matt,

We're also having issues where it says that our robots.txt is unavailable as well.  It's on a bunch of our sites, but not all of them in spite of them being hosted the same.  We've tried everything to figure out what the issue is, but logs show no issues. Looking forward to seeing an update from you!

Jessica
Re: Googlebot can't access your site - Server connectivity - Unreachable page pancakeprince 4/26/13 6:12 AM
Hi John/Matt, we are experiencing this as well: hotelplanner.com and all our subdomains.
Re: Googlebot can't access your site - Server connectivity - Unreachable page ChrisCunningham 4/26/13 6:40 AM
John,

We have been experiencing these issues on several URLs since Tuesday as well.
Here's a small sampling:
Re: Googlebot can't access your site - Server connectivity - Unreachable page Simon-Mc 4/26/13 6:52 AM
If I rename my robots text file and do a fetch as googlebot, everything is fine.  Nothing has changed in my robots file though so what if you do the same.  Does yours pass?


Re: Googlebot can't access your site - Server connectivity - Unreachable page Simon-Mc 4/26/13 6:56 AM
I made a change in my robots.txt file and re-uploaded.  Now it is fine.  Try this.
Re: Googlebot can't access your site - Server connectivity - Unreachable page diego aleu calas 4/26/13 6:57 AM
Since yesterday I have the problems with some sites

irbarcelona.com
irbarcelona.cat
irbarcelona.it
guided londres.com
travel-italia.com


In other sites hosted on the same server I have no problems

With the tool 'explores how Google' sometimes I detect the Web and other tells me that is not accessible.

You can take a look?
Re: Googlebot can't access your site - Server connectivity - Unreachable page diego aleu calas 4/26/13 7:00 AM
Since yesterday I have the same problems


irbarcelona.com
irbarcelona.cat
irbarcelona.it
guided londres.com
travel-italia.com


In other sites hosted on the same server I have no problems

With the tool 'explores how Google' sometimes I detect the Web and other tells me that is not accessible.

You can take a look?
Re: Googlebot can't access your site - Server connectivity - Unreachable page diego aleu calas 4/26/13 7:01 AM
Since yesterday I have the same problems with these sites

irbarcelona.com
irbarcelona.cat
irbarcelona.it
guia-londres.com
viajar-italia.com
roma.viajar-italia.com

I received an email advising that the robots.txt could not be traced and that my website is not accessible

In other sites hosted on the same server I have no problems

With the tool 'explores how Google' sometimes I detect the Web and other tells me that is not accessible.

You can take a look?
Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/26/13 7:04 AM
Both my DNS and robots.txt show green ticks in Webmaster tools.

It's the Server Connectivity which shows a red "exclamation"

On the 4/24/13

Connect timeout:
Errors / Attempts : 170 / 342 (50%)

Total server connectivity errors:
Errors / Attempts : 170 / 342 (50%)
Re: Googlebot can't access your site - Server connectivity - Unreachable page Hotconductor 4/26/13 7:10 AM
This is a bad deal!  Sitemaps seem to not be grabbed due to this issue!
Re: Googlebot can't access your site - Server connectivity - Unreachable page Cristiano Schiavolini 4/26/13 7:18 AM
Hey John,

another website having the same issue: 
by the way, we have other websites on the same host (i.e. www.rentxpress.it) which does not show any issue.

thanks for your support

Best, 
Cristiano
Re: Googlebot can't access your site - Server connectivity - Unreachable page Andy Garcia 4/26/13 7:27 AM
Hi John,

I got an email yesterday that Googlebot can't access my site due to server connectivity issues; 49 errors; 50.5% connectivity.

The URL is:  http://www.franchisechatter.com

This is hosted on Hostgator.

Thank you!
Re: Googlebot can't access your site - Server connectivity - Unreachable page David Hardcastle 4/26/13 7:55 AM
www.machinetools.com it happened to us April 23 and 24. 

Thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page Bob Kelly1 4/26/13 7:56 AM
Same issue with turbogsa.com on hosted on hubspot
Re: Googlebot can't access your site - Server connectivity - Unreachable page anilsnair 4/26/13 8:05 AM
MY SITE  http://www.scientificastrology.com/
(unknown) 4/26/13 8:07 AM <This message has been deleted.>
(unknown) 4/26/13 8:11 AM <This message has been deleted.>
(unknown) 4/26/13 8:13 AM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page AlexStone 4/26/13 8:14 AM
Hey John,

Our site: theversed.com

We host multiple sites on this server, but this is the only one with the issue.

Thank you!
Re: Googlebot can't access your site - Server connectivity - Unreachable page trport 4/26/13 8:24 AM
Hello John, I received the server connectivity error for www.thetruckersreport.com
Re: Googlebot can't access your site - Server connectivity - Unreachable page Aureli Martin 4/26/13 8:57 AM
Hola Jhon,

Mi sitio también ha recibido el mensaje:


Espero que todo se solucione pronto.

Grac
Re: Googlebot can't access your site - Server connectivity - Unreachable page Ruth Seddon 4/26/13 9:16 AM
My site is also affected
www.vsmusicsupplies.com

Thanks

Re: Googlebot can't access your site - Server connectivity - Unreachable page um6890069 4/26/13 9:20 AM
Hi John,
www.usedmacs.us also received an error report for the 24th
Thanks.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Trilma Rose 4/26/13 9:32 AM
I'm getting the same error:

www. bleepingtech.com

Hosgator says its a problem with google server


(unknown) 4/26/13 9:33 AM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page elexis 4/26/13 9:40 AM
Hi John,
 
http://www.niho.com was affected over the last 24 hours, but looks like it's coming back within the last 30 mins or so.
 
Thanks.
 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Sandia Web 4/26/13 10:10 AM
http://www.ifly.com began experiencing this issue on 4/23.  No site changes in two weeks.
Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/26/13 10:21 AM
Just been Googling online and found the following info:

http://www.seroundtable.com/google-webmaster-tools-googlebot-cant-access-16704.html
Re: Googlebot can't access your site - Server connectivity - Unreachable page um6890069 4/26/13 10:37 AM
Posting a link to a review of this thread.  Very informative! :)
Re: Googlebot can't access your site - Server connectivity - Unreachable page Hotconductor 4/26/13 10:39 AM
The response quoted in the article is within this thread.  Nothing new on that post.  Just someone looking for page hits.  Success.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Nitin Gupta Sep 4/26/13 10:45 AM
Hi,

This is my site i also got same message.

Over the last 24 hours, Googlebot encountered 5006 errors while attempting to connect to your site. Your site's overall connection failure rate is 9.5%.

Also at the same time Crawling is also down .  


Thanks
Nitin 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Marie O'Stroske 4/26/13 10:53 AM
We are also experiencing the same issue and received the email from Google within the last 24 hours. Our hosting company has confirmed nothing is wrong on their end.

Website : http://www.fate-cakes.com

Thank you
Re: Googlebot can't access your site - Server connectivity - Unreachable page eweber 4/26/13 10:57 AM
Matt, I've been pulling my hair out over these unreachable error and can't see anything that is causing the random responses.  Will these unreachable error affect our google rankings?

The site in question btw, is www.sightmax.com

Thanks for your involvement and assistance.

Eric weber

Re: Googlebot can't access your site - Server connectivity - Unreachable page Juan Pablo Baudracco 4/26/13 10:59 AM
Hello!

We are also experiencing problems from the 25/6 in the domain http://riocuartoenventa.com

Hopefully that will be resolved soon.

thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page Mike Piontek 4/26/13 11:09 AM
The site I'm having this problem with is http://junecode.com Like most people have said the errors started on 4/23 with 4% failures, then went up to 51% failures on 4/24, and 44% on 4/25. I just did a "Fetch as Google" test that was successful, but the Dashboard is still showing an error for Server Connectivity, so it's hard to tell if it's working consistently now.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Joey Navarro 4/26/13 11:13 AM
Same problems www.theshackpaintball.com started the 24th
Re: Googlebot can't access your site - Server connectivity - Unreachable page elexis 4/26/13 11:24 AM
Actually John, disregard this. http://www.niho.com is still affected as of 11:20 AM (PST), no recent site changes, and our host provide says everything seems to be OK.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Adam Shabbir 4/26/13 11:26 AM
Hi John. We are having the same problem. Server Connectivity issues and high crawl errors. We have fetched with Google bot twice and is successful. The issue began on Tuesday the 23rd. Everything with our host is fine and nothing on the error log list. Here is the site: Stuspots.com
Re: Googlebot can't access your site - Server connectivity - Unreachable page Adam Shabbir 4/26/13 11:36 AM
Sorry. Here is the link for the site: 
Re: Googlebot can't access your site - Server connectivity - Unreachable page MattJo1991 4/26/13 12:10 PM
Hey John

Our url is http://wegotthiscovered.com, been seeing this issue for a few days now. Checked with my host and everything and no one knows what's wrong.
Re: Googlebot can't access your site - Server connectivity - Unreachable page lesliekirk 4/26/13 12:48 PM
Same problem here - www.cross-dress.com - so obviously - it's a Google / Googlebot issue.
Re: Googlebot can't access your site - Server connectivity - Unreachable page makeitnow 4/26/13 1:19 PM
John,

Same issue here with http://www.allbookstores.com. 543,943 crawling attempts and 14,910 Connect Timeout Errors (3%), it's been like this for 2 days and other indicators confirm my site is not getting crawled from Google but that it has no connectivity issues.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Art Minds 4/26/13 1:44 PM
Receiving the same error for artminds.com hosted by HostGator and store.artminds.com hosted by SmugMug.com.

Re: Googlebot can't access your site - Server connectivity - Unreachable page Phil Rosenthal 4/26/13 2:21 PM
Matt - I run a web hosting company and have a few customers complaining about this issue. 

Looking into it, I believe I see the cause.  We see googlebots resetting TCP connections.

Tcpdump basically shows:
Google: SYN
Us: SYN-ACK
Google: RST
and then looping over and over with the same port info.

Full TCPdump of an example session looks like this:

13:51:44.072619 IP (tos 0x0, ttl 47, id 25599, offset 0, flags [none], proto TCP (devil), length 60) 66.249.73.207.54842 > [redacted].80: S, cksum 0x51ac (correct), 196439770:196439770(0) win 62920 <mss 1430,sackOK,timestamp 3719880483 0,nop,wscale 6>

13:51:44.072633 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (devil), length 60) [redacted].80 > 66.249.73.207.54842: S, cksum 0x855b (correct), 3178020602:3178020602(0) ack 196439771 win 5792 <mss 1460,sackOK,timestamp 2965143075 3719880483,nop,wscale 9>

13:51:44.112282 IP (tos 0x0, ttl 47, id 20376, offset 0, flags [none], proto TCP (devil), length 40) 66.249.73.207.54842 > [redacted].80: R, cksum 0x6c12 (correct), 196439771:196439771(0) win 0

13:51:45.072333 IP (tos 0x0, ttl 47, id 25600, offset 0, flags [none], proto TCP (devil), length 60) 66.249.73.207.54842 > [redacted].80: S, cksum 0x4dc4 (correct), 196439770:196439770(0) win 62920 <mss 1430,sackOK,timestamp 3719881483 0,nop,wscale 6>

13:51:45.072363 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (devil), length 60) [redacted].80 > 66.249.73.207.54842: S, cksum 0x2531 (correct), 3193641300:3193641300(0) ack 196439771 win 5792 <mss 1460,sackOK,timestamp 2965143325 3719881483,nop,wscale 9>

13:51:45.111901 IP (tos 0x0, ttl 47, id 20377, offset 0, flags [none], proto TCP (devil), length 40) 66.249.73.207.54842 > [redacted].80: R, cksum 0x6c12 (correct), 196439771:196439771(0) win 0

13:51:47.072393 IP (tos 0x0, ttl 47, id 25601, offset 0, flags [none], proto TCP (devil), length 60) 66.249.73.207.54842 > [redacted].80: S, cksum 0x45f4 (correct), 196439770:196439770(0) win 62920 <mss 1430,sackOK,timestamp 3719883483 0,nop,wscale 6>

13:51:47.072407 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (devil), length 60) [redacted].80 > 66.249.73.207.54842: S, cksum 0x4051 (correct), 3224892051:3224892051(0) ack 196439771 win 5792 <mss 1460,sackOK,timestamp 2965143825 3719883483,nop,wscale 9>

13:51:47.112079 IP (tos 0x0, ttl 47, id 20378, offset 0, flags [none], proto TCP (devil), length 40) 66.249.73.207.54842 > [redacted].80: R, cksum 0x6c12 (correct), 196439771:196439771(0) win 0

13:51:51.072372 IP (tos 0x0, ttl 47, id 25602, offset 0, flags [none], proto TCP (devil), length 60) 66.249.73.207.54842 > [redacted].80: S, cksum 0x3654 (correct), 196439770:196439770(0) win 62920 <mss 1430,sackOK,timestamp 3719887483 0,nop,wscale 6>

13:51:51.072381 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (devil), length 60) [redacted].80 > 66.249.73.207.54842: S, cksum 0x7df9 (correct), 3287391658:3287391658(0) ack 196439771 win 5792 <mss 1460,sackOK,timestamp 2965144824 3719887483,nop,wscale 9>

13:51:51.112731 IP (tos 0x0, ttl 47, id 20379, offset 0, flags [none], proto TCP (devil), length 40) 66.249.73.207.54842 > [redacted].80: R, cksum 0x6c12 (correct), 196439771:196439771(0) win 0


You can feel free to email me if you'd like any more information.


Hoping this gets fixed soon, as a lot of people are panicking about this.

Re: Googlebot can't access your site - Server connectivity - Unreachable page BangBrosTom 4/26/13 2:42 PM
http://www.bangbros.com @ ISPrime.

We're seeing TCP handshake issues and can provide more specific details if interested.
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 4/26/13 3:28 PM
Hi everyone
Thank you for posting the URLs where you've been seeing these issues - as well as some of the other details. There's no need for more samples at the moment. The team is working at high priority to resolve this problem, I'll update here in about 9 hours. Thank you for your patience as we resolve this issue, and sorry for the difficulties that it has been causing. 

Best regards,
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page Cameron Paterson 4/26/13 3:35 PM
Hey guys.

Exact same issue here.  So happy to find this post as I've spent all day tearing my hair out.  It works one minute, but not the next.

My host is Bigcommerce and they verified that nothing is wrong on their end.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Domenec Benaiges Fuste 4/26/13 4:18 PM
I have the same problem, and too in 25 day. ¿IS not solved yet?
Re: Googlebot can't access your site - Server connectivity - Unreachable page fidmas 4/26/13 4:23 PM
Can't be the "Hosts."  I have two domains registered with "Hover."  The DNS records point to the shared Host (Hostgator).  Both domains are "parked" at Hostgator and have subdomains that use subdirectories.  Googlebot is having trouble with only one subdomainname.domain.com and subdomainname.domain.org.  The "Fetch as Google" fails about half the time.  Google has no problem accessing anything from its search results.
Re: Googlebot can't access your site - Server connectivity - Unreachable page hentaisd 4/26/13 6:13 PM
hola tambien tengo el mismo problema y estoy en banahosting

ellos han revisado y todo esta bien pero la conectividad de googleboot ufff esta off

buen se resulva el problema y me envien repuesta


Re: Googlebot can't access your site - Server connectivity - Unreachable page hentaisd 4/26/13 6:17 PM
Olvide ajuntar imagen de mi webmaster tool
captu problema
Re: Googlebot can't access your site - Server connectivity - Unreachable page Trilma Rose 4/26/13 8:00 PM
Try to fetch as Google bot now, it seems to be working
Re: Googlebot can't access your site - Server connectivity - Unreachable page Ibus Web Services 4/26/13 10:03 PM
I too received something similar yesterday

http://www.tvmdata.com/: Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 45 errors while attempting to connect to your site. Your site's overall connection failure rate is 57.0%.


Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 4/26/13 11:35 PM
Hi everyone

From my information, this should be working again in the meantime. We will continue to monitor the status and I'll update here should anything change. 

Thanks for your patience!

Best regards,
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page crazyaboutmagazines 4/27/13 1:37 AM
Thanks John,

I can on the 25 April the spike on the "Total server connectivity errors" dropped down to 2% (from 50% the previous day).
No info yet for the 26 April.

Thanks for keeping us informed.

Re: Googlebot can't access your site - Server connectivity - Unreachable page Robbo 4/27/13 3:54 AM

Thanks John for all the efforts you and your colleagues put into resolving this and keeping us informed.
Re: Googlebot can't access your site - Server connectivity - Unreachable page fidmas 4/27/13 6:30 AM
Well, it just worked 6 times in a row, for now anyway, for whatever it's worth. :-/
Re: Googlebot can't access your site - Server connectivity - Unreachable page mahmod sowwan 4/27/13 11:33 AM
John Mueller

nothing change 

on www.dreambox-sat.com still have 


everything ok

Also i have another problem on my site 
never receive any replay to my all reconsideration request
can u check it for me  
Googlebot can't access your site - Server connectivity - Unreachable page Jean Korte 4/27/13 12:00 PM
Same problem here with two domains.  Hosted by hostgator.  They have advised that the problem is google's and that there is actually no problem accessing any of my sites.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Margarita Duarte 4/28/13 1:14 AM
Hola, también mi sitio está recibiendo mensaje y problemas de conexión servidor es Minervahosting por si es necesario saberlo y el sitio es:


Todo el resto parece que funciona bien...

Gracias y esperamos que se solucione lo antes posible.
Re: Googlebot can't access your site - Server connectivity - Unreachable page khn483 4/28/13 6:46 PM
Is there anyone here still experiencing timeout error as of April 27th? 

Fetch as Google gives us 100% success rate but we're still seeing connection timeout 4% on April 27th under crawl errors... It was 14% on 24th and 25th.


Re: Googlebot can't access your site - Server connectivity - Unreachable page Art Minds 4/28/13 7:41 PM
John,

Using "Fetch as Google" is not the problem.  Anytime googlebot reports access errors, the "Fetch as Google" always is able to access the home page.

Here is the recent list of errors you reported about my site artminds.com in Webmaster Tools:

April 19, 2013
Over the last 24 hours, Googlebot encountered 244 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 6.2%.

April 24, 2013
Over the last 24 hours, Googlebot encountered 60 errors while attempting to connect to your site. Your site's overall connection failure rate is 52.2%.

April 23, 2013

While crawling your site, we have noticed an increase in the number of transient soft 404 errors around 2013-04-23 19:00 UTC (London, Dublin, Edinburgh). Your site may have experienced outages. These issues may have been resolved. Here are some sample pages that resulted in soft 404 errors:

Both my DNS provider, DNSMadeEasy.com, and my web hosting company, HostGator.com, have reported that there are no errors in their logs, and that the problem appears to be with the googlebot.

These errors have been occurring periodically over the past several months.
 
Art Minds

Re: Googlebot can't access your site - Server connectivity - Unreachable page Charu Rastogi 4/28/13 9:44 PM
The same thing had happened with my site. This is really a mess. Being a webmaster, Its very difficult to judge that what issues are really we have to be sort out?
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 4/29/13 2:38 AM
Just following up on the recent sites posted here, to double-check:

- The crawling of http://www.maspatchwork.com looks ok for yesterday.
- The crawling of http://www.artminds.com & http://store.artminds.com looks ok for yesterday
http://www.dreambox-sat.com looks ok for yesterday (but you redirect invalid URLs to your homepage, which is a bad practice / soft-404)
http://www.tvmdata.com/ looks ok for yesterday

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page ImaginMor 4/29/13 3:52 AM
Same issue with my website http://imaginmor.com/

non-www version has the error messages and the www version does not have the error messages. 


http://imaginmor.com/: Googlebot can't access your site
Apr 9, 2013

Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%

http://imaginmor.com/: Googlebot can't access your site
Apr 9, 2013

Over the last 24 hours, Googlebot encountered 1 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 50.0%. 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Admin SmokingFetishSociety 4/29/13 4:28 AM
Having same issues with the googlebot and glad to see it's not just my site with this issue. Hopefully google gets the bot problem fixed soon.
Re: Googlebot can't access your site - Server connectivity - Unreachable page hodaraadam 4/29/13 4:29 AM
What about my site ? justsurfrax.com, can you check it John?
seeing the same problem since the 25th.

thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 4/29/13 10:44 AM
Hi John,

I am having the same problem with my site www.best-cat-tree-reviews.com - I am also hosted with HostGator.com and found this thread from their site.

I first noticed this issue through Google Webmaster Tools that my site had a server connectivity issue. I'm quite relieved, in a funny way, that the problem is from Google's end...Thank you for the updates, it is comforting.

With kind egards,


Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 4/29/13 10:52 AM
Hi John,

I have been experiencing the same problem with my site best-cat-tree-reviews.com

I've tried fetch and that seems to be ok, but I'm still getting the 'server connectivity issue' message.

Thanks for keeping us up to date, it's much appreciated.

Thanks again,
Re: Googlebot can't access your site - Server connectivity - Unreachable page kazmattsas 4/29/13 1:21 PM
Yeah - we have to throw our site into the ring here 
http://www.backpackertours.com.au still experiencing the same issues
Checked with server techs  - no issues with google bot or errors in logs
DNS all good
we also have about 100 other sites on the server - none experiencing any errors from within webmaster tools area

Last time it was ok was the 25th April according to WMT - no changes since then

IS there still an issue on Google end?
Re: Googlebot can't access your site - Server connectivity - Unreachable page lbuben 4/30/13 12:29 AM
Is there still an issue with this Matt? We haven't seen any changes in our webmaster tools for days now. Thank you.
(unknown) 4/30/13 1:28 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 4/30/13 3:07 PM
Therefore your problem simply cannot be explained away by any glitch on Google's end, as so many seem to want to do.

It will be due to a block in your server's firewall or even on your server.

This is the most obvious cause, no point in avoiding that conclusion.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 4/30/13 3:40 PM
Hi Matt,

Would you happen to know if there is an update on this situation?

Thank you for your time

(unknown) 4/30/13 6:59 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page Tim Thurlings 4/30/13 10:43 PM
Hey John,

We had the same problem on www.onlinepokerwins.com and believed it was due to GoLeads. They admitted to have placed filters on the site to block traffic due to a high non human traffic peak. However that sounded not logical, we migrated the site to 1and1. The moment the dns was changed the problem was resolved.

Maybe it helps...

Re: Googlebot can't access your site - Server connectivity - Unreachable page Tim Thurlings 4/30/13 10:49 PM
Godaddy, not GoLeads...
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 5/1/13 1:49 AM
Following up here from a crawling point of view with the new sites mentioned ...
- http://www.backpackertours.com.au  - I can't reach your site at all from my workstation, Googlebot can't access it either (web-sniffer works, so you're perhaps blocking our IP range somewhere?)

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page srivathsan 5/1/13 2:08 AM
Hi John,

Can you confirm me the websites - www.madrasgeek.com & www.mobigizmos.com ?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Admin SmokingFetishSociety 5/1/13 10:16 AM
Hi John,
 
Can you confirm my site http://smokingfetishsociety.com ?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Joey Navarro 5/1/13 11:24 AM
Hey John, I have used fetch as Google since the server errors and it finds all my pages fine but the little warning sign under server connectivity hasn't gone away. Dose this take time or is there still something wrong? My site is www.theshackpaintball.com, any help is much appreciated. Thank you
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/1/13 2:20 PM
Yes it takes time to clear. As long as you get no new message to that effect it should be all good.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Admin SmokingFetishSociety 5/2/13 4:01 AM
Not entirely true Webado! Easiest way to tell if it's your site or Google is to do the fetch as Google in Webmasters Tools and if it works successfully this indicates a problem with the Google Bot. Also you can check with other search engine bots to see if they are able to connect because if Bing and Yahoo can connect surely Google can too. As John has already stated there was an issue with the Google Bot so don't just dismiss that as an option. Many have checked with their hosting providers and been told there is nothing in firewall or spam protectors blocking Google Bot. Typically if you have something like Google Bot able to access your site for years and then all of a sudden it starts throwing server connectivity error message especially on such a huge number of sites as indicated by this thread then it would seem to be the best conclusion is that the Bot is to blame.
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/2/13 4:46 AM
You keep missing the point. 

Your site or server firewall may be blocking certain IPs and/or certain user-agents. A successful Fetch as Googlebot only shows that the particular Googlebot  IP, using the typical Googlebot user agent string sent to do the Fetch  by Webmaster Tools at that moment is not blocked. Googlebot has a very large number of IPs and uses several user agent strings.

It's quite irrelevant whether other robots can access it OK. Do they even report failures the way Webmaster Tools does?

Hosting providers typically deny very categorically  they block anything until pressed multiple times to check through lots of firewall settings. They also would have trouble to check everything happening on the network of which they are part, that would require they check with their own wholesale hosting providers  and datacenter admins. 

I don't recall a definite response from John or anybody else from Google that there was a specific issue with Googlebot. I recall statements to the effect that it was being looked at to see whether there was.

Best conclusion is that there was a block along the way between a number of sites and one or several Googlebots. 








Re: Googlebot can't access your site - Server connectivity - Unreachable page Admin SmokingFetishSociety 5/3/13 12:21 AM
You do realize it's very easy to see which IP address Google Bot uses to crawl a site right? So it's very easy for a hosting provider to check if that IP address is blocked by a firewall.
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 5/3/13 2:21 AM
Let's check a few more of these just to be sure ... :-)

http://smokingfetishsociety.com - looks ok, but your 404 page is broken - it redirects to itself 

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page Hratch Gulumian 5/3/13 3:17 AM

Hi John,

I have changed my server host yesterday, may you kindly check if my site is okay? till now it's giving me 'Server Connectivity !'

My website is: Click-Sports.com

Thanks in advance.
Awaiting your reply.
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/3/13 3:53 AM

>>You do realize it's very easy to see which IP address Google Bot uses to crawl a site right? So it's very easy for a hosting provider to check if that IP address is blocked by a firewall.

You don't know which IP Googlebot used to crawl when it was blocked. It can be any of dozens if not hundreds.

The firewall will have many IPs and IP ranges blocked. The catch is you or your server admin have to test all of them to see what they resolve to.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Trilma Rose 5/3/13 7:53 AM
The server connectivity still shows a yellow triangle. Is the issue resolved?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Admin SmokingFetishSociety 5/7/13 12:19 AM
Ok thanks John for whatever you did as the little message no longer shows in webmaster tools.

So in essence what you're saying webado is that google uses hundreds of different bots and it's essentially impossible for us or host providers to know the ip address of the bot being blocked. Therefore, you're earlier comments that we should contact our hosting providers first to make sure their firewalls aren't blocking google bot is useless because without knowing the ip address there's no way to unblock it in a firewall. Thus using this forum to reach out to google staffers like John is a good thing. Also just an FYI for you but according to my access logs Googlebot has crawled my site everyday for the past month including the day in which webmaster tools was showing server connectivity errors which would indicate that this is not a bot being blocked by firewall issue but rather a google webmaster tools reporting issue or issue with the bot itself.
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 5/7/13 1:13 AM
I'm glad to hear that things are back to normal again!

Yes, we do use quite a large number of IP addresses for Googlebot, and these may change over time. This is one reason why we recommend using reverse DNS lookups as a way to verify whether or not an IP address is used by Googlebot: http://support.google.com/webmasters/bin/answer.py?hl=en&answer=80553

Unfortunately, it's not completely uncommon for servers, firewalls, networks, or hosters to block individual or several Googlebot IP addresses (be it for crawling or DNS lookups). Going from errors mentioned in Webmaster Tools, attempting to drill down into specifics, and working with your hoster to resolve those issues is always a good idea. In this particular case, it ended up being more of an issue on our side, but in pretty much all other cases, it's really an issue somewhere outside of Google's network. There are legitimate reasons to block or rate-limit crawling, and for these we generally recommend using the robots.txt file ( https://developers.google.com/webmasters/control-crawl-index/ ) or the Webmaster Tools crawl-rate limiter ( http://support.google.com/webmasters/bin/answer.py?hl=en&answer=48620 ), so we generally don't recommend just blocking the IP addresses. 

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/7/13 5:12 AM
>>So in essence what you're saying webado is that google uses hundreds of different bots and it's essentially impossible for us or host providers to know the ip address of the bot being blocked. Therefore, you're earlier comments that we should contact our hosting providers first to make sure their firewalls aren't blocking google bot is useless because without knowing the ip address there's no way to unblock it in a firewall. 

I said every IP address or IP range being blocked in the firewall has to be tested to see what it resolves to and if it's Google it should be unblocked. 

>>according to my access logs Googlebot has crawled my site everyday for the past month including the day in which webmaster tools was showing server connectivity errors
That can very well be another Googlebot IP not the one being blocked.

>>Thus using this forum to reach out to google staffers like John is a good thing.
Absolutely. But don't go expecting Google staff to respond every time unless they have specific insight into an issue which the rest of us ordinary forum members don't have. They will intervene when we cannot provide the answers.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 5/9/13 5:02 PM
Hi John,

I think things are beginning to look better now.

Even though under the 'Current Status' heading 'Crawl Errors' it actually says:

No errors detected in the last 90 days. Nice!

 I'm still getting the message:

http://www.best-cat-tree-reviews.com/: Googlebot can't access your site

Should I simply ignore this message, because I don't know what else to do.

Thank you for your time,

Jasmine


Googlebot can't access your site - Server connectivity - Unreachable page Louis Rigo Jr 5/9/13 6:23 PM
I'm seeing the same issue on my site, however, my error message shows the URL ending in a ":" of course this wont resolve!  Today is the first I'm getting this, and the site's been up without chances for weeks. The URL from google shows "www.domain.com/:"
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/9/13 6:32 PM
You cannot expect help without your real website url.
Re: Googlebot can't access your site - Server connectivity - Unreachable page charles shaw 5/13/13 6:20 PM
please fix my as well  http://www.transamgrafx.com  
will not fecth 
Re: Googlebot can't access your site - Server connectivity - Unreachable page charles shaw 5/13/13 6:55 PM
My website is http://www.transamgrafx.com    and when i go to webmaster tools  to fetch the website it has stopped working 5 days ago,   can some please help me fix this, is this a google issue?   bing,alea,internetseer,yahoo   all work and fetch fine,  please help me fix this issue 

thanks,
charles
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dario Di Toro 5/20/13 3:09 AM
I'm sorry, is this issue still unresolved?

I've had the problem since april 29th and it hasn't stopped yet.

I'm sure our server is OK, with no downtime whatsoever. Should I worry or just wait?

thanks a lot.

p.s. Is there a way to see which pages are giving a server timeout error in webmasters tools?
Re: Googlebot can't access your site - Server connectivity - Unreachable page ppc zeald 5/21/13 8:43 PM
Hi John, the issue is still happening intermittent  on   http://www.abtrac.com.au  and  www.abtrac.co.nz , Could you please help?
http://www.abtrac.com.au/: Googlebot can't access your siteOver the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 50.0%.

We used "Fetch as Google"  under "Health" menu,  and it returns  "Success" every time. We have checked none Google IP addresses are being blocked.   
Appreciate any help.  

Re: Googlebot can't access your site - Server connectivity - Unreachable page FindEclinic Sol 5/22/13 3:21 AM
My url is findeclinic.com

getting same error Googlebot can't access your site - Server connectivity - Unreachable page
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/22/13 5:48 AM
I can't help you with that (it's likely a firewall issue), but the robots.txt file is invalid.

You have to group together all directives for a given user agent.
Re: Googlebot can't access your site - Server connectivity - Unreachable page FindEclinic Sol 5/22/13 6:32 AM
No it does not look a firewall issue, as I can access the site by setting user agent as google blot in ff.

Also few days ago this was working perfectly so not a issue with robots.txt too (Though I will correct it soon).

Still is live and active but in webmaster I see this error, anyway I can test and debug what is wrong here.

Thanks for the response in advance!
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/22/13 6:38 AM
I am referring to your server's firewall which is very likely blocking some IPs, and some of those IPs are very likely Googlebot IPs, regardless of user agent.

Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 5/22/13 8:45 AM
@ppc zeald -- I currently don't see any issues crawling http://www.abtrac.com.au or http://www.abtrac.co.nz itself, however I see that /Members.html redirects to a site that returns errors instead of a robots.txt file. 

@FindEclinic Sol: It looks like your site's issues were primarily from the 20th, and it looks better now.

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page FindEclinic Sol 5/22/13 11:42 AM
Thanks,

Just correction my site i.e http://findeclinic.com has issues starting from 20th even today i tried couple of times to fetch site as google blot and it showed me failed due to connection timeout.

I am not using any firewall nor anything serious change after 20th which could have broke things.

Please help me with this.

Thanks in advance.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Aimee Holland 5/23/13 3:36 AM
Hi Guys,


Bit new to this WMT thingy but here's my challenge.  Have been getting regular messages to say that Google cannot access my site due to server connectivity for months.  Was due for a refresh anyway so put up a new fully responsive site on 8th May.  Now still getting daily reports that Google cannot access the site because of server connectivity.  Have checked and everything looks fine from my end, new site maps are indexed etc and fetch as Google works perfectly.  What am I doing wrong please?

Thanks-you 

Learning Meme   
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 5/23/13 6:50 AM
@Aimee: We're having trouble getting pretty much anything under /index.php/ from your site, for example, when I click on any of these results, I see "No data received" errors in my browser: https://www.google.com/search?q=site%3Ahttp%3A%2F%2Fwww.growmyprofit.co.uk%2Findex.php%2F . If these URLs no longer exist, then returning 404 would be the appropriate way to handle it. Even a clear server-error (5xx result code) would be better. As it is now, to our systems, it looks like "sometimes" we can crawl, and other times we can't (these kinds of URLs). I imagine this is just a small thing to fix on your side though :)

@Findeclinic: this really looks like something that was primarily restricted to the 20th on your website.

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page Aimee Holland 5/23/13 8:01 AM
@JohnMu: Thank-you for your reply, It makes sense now, I haven't added any 404 or 5xx so that's why pages are returning errors.  Rookie error!  Will get on the fix right away!
Re: Googlebot can't access your site - Server connectivity - Unreachable page Aimee Holland 5/23/13 9:26 AM
404 now up and running http://www.growmyprofit.co.uk/404.html so fingers crossed!
Re: Googlebot can't access your site - Server connectivity - Unreachable page FindEclinic Sol 5/23/13 9:09 PM
Well, I found what was wrong after 5 days. So virus or things called "sitemap_win-beta1-20091231" got installed in my IIS, so it was blocking google blot to index my site now findeclinic.com is accessible.

Ufffhhhh, very tough to get a fix for this.

I think google should come-up with a reverse look-up tool which can be used from client machine to query bot whether it is accessible or not.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 5/25/13 2:07 PM
Hi John,

Please could you tell me if my site www.best-cat-tree-reviews.com is okay now.

I am still getting the message that Google Bot cannot access my site...

I would really appreciate it as I have no idea what to do next.

Thanks

Jasmine

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 5/26/13 7:47 AM

@FindEclinic Sol:

>>I think google should come-up with a reverse look-up tool which can be used from client machine to query bot whether it is accessible or not

Re: Googlebot can't access your site - Server connectivity - Unreachable page tdartdar 5/29/13 6:28 PM
Hello,
   MY Webmaster tools also has Red DNS and Server connectivity on one of my sites 5/29/13 ;(
Re: Googlebot can't access your site - Server connectivity - Unreachable page mathieu Upright 5/31/13 6:46 AM
ok!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Re: Googlebot can't access your site - Server connectivity - Unreachable page mathieu Upright 5/31/13 6:48 AM

Re: Googlebot can't access your site - Server connectivity - Unreachable page chicageek 6/3/13 8:42 AM
Hi @johnMu

I appreciate your help in this group.
I hope you can help me with my site.


Since January we are getting from 1 to 2 percent of Server error: No response.
DNS and robots are ok.

Thanks in advance.


Re: Googlebot can't access your site - Server connectivity - Unreachable page Jay B Sauceda 6/3/13 10:30 AM
Hi John,


I am getting a 100% DNS error rate. My DNS information all seems to be correct with no changes having taken place in the last couple of years. I tried changing my domain name to different nameservers with no luck still. Can you please give me more information as to why I might still be getting this error message?
Re: Googlebot can't access your site - Server connectivity - Unreachable page mr.shah 6/6/13 9:16 PM
i am getting below error since 2 months now..(i checked fetch as google and even submitted index and all pages again, but below status does not change).
my site's ranking has gone down badly. 
please help,
mr.shah, india, my cell phone -- +91-9222922292


http://www.easyfriends.com/: Googlebot can't access your site
May 14, 2013

Over the last 24 hours, Googlebot encountered 263 errors while attempting to connect to your site. Your site's overall connection failure rate is 13.0%. 
You can see more details about these errors in Webmaster Tools
Re: Googlebot can't access your site - Server connectivity - Unreachable page mr.shah 6/6/13 9:24 PM
hi john, my site is getting this error since may 2013. please help? i have lost all my rankings..

please HELP, PLEASE.
REGARDS, CEO, EASYFRIENDS.COM , con...@easyfriends.com , india, +91-9222922292




http://www.easyfriends.com/: Googlebot can't access your site
May 14, 2013

Over the last 24 hours, Googlebot encountered 263 errors while attempting to connect to your site. Your site's overall connection failure rate is 13.0%. 
You can see more details about these errors in Webmaster Tools
Re: Googlebot can't access your site - Server connectivity - Unreachable page Rikky Rk 6/10/13 1:12 AM
hi john, same issue here

http://www.ayostyle.com/: Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 28 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 56.0%.

all of my indexed page has gone, i type keyword on google no one page has shown

help me pls..

thx

Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 6/10/13 3:06 AM
Hi John,

I am still getting the following message for my site http://www.best-cat-tree-reviews.com/ :

http://www.best-cat-tree-reviews.com/: Googlebot can't access your site
April 24, 2013

Over the last 24 hours, Googlebot encountered 9 errors while attempting to connect to your site. Your site's overall connection failure rate is 56.2%.

I'm really not sure what else to do to fix it. Please could you help me.

Thanks for your time,

Jasmine
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/10/13 4:43 AM
That was on April 24, 2013 - we are now in June 2013!
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/10/13 4:47 AM
@Rikky Rk - I cannot load your homepage at all. It simply times out.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Rikky Rk 6/11/13 8:48 AM
@webado - can you please check it again? i have just already asked my website hosting to check about my domain access. please let me know if you can access it. kindly waiting for your reply
thanks before :)
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/11/13 9:16 PM
Still not loading. And that is 12 hours after you posted.
It times out.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dipin Kapur 6/12/13 12:24 AM
Hi John,

We are still getting same issue here.

http://www.redshift.co.in/: Googlebot can't access your site
June 4, 2013

Over the last 24 hours, Googlebot encountered 4 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 100.0%.

Is this problem of googlebot resolved? As Matt earlier posted that your webmaster tool team is working on it.

Thanks






Re: Googlebot can't access your site - Server connectivity - Unreachable page Dipin Kapur 6/12/13 12:47 AM
Hello Matt,

I have the exact same issue.

My site www.redshift.co.in shows unreachable in Fetch as Google and the only problem shown there is 15000 milliseconds. This happened a few hours ago and the hosting provider says it's all fine in their end.

Please help this is affecting my indexing.

Thanks

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/12/13 5:02 AM
>>the hosting provider says it's all fine in their end.

They would. 

Dipin, why whenever I copy the hyperlink you posted it turns out to be http://www.gamechup.com/?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Fernando Magno 6/13/13 12:48 AM
Is june and I got the same problem. Hostgator confirms that nothings is wrong with my site, but google can´t crawl. I hope that is gonna work ok soon.
:)
Re: Googlebot can't access your site - Server connectivity - Unreachable page simonelliot 6/13/13 6:08 AM
Good afternoon Matt. I had a question that I wanted to ask yesterday at SMX Advanced, but there wasn't enough time.

I'm having a similar issue with repeated webmaster tools message regarding a robots.txt file where Googlebot looks to be search for a URL which doesn't exist. 

I'll give some background.

Our website features multiple language versions, organised in a sub folder structure.


Our robots.txt is on the root, however via WMTs I keep seeing errors where Googlebot has tried to access the robots.txt file on the sub folder... i.e domain.com/fr/robotx.txt


've already inserted the robots.txt file into the main root, and it has been working for the last 2 years. This appears to be an issue with Webmaster tools THINKING that domain/fr (which is geotargeted to France) is a root, and should therefore have a robots.txt file.

The WMT's error I've received say that "googlebot can't find a robots.txt file at domain.com/fr/robots.txt" which is very strange.

My options are therefore:

a) 301 redirect all requests for domain.com/fr/robots.txt to domain.com/robots.txt
b) Ignore the issue, and let googlebot solve it.

Love to hear your thoughts here. Our daily drawl rate has dropped slightly.. so I'm very concerned here.. particularly as there is nothing I can physically do in the Webmaster Central console to remedy this.
(unknown) 6/14/13 1:57 AM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page Dipin Kapur 6/19/13 10:48 PM
Hi webado,

I dont know why you are getting http://www.gamechup.com/?

But my problem is still there for redshift.co.in. We are still getting below error. Please provide us solution.

Error Detail:

http://www.redshift.co.in/: Googlebot can't access your site.

Over the last 24 hours, Googlebot encountered 4 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 100.0%.

Thanks

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/20/13 4:55 AM
What is the date  associated with that error? If it's in the past, then it was a one-time problem.

DId you do a Fetch as Googlebot?
Re: Googlebot can't access your site - Server connectivity - Unreachable page wadams11 6/20/13 11:32 AM
We have been receiving this message since the beginning of the year.  Our site has most of the search engines blocked from 6am-11:59pm, then at midnight opens up and allows scanning.

I have tried fetching as google between the open hours and it either tells it it fails or is unreachable.  My site is www.cameron.edu.

Bill

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/20/13 6:09 PM
How do you block search engine robots at those times?

You should respond with 503 . This will not result in any error, it's a perfectly acceptable response and it signals service unavailable right now, try later.

Re: Googlebot can't access your site - Server connectivity - Unreachable page GoneforGood 6/21/13 5:48 AM
hello anyone who's concern of google staff please help my site, i have the same excact problem

since 17 june 2013 ,i never check my site statistic because doing another project but i see my alexa rank was droping far away then i login and check google  WMT tells me crawls error report were raising significantly all error report was 9K url error (404 not found)

but the fact i check my site are fine up normally from dns, server uptime and etc, there all on green status

and because this error log (g bots cannot acess) my traffic was drop really badly, i very frustrated right now

please some one help me what should i do

here it is i attach screnshoot to prove it

i have no idea what to do beside click the "mark as fixed" all url that seems working fine but google said google bot cannot acees it

my traffic was drop from 10K perday untill now 2K perday please someone need advice

what should i do

i have contact my hosting provider and i still waiting their answer but actually i have no receieved any downtime since 17 june and therefore i never check the traffic/ to WMT


if this problem causing from google webmster tools for me no big deal but how about my traffic ? its drop 80%  i really need your advice here

if someone google staff/ team want to take a look at my site i will post here

thanks

(unknown) 6/21/13 5:53 AM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page GoneforGood 6/21/13 6:15 AM
update : to shorten my url site

here it is my site : http://goo.gl/YWdCj
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/21/13 5:32 PM
Please open your own thread and provide all information. Your problem is not the same as thatg discussed in this thread.
Re: Googlebot can't access your site - Server connectivity - Unreachable page davidw1999 6/23/13 12:44 AM
Hi, John, thanks for help.
We have a dozen sites hosted in a CMS, we had them in webmaster tool, but we got "Googlebot can't access your site" email for a while now, when I check the webmaster tool,  I see a lot DNS errors. And fetch as Google gives "Unreachable page"
I can access all those sites fine.
Could you please check one of them "htt​p:/​/ww​w.s​ica​.bc​.ca​/"
 
Thanks
Re: Googlebot can't access your site - Server connectivity - Unreachable page Jasmine Webley 6/26/13 12:57 AM
Hi John,

I just wanted to take the time to say thank you for your time in trying to solve this issue.

My site www.best-cat-tree-reviews.com is appearing as normal and I am feeling very relieved.

Thanks again and best wishes to you,

Jasmine

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/26/13 7:33 AM
@davidw1999, please open your own thread. if the discussion in this one doesn't help yo identify your issues.
I will tell you you messed up your url. You hyperlinked it to one that does not exist.
Re: Googlebot can't access your site - Server connectivity - Unreachable page davidw1999 6/26/13 9:00 AM
Thanks for help.
I have the same problem as described in this post, it seems this problem is related issue on Google side, that is why I post here hope to get some help.
 
So bad I typed that URL wrong. it should be http://www.sica.bc.ca
 
I have a few sites on the same CMS, the below is one I just got the Googlebot error message. 
 

http://www.mpssociety.ca/: Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 58 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 69.9%.

You can see more details about these errors in Webmaster Tools.

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/26/13 9:34 AM
I said for you to open your own thread.

And we cannot see you Webmaster Tools errors, only you can see them.
Re: Googlebot can't access your site - Server connectivity - Unreachable page chicageek 6/26/13 3:06 PM
Hi everyone.

Webado and John, I really appreciate your help in this group.
Im writting wishing you can help me to track the main issue with my site.


Since January we are getting from 1 to 2 percent of Server error: No response.
The DNS and robots are ok.

Please let me know wich other information you need.
Thanks in advance.
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/26/13 4:09 PM
Please open your own thread!
Re: Googlebot can't access your site - Server connectivity - Unreachable page davidw1999 6/26/13 4:25 PM
I already opened my own thread, maybe you can help over there?
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 6/26/13 5:07 PM
I was responding here to the poster just before.
I will see if I find your thread.
Re: Googlebot can't access your site - Server connectivity - Unreachable page moonslider30 7/2/13 5:24 PM
the problem is that this issue is still not solved! my website is also getting 100% DNS errors, and it can't be fetched by Googlebot in webmaster tools, always giving "unreachable page" . Indexing dropped to 0 pages per day, visitors dropped 100% from Google!
 What do to?! Website is live all the time, why is this happening?
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 7/2/13 5:43 PM
Did you read this thread from the beginning? 
Re: Googlebot can't access your site - Server connectivity - Unreachable page Sajal Basu 7/9/13 12:07 AM
We are recently getting some robots.txt access issue from googlebot
 
eg . Googlebot encountered 1272 errors while attempting to access your robots.txt
 
Website's url is : www. 123 greetings.com (Please remove the spaces inbetween) , fetch as google works perfectly from within webmaster tools. Is everything ok or we need to fix something.
Re: Googlebot can't access your site - Server connectivity - Unreachable page randymir 7/16/13 7:58 AM
Since the beginning of June I have been experiencing the same problem as most people in this thread. I monitor my site closely and every day Google has "connectivity" issues. I have received several emails saying, "Over the last 24 hours, Googlebot encountered 314 errors while attempting to connect to your site. Your site's overall connection failure rate is 58.7%." Of course the error count and percentage fluctuates.

I have tried to work with Godaddy to no avail. I have removed plugins and tried doing things with .htaccess and robot.txt and still experience a problem.

Could this be something on Google's end? If so, any suggestions how to resolve.

The site is http://celebrityexaminer.com

This has been frustrating to say the least.

If there's another thread related to this, or if I should start another one, let me know.

Thanks.

Re: Googlebot can't access your site - Server connectivity - Unreachable page Obi-One 7/18/13 11:57 AM
I am still having this problem and it IS NOT FIXED. Can we please have an update from Google. Go-Daddy says you guys are useless.What's the deal already?????
Re: Googlebot can't access your site - Server connectivity - Unreachable page Bettina Yanez 7/24/13 5:55 PM
John,

We were hit with is "Googlebot can't access your site" issue back on 4/13; however, the problem is back, it started again on 7/6/13 and continues to this day (18 days). 

Is Google still working on resolving this issue?

best,
Bettina
Re: Googlebot can't access your site - Server connectivity - Unreachable page jfiebig 7/26/13 5:28 AM
It's July and this error still seems to be happening. What is Google's response?
Re: Googlebot can't access your site - Server connectivity - Unreachable page vijaybez 7/29/13 3:21 PM
HI,

Is this issue resolved..

I still get the error for my site:  http://www.dealhome.in

If it is not, is there any estimate given about when the resolution will be provided..
Re: Googlebot can't access your site - Server connectivity - Unreachable page badda1212 7/29/13 11:19 PM
I have also got same email in last 2 days continuously.  My site is http://www.hospitality-school.com
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 7/30/13 4:56 AM
@ badda1212, when I try your url I get this error message:

Fetching of original content failed with the following error: Proxy Publisher Failure - CONNECTION ERROR. If you own this domain, please consult this FAQ.

So this explains your issue.
Re: Googlebot can't access your site - Server connectivity - Unreachable page vijaybez 7/30/13 5:45 AM
@webado..

Could you please help me with my domain as well.


I get a success most of the times on these parent domains but the child domains which contain categories and the actual posts have a huge issue they are unreachable most of the times.


Please help.
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 7/30/13 5:20 PM
Did you test yrou url?


I get a 500:

View HTTP Request and Response Header

Check out our new free Web-Sniffer desktop app for Windows and Mac.

For more information on HTTP see RFC 2616

HTTP(S)-URL:   (IDN allowed)

HTTP version:  HTTP/1.1  HTTP/1.0 (with Host header)  HTTP/1.0 (without Host header)

 Raw HTML view  Accept-Encoding: gzip • Request type: GET  POST  HEAD  TRACE

User agent:        


HTTP Request Header

Connect to 119.18.49.212 on port 80 ... ok

GET /daily-deals-category/kitchen/ HTTP/1.1[CRLF]
Host: www.dealhome.in[CRLF]
Connection: close[CRLF]
User-Agent: Web-sniffer/1.0.46 (+http://web-sniffer.net/)[CRLF]
Accept-Charset: ISO-8859-1,UTF-8;q=0.7,*;q=0.7[CRLF]
Cache-Control: no-cache[CRLF]
Accept-Language: de,en;q=0.7,en-us;q=0.3[CRLF]
Referer: http://web-sniffer.net/[CRLF]
[CRLF]

HTTP Response Header

NameValueDelim
Status: HTTP/1.1 500 Internal Server Error
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 7/30/13 5:24 PM
Even your homepage http://www.dealhome.in/  is 302 redirected to http://www.dealhome.in/bangalore-deals  whcih then responds with a 500.

Your site is broken.

Ask these guys to fix it: http://www.gobyweb2.com/ - at the very elast they should earn the right to hope  to have a link in your footer. 
Although that link should be nofollowed anway.

Re: Googlebot can't access your site - Server connectivity - Unreachable page vijaybez 7/30/13 6:20 PM
hi @webado

Try the same URL second time it will give you a 200 ok..

i get an unreachable page first time and status ok the second time with just 5 sec delay..

the 302 redirect was intentional which will stay there for some time.. i used the web sniffer and got 200 ok on all the URLs i know that there are sometimes i see this error but I don't know what is causing it.

The issue is very intermittent to be able to even find out what the issue is..Is there any help you can offer in this regard..

Please help me..


Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 7/30/13 6:27 PM
Worst kinds of issues these intermittent ones.
And I'm afraid you cannot assume it's OK, it's not.

Sorry I cannot offer any assistance. This is to be troubleshot strictly from the inside of your hosting account and your website.
Re: Googlebot can't access your site - Server connectivity - Unreachable page safame20 8/1/13 10:08 PM
I am using Godaddy and getting this error.

http://www.xowned.com/blog/: Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 1 errors while attempting to connect to your site. Your site's overall connection failure rate is 50.0%.

You can see more details about these errors in Webmaster Tools.

The same site and pages were accessed without any problems in the past.




Re: Googlebot can't access your site - Server connectivity - Unreachable page Kevin Wilkinson 8/5/13 9:43 AM
@JohnMu, if/when you have time, could you check out either http://coolscifi.com and http://awalkerbit.me?  

Starting around mid-July we've been experience the problems being discussed in this thread.  First a wave of warnings that the server was unreachable at 100% and then, because the server was not being reached,our verification status dropped with no way of being able to re-verify again so we can't even do a "Fetch as Google" to test.

Our DNS settings look fine (http://dnscheck.pingdom.com/?domain=coolscifi.com / http://www.intodns.com/coolscifi.com), we tried whitelisting ".googlebot.com" in our firewall (CSF), disabling our firewall entirely, created a new account on the server with no robots.txt nor .htaccess defined to rule them out, and looking at the raw access logs we aren't seeing any googlebot requests.

Your assistance would be appreciated.
Re: Googlebot can't access your site - Server connectivity - Unreachable page rockxlee1 8/5/13 5:09 PM
gamechup how are you ?

I have opened my website may be 2 weeks ago and i have the same problem .

my website talks about animes and it contines animes so i need your advis about the them what should pick or what can i do to make my websit better this is my websit ‪projectdownloadx.com you can chek it and give some advises thank u.for reading this
Re: Googlebot can't access your site - Server connectivity - Unreachable page Damian Wynter 8/12/13 5:29 PM
I am getting this error: 
http://uniquedesignsolution.com/: Googlebot can't access your site
Aug 11, 2013

Over the last 24 hours, Googlebot encountered 15 errors while attempting to connect to your site. Your site's overall connection failure rate is 100.0%. 

You can see more details about these errors in Webmaster Tools
Re: Googlebot can't access your site - Server connectivity - Unreachable page Seana Elizabeth Fenner von Fenneberg 8/12/13 10:40 PM
Yes I've read the FAQs and searched the help center. 
My URL is: odinist.org

I have a similiar issue. I have an older and a new site with the exact same conditions hosted by the same host. I am very concerned because when I search for my exact domain, odinist.org I get the results for another domain. This did not happen the first day. I keep asking about this but it seems like I do not get any further messaging or indexing since the message that there was a hundreds percent failure rate. The only thing I do see that has changed is that it is now recognizing server connectively which, according to the host, was always there. Since it is on the same plan as my  other site that has connectivity I think that it it may be a google glitch. The problem is that my site , my exact name, odinist.org still does not come up in the search results. It does show up on other search engines. Any help appreciated. Thanks!
(unknown) 8/12/13 10:41 PM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page ifaniqbal 8/18/13 8:36 PM
Hi. I have same issue. My site is http://www.ifaniqbal.com/. I don't see any problem in my site and still get those message. I have clicl Fetch As Google link in the message and I hope everything gonna be alright because fetching is success.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Howard Kim 8/19/13 6:54 PM
same issue on my website.
http://www.displayinfo.kr
Re: Googlebot can't access your site - Server connectivity - Unreachable page Howard Kim 8/19/13 6:55 PM
Re: Googlebot can't access your site - Server connectivity - Unreachable page Howard Kim 8/19/13 6:55 PM
Re: Googlebot can't access your site - Server connectivity - Unreachable page Howard Kim 8/19/13 6:55 PM
Re: Googlebot can't access your site - Server connectivity - Unreachable page shogun60 8/20/13 3:03 AM
I have the same problem from 16 august 2013 on www.sicurmetal.com 
I have other web sites on the same provider (aruba.it) without any problem till now
I've done a lot of test: dns check using intodns.com  , accessing my site from united states using a webproxy to verify globally if a reach is possible from other countries (i'm in Italy) and thera are no problem.
I'm afraid that this problem could impact on my google ranking
Can anyone help me ?
Sebastiano
Re: Googlebot can't access your site - Server connectivity - Unreachable page Sarah Snowball 8/26/13 5:28 AM
Hi
I am have the same problem too. I got this message below.

http://www.oilyskinguide.com/: Googlebot can't access your site
August 24, 2013

Over the last 24 hours, Googlebot encountered 2 errors while attempting to connect to your site. Your site's overall connection failure rate is 100.0%.

I'm using Wordpress and GoDaddy. Have checked everything and there's nothing out of place or wrong so no reason to get this warning:

Two days ago I tried Google as Fetch and got some pages fine but I've been getting these server connectivity warnings since August 16th. Can you check out why this is happening? 

Thank you

Sarah


Re: Googlebot can't access your site - Server connectivity - Unreachable page Marin Fernald 8/26/13 9:13 AM
I am having the problem.  My site is a Wordpress site, hosted by Lunarpages.  I get this message every couple of days, and Google won't find my site, despite being the first result when searched by Bing, Yahoo, IE, etc.  My site is santacruzfamilycounseling.com.  I can access it by typing it into the URL, but no one searching for my site can find and I'm not sure if it's because I'm getting these Webmaster Tool Crawl Errors?  
  Anyone?  I would appreciate your help:)  Thanks!

Re: Googlebot can't access your site - Server connectivity - Unreachable page CZD 8/27/13 1:52 AM
Still having issues on different domains which are hosted on the same server. We moved server from one Hostgator shared account to another and we still have the problem. Our sites are not visible when we search on google, not even with the direct address.

Going crazy
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 8/27/13 4:32 AM
Please everybody, open your own threads and provide full information and somebody will check what problems each site may have.

Your sites are pretty sure to have different issues, not the same as what this thread was about originally (which was a one time short-lived  Google issue, long since resolved).
Re: Googlebot can't access your site - Server connectivity - Unreachable page Ahmet Hassan 8/29/13 5:35 AM
I am in the same situation today , I have following error message ;

http://upucuza.com/: Googlebot can't access your site

but DNS is green .
DNSSunucu BağlantısıRobots.txt Getirme
 
I can fetch this robots.txt file with webmaster tool . I didnt understand the problem .
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 8/30/13 11:01 PM
Ahmet, http://upucuza.com/ is performing a 302 redirection to http://www.upucuza.com/

So for starters you need to have in Webmaster Tools http://www.upucuza.com/ and not http://upucuza.com/ .

Then, very important, the 302 redirection should be a 301.

Also the robots.txt file is incorrect. 

You have:
User-Agent: *
Disallow: /products.php

User-Agent: *
Disallow: /
filters-ajax.php


The directives for a given user agent should be all together:

User-Agent: *
Disallow: /products.php
Disallow: /
filters-ajax.php



Re: Googlebot can't access your site - Server connectivity - Unreachable page Dariya Dariya 9/19/13 3:07 PM
Hi, there. I have the same problem, and my website was down for a several hours and it was true, that googlebot couldn't access it. But I discovered strange thing - my webpages in google search result were marked as "close".
here is the link
https://www.google.com/#psj=1&q=turbosonic+whole+body+vibration
my site is www.ocfitnesssource.com

so for now I don't know what cause that word "close" appear in google search result.  I goodled it, no answer found. Yes, my url on the page #1, but what my customers will think about the title??

Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 9/19/13 3:50 PM
At the time your site was down, it must have responded that way.

It's not all your pages, just those which happened to be crawled at that time.

This should be getting cleared soon.
Re: Googlebot can't access your site - Server connectivity - Unreachable page kinopi 9/20/13 12:23 PM
This is my response  for this message. Thank you for your information. The site http://p.kinosita.itabashi.tokyo.jp/ is closed because there happened some troubles in that site. The site is deleted in your Webmaster tool. The site is never appered in the netwok for ever. The IP address of http://p.kinosita.itabashi.tokyo.jp was 221.186.84.150. This IP address is used for new site http://c.kinosita.itabshi.tokyo.jp. DNS are updated at 2013/9/15 and will work stable for several times.  Thank you for your supports especially in Webmaster Tool.
Shoichi Kinoshita,
JPNIC Handle:SK2377JP
Re: Googlebot can't access your site - Server connectivity - Unreachable page loginid 9/26/13 2:06 AM
Hi all,

Looks like lots of people seem to be having this problem.
So am I unfortunately :^(

My site: http://www.pureshowers.co.uk

Has been experiencing this exact problem from the start of this month (9th of Sept).
Then it seemed to resolve itself and the error went away.
Then it happened again on yesterday (24th Sept).

But like everyone else, none of my monitoring programs have shown any downtime throughout that period.

Is this a problem with webmaster tools?
Or should I really actually be looking into this issue as a technical fault with my website?

Thanks!
(unknown) 9/26/13 3:02 AM <This message has been deleted.>
Re: Googlebot can't access your site - Server connectivity - Unreachable page Kunle Anjorin 10/13/13 1:43 AM
Hi John,
I am getting the error below for a site, but have verified that it is working properly on my end. Can you please check and let me know if I need to take any steps? thanks
"Googlebot encountered 1 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 100.0%."
Re: Googlebot can't access your site - Server connectivity - Unreachable page Kunle Anjorin 10/13/13 1:58 AM
Hi John,
I am getting the error below for www.venturenumbers.com, but have verified that it is working properly on my end. Can you please check and let me know if I need to take any steps? thanks
"Googlebot encountered 1 errors while attempting to retrieve DNS information for your site. The overall error rate for DNS queries for your site is 100.0%."
Re: Googlebot can't access your site - Server connectivity - Unreachable page JohnMu 10/16/13 3:53 AM
Hi Kunle
It looks like we weren't able to crawl for web-search on that day because of a DNS timeout issue we ran into -- however that seems to have been limited to that day and was ok before, and ok afterwards. I'd recommend keeping an eye on it, but maybe it was just a random fluke that won't happen again (or at least not regularly enough to make it hard to crawl & index your new & changed content). 

Cheers
John
Re: Googlebot can't access your site - Server connectivity - Unreachable page IvarsD 10/17/13 11:43 AM

Hi

I have a problem with server connectivity for my non www domain connectivity error till 100% several days per month, but for www domain looks quite ok with some errors but not more then 1 error out of some 60 Attempts in some days.

What could be the reason of that?

my domain: www.naturholz-grtenhaus.de 

Ivars

Re: Googlebot can't access your site - Server connectivity - Unreachable page KhemchandKumar 10/17/13 12:03 PM
Dear
Sir/madam

How long
will Google something changes, I got my job is under threat,
I was working with some people all the water has flowed, My business logo will be updated if Google would have come on the road.

SEO This Time Hard Working who which time stable google
Re: Googlebot can't access your site - Server connectivity - Unreachable page IvarsD 10/17/13 1:06 PM
Hi John,

I made a spelling mistake, my domain name is www.naturholz-gartenhaus.de

Ivars
Re: Googlebot can't access your site - Server connectivity - Unreachable page Yudi444 10/28/13 11:13 PM
but alexa rank drop down after server down for few seconds .the alexa rank drop down about many lakhs in a seconds then what we do  at that time to maintain the alexa rank
Re: Googlebot can't access your site - Server connectivity - Unreachable page Nikki Rafaela Sangil 10/29/13 1:27 AM

Hello, I have the same issue received in my email today from Webmaster Tools. 

"Googlebot can't access your site 

Over the last 24 hours, Googlebot encountered 2 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%."

my domain is: www.nikkikaysangil.com


Thanks.

Re: Googlebot can't access your site - Server connectivity - Unreachable page Johnny Apple Seed 10/30/13 10:51 AM
I'm having the same issue with my website and now my business website cant be found anywhere on google. Going from 1st page ranked 4th to now not even being on google is pretty much a kick in the teeth. What are you people doing about this?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Viki David 11/5/13 6:57 PM
Hello John,

I have a question.. I added robot.txt file of 2 days before and removed on that day itself... But still now my page has not been crawled by googlebot... all my pages has been indexed... can you say when it has been rectified.... what is the time limit.......
Googlebot can't access your site - Server connectivity - Unreachable page ana dani 11/6/13 8:39 AM
Re: Googlebot can't access your site - Server connectivity - Unreachable page Shoba K 11/22/13 4:59 AM
Hi, is this been fixed, i am getting this error now, my site is www.dealsdirectory.in

Re: Googlebot can't access your site - Server connectivity - Unreachable page Shoba K 11/22/13 5:40 PM
Even i tried "Fetch as Google" , that also showing fetch status as "Failed" but when i click the link the page is appearing without any problem. Please let me know what is solution
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 11/22/13 6:53 PM
Your server or the firewall are blocking one or several Googlebot IPs. Get your hoster to fix this pronto or move to a different hoster.
Re: Googlebot can't access your site - Server connectivity - Unreachable page hossein torki 11/23/13 11:11 PM
Hi,
I have same problem with MSC Co Website (www.msc.ir).
I check several parameters, Firewalls, DNS servers and etc.
google webmaster say "Googlebot can't access your site"
I sent my problem to google support and unfortunately they don't answer me until now.
Are you find any solution for this problems?
Re: Googlebot can't access your site - Server connectivity - Unreachable page Asiya Begum 1/8/14 11:07 AM
Hi Matt,

Is this issue is fixed  from your end as i have received an email on Dec 17, 2013 that  "Googlebot can't access your site" . i had added robots.txt file and till date i am not sure whether google can access my website or not.

Also would like to highlight that i had added local business in google maps last month and till date not received any post card which should contain PIN number to add the entry into listing.

is there any problem with local business as well? please help me to fix the same.
Re: Googlebot can't access your site - Server connectivity - Unreachable page MD RUBEL AHMED 1/21/14 7:26 PM

Dear Sir

My site www.updateapps.com same problem .  how can fix it ?

regards
Md Rubel Ahmed
Re: Googlebot can't access your site - Server connectivity - Unreachable page MD RUBEL AHMED 1/21/14 7:28 PM
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 1/21/14 7:35 PM
The same as all the others with this issue.

Read my post above.
Re: Googlebot can't access your site - Server connectivity - Unreachable page Alesa Hijab 2/18/14 5:18 PM
i have a site about manual guide called imanualguide.com it have same issue, i try to fix that and i think it is fine right now...but google still detect as server connectivity error :(
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 2/18/14 6:16 PM
Alesa Hijab, your robots.txt file is invalid.

You have just this line in it which is not just incomplete but incorrect:
Disallow /interchange/product-interchange-and-wiring-guide-electrika.html

You need to have this:

User-agent: *
Disallow: /interchange/product-interchange-and-wiring-guide-electrika.html


Re: Googlebot can't access your site - Server connectivity - Unreachable page Rick Dynek 2/19/14 8:55 AM
I am showing issues with only some products in Merchant Center with same message "robots.txt on the server is unreachable"

Re: Googlebot can't access your site - Server connectivity - Unreachable page Carlos Puelma 2/24/14 12:47 PM
when i clic on Crawl > Fetch as Google. always the system show me Pending and refresh and refresh and refresh with the legend Pendind, later 2 hours the system showme Error. 3 days with the same problem, but my server its ok and DNS too
Re: Googlebot can't access your site - Server connectivity - Unreachable page webado 2/24/14 8:19 PM
Carlos, please open your own thread and provide all the information.
More topics »