| Google Webmaster Tools Detects Different Robots.txt | nkalille | 5/5/12 6:43 AM | I have read the FAQs and checked for similar issues: Yes My site's URL (web address) is: http://www.biooilreviews.net I added this site to my Google webmaster tools. Although, it detected a different robots.txt. The one it detected blocked all access |
| Re: Google Webmaster Tools Detects Different Robots.txt | cristina | 5/5/12 9:55 AM | Do you see the robots.txt with Disallow: / in Google Webmaster Tools - Site configuration - Crawler access ?Can you see the date when Googlebot last downloaded the robots.txt file?It might have been an older version, still cached by Googlebot, if the |
| Re: Google Webmaster Tools Detects Different Robots.txt | nkalille | 5/5/12 10:10 AM | |
| Re: Google Webmaster Tools Detects Different Robots.txt | cristina | 5/5/12 10:25 AM | I see that your robots.txt file was downloaded 20 hours ago.Did you try Fetch as Googlebot for robots.txt ?I see in the header of your robots.txt a recent Last-Modified date, from a few hours ago, could it be that the robots.txt 20 hours ago was with |
| Re: Google Webmaster Tools Detects Different Robots.txt | Phil Payne | 5/5/12 10:45 AM | I got a 500 Internal Server error on the home page. |