Categories: Crawling, indexing & ranking :

Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP)

Showing 1-9 of 9 messages
Danyy2609 12/24/13 8:48 AM <This message has been deleted.>
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Ben Bignell 12/24/13 9:20 AM
Hi

Have you tried to fetch as Google in webmaster tools?

Could be an issue with your server blocking the robots as the robots txt looks fine

Ben
Manjit Lotey 12/24/13 9:34 AM <This message has been deleted.>
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Manjit Lotey 12/24/13 9:38 AM
Nothing to worry! 


On Tuesday, December 24, 2013 10:18:17 PM UTC+5:30, Danyy2609 wrote:
1. My INDEXED are 16 whereas SUBMITTED are 22. Usually my sitemaps gave out equal results e.g 10 INDEXED and 10 SUBMITTED. 
How to fix it? 

"User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

And blocked URL's are 19. 

3. Googlebot cannot access my site. WHY? How to fix it? 

ALL THE PICTURES HAVE BEEN ATTACHED. :) 
I would be thankful. :) 

Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Danyy2609 12/25/13 5:39 AM
But why can't googlebot cant access my site? Could it be fixed? 
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Zineb 12/25/13 6:46 AM
Hi Danyy2609,

The screenshot shows that the message was sent more than a year ago (October 2012).
Googlebot couldn't access your robots.txt file then.

Everything looks fine at the moment. Your pages are being crawled and processed normally. No need to worry :)

Cheers,

Zineb
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Danyy2609 12/25/13 9:10 AM
Thank you. :) 
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Danyy2609 12/25/13 9:10 AM
But why are indexed less than Submitted? 
Re: GOOGLEBOT cant access my site+ Blocked URL robots.txt+Indexed are 16 -- Submitted are 22 (SITEMAP) Zineb 12/25/13 9:23 AM
Hello,

Regarding the Sitemap, it helps Google know about your pages and especially those that wouldn't have been discovered by the normal crawling process.
We also use the data to learn more about your website's structure.
However, Google does not guarantee that it will crawl and index all the URLs submitted in a Sitemap.

As I said in my previous post, there is no issue at the moment regarding how we crawl and process your site.

To learn more about Sitemaps, you can read our Help Center article: https://support.google.com/webmasters/answer/156184

Cheers,

Zineb