Categories: Crawling, indexing & ranking :

Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands

Showing 1-24 of 24 messages
Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/9/13 5:09 PM
I don't have permission to share the URL but I was sent a screen shot of this and verified it myself after gaining access.

The sitemaps page shows tens of thousands of pages index.

But the index status report shows only 3 pages indexed.  

Is this a weird bug?
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Brian Ussery 2/9/13 11:10 PM
Hi Barry,

It will be interesting to see if this is a bug or not because hypothetically this does seem possible!

The Sitemap Details page (Optimization > Sitemaps) can include "the total number of all content items (including web pages, images, video, and News content) submitted and indexed."
- http://support.google.com/webmasters/bin/answer.py?hl=en&answer=78808&topic=8476&ctx=topic

Any chance this site includes and submits lots of images, videos or news?

The index Status page (Health > Index status > total indexed) "does not include URLs that have been identified as duplicates or non-canonical, or less useful, or that contain a meta noindex tag."
- https://support.google.com/webmasters/bin/answer.py?hl=en&answer=2642366

Any chance this site has a lot of duplicate content, low utility content or uses noindex? 
Any chance the site is cloaking noindex or other? 
Any chance content is being filtered for legal reasons, at the webmasters request or due to manual actions?

Are XML Sitemaps for multiple sites being submitted?
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=75712&topic=8476&ctx=topic

If an XML Sitemap index file is submitted along with each of the individual XML Sitemaps listed therein, the total index numbers usually appears to be twice the real number.

Any chance, there are multiple XML Sitemap index files with XML Sitemaps therein also submitted multiple times?

-Brian

Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 4:47 AM
So a site command agrees with the sitemaps count.  There is one sitemap file, not two or three.  To me, it seems like a bug with the index count within index status.
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands StevieD_Web 2/11/13 9:30 AM
URL ?
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 10:02 AM
Is the site new? Could this be explained by the delay in data update in GWT?  

Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 10:04 AM
Another thing, check that you are looking at the same site URL, with www, or without www.
Just in case, look in GWT at both site URLs, with www and without www.


Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 10:05 AM
It is a new site.  Shows tens of thousands of pages index in the sitemap and a site command in Google.  3 indexed in the index status report.  I've just never seen this brought up in this forum, have you?
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 10:05 AM
Wish I could share, not my site, but I found this case to be interesting.  In that, I've never seen it reported here.
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 10:19 AM
There is a well known delay in the data showed by GWT. Some data in GWT is not "live", it is updated at certain time intervals, so depending on the updating schedule it can be up to a few weeks behind.
Did you look in GWT at both site URLs, with www and without www, just in case?
Check also if there are https URLs of the site indexed or crawled by Googlebot.

Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands StevieD_Web 2/11/13 10:57 AM
new site, Age?

how new is the WMT account compared to the age of the site?


Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 10:58 AM
Yea, GWT has www and I did a site command with www.
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 11:01 AM
Look just in case in GWT at both site URLs, with www and without www. Add to GWT both site URLs, with www and without www, and look at data for both. And set preferred domain if you did not already do so.


Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 11:36 AM
few weeks old and WMT went live about the same day or day after with sitemap files.
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 11:42 AM
What do you see in the Advanced tab of Index Status?


Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 11:47 AM

Here are screen shots they shared with me via WMT:








Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 12:05 PM
Is there a "Download chart data" button? (you might need higher level permissions for it). The Downloaded data has more granular information it it, almost day by day.
I am still curious if you looked in GWT at both site URLs, with www and without www.




Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/11/13 12:40 PM
Spoke to John Mueller, in a hangout, he said, he wouldn't worry. The Index Status report may be delayed in this case. 
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/11/13 12:48 PM
Great :) Come back to this thread when things update :)

Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands krisolin 2/11/13 10:26 PM
I've got the same problem on a website I'm researching! It dropped out of the Index Status April 3, 2012 BUT I'm continuously seeing 29 pages (out of 114) currently indexed according to the Sitemap report. You can see the current situation on this image:



The sitemap here: http://australianbusinessgrants.com.au/sitemap.xml It is automatically created by XML-Sitemap Generator Word Press plug in.

I haven't seen any messages or warnings from Google at WMT regarding this issue.

Anybody got any ideas what is happening and how to fix it?

Cheers,
Kris
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands cristina 2/12/13 4:34 AM
I cannot see in your screenshot what site URL you are looking at in GWT, with-www or without-www.
Do you have error/warning messages for your sitemap?


Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands webado 2/12/13 2:12 PM
Barry, I see it says "Data from the last year". So obviously not current.
 
The rise from 0 to 3 was on Jan 20. That's over 3 weeks ago. Much may have happened such as removal of a robots.txt block, expiry or reversal of a directory removal...
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands krisolin 2/13/13 6:32 PM
Thank you for your reply, Cristina! It seems that the screenshot from the Index Status is WITH www. The sitemap, however is all without www, as you can see here: http://australianbusinessgrants.com.au/sitemap.xml. We have not set a Preferred Domain. I can also see that the WordPress Address (URL) is WITHOUT www. Any ideas?
Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands webado 2/13/13 8:48 PM
If you add the site without www to Webmaster Tools and check those index stats you will see a different situation. Just give it time to populate.

The www version will show information from a time before you had 301 redirection in place from www to non-www.

Re: Index Status Report Shows 3 URLs Total Indexed But Sitemap Report Shows Tens Of Thousands Barry Schwartz 2/14/13 4:35 AM
Just got an update, the Index Status report now shows the 33,000+ pages as indexed.  I guess there is a delay... :)
More topics »