Categories: Crawling, indexing & ranking :

Home page disappeared from Google index

Showing 1-20 of 20 messages
Home page disappeared from Google index Michael Wilcox 11/19/13 2:05 AM
I've read the FAQs and searched the help center. 

Hi

I noticed yesterday that our rankings dropped and I found that our home page had completely disappeared from the Google index. 

I searched using text in speech marks from the home page and it was not found.

If I do this search in Google site:www.shop4parts.co.uk/ if doesn't show the home page first which I would expect it to.

I don't understand why it shows this sub directory. www.shop4parts.co.uk/originalbirth/

The only recent change we have made is to add Reviews using reviews.co.uk which was added a week to 10 days ago. Surely this can't have caused this issue.

Any help would be appreciated.

Thanks
Michael

Re: Home page disappeared from Google index Ben Griffiths 11/19/13 2:31 AM
Did you have a test page of some sort or do a redirect, however briefly, to this address?

Try using Fetch as Google and Submit To Index on your homepage and see if that clears things up.




Re: Home page disappeared from Google index Michael Wilcox 11/19/13 2:43 AM
Hi Ben

thanks for your reply.

I noticed that http://ggb.me.uk/ came up when I did a search foe www.shop4parts.co.uk

We own this site but it is going to be our wholesale site and we won't want it to be found on Google.

I am sure that we haven't done a redirect. Our web designer only has FTP access.

I have already done the fetch in WMT and added the URL here https://www.google.com/webmasters/tools/submit-url so hopefully things will go back to normal but I am confused as to why this has happened.

Thanks
Michael 
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 2:48 AM
DNS maybe?
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 2:53 AM
mmm good thinking ! they are on the same server and have the same IP address. I am no DNS expert do you know any tools I can use to check please?
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 2:58 AM
Hi Ben

I found a reverse lookup tool, typed in the IP address and it returned shop4parts.co.uk so I presume that means everything is ok ??

Thanks
Michael
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 3:02 AM
DNS isn't my speciality but I used intodns.com and didn't see anything extraordinary for either domain - when you use Fetch As Google on the S4P homepage and click the "Success" link, do you see the page you're expecting to see?
Re: Home page disappeared from Google index rollingreenhills 11/19/13 3:05 AM
I had this exact problem the other day.

My local ads stopped showing becuase of the these page speed issues, and my home page dissapeared at the same time.

You should run page speed insights.

I have fixed the page speed problems (mainly related to java script), and the home page is back!

Whether these two are related I can not tell you, but it may work.

It was a stressful few days for me!
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 3:16 AM
thanks for both replies. I don't think it is speed I think Ben is on the right track.

when I do the fetch it says success and then when I submit to the index it says URL submitted to index so yes I think that is fine.

I have since found 496 pages indexed on Google when I do site:ggb.me.uk - argh!

Ben I think you are right. We gave our web designers a full copy of our shop4parts site and I think at some point they must have set it up and Google somehow found it.

I will get on to them. Any advice on how to remove ggb.me.uk quickly?

Thanks
Michael

 
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 3:19 AM
sorry Ben just read your message again and yes it does show the correct shop4parts home page when I click on the success link
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 3:30 AM
The best way to remove GGB at this point (without jeopardising future ranking of the site) would be to serve NOINDEX for all pages there, and then use Fetch as Google on some key ones so it starts to crawl and de-index the pages - or to delete the site (serve 404s) and F.A.G, but this might actually take longer than NOINDEX.

Do NOT use the Remove URLs tool. 
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 5:01 AM
Hi Ben

We have added noindex to the robots.txt and I have done a fetch in WMTs and get a message saying Denied by robots.txt - is this ok?

Thanks for all your help you have been great
Michael
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 5:05 AM
Sorry, robots.txt and NOINDEX are 2 separate things - robots.txt is used to deny access to the crawler whereas NOINDEX tells Google explicitly to not index pages it crawls. Robots.txt won't accomplish what you need here as the pages are already indexed, and in fact would prevent googlebot from seeing the NOINDEX directive once added to the pages:


So you need to allow access again and modify the source (or HTTP Headers) of all of the unwanted pages to include NOINDEX.



Re: Home page disappeared from Google index Michael Wilcox 11/19/13 5:22 AM
Hi Ben

The pages that are cached have been removed so we can't add NOINDEX. Is it just a case of waiting?

Thanks
Michael
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 5:25 AM
Ah, right, if they're serving 404 then yeah they should be deindexed after a short time.

You could also implement canonical statements on the main site to guard against this happening in future, although the steps taken so far should return the homepage to the index.

Edit: Having said that, the GGB homepage is still live and that's the one that's suppressing the proper homepage, so you should NOINDEX that if at all possible.
Re: Home page disappeared from Google index Michael Wilcox 11/19/13 5:27 AM
brilliant thanks for all your help
Re: Home page disappeared from Google index Ben Griffiths 11/19/13 5:34 AM
Do feel free to post on this thread again if the situation doesn't sort itself out in the next 48h or so, the trouble with Google is that everything is a guess, 99% of the time...
Re: Home page disappeared from Google index JohnMu 11/20/13 6:53 AM
Hi Michael

It looks like a lot of your pages had a noindex robots meta tag on them for a while and dropped out because of that. In the meantime, that meta tag is gone, so if you can keep it out, you should be good to go :).

Cheers
John
Re: Home page disappeared from Google index Ben Griffiths 11/20/13 7:45 AM
...and there's the 1% of times it isn't a guess ;)

Re: Home page disappeared from Google index Lysis 11/20/13 8:24 AM
It's fun when they don't tell you everything.