Please - do Not post your questions in this topic!

---------------------------------------------------------------------

This is an Auto-Response for the (moderately) common subject of Google removing/deindexing pages/URLs due to encountering Errors.
This is an attempt to compile information regarding the following;

* Bad Server Responses
   - Accidentally sending Denied Responses 401/403
   - Accidentally sending Bad Request Responses 404,410
   - Server giving 500 Response
* DomainName issues
   - DNS errors preventing access/crawl
   - Domain not being Renewed/Lapsing
   - DomainName pointing to deadend/poor response
* Denying access/indexing
   - Accidentally showing "NoIndex" in a meta-robot tag
   - Accidentally sending "NoIndex" in the x-robot header response
 * Pointing to other/incorrect URL
   - Accidentally pointing to a different URL with the Canonical Link Element
   - Accidentally applying a 301 Redirect to a different URL
   - Accidentally giving a Meta-Refresh
   - Using the Parameter Handling Tool incorrectly
* URL Removal Request
   - Using the URL Removal Request tool
   - Someone else requesting removal with the URL RR tool

etc.

(I say "etc." - but that covers most causes :D)


=============   First thing first...  =============

Depending on the circumstances, you amy be looking at one of the following;

Filter : The URL is removed from the SERPs.
It is still in G's index/DB, the ranking info still exists etc.
It's simply not shown to searchers - this is to stop people getting annoyed by seeing non-working results (it's Very annoying!).

Removal : The URL is removed from G's Index.
It is nolonger in teh DataBase, and any associated values are lost.


The former is often the first step.
If something is filtered (including URL Removal Requests), you have a period of time to rectify/correct.
Google will not slam you instantly because of a bit of downtime, or even accidentally requesting the wrong URL to be removed etc.
So no need to panic :D

The latter usually occurs after some time has passed.
G would have to have seen the same resposne numerous times, or been allowed to filter something for a while before going the extra step.


=============   So what do I do?  =============

Well, you go and fix things.

You need to make sure that things are back on track, and working correctly (sending 200/304 responses),
nolonger pointing to some other URL, the Removal Request has been revoked etc.

You then need to examine how it happened, and why.
If it's a scripting issue giving poor responses, get it changed to show a 503 response instead of a 404 etc.
(503 = come back later - G will not index what it saw, and retry at a later date)

If it was a request for removal, either ensure you double check things,
or find whoever screwed up and beat them with a frozen fish.

It it was a pointing error ... ensure you double check things in future (what you type, that it's the correct URL, the the script works as predicted etc.),
or go get the frozen fish :D


=============   Then what do I do?  =============

Well, now you do the hard part ...
... you Wait.

G has to recawl and see things are working/pointing correctly, nolonger up for removal etc.
(It then likely has to do a plittle processing, update the various DCs),
so do Not expect immediate results!
(You may have to wait days/weeks)


=============   It's been Months...  =============

Well, to be hoenst, I wouldn't get my hopes up.
After that amount of time, I'd personally expect G to have ditched it, and you may start from scratch.


=============   Should I file a Reconsideration Request?  =============

In my opinion, not really.
If it's only a short term, SERP filter, then G will get around to it soon enough.
If it's a permanent Removal, not a lot can be done.


=============   Can I prevent it from happening?  =============

To be frank - not likely.
Some things cannot be prevented/avoided ... they are out of your control (servers drop, DNS goes tits up, lines go dead etc.).

But that does leave you with the ability to Check, Test and Review.
Preventative Checks are Always advisable - you should double check everything you do!
Observational checks are suggeted - check your site each day.
Alert setups are well worth doing - checkign logs is tedious - but you can ahve scripted alerts/emails if things fall over.  There are also sites/services out there that will check for you on a regular basis.


=============   It keeps happening!   =============

Well, look at the cause.

If it's a host/DNS provider etc. - then it's time to move!
If they are unreliable - they are goign to cause you problems ... and you likely cannot afford for them to cripple your rankings.

If it's due to some mishap - go and fire someone.
Once is excusable ... twice is pushing it.
But if you find yourself reaching for the frozen fish for a third time, simply face it, someone should be swimming with the fishes,
not being beaten by one.


---------------------------------------------------------------------


NOTE:

This is a "general auto-response" post.

This is Not a Topic for discussion;

It is a point of reference to save having to type the same answer repeatedly due to the sheer number of times this question is asked and is meant as an aid for people that don't seem search/read the various other posts regarding this topic.
Thank you for taking the time to read this Auto-Response.

---------------------------------------------------------------------

Please - do Not post your questions in this topic!