Categories: Webmaster Tools :

2 URLs Removed. I didn't do it. How do I find out which URLs they are?

Showing 1-67 of 67 messages
2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 5/31/13 9:23 AM
When I pull up the "Index Status" page and go to advanced and see the removed URLs I have two URLs removed. When I go to the "URL Removal" page it tells me that I did not request any URLs to be removed. Also, my robots.txt file is not blocking any URLs. How do I see which URLs have been removed? As far as I know, all my URLs should be in the index. I put in a reconsideration request asking why the URLs were removed and I got the canned "No manual spam actions found" which I assume is some robot that doesn't actually read the question I asked. I can't reply, so Google is no help on helping me figure out which URLs they removed from their index. Can anyone help me with this?
2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 5/31/13 11:31 AM
At Optimisation - Remove URLs did you look at Show - All ?

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 5/31/13 12:39 PM
I didn't choose show all, but even when I do it still says 0. 

I also checked my user permissions and I am owner.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Robbo 6/1/13 2:28 AM
Andrew

Although it sounds intriguing,  is if important?

You surely know what pages you have on your site, and can easily check whether any given page URL is indexed.

If you identify any important page is missing, it should be easy to add it.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 7:33 AM
Hi Robbo, I think it is a good idea for Andrew to check if URL removal requests were made for some URLs of his site and, if so, by whom and when. He posted also in another thread in which I suggested he looks in Google Webmaster Tools at URL removal requests (with Show All) for all typesof URLs, just in case (with www and without www and just for completion at subdomains if his site has subdomains).
I think it would be great if the Index Status interface could be enhanced a bit to give a few sample URLs when there are Removals data.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 7:45 AM
Andrew, can you post here a screenshot with Index Status - Removed (make sure that only "Removed" is selected), and a screenshot of the URL removal request tools with Show All selected.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 8:14 AM
Here you go. Thanks for the help.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 8:23 AM
Intriguing. Did you look at URL removal requests (Show All) for both site URLs, with www and without www (add both site URLs to Google Webmaster Tools to see the stats).


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 9:44 AM
That was the image of the WWW. The non-WWW looks exactly the same. I also have to throw in that in September of 2012 pretty much all of our traffic went away. We are getting about 10% of the traffic we were getting pre-sept. 2012. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 10:55 AM
Maybe post here your site URL, use a URL shortener if you wish.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 11:14 AM
It's www.carnections.com .

The non-www is redirected to the www version. 


It's /admin/ that's blocked in robots.txt so somebody would have requested that to be removed and it would be OK because it's already blocked.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 11:18 AM
Webado, I think the point here is that nothing appears in the URL removal requests data of Google Webmaster Tools, it is only in Index Status - Removed, where it is not clear which URLs are removed, if there is a URL removal request still in place or for which URLs.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 11:25 AM
I just think the OP did not look in the right place.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 11:34 AM
Webado, can you see that the OP posted here screenshots of the URL removal tool, with zero (nothing) at Show All? (maybe there is some delay and the screenshots did not appesr yet in your forum stream?) Usually if there are URL removal requests they appear in the URL removal requests data, at Show All, even old expired URL removal requests.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 11:40 AM
Andrew, there is a small problem with your robots.txt, it starts with a BOM (Byte Order Mark), usually that can be fixed by re-uploading the robots.txt with the correct FTP setting, probably you FTP-ed it using binary data (not text) settings.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 11:50 AM
Best to look under ALL for both the www and non-www version of the domain:

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 11:55 AM
I don't know, mine usually show 0 for pending or removed, but when I actually look under ALL I see everything that's happened including those made by others.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 11:57 AM
The OP posted here the screenshot with Show All, and I repeatedly asked here if be looked at both with-www and without-www URLs (at Show All) and he replied here that the looked at both URLs (with-www and without-www) and both show the same (zero).

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 12:03 PM
Webado, the screenshot the OP posted here is with Show All and it shows zero URL removal requests (nothing). I already asked here if the OP looked at both site URLs (with www and without www) at Show All, and he replied here (in this thread) that he looked, and both show the same (zero URL removal requests). I cannot really see his computer screen though, but I assume he wrote what he saw.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 12:03 PM
Well maybe the actual links will show more. Google doesn't know how to count ;)
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 12:08 PM
Webado, by "Show All" I assume I mean the same thing as you when you write "ALL". Have a look at the screenshot posted by the OP with the URL removal requests (zero) for Show All. Did you mean something else by "ALL", or the same as in the OP's screenshot? The OP already wrote that he looked at both URLs (with www and without www) and they are both the same, with zero (nothing) URL removal requests at Show All.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 12:14 PM
I meant to show the actual page at those urls I posted.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 12:18 PM
Webado, what do you think about the screenshot posted by the OP? It shows zero URL removal requests. Are you referring to something else? Can you see the Webmaster Tools data for that specific website?


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 12:27 PM
Webado, I cannot see the data for the exact links you posted, because I do not have access for that exact site, but the URL of the links has the same format as for the type of screenshot the OP posted here. For my sites I see the same data when I look at that URL directly in my browser as when I get there by selecting Show All in the Webmaster Tools interface of the URL removal request tool. It would be indeed intriguing if the data would be different depending on the way people got to that URL (directly in the location bar of the browser, or by selecting Show All in Optimization - Remove URL.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 12:33 PM
Yes, both the WWW and non-WWW look the same in the index status and remove URLs page. When I go to the Blocked URLs page it sees the robots.txt and it does have /admin/ as disallow, but it shows 0 blocked URLs. I don't know what you mean with the BOM and FTP settings. I will talked to me web guy and see if he knows anything about that.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 12:34 PM
That's why the OP needs to go to those URLs and take screenshots.

On Saturday, June 1, 2013 3:27:21 PM UTC-4, cristina wrote:
Webado, I cannot see the data for the exact links you posted, because I do not have access for that exact site, but the URL of the links has the same format as for the type of screenshot the OP posted here. For my sites I see the same data when I look at that URL directly in my browser as when I get there by selecting Show All in the Webmaster Tools interface of the URL removal request tool. It would be indeed intriguing if the data would be different depending on the way people got to that URL (directly in the location bar of the browser, or by selecting Show All in Optimization - Remove URL.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 12:40 PM
Here are the screens of the two links you provided.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/1/13 12:45 PM
Andrew, I will escalate this thread, maybe it will be seen by Googlers, (I cannot promise anything), but Robbo had a point, did you notice URLs missing from search results that you expected to be indexed?
Another thing is what I mentioned earlier, fix the BOM in the robots.txt 


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 12:56 PM
Thanks for the help. I emailed my web guy and will probably have to wait till next week to get an answer on the robots.txt. 

As far as pages not showing up, if you search for "carnections" we are number two. We used to be number one till sept. 2012. If you search for "carnection" we are nowhere to be found. I went like 30 pages deep and nothing, which makes no sense at all. We used to be number two for carnection. Also we used to rank really well for terms like "car shipping". We have fallen off the planet for almost all our terms, and even when we are there it isn't for our main page www.carnections.com, but some other random page on the site. Also, we used to rank 5-6 for "Hawaii car shipping" and now we are barely on the tenth page and it doesn't go to the Hawaii page we worked on, but some other page that mentions Hawaii and car shipping. We could have just been hit by an algorithm change, but I would really like to know which pages have been removed, and even better, to know why (not likely.)
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 1:03 PM
Is carnections any sort of real word? Seems to me a made up word. Hardly what anybody would really search for. 


Shows a co.uk, co.za, facebook, twitter urls and the .com  in #18.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 1:19 PM
Our customers search for us sometimes and they must now type it in exactly to find us on Google. Kind of sucks that it is a made up word and we can't even rank for it. Shouldn't have much competition, but we still can't be found. We actually get a lot of our searches for "carnections". In fact it looks to be our 3rd highest search term historically.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Robbo 6/1/13 4:31 PM
The site suffers from rampant duplication and the use of egregious boilerplate text for hundreds of cities across the USA.

NONE of the city pages I sampled had any real information for that city.

So I ask again:  are you able to identify any important pages that has been deindexed?   I mean of course pages that conform to google guidelines and best practice.

When a car is badly damaged, it just seems a  bit misguided to focus on how a dead fly got on the windshield.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 4:54 PM
No I am not able to figure out which URLs have been de-indexed, I believe that is the original question I asked... Whether it is a fly on the windshield or something major I need to look at every avenue I can. The fact is that I have two URLs that have been removed and I would like to know which pages they are. Google says that they will send you a message in WMT, but I never received one. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 5:26 PM
There are 4 messages in your dashboard. Did you check them?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 5:30 PM
https://www.google.com/search?q=site%3Acarnections.com indicates
 About 4,370 results
But there are just 3 results pages listed (with 100 results per page). WHen you get to the lat page it indicates 253 urls are indexed.
This indicates very thin content. Maybe you have cleaned up as well.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/1/13 5:31 PM
Your xmlsitemap http://www.carnections.com/sitemap.xml indicates 32570 urls!

This is huge! 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 6:31 PM
The messages are wordpress updates. I keep up on the messages and I never got any about removed URLs. We had some about server outages, but we have fixed that issue and have been completely stable for 7+ months. 

We used to have 300k+ pages. We took down many pages. I think the that sitemap might be old. We should have something like 5,000 or less pages. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/1/13 6:36 PM
I also forgot to mention that even after taking down all the hundreds of thousands of pages we have not budged in the rankings. We went from 120k pages in the index to 3k and no movement.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/2/13 5:02 AM
Webado, how can you see the number of messages in Google Webmaster Tools for the OP ?


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/2/13 5:13 AM
I see now, one of the screenshots shows 4 messages.
There is another thread in this forum about the discrepancy between Index Status - Removed and the URL removal request tool.
It is still the week-end, let us wait a bit in case a Googler could check later to see why that is.
Have a great week-end everyone :)

Cristina.

 

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/2/13 5:19 AM
Andrew, one minor thing (I think it is minor). You redirect 301 URLs without www to with www, that of course is OK, but you do not redirect robots.txt. This is why Google has only the robots.txt indexed for the site without www. I think it is better to be consistent and redirect the robots.txt as well. Check first that indeed you redirect all the other URLs. Robots.txt is quite a complicated thing, you might be correct in not redirecting it, but see how it goes.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/2/13 9:09 AM
Just to add that in my opinion it is better to look at the URL removal tool by going through the menu options of Google Webmaster Tools, not directly by URL, like Webado's links. I checked first that Webado's links had the exact same format as the URL obtained by going through the menu options of Webmaster Tools, but if the interface changes, the URL structure of Webmaster Tools might change, and if you keep going to that URL without knowing exactly what the URL query string does, you might end when going to the URL directly by doing things like URL removal requests.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/2/13 9:20 AM
I just grabbed the link last night from my own Webmaster Tools interface, after clicking all the right stuff, substituting the poster`s own domain in there, so I doubt it`s changed in the meanwhile. Easier than explaining how to get to it with all the hidden bits.

But if nothing's shown for either version of the domain, then it's a bit strange, that's true. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/3/13 3:51 AM
The link might be OK for a few days, but we do not know how or when the interface changes, so it is better to use only the menu options, not the URL link with the query string, especially when it is about the URL removal tool, and we do not know at all times what exactly the parameters in the URL query string do. It is a GET request with parameters defining an action for Webmaster Tools to do. Better not to go blind and access the URL removal tool with the URL link, but use the menu options that are very clear in the interface.

Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? cristina 6/3/13 4:20 AM
Webado, just out of curiosity, for your sites, do you have different data when you use directly the URL link with query string, than when you look at URL removals - Show All by going through the menu options of Webmaster Tools? The data should be the same. If you see different data you should open a thread about it, to let the Webmaster Tools team know the data is different, because it should be the same, for the direct URL link, and for the menu interface (at least for now if the interface is not modified).

Cristina.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/3/13 4:38 AM
I don't think I have different data for All. But for  Denied, Removed and Made by Others it always shows 0 while All gives the count of all the requests ever made and the detail for All shows all of them and their state. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/3/13 11:22 AM
Have we heard anything yet from someone at Google? It is mid-day on Monday and I don't see any replies. I am working on some of the other issues you brought up, but my web guy is out of town and I don't think I will be able to get anything done till next week at the earliest. I would like to find out about these removed URLs though. There must be a way to find out from Google which pages they are.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/4/13 12:22 AM
Any update?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/4/13 11:19 AM
I would really like to get this figured out...
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/4/13 10:31 PM
Any news?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/5/13 12:16 PM
This is a serious problem and I can not even get a reply back.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/5/13 4:27 PM
I offered you /admin/ and /admin/login.aspx as urls most likely to have been removed.  
It's logical since they are blocked in robots.txt - due to which they'd be present in the index, with no content.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/6/13 12:29 AM
Strange, up until just now it used to say 0 blocked URLs for the robots.txt. It is now saying 1. Is it possible for someone that is blocking specific URLs with their robots.txt to check to see if they also have URLs removed in the index status?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/6/13 4:27 PM
The problem with that is there is an option in the index status for "blocked by robots" If my robots.txt is blocking them than those two URLs should be in there not in the removed section. The tooltip next to removed says that they are URLs removed as a URL removal request.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/6/13 8:52 PM
WHat I meant is that you or somebody must have requested removal of 2 such urls. Once they are blocked in robots.txt anybody can request their removal.

Why you don't see that in your Webmaster Tools account is a bit strange, but maybe the removal request is older than whatever is shown there.

The removal tool is older than the Index stats tool.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/7/13 10:09 AM
Well, I really would like someone at Google to get back to me on this. If it is the admin pages than that is fine, but I would like confirmation as to which pages they are. It is an unknown that I would like to clear my head of. I have no ability to see the pages nor the ability to stop the removal. Everything is out of my hands. 
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/8/13 8:11 AM
Any update on this issue?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Gary Illyes 6/8/13 10:39 AM
Hi Andrew,

Thanks for posting this. I sent it over to the guys responsible for that feature in Webmaster Tools and they're going to take a look.
I'll come back with more details in the unlikely case you need to change something on your side.

Thanks (and sorry for showing up late)!
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/8/13 10:49 AM
Thanks a bunch. Let me know if there is something I need to do on my side, or if you need any other info.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/9/13 7:48 AM
I am new to these types of forums, but how does someone that has never posted in this post mark it as answered? Especially when it hasn't been answered?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/9/13 8:31 AM
If there's an answer that you feel is best, you click Best Answer at the bottom of that post. There can and often will be several posts marked Best Answer by different people.
It doesn't have to address all issues to be Best.

A Best Answer does not stop the thread from receiving further posts, but does bring to the top, right below the original post, those that have been deemed as best answers.

It's unfortunate if you don't agree with what has been marked Best Answer so far. But the one thus marked is from a Google employee, and it was marked best by a Top Contributor. You can't get much better than that.


Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? webado 6/9/13 8:34 AM
Oh, and if you wonder how it is that Stevie marked it as Best Answer, that's because as a Top Contributor he can do that. This privilege  comes with the TC title he has.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/9/13 1:00 PM
Got it. Thanks!
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/10/13 12:27 PM
Just checking in because it is mid day on Monday and wanted to see if there was an answer.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/11/13 2:36 PM
Just checking in on Tuesday to see if I need to give any more information to help with the answer.
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Andrew Oestreich 6/12/13 2:34 PM
Any update?
Re: 2 URLs Removed. I didn't do it. How do I find out which URLs they are? Robbo 6/12/13 3:42 PM


Hi Andrew

Can I just check that the situation is as follows:

--- you have lots of pages on your site that are almost identical;

--- the significant different between those many many pages is the name of the U.S. state or city etc but the rest of the information, including the contact address is the same for all or nearly all;

--- your Webmaster Tools indicates that two page removal requests were processed but not by you and you are naturally concerned about the origin of those requests;

--- however, you do not not know which two pages they relate to;

--- although you presumably have a full list of pages on your site and can easily get a list of all your pages in google index search results, you have been unable/unwilling over the past several days to identify which two pages you believe have been removed.



In my personal view, it would be more productive use of time and effort for you to identify WHICH TWO pages IF ANY have actually been deindexed so that we can then advise how to get them reindexed.


At the moment, you have not shown that two of your pages have actually been removed.


If you can identify ANY pages that have not been indexed, we can suggest ways of increasing the likelihood of getting them indexed.


Otherwise, I think it is a waste of time -

(a) because volunteer advisers here are unlikely to be able to solve the mystery; and
(b) because if those pages were important, you should be able to identify them and tell us the relevant URLs.


Robbo

More topics »