| Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/21/13 3:07 PM |
Hi Everyone, I'm writing about a page that appears to be filtered out of Google's search results for a particular query, and replaced with a proxy version of that page on a different domain. The filtered page is http://www.navtechgps.com/ If I |
| Re: Filtered Out of Search Results by a Proxy Page? |
Damien Anderson |
2/21/13 3:42 PM |
Hey Bill Very strange. When I use App Engine, my application space is created as a subdomain, so I thought http://fastproxyurl.appspot.com was an application which had been mis-configured. But, as you point out, site:http://fastproxyurl.appspot.com shows an off-co |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/21/13 3:51 PM |
Thanks for looking, Damien. I don't know if this is an error, but it definitely doesn't look like it is supposed to be working the way that it is. Robots.txt files do appear to be missing here,if they are even applicable, though it's hard to say wi |
| Re: Filtered Out of Search Results by a Proxy Page? |
alistair.lattimore |
2/21/13 4:26 PM |
Bill, I think there are a couple issues at hand: Who I realise that Google own http://appspot.com but who controls the fastproxyurl subdomain? If Google don't control fastproxyurl, then the URLs are showing up in the index simply because the owner of fastpr |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/21/13 5:18 PM |
Thanks, Alistair Thank you for the research that you've conducted. :) The owner of fastproxyurl is likely a person who agreed to Google's terms of service when signing up to have their application hosted on the http://appspot.com domain. As I mentioned ab |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/21/13 6:16 PM |
It's good to use a canonical link tag in general but be aware that very often proxy scripts strip that off or even replace it with a canonical link tag with their own domain in it. They also strip off javascript such as what you might want to use to |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/21/13 7:07 PM |
Thanks, Webado It is likely that at the very least, the URL in the canonical link element would likely be re-written so that it wouldn't include the "http:/" at the start of it. Probably something like this: <link rel="canonical" href="/www.navtec |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/21/13 7:43 PM |
It would pay attention if it were valid, i.e. not malformed, existent. |
| Re: Filtered Out of Search Results by a Proxy Page? |
Lysis |
2/22/13 7:06 AM |
Hi Bill, My suggestion is to file a DMCA with Google and then follow up with a reconsideration request showing Google that the proxy is basically replacing your URL with its own. |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 7:35 AM |
Hi Lysis, Good to see you. A DMCA notice just might be the route to go in, in lieu of anything from Google saying that they will figure out a way to resolve this. Providing a proxy service isn't copyright infringement, but allowing that content to |
| Re: Filtered Out of Search Results by a Proxy Page? |
Lysis |
2/22/13 7:42 AM |
Yeah, not being a lawyer, I have no idea if they will honor it, but that is also what the reconsideration request is for. Remember, it's a human looking at the reconsideration request, so if you just explain like you did here (you can also link to th |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/22/13 8:11 AM |
I've been complaining about this myself for ages. The response has usually been that they do get ignored. |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/22/13 8:11 AM |
<This message has been deleted.> |
| Re: Filtered Out of Search Results by a Proxy Page? |
travler. |
2/22/13 8:13 AM |
is this the same issue? http://productforums.google.com/forum/#!category-topic/webmasters/crawling-indexing--ranking/h9TdEIg0chI |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 9:33 AM |
Hi Lysis, Most website owners aren't lawyers, but know that something is definitely wrong when some other site is scraping all of their content, and showing up in search results in place of them. These proxy app sites provide a useful service when t |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 9:37 AM |
Hi webado, If this kind of problem is something that gets brushed under the rug on a regular basis, maybe it needs more attention called to it some way? As I mentioned above, site owners caught in a situation like this haven't done anything wrong - |
| Re: Filtered Out of Search Results by a Proxy Page? |
Lysis |
2/22/13 9:45 AM |
"Bad user experience" would imply that webmasters are Google's customers, and they are not. Technically, getting the info from you or the proxy site is the same for the user. But Google isn't pure anarchy. It wants to respect the original owner, and |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 9:47 AM |
Hi travler. Thanks for pointing that thread out. Those are different proxy servers (wondering how many different proxy server sites are hosted by Google on the appspot domain). The problem looks like it is the same though. How many proxy server p |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 9:52 AM |
Hi Lysis, Site owners are as much Google's customers as searchers and advertisers. Forcing them to take legal action against Google and file a reconsideration request is terrible customer service, and a really bad user experience. How would that r |
| Re: Filtered Out of Search Results by a Proxy Page? |
Lysis |
2/22/13 9:54 AM |
OK dude. Enjoy your de-index. |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 10:04 AM |
Hi Lysis, The actual reconsideration process may be appropriate. The name might be misleading to people who aren't aware that might be an option in a situation like this (like me) - it implies that someone might have been doing something wrong and f |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/22/13 12:47 PM |
That's not how it is. The person running the proxy server purposely allows every use of it to have a separate url which is allowed to be crawled and indexed. Furthermore they have also planted linsk to their site iun ways that ensure robots will find |
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
2/22/13 1:34 PM |
The main thingg however is that a good site which is not suffering from any penalty, which has unique original compelling content is unlikely to lose value because of scraping. Yes getting your site scraped is insulting and frustrating but if your si |
| Re: Filtered Out of Search Results by a Proxy Page? |
Ashley |
2/22/13 2:07 PM |
Something feels busted, but it may be prudent in the interim to focus on what you have the ability to change on the site. Duplicate content is strange. When I consider that Google's customer for search is really the user, and not the website owner, t |
| Re: Filtered Out of Search Results by a Proxy Page? |
Pelagic |
2/22/13 3:50 PM |
Hi Bill, back in 2010 someone screwed up and 302'd the domain to a sub-domain of their hosting provider, then quite recently copied the site to a new hosting provider without using a 301 from the original site's URL > that subdomain navtechgps2.intui |
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 5:13 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 5:22 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
Bill Slawski |
2/22/13 5:28 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/24/13 5:34 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
3/24/13 7:18 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/24/13 7:32 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
3/24/13 7:54 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/24/13 8:32 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/24/13 8:34 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
3/24/13 9:06 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
3/24/13 9:13 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/25/13 12:18 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/25/13 6:19 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/25/13 6:44 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/25/13 6:49 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
webado |
3/25/13 8:26 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/26/13 2:44 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
3/26/13 2:48 PM |
|
| Re: Filtered Out of Search Results by a Proxy Page? |
jenkton |
4/12/13 12:43 AM |
|