Google Product Forums

Re: If my site is subscription based, can I still be crawled?

Harvey P. Oct 18, 2011 3:09 PM
Posted in group: Google News Help Forum

Categories: Google News Publishers :

Generally, our users have indicated that they prefer not to encounter a registration or subscription page immediately upon following a link on Google News. If you are a subscription or registration site, there are three approaches to how you can be indexed in Google News:

1. Implementing First Click Free.
2. Opting to have a subscription designation and snippets only.
3. Using robots.txt to block our crawler from accessing your subscription content.

To find out more about these options, check out the Help Center article below.