| How to stop search engine to crawl or index your web pages? I want to stop my some webpages to crawl or index. | jamesaustinwarn | 11/14/11 1:00 AM | Basically some pages of my sites is optimize on different keywords and they take strong value of that page which i expect so I am confused... |
| Re: How to stop search engine to crawl or index your web pages? I want to stop my some webpages to crawl or index. | internal.pouch | 11/29/11 4:57 AM | You need to add a robots.txt file to your site. You can find out about it on http://www.robotstxt.org/ |
| Re: How to stop search engine to crawl or index your web pages? I want to stop my some webpages to crawl or index. | jamesaustinwarn | 11/29/11 5:08 AM | I know about this command where i put this on source. |