Categories: Crawling, indexing & ranking :

I need robots.txt to block a javascript menu

Showing 1-7 of 7 messages
I need robots.txt to block a javascript menu martyy 9/7/10 9:18 PM
I have read the FAQs and checked for similar issues: YES
My site's URL (web address) is:  site in question is not live yet
Description (including timeline of any changes made):
I am unable to find the correct process to block google and other engines from crawling a javascript menu. The menu on the site links offsite to a secure booking page, and some other interior pages on another site I own, however I am worried about google penalising the site as being a link farm (as the menu appears on every page, thats alot of links).

What is the correct way of setting up the robots.txt filr to accomplish this. The javascript file is located at awmdate/menucqa.js within my home directory.

I'm not used to trying to block search enhgines from anything - I usually try to encourage them!2010-09-08

I have used rel=nofollow tags in the html but javascript is like chinese to me

Re: I need robots.txt to block a javascript menu I know nothing 9/8/10 12:51 AM
Why not place the script(s) in a directory and block that directory (disallow) using robots.txt?
Re: I need robots.txt to block a javascript menu martyy 9/8/10 2:39 AM
thats actually the plan - like I said I have no experience blocking spiders - I have spent the last five years trying to get them to index my site and am totally clueless about blocking them.

And I don't want to annoy googlegods by looking like a link farm, which I think the site may if I don't do it correctly. Which is why I'm asking for help here.
Re: I need robots.txt to block a javascript menu Steven Lockey 9/8/10 2:43 AM
Unless there are a LARGE number (50+) external links in the menu then you'll be fine. Internal links should never get you considered to be a link farm so you should be fine there.

To be honest in most cases its far better to make the menu in HTML where possible even if you need to use JS to get the drop-downs in simply so Google can see your link structure more clearly.
Re: I need robots.txt to block a javascript menu SCUPPERED 9/8/10 4:19 AM
what about putting the robots.txt in the webroot of you server with noindex , nofollow?
Re: I need robots.txt to block a javascript menu Autocrat 9/8/10 5:04 AM
IF the links are in JS, then the chances are that G will not associate them as far as Value goes,
as G tends to ignore JS./
(Yes - it may look, see the URLs and note them, but won't pass value, so won't penalise as not manipulation occurs).

If instead you have the links in teh main code as html, and use JS to do fancy things ... then blockign the JS won't achieve anything anyway.


To disallow - jsut do as per the robots.txt info linked to from the FAQs - crawling/indexing/ranking - Don't Index section
(Disallow: /awmdate/menucqa.js)


You realise that if the links are JS only, that some users may not be able to see/use them (only a small %, but it is worth noting for the sake of accessibility).
Re: I need robots.txt to block a javascript menu martyy 9/8/10 5:18 AM
cool - thanks for that