|All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/9/12 8:49 AM|
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/9/12 9:09 AM|
BTW - I will be changing the description and info for each of these other pages but that shouldn't be effecting the cached pages right....
|Re: All Cached Pages except for home page show 404 Page Not Found Error||cristina||4/9/12 9:55 AM|
I think you need to improve a bit your robots.txt file.
You have a line
Change that to
And make the sitemap URL absolute in the Sitemap line.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/9/12 10:03 AM|
Thanks Christina! I updated the robots.txt. Is the fact that it wasn't an absolute address or that "allow" wasn't capitalized that caused this?
|Re: All Cached Pages except for home page show 404 Page Not Found Error||cristina||4/9/12 10:49 AM|
I do not know why those pages are not cached.
Keep an eye on Google Webmaster Tools, for example at the list of keywords (words that Googlebot sees in your site), do some Fetch as Googlebot and look at the HTML source code as seen by Googlebot,, look at crawl errors and HTML suggestions in the Diagnostic tab, etc. and check if all is OK.
In robots.txt start the sitemap URL with http://
and add an empty space between Allow: and /
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/9/12 3:59 PM|
Ok - Just re-edited the robots.txt file. All my keywords are showing up great, I can fetch all the pages with no issues, no crawl errors, no suggested HTML, and I double checked the HTML as seen by Googlebot.
I'll wait to see how the pages look after the next index.
Thanks for the help with the robots.txt file!
|Re: All Cached Pages except for home page show 404 Page Not Found Error||webado||4/9/12 4:45 PM|
How old is the site?
All the pages have the same title and description snippet. You need to do better than that.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/14/12 9:42 AM|
Hi Webado -
The site isn't old. I had realized back when this started that all the pages were using the same title and description snippets. Unfortunately I was trying out a new template approach to building the site and it's pages and made a mistake in the code so the individual pages were all using the same title and description :). I wasn't sure if that would have caused the issue with the cache but I did/do realize that's not good to have either way. While the new title and descriptions aren't all showing when I search using Site:monopolydealrules.com they have been updated for the last five days.
BTW Webado_ What's with your comment? ("You need to do better than that.") If you don't like helping people why reply to threads? I already mentioned the snippets issue in the original post and that I had missed them and was in the process of updating them. I appreciate your help but I don't understand how I should take the comment and if it was meant to be negative or something else. Maybe I'm misreading your comment and I do apologize if I am (that's one of the issues with writing).
In the end it looks like all the pages are now showing correctly in the cache without errors so maybe it was the robots.txt or one of the other tweaks. The title and descriptions for all the pages were updated five days ago but aren't yet all showing updated in the index,
Thanks for the help
|Re: All Cached Pages except for home page show 404 Page Not Found Error||webado||4/14/12 9:53 AM|
My comment was exactly that: you need to have unique titles and description snippets for all pages. I based it on what I found indexed 5 days ago when I posted.
If you've changed that since then, great, one less issue to have to deal with.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/14/12 10:39 AM|
The comment I'm referring to didn't say anything about the titles and descriptions. You could easily have posted without including the comment "You need to do better than that."
I appreciate all the help I can get and hopefully there will be a day where I don't make the same mistakes I made with this site (my first site) but I don't appreciate people posting with the type of attitude you have. It should not be tolerated in a place build for support like these google forums and would only prevent people from using them.As I mentioned myself in the original post (5 Days ago) I had already caught and fixed the duplicate info (5 days ago). You (4 Days ago) re-posting something already mentioned earlier in the thread without reading what I originally wrote and then including the negative comment about me having to do better is not appreciated and not wanted.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||webado||4/14/12 11:04 AM|
I posted 5 days ago on April 9 - it is now April 14.
Regardless of that, you only mentioned:
I said You have to do better than that. If you find that insulting, sorry, but there are lots of worse comments you could have had.
I could have said: "Duh! Of course it will! What were you thinking?"
Considering the other thing you did by having 2 sites on what amounts to the same subject (different aspects of the same subject, shoes here, slippers there, sandals somewhere else... all footwear) and you nixed it, do you still you need things to be sugar-coated ?
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/14/12 12:19 PM|
Wabedo - It's not about things being sugar-coated - it's about including comments that don't help and are geared towards the person and not the topic. You could have added a lot of comments and just because you included one that was bad but not as bad as something else you could have wrote doesn't mean it's ok. I'm not asking for you to add sugar coating - just keep the replies focused on the topic and not the person. Like I said, you could have posted the reply without the comment without losing any value.
Also - in a reply I added right after the original post I mentioned that I would be changing the description and info for each - "BTW - I will be changing the description and info for each of these other pages but that shouldn't be effecting the cached pages right..."
Lastly, just because you disagree with the fact I have two sites about monopoly (different aspects and no repeat info) and you think they should be one site shouldn't affect your demeanor on the forum. Next time I'm be sure I'll keep it to one site but at this point I have two domains, why not use them. I'm not hurting anyone, not using black hat methods, and not being shady by having two different sites on the same subject, In the end of the day both sites have completely different information and topics (yes on the same subject) with no overlapping info and no duplicate info.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||webado||4/14/12 12:43 PM|
However my reply stands considering what was on the site at the time.
Yes, I indeed meant YOU, the site owner, could do a lot better. That was and is my opinion, like it or not.
My overall recommendation of merging the sites stands as well.
Only after you have done all these things properly can you even hope to see your ONE consolidated site perform acceptably at all and eventually even improve in performance, assuming the content is of high enough quality and originality.
|Re: All Cached Pages except for home page show 404 Page Not Found Error||Mrfrostie||4/15/12 6:30 AM|
In the end of the day duplicate meta data wouldn't cause a 404 page not found message which is what my question was. The fact the sites aren't merged has nothing to do with this or the other issues I'm running into. My other site is performing excellently for the keywords it's focused on, only this site is having problems. This fluff about the site will only perform well when it's merged is just puff and air - meaningless dribble. Opinion that isn't backed by anything factual. The bottom line is there should be no reason two sites for the same subject with no duplicate content could both perform excellently. (it happens everyday - just search for something)
While yes I could do a lot better - so could you.
Thanks again for all the help
|Re: All Cached Pages except for home page show 404 Page Not Found Error||webado||4/15/12 7:53 AM|
It's webcache links that showed 404, not pages from the site. This is just something that happens for newer sites where the cache is not yet available in all datacenters. Not a matter for worry. It's very, very common.
Right now all the cache links work from where I'm looking.
For the rest and how either site performs, remember what was said a few months from now.