I'm getting thousands of crawl errors from Google such as.............
There are no such URL's as /~r/ or /blog/ or /news/ or /article/. Where is it picking up such non-existent locations?
This is a discussion on Weird Google Crawl Errors within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I'm getting thousands of crawl errors from Google such as............. http://conservativetalkforums.com/~r/retort/~4/DGJJHI5Q48g 404 (Not found) unavailable Jul 14, 2011 http://conservativetalkforums.com/~r/retort/~4/428XvsW9GvQ 404 ...
I'm getting thousands of crawl errors from Google such as.............
There are no such URL's as /~r/ or /blog/ or /news/ or /article/. Where is it picking up such non-existent locations?
Those are just warnings.
Mert Gökçeimam / Crawlability Inc.
vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!
Twitter:@Depkac
Personal Blog : Mert Gökçeimam
returning a 404 is the correct thing to do since these don't exist.
Google will follow bad links (such as people linking to external pages and forgetting the http so it ends up like http://www.yoursite.com/someothersitefolder/page/) and even 'stuff' urls to try.
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!