My forum has lots of showhread pages in Google with a posts per page value of 10, e.g. /showthread.php?t=5274&page=5&pp=10. Some time ago, I changed that value to 15, so this probably means that Google will apply some kind of duplicate content filter on this forum (seems it already has).
I haven't installed vBSEO yet, but when I do, I'd like to include a command "Disallow: /*?pp=10" to the robots.txt file so all old per page values wouldn't be crawled (vBSEO produces URLs like /thread.html?pp=10). My question is this: is that command possible? I think only Google supports it but they haven't explicitly mentioned a syntax like that on their page: http://www.google.com/webmasters/rem...#exclude_pages . Does anyone have experience with this?
Edit:
Another option would be to add "<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">" to a page where the URL contains a question mark (?). Since I'm not a programmer, I would still need a syntax for this. Anyone?



LinkBack URL
About LinkBacks





Reply With Quote
