I have my archive/ set to rewrite to sitemap/ in vBSEO CP.
I have noticed spiders still showing the url they are following is archive/xxxx in whos online.
I also see them seeing threads as showthread.php as the URL they are following.
If i have archive/ blocked in my robots.txt am i effectivly blocking them using my sitemap or would sitemap/ have to be in the robots.txt to do that.
Basically does blocking an old dynamic url effectivly block the rewritten ones also?
Like if i blocked showthread.php would it stop my rewritten threads being indexed?
Just trying to understand bots better.
Thanks.



LinkBack URL
About LinkBacks





Reply With Quote