I am using the sitemap plugin from my forum root.
Should I have an additional robots.txt file in the forum root, or just the one in my top level root folder (public.html)?
This is a discussion on Question about location of robots.txt file within the General Discussion forums, part of the vBulletin SEO Discussion category; I am using the sitemap plugin from my forum root. Should I have an additional robots.txt file in the forum ...
I am using the sitemap plugin from my forum root.
Should I have an additional robots.txt file in the forum root, or just the one in my top level root folder (public.html)?
Spiders only look for robots.txt in the root. Just make sure you use full, absolute, paths when listing exclusions.
/forum/showpost.php
etc
Last edited by Keith Cohen; 05-22-2006 at 02:08 PM.
thought that was the case, just wanted to be sure.
Thanks