What is a good robots file to use for vbulletin 4?
Is this one adequate:
http://www.vbseo.com/robots.txt
Thanks
This is a discussion on robots.txt for vbulletin 4 within the General Discussion forums, part of the vBulletin SEO Discussion category; What is a good robots file to use for vbulletin 4? Is this one adequate: http://www.vbseo.com/robots.txt Thanks...
What is a good robots file to use for vbulletin 4?
Is this one adequate:
http://www.vbseo.com/robots.txt
Thanks
In my opinion the robots file you should make it to yourself, That's about what you want search engines to index or not, However in vbulletin 4 I didn't see anything that's should be edited since vb3 to vb4 on it so use your old one or use the vbseo.com robots and don't forget to add the sitemap line :
That's if you installed your forum in your site root
And this code if you use vBulletin in any sub-directory :Code:Sitemap: http://www.yoursite.com/sitemap_index.xml.gz
Code:Sitemap: http://www.yoursite.com/vb-root/sitemap_index.xml.gz