Is this robots.txt correct?
User-agent: *
Allow: /
Disallow: /archive/
Disallow: /sitemap/
This is a discussion on [How To] Completely Turn Off the vBulletin Archive within the Member Articles forums, part of the Focus on Members category; Is this robots.txt correct? User-agent: * Allow: / Disallow: /archive/ Disallow: /sitemap/...
Is this robots.txt correct?
User-agent: *
Allow: /
Disallow: /archive/
Disallow: /sitemap/
Yes. that is fine.
Brian Cummiskey / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
i couldn't find the "vbseo footer archive links"Step 5: Remove the sitemap links in footer
- Go into your vBSEO Control Panel (vbseocp.php) from your web browser and find the setting group called vBSEO Footer Archive Links.
- In the dropdown, select the Do not add Links to Archive Pages option, then hit the save settings button
![]()
Brian Cummiskey / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
thank you very much
I just checked your vbseo.com sitemap page, and you have links like (for General Discussions):
http://www.vbseo.com/sitemap/f-2.html, but on the forum you have http://www.vbseo.com/f2/
Should it work that way? in my forum I have something like /sitemap/f-2.html in sitemap and /general-duscussion/ as a regular forum link, is this ok? Shouldn't these sitemap links be the same as the forum ones ?
No, they are different. It is the archive re-written. The threads then re-direct to the true thread (in our configuration option in use)
Brian Cummiskey / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
I fully support disabling the archive. It is completely un-ncessary with vbseo installed.
Brian Cummiskey / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
I see vbseo has sitemap in footer, why should we remove that ? i followed all steps, here are my websites Whatafy - We Have All The Answers For you, Mybetinfo.net - Mybetinfo.NET - Online betting, poker, casino, backgammon, bingo,rummy it is ok ?
I like vbseo i use it on sports betting and whatafy.com
vbseo.com has every option enabled as it serves as a 'live demo' of every feature. Some of these features were added in the first versions of vbseo, way back in 2005. Things change, and in time, the archive has become less effective, especially once the XML sitemap protocol came out. Before that, the archive was the best way to have deep-links to pages (ie, page 97 of a 100 page thread will never have a direct link to it until you're on page 96 of that thread). But, the sitemap XML has every page on it to tell google about it already, so it's purpose is not as important as it used to be.
Brian Cummiskey / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
I understand now, thank you for explanation and support.
I like vbseo i use it on sports betting and whatafy.com
I just disabled the Archive, let's see if it's a good works![]()
God is good all the time ~ all the time God is good..
After i disabled archive and sitemap in one month lost 15% visitors, so i go turn on at least archive.
Best Regards