I have read all the merrits of what VBSEO does but was wondering if there was an option to actualy block search engines from spidering certain forums but still allow them to take full advantage of VBSEO for the others?
This is a discussion on Block Search engines? within the Pre-Sales Questions forums, part of the Announcements & Pre-Sales category; I have read all the merrits of what VBSEO does but was wondering if there was an option to actualy ...
I have read all the merrits of what VBSEO does but was wondering if there was an option to actualy block search engines from spidering certain forums but still allow them to take full advantage of VBSEO for the others?
You can use a robots.txt file to disallow spiders from spidering certain forums.
You would add the rewritten names to the robots.txt file.
Example:
/forums/general-discussion/