Results 1 to 2 of 2

Block Search engines?

This is a discussion on Block Search engines? within the Pre-Sales Questions forums, part of the Announcements & Pre-Sales category; I have read all the merrits of what VBSEO does but was wondering if there was an option to actualy ...

  1. #1
    Member 1QuickSI's Avatar
    Real Name
    Steven
    Join Date
    Jan 2006
    Location
    CT
    Posts
    87
    Liked
    3 times

    Block Search engines?

    I have read all the merrits of what VBSEO does but was wondering if there was an option to actualy block search engines from spidering certain forums but still allow them to take full advantage of VBSEO for the others?

  2. #2
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    12 times
    You can use a robots.txt file to disallow spiders from spidering certain forums.

    You would add the rewritten names to the robots.txt file.

    Example:

    /forums/general-discussion/

Similar Threads

  1. Which search engines do you use?
    By hornstar6969 in forum General Discussion
    Replies: 12
    Last Post: 07-15-2006, 02:56 PM
  2. Search phrase selection
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 10:57 AM
  3. Techniques that are used to fool search engines
    By rob in forum Member Articles
    Replies: 0
    Last Post: 02-08-2006, 05:22 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •