Results 1 to 4 of 4

Block Spider Access

This is a discussion on Block Spider Access within the General Discussion forums, part of the vBulletin SEO Discussion category; I'd like to block spiders from coming into a single forum on my board. Do you know how I can ...

  1. 06-25-2008 12:32 AM #1
    battleforums
    battleforums is offline
    Junior Member
    Real Name
    Donny Ouyang
    Join Date
    Nov 2007
    Posts
    8
    Liked
    0 times

    Block Spider Access

    I'd like to block spiders from coming into a single forum on my board. Do you know how I can do this?
    Last edited by battleforums; 07-02-2009 at 08:01 PM.
    Reply With Quote Reply With Quote  
  2. 06-25-2008 01:17 AM #2
    briansol
    briansol is offline
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    you can add it to your robots.txt file with the Disallow rule.

    more info: Introduction to "robots.txt"
    Reply With Quote Reply With Quote  
  3. 06-25-2008 02:07 AM #3
    amelia_seo
    amelia_seo is offline
    Junior Member
    Real Name
    ailema
    Join Date
    May 2008
    Posts
    1
    Liked
    0 times
    Quote Originally Posted by briansol View Post
    you can add it to your robots.txt file with the Disallow rule.

    more info: Introduction to "robots.txt"
    thanks for the source brian
    Reply With Quote Reply With Quote  
  4. 06-25-2008 03:43 AM #4
    battleforums
    battleforums is offline
    Junior Member
    Real Name
    Donny Ouyang
    Join Date
    Nov 2007
    Posts
    8
    Liked
    0 times
    Thank you. That fixed the small problem .
    Reply With Quote Reply With Quote  
« vBSEO 3.1 or 3.2 for vBulletin 3.6.8? | Duplicate content question »

Similar Threads

  1. Block hotlinking
    By kuyenmotdivad in forum URL Rewrite Settings
    Replies: 2
    Last Post: 03-31-2008, 04:29 PM
  2. Google Spider / Google Adsense Spider
    By Yours Truly in forum General Discussion
    Replies: 2
    Last Post: 02-29-2008, 04:34 PM
  3. New Kid On The Block
    By flixray in forum Introduce Yourself
    Replies: 5
    Last Post: 01-06-2008, 03:57 PM
  4. Newbie on the block :)
    By dealcrasher in forum Introduce Yourself
    Replies: 3
    Last Post: 05-21-2007, 03:18 PM
  5. off topic forums - block from guest/spider view?
    By Mike in forum General Discussion
    Replies: 1
    Last Post: 02-04-2006, 10:05 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules