Results 1 to 3 of 3

Question about location of robots.txt file

This is a discussion on Question about location of robots.txt file within the General Discussion forums, part of the vBulletin SEO Discussion category; I am using the sitemap plugin from my forum root. Should I have an additional robots.txt file in the forum ...

  1. #1
    Senior Member
    Real Name
    Michael
    Join Date
    Oct 2005
    Posts
    1,755
    Liked
    1 times
    Blog Entries
    1

    Question about location of robots.txt file

    I am using the sitemap plugin from my forum root.

    Should I have an additional robots.txt file in the forum root, or just the one in my top level root folder (public.html)?

  2. #2
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    12 times
    Spiders only look for robots.txt in the root. Just make sure you use full, absolute, paths when listing exclusions.

    /forum/showpost.php
    etc
    Last edited by Keith Cohen; 05-22-2006 at 02:08 PM.

  3. #3
    Senior Member
    Real Name
    Michael
    Join Date
    Oct 2005
    Posts
    1,755
    Liked
    1 times
    Blog Entries
    1
    thought that was the case, just wanted to be sure.

    Thanks

Similar Threads

  1. "should" I use a robots.txt file?
    By drex in forum General Discussion
    Replies: 5
    Last Post: 11-03-2005, 09:47 AM
  2. Site File Structure Question
    By Lazer in forum Pre-Sales Questions
    Replies: 4
    Last Post: 10-16-2005, 05:14 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •