Results 1 to 6 of 6

robots.txt entries

This is a discussion on robots.txt entries within the General Discussion forums, part of the vBSEO SEO Plugin category; Oh still one question. I´ve put showthread.php and printthread.php in the robots.txt before i ordered vbseo . Now the feature ...

  1. #1
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44
    Liked
    0 times
    Oh still one question.

    I´ve put showthread.php and printthread.php in the robots.txt before i ordered vbseo. Now the feature "nofollow" for these sites is integrated in vbseo. Should i take it out of the robots.txt?

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    Generally, you may leave your robots.txt content.
    However, why did you had showthread.php excluded in it? - these are the main content pages in vB and you certainly should allow spidering them.
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  3. #3
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44
    Liked
    0 times
    No, sorry, i mean showpost.php not showthread.php

  4. #4
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    Ah, ok
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  5. #5
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44
    Liked
    0 times
    So, i can let the entries in the robots.txt?

  6. #6
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    Yes
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


Similar Threads

  1. robots.txt
    By Zenith in forum General Discussion
    Replies: 64
    Last Post: 12-01-2010, 08:52 PM
  2. Temp robots.txt Brand New Forum?
    By rmjvol in forum Pre-Sales Questions
    Replies: 7
    Last Post: 08-26-2006, 02:53 AM
  3. Problems with multiple entries in vB's Scheduled Tasks
    By jamesk in forum Troubleshooting
    Replies: 6
    Last Post: 01-30-2006, 07:45 AM
  4. "should" I use a robots.txt file?
    By drex in forum General Discussion
    Replies: 5
    Last Post: 11-03-2005, 09:47 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •