vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 6 of 6

robots.txt entries

This is a discussion on robots.txt entries within the General Discussion forums, part of the vBSEO SEO Plugin category; Oh still one question. I´ve put showthread.php and printthread.php in the robots.txt before i ordered vbseo . Now the feature ...

  1. #1
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44

    Re: robots.txt entries

    Oh still one question.

    I´ve put showthread.php and printthread.php in the robots.txt before i ordered vbseo. Now the feature "nofollow" for these sites is integrated in vbseo. Should i take it out of the robots.txt?

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,554

    Re: robots.txt entries

    Generally, you may leave your robots.txt content.
    However, why did you had showthread.php excluded in it? - these are the main content pages in vB and you certainly should allow spidering them.
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation


  3. #3
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44

    Re: robots.txt entries

    No, sorry, i mean showpost.php not showthread.php

  4. #4
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,554

    Re: robots.txt entries

    Ah, ok
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation


  5. #5
    Member
    Real Name
    XXXXXX
    Join Date
    Sep 2005
    Posts
    44

    Re: robots.txt entries

    So, i can let the entries in the robots.txt?

  6. #6
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,554

    Re: robots.txt entries

    Yes
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation


Similar Threads

  1. robots.txt
    By Zenith in forum General Discussion
    Replies: 60
    Last Post: 11-04-2009, 03:44 PM
  2. Temp robots.txt Brand New Forum?
    By rmjvol in forum Pre-Sales Questions
    Replies: 7
    Last Post: 08-26-2006, 01:53 AM
  3. Problems with multiple entries in vB's Scheduled Tasks
    By jamesk in forum Troubleshooting
    Replies: 6
    Last Post: 01-30-2006, 06:45 AM
  4. "should" I use a robots.txt file?
    By drex in forum General Discussion
    Replies: 5
    Last Post: 11-03-2005, 08:47 AM