Results 1 to 6 of 6

Blocking External RSS Feeds from Search Engines

This is a discussion on Blocking External RSS Feeds from Search Engines within the General Discussion forums, part of the vBSEO SEO Plugin category; We are thinking about working a deal with another site that will have similar type readers that visit our forum. ...

  1. #1
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times

    Blocking External RSS Feeds from Search Engines

    We are thinking about working a deal with another site that will have similar type readers that visit our forum. We would extend them a forum with their RSS feeds, which would include about 500 characters of their feed article with a link to the full article. This will obviously be duplicate content to their site. Would it be best to exclude this forum from indexing in search engines?

    Thanks!

  2. #2
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    23,100
    Liked
    622 times
    Blog Entries
    4
    Hello Sonnie ,

    Your best option will be excluding that forum from Sitemap Generator
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

  3. #3
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    How exactly would be best to do that... the link to that forum is:

    Gaming News Discussion at Home Theater Forum and Systems - HomeTheaterShack.com

    Could I just add: /forums/gaming-news-discussion/ to the robots.txt file?

    Thanks!

  4. #4
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    You can robots it out and set the sitemap to exclude that forumId

    or

    make that forum available to members only.

  5. #5
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    I have the robots.txt set, but how do I add the forum ID to the sitemap?

    Thanks!

  6. #6
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    vbseo -> vbseo sitemap options
    Excluded Forums List

    enter in forum Ids separated by spaces

Similar Threads

  1. Replies: 7
    Last Post: 10-01-2010, 08:56 PM
  2. Which search engines do you use?
    By hornstar6969 in forum General Discussion
    Replies: 12
    Last Post: 07-15-2006, 01:56 PM
  3. Search Engines...
    By SecondLaw in forum Pre-Sales Questions
    Replies: 5
    Last Post: 04-22-2006, 09:52 PM
  4. Already Near Top of Search Engines
    By mikem79 in forum Pre-Sales Questions
    Replies: 1
    Last Post: 02-08-2006, 10:41 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •