Results 1 to 4 of 4

Why include archive URLs in sitemap?

This is a discussion on Why include archive URLs in sitemap? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Just checking my Google Webmaster Central stats and warnings, etc., I notice that there are a number of errors relating ...

  1. #1
    Senior Member
    Real Name
    djbaxter
    Join Date
    Mar 2009
    Posts
    176
    Liked
    6 times

    Question Why include archive URLs in sitemap?

    Just checking my Google Webmaster Central stats and warnings, etc., I notice that there are a number of errors relating to archive posts.

    As it turns out, I have blocked spider accessd to /archive/ in my robots.txt file as an anti-duplicate content strategy.

    Now, although I feel I should know the answer to this, I'm confused about whether

    1. to continue to block indexing of /archive and delete the archive links from the sitemap; or
    2. to remove the block from robots.txt.
    Are there any advantages to allowing indexing of archived posts? Are there any disadvantages?

  2. #2
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    I suggest disabling the archive entirely. remove it from the site and the sitemap. it's pointless with vbseo.

  3. #3
    Senior Member
    Real Name
    djbaxter
    Join Date
    Mar 2009
    Posts
    176
    Liked
    6 times
    Thanks, briansol. I've now disabled those pages in the sitemap.

  4. #4
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    22,367
    Liked
    542 times
    Blog Entries
    4
    I also donot find any value within vBulletin archive and disabled it completely.
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

Similar Threads

  1. Include old urls ?
    By f4vn in forum General Discussion
    Replies: 4
    Last Post: 10-11-2008, 08:31 PM
  2. Sitemap - Include old URLs?
    By Nikke86 in forum General Discussion
    Replies: 1
    Last Post: 04-24-2008, 11:17 AM
  3. What not to include in Sitemap (and what to include in Robots.txt)
    By Marvin Hlavac in forum General Discussion
    Replies: 2
    Last Post: 03-21-2008, 11:35 AM
  4. Sitemap generator prefs - Include Old URLs - Yes or No?
    By ehmax in forum General Discussion
    Replies: 5
    Last Post: 04-20-2007, 09:43 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •