Results 1 to 2 of 2

G. Sitemaps (2200 not found/unreachable urls + robots.txt question)

This is a discussion on G. Sitemaps (2200 not found/unreachable urls + robots.txt question) within the General Discussion forums, part of the vBulletin SEO Discussion category; Ok i recently imported my phpbb to vb 3.61, and of course added vbseo . I noticed that in google ...

  1. #1
    Member
    Real Name
    Justin
    Join Date
    Oct 2006
    Posts
    37
    Liked
    0 times

    G. Sitemaps (2200 not found/unreachable urls + robots.txt question)

    Ok i recently imported my phpbb to vb 3.61, and of course added vbseo.
    I noticed that in google sitemaps, i have about 2200 urls that are not found. I beleive these urls are for my old phpbb setup.

    Are all these broken links (that redirect to home) diluting my pagerank/keywords/etc? How can I make google forget about those urls that no longer exist? I was hoping they would automatically just drop off with the next google dance but that does not appear to be true.

    Here is a link to a csv file listing all of my broken urls:
    http://www.ruleoneforum.com/uploaded/temp/notfound.csv

    Also, I have about a dozen urls under the "unreachable urls". Here is the link to those: http://www.ruleoneforum.com/uploaded...nreachable.csv

    What should I do with these urls? Are they working against my seo?

    Finally, can someone verify that my Robots.txt file is correct?
    http://www.ruleoneforum.com/robots.txt

    Thank you so very much!

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,744
    Liked
    168 times
    Hello Justin,

    I checked your not found URLs list. You can setup a redirection for your old phpbb URLs (thread, post and member pages) to the homepage by adding the into .htaccess right after "RewriteEngine on" line:
    Code:
    RewriteRule ^\.html$ http://www.ruleoneforum.com/ [L,R=301]
    RewriteRule ^(post|member)[0-9]+\.html$ http://www.ruleoneforum.com/ [L,R=301]
    RewriteRule ^viewtopic\.php http://www.ruleoneforum.com/ [L,R=301]
    Your robots.txt seems to be correct

Similar Threads

  1. Replies: 12
    Last Post: 08-16-2006, 05:22 AM
  2. Google Sitemap-Listing of old url's option-from 1.7
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 08:46 AM
  3. Question Regarding URLs
    By Steve in forum Troubleshooting
    Replies: 3
    Last Post: 12-29-2005, 10:37 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •