vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 6 of 6

Search engine spidering urls incorrectly

This is a discussion on Search engine spidering urls incorrectly within the Troubleshooting forums, part of the vBSEO SEO Plugin category; Hi, I have been getting alot of referals from search engines who have indexed some of my site's urls incorrectly. ...

  1. #1
    Member
    Join Date
    Nov 2005
    Posts
    90

    Search engine spidering urls incorrectly

    Hi,

    I have been getting alot of referals from search engines who have indexed some of my site's urls incorrectly.

    For example:
    www.domain.com/?t=859&page=2

    When I go there, it doesn't redirect but goes to the homepage.

    that topic was created 2 weeks ago. What is the cause of this problem?
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,550

    Re: Search engine spidering urls incorrectly

    Hi,

    as you see, this link is incorrect ("whosthread.php" is missing) - perhaps someone has posted a wrong link somewhere and search engines found it?

    If you want to keep it working, you can try to add this in .htaccess after "RewriteEngine on":
    RewriteCond %{QUERY_STRING} ^t=([0-9]+)
    RewriteRule ^$ showthread.php?%{QUERY_STRING}
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation

    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

  3. #3
    Member
    Join Date
    Nov 2005
    Posts
    90

    Re: Search engine spidering urls incorrectly

    It worries me that it's not only restricted to one url but most of my referrers.

    When I check the source (search engine) of the referrer, it lists that format of the url.

    I am using httpd.conf, so should I add:
    RewriteCond %{QUERY_STRING} ^t=([0-9]+)
    RewriteRule ^$ showthread.php?%{QUERY_STRING}

    for httpd.conf? or does it have a different format.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

  4. #4
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,550

    Re: Search engine spidering urls incorrectly

    You should try the following for httpd.conf:
    RewriteCond %{QUERY_STRING} ^t=([0-9]+)
    RewriteRule ^/$ /showthread.php?%{QUERY_STRING}
    ps. could you please PM me the link to the serp example with this link pointing to you?
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation

    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

  5. #5
    Member
    Join Date
    Nov 2005
    Posts
    90

    Re: Search engine spidering urls incorrectly

    Hi,

    Thanks for the code.

    It works now fully and after implementing that code, I am not getting any incorrect urls anymore.

    Thanks
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

  6. #6
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    24,550

    Re: Search engine spidering urls incorrectly

    Ok, great!
    Oleg Ignatiuk / Crawlability Inc.
    Sneek Preview Video of the new Control Panel

    vBSEO 3.5 RC2 (Final)- Released for your Evaluation

    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!

Similar Threads

  1. Replies: 8
    Last Post: 09-01-2008, 02:27 AM
  2. Google Sitemap-Listing of old url's option-from 1.7
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 08:46 AM