Results 1 to 12 of 12

Too many URL's indexed

This is a discussion on Too many URL's indexed within the General Discussion forums, part of the vBSEO SEO Plugin category; This is my latest vBSEO sitemap report. I wonder why I have that many URL's indexed by vBSEO . And ...

  1. #1
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times

    Too many URL's indexed

    This is my latest vBSEO sitemap report. I wonder why I have that many URL's indexed by vBSEO. And Google has 80,000 URL's iindexed, too. Even though I have only 25,000 threads and 180,000 posts. I notice if I look through the Google indexed UR"s, that even user profiles are there. Is that counter-productive?
    -------------
    Summary:
    ============================
    Forum Display: 2622
    Show Thread: 65124
    Show Post: 349944
    Member Profiles: 19426
    Poll Results: 52
    Archive: 297

    Total Indexed URLs: 437494
    LenBackus


  2. #2
    Senior Member
    Real Name
    A.D
    Join Date
    Oct 2007
    Location
    France
    Posts
    159
    Liked
    0 times
    Not sure but I think , on mine I disabled the memberlist totally (too much bots were crawling profiles) , also disabled member profiles from the sitemap generation and the links to the old thread links system of vb you can disable them too like forumdisplay.php if you havent done that and personnally i find this better now bot are crawling what I want, tags and threads

  3. #3
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    i'd disable showpost. that's your most likely problem

  4. #4
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times
    What is showpost?
    LenBackus


  5. #5
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    showpost.php?p=123

    its the single post viewer.

  6. #6
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times
    Is that sometihing you want the SE's to see?
    LenBackus


  7. #7
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    no. its already a part of your threads. posts by post, its duplicate

  8. #8
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times
    So what all is the stuff should we keep away from the SE's?

    Is it enough to just remove it from the mapping function or is there another step that needs to be taken?
    LenBackus


  9. #9
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    best is to NOT re-write it (so its all 1 file) and then block it with robots.txt

    if its blocked, it's not re-written on my forum
    Last edited by Brian Cummiskey; 12-01-2009 at 12:51 AM.

  10. #10
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times
    Is it possible to hire someone, like you, to do some optimizing on my vBSEO settings?
    LenBackus


  11. #11
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    sure, plenty of people do it.

    But you probably can't afford me

    I free-lance at $125 /hr

  12. #12
    Senior Member
    Real Name
    len backus
    Join Date
    May 2007
    Posts
    127
    Liked
    0 times
    Thanks, you are right.
    LenBackus


Similar Threads

  1. Google Sitemap-Listing of old url's option-from 1.7
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 08:46 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •