vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 3 of 3

Could a huge sitemap & bots hurt my site?

This is a discussion on Could a huge sitemap & bots hurt my site? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Hi, I've submited a ticket to support due to awfull load peek after installing vbseo , no worry about that ...

  1. 03-13-2009 05:30 AM #1
    Blacklava
    Blacklava is offline
    Junior Member
    Real Name
    Blacklava
    Join Date
    Mar 2009
    Posts
    25

    Question Could a huge sitemap & bots hurt my site?

    Hi,

    I've submited a ticket to support due to awfull load peek after installing vbseo, no worry about that but wondering if it could come from the sitemap generator too?

    Can a huge sitemap with 500.000 urls hurt my site by triggering too many bots at the same time and create those load peeks?
    How can I know if it's the bots who are generating load peek (the sitemap report is only showing the hits on existing forum pages)?
    I never used a sitemap before and generated a full one (which was an error I bet), the new generated one got only 18.000 showthread.php and forums structure urls now but I'm wondering how google plannify the visits : Is there a queue that will be processed or a newly uploaded sitemap will stop all actual visits plannified from my huge first sitemap?

    Thanks

    Guy
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  2. 03-13-2009 10:07 AM #2
    Mert Gökçeimam
    Mert Gökçeimam is offline
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul
    Posts
    16,944
    Blog Entries
    4
    Send a message via MSN to Mert Gökçeimam
    Hello Guy ,

    Sitemap Generator can be used in different ways. I personally choose to include only forumdisplay and showthread content to sitemap as i want bots to focus on these pages.
    Mert Gökçeimam / Crawlability Inc.

    Yeni vBSEO Kontrol Paneli ve vBSEO 3.5 Yayın Tarihleri

    vBSEO 3.5 Beta 2 Yayınlandı - vBulletin 4 Uyumlu!


    Kişisel Sitem : Felsefe - Kültür merkeziniz
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  3. 03-13-2009 11:34 AM #3
    Blacklava
    Blacklava is offline
    Junior Member
    Real Name
    Blacklava
    Join Date
    Mar 2009
    Posts
    25
    Thanks, yes I agree, that's what I've done now

    My question was more about having a huge load due to bots coming after the submit a too huge sitemap, is that possible?
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
« Number of URLs have dropped off signifcantly in the past few months | Vbseo problem with another plugin »

Similar Threads

  1. Huge Processing Time for VBSEO Sitemap Report
    By deep45 in forum General Discussion
    Replies: 3
    Last Post: 01-26-2009, 05:06 PM
  2. 200 bots on my site for the last 2days, killin my load
    By sross in forum General Discussion
    Replies: 5
    Last Post: 01-04-2007, 07:06 PM
  3. testing the waters... huge import car site possibly for sale
    By briansol in forum Forum Marketplace
    Replies: 2
    Last Post: 11-13-2006, 12:16 PM
  4. How severely can Bots hamper a site?
    By mikeinjersey in forum General Discussion
    Replies: 5
    Last Post: 09-07-2006, 08:04 AM
  5. Wowzers! Huge Google update for my site
    By BamaStangGuy in forum Analysis: Traffic & SERPS
    Replies: 24
    Last Post: 04-18-2006, 10:55 PM