Results 1 to 3 of 3

Optimum Frequency to generate new sitemaps for large sites

This is a discussion on Optimum Frequency to generate new sitemaps for large sites within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Hi, I just upgraded to Sitemap 3.0 and vBSEO 3.6.0 (great products from a great company BTW). I have optimized ...

  1. #1
    Junior Member
    Real Name
    David
    Join Date
    Apr 2006
    Posts
    7
    Liked
    0 times

    Optimum Frequency to generate new sitemaps for large sites

    Hi, I just upgraded to Sitemap 3.0 and vBSEO 3.6.0 (great products from a great company BTW).

    I have optimized the sitemap config in accordance with recommendations found here in this forum. 275,586 URLs have been submitted to Google and they have indexed 229,629 of those, according to webmaster tools.

    When I looked at the status of the individual .gz sitemap files yesterday, google was still saying 0 indexed for a few of them. So, I assumed they were just moving thru all the URLs and would eventually get to everything.

    I have a cron job set to rebuild the sitemaps every morning. I am wondering if daily sitemap rebuilds are a good idea for a site this large? Should it be every 2 or 3 days to allow google to catch up with what I submitted before? It *seems* like google has not processed all the URLs, then it gets notification of a new sitemap build and has to start all over before it finished the last ones. Thus, the ones at the proverbial end of the process are never being indexed.

    Seeking advice from the SEO experts.

  2. #2
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    We suggest once a day. If you have a VERY new-thread heavy site, perhaps twice a day max. But there are load concerns with running it often.

  3. #3
    Junior Member
    Real Name
    David
    Join Date
    Apr 2006
    Posts
    7
    Liked
    0 times
    OK thanks! I just discovered that it was running as a vB scheduled task in addition to my cron job, so I guess it was running twice. I disabled the vB Task.

Similar Threads

  1. vBulletin 4.x Can't generate sitemaps either with cron or by browser without timeout
    By chris15440 in forum Troubleshooting
    Replies: 10
    Last Post: 02-24-2011, 09:01 AM
  2. vBulletin 4.x Can i generate multiple sitemaps for different sections?
    By unleashedfx in forum Troubleshooting
    Replies: 3
    Last Post: 09-08-2010, 12:59 PM
  3. Can't generate sitemaps?
    By Plaroma in forum Troubleshooting
    Replies: 10
    Last Post: 11-30-2008, 06:05 PM
  4. Sitemap generator for Google on large sites
    By Ace in forum Pre-Sales Questions
    Replies: 3
    Last Post: 11-14-2007, 05:29 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •