Results 1 to 13 of 13

Sitemap Total Processing Time: 345,688.13 seconds

This is a discussion on Sitemap Total Processing Time: 345,688.13 seconds within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Since installing vB4.0.x and updating vBSEOSitemap, I've been having issues. Previously it took about 700 seconds to run the sitemap, ...

  1. #1
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times

    Question Sitemap Total Processing Time: 345,688.13 seconds

    Since installing vB4.0.x and updating vBSEOSitemap, I've been having issues. Previously it took about 700 seconds to run the sitemap, but now it takes much longer. The last run took 345,688 seconds! (Yes, 4 days!).

    I've rechecked everything, but I can't figure out the problem. Does anyone have an idea of what may be happening? Thanks.

  2. #2
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Please make sure you are using sitemap 2.6 beta2. If you are and its still taking 4 days to complete, you need to either add resources to your server (memory_limit in php.ini) or trim sections from being included in the sitemap itself so it runs faster.

  3. #3
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    Hi Brian - the earlier version ran fine and I've made no changes to the server backend. I already increased memory_limit when I first installed it a few years back, but I'll double check it in case something changed it for some reason.

  4. #4
    Senior Member
    Real Name
    Michael Biddle
    Join Date
    Jan 2007
    Location
    Southern California
    Posts
    7,097
    Liked
    5 times
    What all are you including in the sitemap?
    The Forum Hosting - Forum Hosting from the Forum Experts

  5. #5
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    I've turned off "Show Posts" and it is only doing Forum Display, Show Thread, Profiles and Poll. Total 468,496 URLs in latest run, taking 345,657.25 seconds.

    It only took a 15-20 minutes before the upgrade, and that included show post pages too.

  6. #6
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    If it fails to complete the first time, it will tach on the total time until it runs again the next day. It is not runnning for that entire period of time.

    You may need to increase your php memory_limit in php.ini or your wait_timeout setting in my.cnf and then restart the appropriate services.

  7. #7
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    I've increased greatly memory_limit and wait_timeout settings (and restarted services), but it is still not running properly.

    I'm going to remove the software and reinstall from scratch, just in case.

  8. #8
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    I've reinstalled and it is still doing it.

    I'm keeping an eye on the files it produces and if I tell it to run, it will produce around 14 archive files and stop. If I rerun it, it will create 14 more.... I've rerun it until it finishes and does them all (a total of 48 files). Not can't see what it issue is, please help.

  9. #9
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    You need more resources for the sitemap to complete in one shot, you or you need to trim the sitemap included sections.

    increasing wait_timeout in my.cnf and memory_limit max_execution_time settings in php.ini will allow the script to run longer.

    Removing sections that are not necessary (basically everything but forumdisplay and showthread, and the cms) will also help it to run faster.
    Last edited by Brian Cummiskey; 06-11-2010 at 08:58 PM.
    Brian Cummiskey / Crawlability Inc.
    Security vbulletin - Patch Level for all supported versions released!

    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  10. #10
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    I've trimmed it right back already - pretty much just CMS, foruumdisplay (4.5 million posts) and userprofiles. It ran fine with even showposts before I upgraded to vbulletin4. I'll adjust max_execution_time in addition to the others.

    Based on the fact I have 4.5 million posts, what would you recommend I set wait_timeout, memory_limit and max_execution_time to?

  11. #11
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Correct settings for those have a lot to do with your hardware specs as well. What kind of server are you running?

  12. #12
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times
    Quad 2.4ghz AMD, 4GB DDR2 Ram, 2x SATA HDs.

  13. #13
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    i'd suggest
    wait_timeout = 240
    memory_limit = 64M
    max_Execution_time = 30

Similar Threads

  1. vBulletin 4.x Total processing time: 86,410.27 seconds! - Is it abnormal?
    By Kaustubh in forum Troubleshooting
    Replies: 8
    Last Post: 04-14-2010, 01:26 AM
  2. Huge Processing Time for VBSEO Sitemap Report
    By deep45 in forum General Discussion
    Replies: 3
    Last Post: 01-26-2009, 05:06 PM
  3. Total Processing Time: 172,804.13 seconds
    By 420 in forum Troubleshooting
    Replies: 2
    Last Post: 01-08-2009, 07:58 PM
  4. Sitemap processing time
    By emdee90 in forum Troubleshooting
    Replies: 1
    Last Post: 04-23-2008, 12:31 PM
  5. Total Processing Time
    By Black Cobra in forum Troubleshooting
    Replies: 1
    Last Post: 12-19-2006, 05:25 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •