vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
New vBSEO Discount Level for Network Builders Meet vBSEO Team in New York (Nov. 3rd & 4th) vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

High memory usage

This is a discussion on High memory usage within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Ok, I`m the lucky owner of a : Fatal error : Allowed memory size of 41943040 bytes exhausted (tried to ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > Troubleshooting

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 07-28-2008, 11:23 AM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Exclamation High memory usage

Ok, I`m the lucky owner of a : Fatal error: Allowed memory size of 41943040 bytes exhausted (tried to allocate 35063540 bytes)
which implies that the sitemap tried to allocate aprox 75 MB of memory, 35 over the alloted one. Is there any way to decrease and optimize the sitemap generator ? Smaller amounts of urls per file ? Need suggestions.

Regards,
Adrian A.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2  
Old 07-28-2008, 12:22 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,450
Blog Entries: 1
Hello,

try to disable "generate text sitemap" option, remove files from vbseo_sitemap/data/ folder and regenerate sitemap.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3  
Old 07-28-2008, 12:23 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Would that disable generating yahoo sitemaps ?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4  
Old 07-28-2008, 12:27 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Tried it, still not working.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5  
Old 07-28-2008, 12:38 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,450
Blog Entries: 1
Yahoo supports xml sitemaps now, you don't need text sitemap for them.

What exactly is the error you get?
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6  
Old 07-28-2008, 12:41 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
SECTION START] tags [9,012.7Kb mem used] [197,085s (+879s)]
[create sitemap file] filename: sitemap_19.xml.gz, number of urls: 1 [9,014.1Kb mem used] [197,085s (+0s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 19 [9,022.6Kb mem used] [197,085s (+0s)]

Fatal error: Allowed memory size of 41943040 bytes exhausted (tried to allocate 35063540 bytes) in /xxxxxxxxx/vbseo_sitemap/vbseo_sitemap_functions.php on line 1298
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7  
Old 07-28-2008, 01:55 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,450
Blog Entries: 1
Looks like you did not disable text sitemap option OR did not remove files from data/ folder before generating sitemap. Please double check that.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8  
Old 07-28-2008, 03:53 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Well it worked now. I just deleted *.gz and the sitemap was created. Is that enough ? Reason why I`m asking is I have about 1.2 mil posts and this shows : 661,013 total urls ...
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9  
Old 07-28-2008, 04:31 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,473
if you aren't including showpost itself, that sounds fine. the sitemap should link threads (all pages) and anything else you want
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10  
Old 07-28-2008, 04:57 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
That`s the problem, I have show post, show thread, forum display set.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #11  
Old 07-28-2008, 05:00 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Well I did some changes now ... and I see the sitemap being generated and using about 9 MB per sitemap created.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #12  
Old 07-28-2008, 08:48 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,450
Blog Entries: 1
Do you get more URLs included now? Note that private (not visible to guests) forums are NOT included in sitemap.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #13  
Old 07-28-2008, 08:51 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Yes. The main factor was disabling the smart show post option.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #14  
Old 07-28-2008, 09:13 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,450
Blog Entries: 1
I see. That option excludes showpost pages from sitemap in case if thread contains only a single post.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #15  
Old 07-28-2008, 09:44 PM
Junior Member
Big Board Administrator
 
Real Name: Adrian A.
Join Date: Aug 2005
Location: Romania
Posts: 29
Send a message via MSN to bin_asc Send a message via Yahoo to bin_asc
Well hopefully this will have solved my issues.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Tags
allocate, high, memory, sitemap, usage

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
100% CPU usage with vBSEO danlefree Troubleshooting 7 07-12-2008 07:12 PM
Excessive resource usage. AdamUOF General Discussion 2 07-12-2008 09:30 AM
High impression/Low CTR or Low impressions/High CTR Get Shorty Google Adsense, YPN, & Other Ad Networks 38 11-07-2007 05:33 AM
Last Problem, I hope - CPU Usage BoTGoD Troubleshooting 4 06-28-2006 06:20 PM


All times are GMT -4. The time now is 05:02 PM.


Powered by vBulletin Version 3.8.0 Beta 3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.