vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
New vBSEO Discount Level for Network Builders Meet vBSEO Team in New York (Nov. 3rd & 4th) vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Over 2 million urls lost!

This is a discussion on Over 2 million urls lost! within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I've noticed a significant drop in the URL's that are being on reported. I noticed a significant drop in my ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > Troubleshooting

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 09-02-2008, 08:58 PM
Junior Member
 
Real Name: bob
Join Date: Mar 2007
Posts: 3
Over 2 million urls lost!

I've noticed a significant drop in the URL's that are being on reported. I noticed a significant drop in my index pages in Google. Before this problem, I had over 830,000 pages indexed in Google. Now, I have only 380,000...

For example, here are the last two days the report is listed in my admincp:

229 2008-08-20 02:00 1,002.81 s 3,039,979 +1,619 Yes Yes
230 2008-08-21 02:00 777,598.59 s 609,912 -2,430,067 Yes Yes

These are the last two dates that the report appears in my AdminCP

I just upgraded to 3.2 and when I run the Sitemap generator, I get the following:

[SECTION START] tags [5,972.3Kb mem used] [237,297s (+349s)]
[create sitemap file] filename: sitemap_92.xml.gz, number of urls: 48 [5,983.3Kb mem used] [237,298s (+0s)]
[create sitemap in text format] part #93 [5,983.2Kb mem used] [237,298s (+0s)]
[create sitemap index] filename: sitemap_index.xml.gz, number of sitemaps: 92 [6,011.5Kb mem used] [237,298s (+0s)]

It runs in about 1 second, and when I try to view a report, one doesn't exist!

Here are my current settings:

max_execution_time to 1500

My PHP Memory Limit is set to 48.00 MB

PHP Maximum Upload Size 2.00 MB

PHP Max Post Size 8.00 MB

Can someone please help me?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2  
Old 09-03-2008, 01:32 AM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,473
92 sitemap files is absurd.

a general rule of thumb is 5-7 files at 30,000 urls each per million posts.


see the settings in my ultimate guide. sounds like you're just including everything, which you shouldn't.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3  
Old 09-03-2008, 01:50 AM
Junior Member
 
Real Name: bob
Join Date: Mar 2007
Posts: 3
I changed my settings, but now it's up to 97 files. Should I delete all the sitemap files then run the sitemap generator?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4  
Old 09-03-2008, 02:28 AM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,473
yeah, delete all the .gz files from the /data folder and run again
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Google Advise - 1.7 Million URL submitted greecemonkey General Discussion 2 03-05-2007 11:04 AM
Currently enhancing over 20 million pages. Neutral Singh General Discussion 1 12-01-2006 07:19 PM
Help! I have a million trackbacks to validate! Sal Collaziano General Discussion 2 08-18-2006 10:28 PM


All times are GMT -4. The time now is 04:28 PM.


Powered by vBulletin Version 3.8.0 Beta 3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.