Progress Report - cellphoneforums

I've been fighting with search engines ever since I implimented vbSEO. One major issue initially was server load. (look at how yahoo was pounding the site in the screen capture below) I will say that hits have gone down a lot since I started using vbSEO, but I guess that is expected while things are being reindexed.

I wish I would've done this earlier to keep better track of things, but I'm confident things will pick up soon. Since google dropped almost all my pages, I requested reinclusion a week ago and already google is starting to pick up a little.

Site: Cell Phone Forums - Your Cell Phone Source
Threads: 103,502
Posts: 532,416
Members: 98,613
Installed vbSEO on 4/19.

Pages in Google 16,400
Google vbSEO pages 16,000
I'm pretty sure numbers in google yesterday were 22,000. I noticed that when google drops pages like this they are switching around things. I bet tomorrow there will be around 24k

Pages in Yahoo 952,000
Yahoo vbSEO pages 206,000
I'm fairly sure that before vbSEO yahoo had over 1,100,000 pages. Traffic has dropped from yahoo.

Pages in MSN 371
MSN vbSEO pages 192

Pages in Ask 151,700
Ask vbSEO pages 8,100
Now here's something that doesn't make sense. Go to the vbseo link above. Look at the URL's under each result. This is the old format of my url's, but yet the new content is indexed ??? Maybe ask doesn't update url's when they update content?

Now, check out the se results from the vbseo sitemap thinger below. The days that no data was registered was because the server had to be rebooted due to massive amounts of bot traffic. I eventually put a couple restrictive lines in my robots.txt to tell yahoo to stop rapid-firing my site.

Any comments are appreciated.

The numbers today:


Pages in Google 11,400
Google vbSEO pages 11,000
-7,000

Pages in Yahoo 951,000
Yahoo vbSEO pages 205,000
-1,000

Pages in MSN 327
MSN vbSEO pages 162

Pages in Ask 151,700
Ask vbSEO pages 8,100

Yesterday googlebot was active. Today, not so much. Grrr!!

Anyone have any idea why my yahoo rankings would've dropped so much? I got rid of one of my old archives, but I put in 301's to the new vbSEO pages. I think yahoo liked these archives a lot more than google did. That's my theory.

Pages in Google 11,700
Google vbSEO pages 11,300
+700

Pages in Yahoo 945,000 -6,000
Yahoo vbSEO pages 197,000 -8,000


Pages in MSN 351 +24
MSN vbSEO pages 192 +30

Pages in Ask 151,700
Ask vbSEO pages 8,100

I've since moved to a new, larger server! I turned off the time limits on the bots. Already yahoo is going nuts. Today 92,000 pages were crawled by yahoo alone!

looking good. keep us posted

I just thought this was funny. Check out the processing time.

Old server:
Summary:
============================
Forum Display: 3432
Show Thread: 114847
Show Post: 521920
Member Profiles: 97966
Archive: 2084
Total Indexed URLs: 740250
Total Processing Time: 1,361.99 seconds

New Server:
Summary:
============================
Forum Display: 3481
Show Thread: 116197
Show Post: 526417
Member Profiles: 98946
Archive: 2104
Total Indexed URLs: 747146
Total Processing Time: 601.64 seconds

Wow, this is really good

Pages in Google 22,900 +11200
Google vbSEO pages 22,600 +11,300

Pages in Yahoo 982,000 +37,000
Yahoo vbSEO pages 218,000 +21,000


Pages in MSN 307
MSN vbSEO pages 162 -30

Pages in Ask 152,700 +1,000
Ask vbSEO pages 8,390 +290

Woo!! Since the new server things have picked up. 103,000 pages crawled by yahoo yesterday!

The server is very important in the world of search engine optimization.

That doesnt make since to alot of people, but from my experience, it doesnt take much for a bot to get disgusted and leave.

I noticed many improvements on my sites as i upgraded them to bigger servers, rather than shared hosting.

Fantastic - you are doing extremely well.

Originally Posted by sportsoutlaw

The server is very important in the world of search engine optimization.

That doesnt make since to alot of people, but from my experience, it doesnt take much for a bot to get disgusted and leave.

I noticed many improvements on my sites as i upgraded them to bigger servers, rather than shared hosting.

Have any opinion on scsi drives with large databases? I'm sure they can't hurt, but are they worth it over something like SATAII drives?

Thanks Joe! Hits started to pick up a lot from yahoo today. I def can't see things gettying any worse at this point.

Originally Posted by tavenger5

Have any opinion on scsi drives with large databases? I'm sure they can't hurt, but are they worth it over something like SATAII drives?

.

You just went way over my head there, LOL. I dont really know anything about servers, just know that the bigger and faster they are, the better. I dont mess with my own servers, I have someone that actually knows what they are doing do all that for me.

Pages in Google 27,300 +4,400
Google vbSEO pages 27,100 +4,500

Pages in Yahoo 1,020,000 +38,000
Yahoo vbSEO pages 251,000 +33,000


Pages in MSN 374
MSN vbSEO pages 219

Pages in Ask 152,700
Ask vbSEO pages 8,390

139,925 pages indexed from yahoo yesterday.

Conclusions so far: Google is careful. Yahoo rapid fires everything it possibly can asap. MSN doesn't do anything. Ask is slow to index.

Tremendous indexing progress!

Pages in Google 28,000 +800
Google vbSEO pages 27,600 +500


Pages in Yahoo 1,100,000 +80,000
Yahoo vbSEO pages 312,000 +62,000

Pages in MSN 337
MSN vbSEO pages 198

Pages in Ask 150,700 -2,000
Ask vbSEO pages 8,430 +140

Why does MSN not like me?

That's really odd, I've found MSN to be the easiest to get into #1 and #2 spots with out of all the SE's.