vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Too many pages indexed?

This is a discussion on Too many pages indexed? within the General Discussion forums, part of the vBulletin SEO Discussion category; Is there any harm in having too many pages indexed by google? We are using vbseo and the sitemap plugin ...

Go Back   vBulletin SEO Forums > vBulletin SEO Discussion > General Discussion

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 06-30-2008, 04:27 PM
Member
 
Real Name: Corey Costadura
Join Date: May 2006
Posts: 39
Too many pages indexed?

Is there any harm in having too many pages indexed by google? We are using vbseo and the sitemap plugin and have 143,000 pages indexed.

There are right around 650,000 pages in my sitemap, so I am expecting this to get even bigger. I do worry about Google thinking that I am spamming them though...
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 06-30-2008, 05:50 PM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
There is certainly no harm in having millions of pages IF:
  • The pages are not duplicate content or duplicate paths to the same content
With that many pages indexed, you want to make sure every page indexed is unique. You definitely do not want Google wasting time re-crawling duplicate content.

As a vBSEO user, almost all duplicate content issues are already solved for you. However, I would strongly consider disabling the showpost pages by using the vBSEO feature to "replace showpost with Permalink" if you have not done so already.

That will *greatly* reduce the # of pages included in your sitemap, and reduce Google's work load for your site, without sacrificing any of your unique content from being included.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 07-04-2008, 12:11 PM
Member
 
Real Name: Corey Costadura
Join Date: May 2006
Posts: 39
Quote:
Originally Posted by Joe Ward View Post
There is certainly no harm in having millions of pages IF:
  • The pages are not duplicate content or duplicate paths to the same content
With that many pages indexed, you want to make sure every page indexed is unique. You definitely do not want Google wasting time re-crawling duplicate content.

As a vBSEO user, almost all duplicate content issues are already solved for you. However, I would strongly consider disabling the showpost pages by using the vBSEO feature to "replace showpost with Permalink" if you have not done so already.

That will *greatly* reduce the # of pages included in your sitemap, and reduce Google's work load for your site, without sacrificing any of your unique content from being included.

I did as suggested, but wouldn't this greatly increase the amount of duplicate content you have? If you anchor the link to each post to the showthread page, you now have 10 pages indexed with the same exact content.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 07-06-2008, 04:57 PM
Member
 
Real Name: Corey Costadura
Join Date: May 2006
Posts: 39
Quote:
Originally Posted by Corey View Post
I did as suggested, but wouldn't this greatly increase the amount of duplicate content you have? If you anchor the link to each post to the showthread page, you now have 10 pages indexed with the same exact content.
Can somebody address this? Is there an exception that I don't know about?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 07-06-2008, 06:49 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,597
An anchor is not a part of URL, so you will have indexed only a single URL.
For instance, there is only one indexed page for this thread: site:http://www.vbseo.com/f4/too-many-pages-indexed-24533/ - Buscar con Google
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 07-06-2008, 07:16 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,540
all you need to do is:

- use the option in vbseocp for "replace showpost with permalink"
- remove showpost from the sitemap generator
- robots.txt out showpost.php
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 07-07-2008, 02:26 PM
Member
 
Real Name: Corey Costadura
Join Date: May 2006
Posts: 39
Quote:
Originally Posted by Oleg Ignatiuk View Post
An anchor is not a part of URL, so you will have indexed only a single URL.
For instance, there is only one indexed page for this thread: site:http://www.vbseo.com/f4/too-many-pages-indexed-24533/ - Buscar con Google

I understand that each URL is unique. What I am concerned about is that the content for each post link will be the same as the content for the other 10 post links that will appear on that particular thread page. The only thing different is the URL and the anchor... the content would be exactly the same. Isn't this a big no-no?

I also understand brian's solution (thanks Brian). I just want to understand the suggestion Joe gave me, as he said that I should avoid duplicate content but the suggestion seems to cause more duplicated content than linking to a single post.

I promise that I am not trying to be difficult, just wanting to understand...
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 07-07-2008, 02:45 PM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
Search engines are smart enough to recognized references to the same page.

Anchors do not indicate new pages. They indicate only to "jump to" a particular place on the *same* page.

This will not result in any duplicate content.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 07-07-2008, 08:45 PM
Member
 
Real Name: Corey Costadura
Join Date: May 2006
Posts: 39
Quote:
Originally Posted by Joe Ward View Post
Search engines are smart enough to recognized references to the same page.

Anchors do not indicate new pages. They indicate only to "jump to" a particular place on the *same* page.

This will not result in any duplicate content.
Outstanding, thanks Joe!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
More indexed pages vBSEO Blogger Member Blogs 0 02-04-2008 07:20 AM
More indexed pages vBSEO Blogger Member Blogs 0 01-26-2008 02:00 AM
indexed pages croportal General Discussion 4 12-18-2007 01:32 PM
Indexed Pages Paul Govier Analysis: Traffic & SERPS 1 01-20-2007 05:25 PM
no indexed pages MentaL General Discussion 4 11-11-2005 02:31 PM


All times are GMT -4. The time now is 12:12 AM.


Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.