vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Whats going on sitemap and posts being indexed problems

This is a discussion on Whats going on sitemap and posts being indexed problems within the General Discussion forums, part of the vBSEO SEO Plugin category; I need someone to explain this to me please. My site map is 4000 pages, just threads are included. Google ...

Go Back   vBulletin SEO Forums > vBSEO SEO Plugin > General Discussion

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 06-06-2007, 03:08 PM
Dave Hybrid's Avatar
Senior Member
 
Real Name: Dave Hybrid
Join Date: Mar 2007
Location: UK
Posts: 321
Whats going on sitemap and posts being indexed problems

I need someone to explain this to me please.

My site map is 4000 pages, just threads are included.

Google has 12000 pages indexed and none of them are members so they must be threads... and what else?

I have tried "site:www.domain.com +vbseo" and according to that all the pages are vBSEO ones so the extra 8k are not old pages.

I also see this in my webmaster account:




My posts are set to permalink only.

Is Google indexing my posts?

Why is it even finding these URLs as they are meant to be no-follow or stopped by vBSEO no?

Please explain, maybe I'm missing something.

Last edited by Dave Hybrid; 06-07-2007 at 06:16 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 06-07-2007, 05:27 AM
Dave Hybrid's Avatar
Senior Member
 
Real Name: Dave Hybrid
Join Date: Mar 2007
Location: UK
Posts: 321
Anyone?

Last edited by Dave Hybrid; 06-07-2007 at 06:13 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 06-07-2007, 11:21 AM
Keith Cohen's Avatar
vBSEO Staff
vBSEO Total Customer SupportBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,266
The nofollow doesn't guarantee the links won't be followed. If you don't want your showpost pages indexed, turn off rewriting for the showpost page and disallow showpost.php in your ROBOTS.TXT.

Even then, it can take quite a while for any previously indexed pages to drop off. It's not an instant change.
__________________
Keith Cohen / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.


My Personal Sites: My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 06-07-2007, 01:00 PM
Dave Hybrid's Avatar
Senior Member
 
Real Name: Dave Hybrid
Join Date: Mar 2007
Location: UK
Posts: 321
So if i leave permalinks enabled for posts like you have here at vBSEO are you saying that my posts will be indexed?

Isn't that against vBSEOs views on duplicate content?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 06-07-2007, 01:02 PM
Keith Cohen's Avatar
vBSEO Staff
vBSEO Total Customer SupportBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,266
A permalink links to the thread, not a showpost page, so if you use permalinks then you should be fine. However, previously indexed ones on your site can still take a while to drop out of the search engines.

Hover over the Post # link here on this post. It links to the thread, with an anchor to the correct post; not a showpost page.
__________________
Keith Cohen / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.


My Personal Sites: My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 06-07-2007, 01:05 PM
Dave Hybrid's Avatar
Senior Member
 
Real Name: Dave Hybrid
Join Date: Mar 2007
Location: UK
Posts: 321
Quote:
Originally Posted by Keith Cohen View Post
A permalink links to the thread, not a showpost page, so if you use permalinks then you should be fine. However, previously indexed ones on your site can still take a while to drop out of the search engines.

Hover over the Post # link here on this post. It links to the thread, with an anchor to the correct post; not a showpost page.

But according to the crawl dates Google found these URLS as recent as a few days ago.

It shouldn't be finding them whatsoever!

The URLS above are not anchors they are duplicate URLs with the same content as the show-thread pages.

EDIT**

Just realised that those URLs re-direct to the anchored versions, so this shouldn't cause duplicate URLs with the same content?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 06-07-2007, 01:10 PM
Keith Cohen's Avatar
vBSEO Staff
vBSEO Total Customer SupportBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,266
When you changed your sitemap to not include showpost links, did you delete all your old sitemap files? Since you went down on the number of URLs that would be included, you will have less sitemap files, so the older (higher numbered) sitemap files could still exist, and Google could still be downloading those.

But, I looked at your site and your permalinks are set up correctly, so Google is not getting those URLs from reading your pages. It's either getting them from the old leftever sitemap files like I mentioned eariler, or they are just leftover from long ago and they will stop eventually.
__________________
Keith Cohen / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.


My Personal Sites: My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 06-07-2007, 01:13 PM
Dave Hybrid's Avatar
Senior Member
 
Real Name: Dave Hybrid
Join Date: Mar 2007
Location: UK
Posts: 321
I don't understand mate.

How can you include show post in the sitemap when they are not actual pages, if they were actual pages they would have their own URL and then they would be duplicates of show thread...

Also how do i delete my old sitemap files?

Thanks.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 06-07-2007, 01:15 PM
Keith Cohen's Avatar
vBSEO Staff
vBSEO Total Customer SupportBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,266
In your vBSEO Sitemap settings, do you currently have it set to include Showpost links?

If you do, then set that to No, delete all of the sitemap files from you vbseo_sitemap/data directory (the sitemap_.....gz files), then re-generate your sitemap using the menu option on the vBSEO Sitemap menu.
__________________
Keith Cohen / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.


My Personal Sites: My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
sitemap does not index threads, posts, forumdisplay. Only members HeadBuilder Troubleshooting 11 05-20-2007 07:31 AM
Suggestion: make a special sitemap for sticky threads and important topics dutchbb Feature Requests 9 07-15-2006 12:54 PM
Currently Indexed Pages, Analytics, Adsense, PR... NeutralizeR Pre-Sales Questions 56 03-12-2006 05:06 AM
Single Posts in sitemap or not? etc vissa General Discussion 1 02-09-2006 07:49 PM
vbseo sitemap: should I index posts? archimedes General Discussion 5 11-14-2005 02:21 AM


All times are GMT -4. The time now is 10:08 PM.


Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.