vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Google Sitemap-Listing of old url's option-from 1.7

This is a discussion on Google Sitemap-Listing of old url's option-from 1.7 within the Member Articles forums, part of the Focus on Members category; When upgrading your vBSEO Google/Yahoo Sitemap Generator from version 1.6.1 to 1.7.0, there is a new option to include both ...

Go Back   vBulletin SEO Forums > Focus on Members > Member Articles

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 04-02-2006, 09:46 AM
T2DMan's Avatar
Senior Member
vBSEO Pre-Release Team
 
Real Name: Michael Brandon
Join Date: Jul 2005
Location: Auckland, New Zealand
Posts: 357
Send a message via ICQ to T2DMan Send a message via AIM to T2DMan Send a message via MSN to T2DMan Send a message via Yahoo to T2DMan
vBSEO Sitemap 1.7 - Why use the new option to include old vB URLs?

When upgrading your vBSEO Google/Yahoo Sitemap Generator from version 1.6.1 to 1.7.0, there is a new option to include both the rewritten vBSEO urls and the old urls. This is a new feature I recommended to the vBSEO team, so here is an analysis of why I feel you should use this feature:

Why list the old urls?

Simply:

Google needs to be able to see the 301 redirect from the old to the new url, and so delete the old url from its index.

If the old urls on the forum have been totally rewritten by vBSEO, then Google is not able to find the old urls and will not respider the old urls for awhile. The old urls will exist and will, therefore, be duplicate content to the new urls until the old urls are respidered and the redirects found.

It will, however, find the old urls that have external links into them.

Therefore:

Best to have a vBSEO sitemap that includes each of the old urls and so have a way of telling Google to spider the old urls and find the 301 redirects. It will, therefore, delete the old urls from its index. The deletion won't be immediate, as Google treats the deletion as a separate batch process.

When to stop including the old urls:

Stop including the old urls once Google stops showing them on your site:domain.com search.The vBSEO Google/Yahoo Sitemap will show the main old urls, but not all the possibilities, so there will still be some that Google needs to look after itself with its own respidering process.

Complications

Even though you may have a sitemap, those urls may not be spidered that fast, and not all the urls may be spidered. You need to make sure that you have good Google PR (probably PR5+) on your index page plus lots of external links to internal pages. This will get all your urls spidered well.

See the following on Matt Cutts blog 27 Mar 2006:

Q&A Thread


Quote:
Q: “My sitemap has about 1350 urls in it. . . . . its been around for 2+ years, but I cannot seem to get all the pages indexed. Am I missing something here?”

A: One of the classic crawling strategies that Google has used is the amount of PageRank on your pages. So just because your site has been around for a couple years (or that you submit a sitemap), that doesn’t mean that we’ll automatically crawl every page on your site. In general, getting good quality links would probably help us know to crawl your site more deeply. You might also want to look at the remaining unindexed urls; do they have a ton of parameters (we typically prefer urls with 1-2 parameters)? Is there a robots.txt? Is it possible to reach the unindexed urls easily by following static text links (no Flash, JavaScript, AJAX, cookies, frames, etc. in the way)? That’s what I would recommend looking at.
All the best.
__________________
T2DMan
Search engine optimize vBulletin - over 55001 views
or Contract me to onpage SEO your forum - experience the additional SERP improvements


Last edited by Juan Muriente; 04-03-2006 at 10:30 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Sitemap generating a lot more urls poprulz Troubleshooting 13 02-28-2007 05:15 PM
Google Sitemap Error (Location?) Spitfire General Discussion 5 05-30-2006 07:12 AM
vBSEO 2.4.0 Released - Includes Google AdSense Targeting Feature! Juan Muriente vBSEO Announcements 74 05-20-2006 10:29 PM
Memory Problem: TraumTeam Troubleshooting 1 04-06-2006 09:24 AM
vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.6.x, vBulletin 3.5.x & vBulletin 3.0.x Joe Ward General Discussion 0 12-17-2005 02:11 PM


All times are GMT -4. The time now is 08:55 AM.


Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.