vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Sitemap 2.1 - google webmaster tools

This is a discussion on Sitemap 2.1 - google webmaster tools within the General Discussion forums, part of the vBulletin SEO Discussion category; Couple fo questions 1. what do you think is it good to disable member profile in sitemap and in robots.txt? ...

Go Back   vBulletin SEO Forums > vBulletin SEO Discussion > General Discussion

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 01-29-2008, 04:06 PM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
Sitemap 2.1 - google webmaster tools

Couple fo questions
1. what do you think is it good to disable member profile in sitemap and in robots.txt? Because i have duplicate title tags in webmaster tools - Spletne Igre - Members List - 172

2. how can i add links from games like this hxtp://www.spletne-igre.com/forum/arcade/game/1619.html to sitemap ... i know i can use extra-urls.txt but i have more then 1.300 games and add manually every link to extra-urls.txt is a lot of work

3. i finnaly checked webmaster tools on google and i see i have some errors
hxtp://www.spletne-igre.com/forum/arcade/category-4/0.html,4xx error,"Jan 21, 2008"
hxtp://www.spletne-igre.com/forum/members/applianceshoes.html,4xx error,"Jan 21, 2008"
hxtp://www.spletne-igre.com/forum/a/,404 (Not found),"Jan 26, 2008"
hxtp://www.spletne-igre.com/forum/526-post1.html,Network unreachable,"Jan 13, 2008"
hxtp://www.spletne-igre.com/forum/calendar.php,URL restricted by robots.txt,"Jan 26, 2008"
hxtp://www.spletne-igre.com/forum/index.php/register.php,URL restricted by robots.txt,"Jan 24, 2008"
hxtp://www.spletne-igre.com/forum/index.php/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008"
hxtp://www.spletne-igre.com/forum/index.php/sitemap/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008"
hxtp://www.spletne-igre.com/forum/memberlist.php,URL restricted by robots.txt,"Jan 16, 2008"
hxtp://www.spletne-igre.com/forum/private.php,URL restricted by robots.txt,"Jan 26, 2008"
hxtp://www.spletne-igre.com/forum/register.php,URL restricted by robots.txt,"Jan 24, 2008"
hxtp://www.spletne-igre.com/forum/search.php,URL restricted by robots.txt,"Jan 23, 2008"
hxtp://www.spletne-igre.com/forum/showgroups.php,URL restricted by robots.txt,"Jan 25, 2008"
can someone tell me whay i get those errors?

4. thank you for answers and help
__________________
Igre / Best 1st Games
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 01-30-2008, 07:28 PM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
can anyone answer please?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 01-30-2008, 11:09 PM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
1. Personally I do prefer to disable member profiles since I advocate focusing the search engines attention on core content within the threads and other valuable content pages on your site.

vBSEO founder Juan Muriente has, however, provided an excellent argument as to why vBulletin member profile pages have SEO benefit. See also here.

If you do decide to block member profile pages, you can do it with robots.txt for further redundancy.

However, vBSEO supports the following rel=nofollow features within your vBSEO Control Panel (vbseocp.php):

Quote:
Add rel="nofollow" to Links pointing TO Member Profiles FROM Postbit
Enable this option to prevent search engines from following links to member profiles found in posts.

Add rel="nofollow" to Links pointing TO Member Profiles FROM Forumhome
Enable this option to prevent search engines from following links to member profiles found in your Forum Homepage.
2. If you can find alternative software to generate a sitemap for your games, you can copy/paste them into extra-urls.txt.

You can also create a separate sitemap for that content and include its location in your robots.txt file. See here for discussion.

3. Eliminating the robots.txt related entries, it seems you have very few errors. You should consider extracting those and either creating a support ticket or a new post for feedback on the remaining few errors from tech support.

4. You are welcome. Apologies for the delay.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 01-31-2008, 01:04 AM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
1. i blocked them and i have rel="nofollow" from the start:P
2. i get all the urls from the database but have another question ... is it worth to put them in sitemap because can you check both bottom url and you will see that there is the same text but different page
2a = forum: Slime Ball - Spletne Igre
2b = game: Spletne Igre

what do you think to put the game url in sitemap or not?

3. will send a ticket
4. thank you again for all answers
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 01-31-2008, 10:36 AM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
If the content is unique and valuable to your theme, then you should consider including it. If its along the same level of quality as member profile pages, then that is up to you to decide how you want to handle it.

Note: The 2nd URL gave me a cookie error, but I have cookies enabled in my browser.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 01-31-2008, 10:44 AM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
can you visit again and if you again get this error about cookie please just refresh and you will see tha whole page ... and then let me know is it ok to include those urls or not
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 01-31-2008, 10:47 AM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
Page worked for me this time.

Well, it does have some content. It's really up to you. Google is likely going to find this content anyway.

Allow me to suggest the following for efficiency purposes:

If you can find software that will generate the sitemap for these URLs easily, then go ahead and add it. If, however, there is nothing currently available, or the process would be labor intensive/time consuming then don't do it.

In scenario II (i.e. don't do it), just keep an eye on how well these pages get indexed naturally, and if they pull any traffic for you.

If you are having trouble getting them crawled/indexed, then perhaps it might be best *at that stage* to make the effort to get the sitemap updated to include these gaming URLs too.

Quote:
Who`s round, green and slimy? You are. Grannies, skateboarders, slime and cherries. Mmmm yum. Dodge the ice-cream carts and bombs and see how far you can grow.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 01-31-2008, 10:59 AM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
i find an easy way to get all the urls from the mysql in 1 minute ... but there is maybe another problem i put every game in the forum too ... if you compare those two links you will see that the text is the same ... thats why i waiting for you

2a = forum: Slime Ball - Spletne Igre
2b = game: Spletne Igre
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 01-31-2008, 11:06 AM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
Well, in that case, stick with the game listings in the forum only, and use robots.txt to block the others.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #10  
Old 01-31-2008, 11:16 AM
Senior Member
 
Real Name: Samo
Join Date: Jan 2006
Location: Slovenia
Posts: 118
thank you - i will stick with forum then

ok what i done so far is that i block members / show posts in robots.txt and remove them from sitemap generator and fixed stuff in vbseocp ... i lost about 7.000 links ... i hope im doing right that way ... i hope google will like me more coz now im on #6 position on first page for my main keyword and i dont wannt lose it ... any more sugestions?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #11  
Old 01-31-2008, 02:36 PM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,748
Blog Entries: 7
One would expect that improving your SEO and removing redundant pages should help you to maintain or improve your existing ranking keywords. Keep us posted.
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Tags
error, google, sitemap, webmaster tools

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Google Webmaster tools- crawl rate JADM General Discussion 11 01-11-2008 06:26 PM
Google webmaster tools - Network Uncreachable OnR Türkçe 1 08-22-2007 06:15 AM
Google Webmaster Tools OnR Türkçe 2 07-12-2007 12:42 PM
Weird entry in Google webmaster tools. Dave Hybrid General Discussion 5 05-30-2007 11:45 AM
Google Webmaster Tools - Matt Cutts Video Joe Ward SEO Buzz 2 11-01-2006 02:33 AM


All times are GMT -4. The time now is 12:38 AM.


Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.