vBulletin Search Engine Optimization
This is a discussion on Sitemap 2.1 - google webmaster tools within the General Discussion forums, part of the vBulletin SEO Discussion category; Couple fo questions 1. what do you think is it good to disable member profile in sitemap and in robots.txt? ...
| |||||||
Enhancing 80 million pages. | Register | FAQ | Members List | Social Groups | Calendar | Search | Today's Posts | Mark Forums Read |
|
#1
| |||
| |||
| Sitemap 2.1 - google webmaster tools
Couple fo questions 1. what do you think is it good to disable member profile in sitemap and in robots.txt? Because i have duplicate title tags in webmaster tools - Spletne Igre - Members List - 172 2. how can i add links from games like this hxtp://www.spletne-igre.com/forum/arcade/game/1619.html to sitemap ... i know i can use extra-urls.txt but i have more then 1.300 games and add manually every link to extra-urls.txt is a lot of work 3. i finnaly checked webmaster tools on google and i see i have some errors hxtp://www.spletne-igre.com/forum/arcade/category-4/0.html,4xx error,"Jan 21, 2008" hxtp://www.spletne-igre.com/forum/members/applianceshoes.html,4xx error,"Jan 21, 2008" hxtp://www.spletne-igre.com/forum/a/,404 (Not found),"Jan 26, 2008" hxtp://www.spletne-igre.com/forum/526-post1.html,Network unreachable,"Jan 13, 2008" hxtp://www.spletne-igre.com/forum/calendar.php,URL restricted by robots.txt,"Jan 26, 2008" hxtp://www.spletne-igre.com/forum/index.php/register.php,URL restricted by robots.txt,"Jan 24, 2008" hxtp://www.spletne-igre.com/forum/index.php/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008" hxtp://www.spletne-igre.com/forum/index.php/sitemap/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008" hxtp://www.spletne-igre.com/forum/memberlist.php,URL restricted by robots.txt,"Jan 16, 2008" hxtp://www.spletne-igre.com/forum/private.php,URL restricted by robots.txt,"Jan 26, 2008" hxtp://www.spletne-igre.com/forum/register.php,URL restricted by robots.txt,"Jan 24, 2008" hxtp://www.spletne-igre.com/forum/search.php,URL restricted by robots.txt,"Jan 23, 2008" hxtp://www.spletne-igre.com/forum/showgroups.php,URL restricted by robots.txt,"Jan 25, 2008" can someone tell me whay i get those errors? 4. thank you for answers and help |
|
#2
| |||
| |||
|
can anyone answer please?
|
|
#3
| ||||
| ||||
|
1. Personally I do prefer to disable member profiles since I advocate focusing the search engines attention on core content within the threads and other valuable content pages on your site. vBSEO founder Juan Muriente has, however, provided an excellent argument as to why vBulletin member profile pages have SEO benefit. See also here. If you do decide to block member profile pages, you can do it with robots.txt for further redundancy. However, vBSEO supports the following rel=nofollow features within your vBSEO Control Panel (vbseocp.php): Quote:
You can also create a separate sitemap for that content and include its location in your robots.txt file. See here for discussion. 3. Eliminating the robots.txt related entries, it seems you have very few errors. You should consider extracting those and either creating a support ticket or a new post for feedback on the remaining few errors from tech support. 4. You are welcome. Apologies for the delay.
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#4
| |||
| |||
|
1. i blocked them 2. i get all the urls from the database but have another question ... is it worth to put them in sitemap because can you check both bottom url and you will see that there is the same text but different page 2a = forum: Slime Ball - Spletne Igre 2b = game: Spletne Igre what do you think to put the game url in sitemap or not? 3. will send a ticket 4. thank you again for all answers |
|
#5
| ||||
| ||||
|
If the content is unique and valuable to your theme, then you should consider including it. If its along the same level of quality as member profile pages, then that is up to you to decide how you want to handle it. Note: The 2nd URL gave me a cookie error, but I have cookies enabled in my browser.
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#6
| |||
| |||
|
can you visit again and if you again get this error about cookie please just refresh and you will see tha whole page ... and then let me know is it ok to include those urls or not
|
|
#7
| ||||
| ||||
|
Page worked for me this time. Well, it does have some content. It's really up to you. Google is likely going to find this content anyway. Allow me to suggest the following for efficiency purposes: If you can find software that will generate the sitemap for these URLs easily, then go ahead and add it. If, however, there is nothing currently available, or the process would be labor intensive/time consuming then don't do it. In scenario II (i.e. don't do it), just keep an eye on how well these pages get indexed naturally, and if they pull any traffic for you. If you are having trouble getting them crawled/indexed, then perhaps it might be best *at that stage* to make the effort to get the sitemap updated to include these gaming URLs too. Quote:
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#8
| |||
| |||
|
i find an easy way to get all the urls from the mysql in 1 minute 2a = forum: Slime Ball - Spletne Igre 2b = game: Spletne Igre |
|
#9
| ||||
| ||||
|
Well, in that case, stick with the game listings in the forum only, and use robots.txt to block the others.
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#10
| |||
| |||
|
thank you - i will stick with forum then ok what i done so far is that i block members / show posts in robots.txt and remove them from sitemap generator and fixed stuff in vbseocp ... i lost about 7.000 links ... i hope im doing right that way ... i hope google will like me more coz now im on #6 position on first page for my main keyword and i dont wannt lose it ... any more sugestions? |
|
#11
| ||||
| ||||
|
One would expect that improving your SEO and removing redundant pages should help you to maintain or improve your existing ranking keywords. Keep us posted.
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
| Tags |
| error, google, sitemap, webmaster tools |
| Thread Tools | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Google Webmaster tools- crawl rate | JADM | General Discussion | 11 | 01-11-2008 06:26 PM |
| Google webmaster tools - Network Uncreachable | OnR | Türkçe | 1 | 08-22-2007 06:15 AM |
| Google Webmaster Tools | OnR | Türkçe | 2 | 07-12-2007 12:42 PM |
| Weird entry in Google webmaster tools. | Dave Hybrid | General Discussion | 5 | 05-30-2007 11:45 AM |
| Google Webmaster Tools - Matt Cutts Video | Joe Ward | SEO Buzz | 2 | 11-01-2006 02:33 AM |