vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 11 of 11

Sitemap 2.1 - google webmaster tools

This is a discussion on Sitemap 2.1 - google webmaster tools within the General Discussion forums, part of the vBulletin SEO Discussion category; Couple fo questions 1. what do you think is it good to disable member profile in sitemap and in robots.txt? ...

  1. 01-29-2008 03:06 PM #1
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118

    Sitemap 2.1 - google webmaster tools

    Couple fo questions
    1. what do you think is it good to disable member profile in sitemap and in robots.txt? Because i have duplicate title tags in webmaster tools - Spletne Igre - Members List - 172

    2. how can i add links from games like this hxtp://www.spletne-igre.com/forum/arcade/game/1619.html to sitemap ... i know i can use extra-urls.txt but i have more then 1.300 games and add manually every link to extra-urls.txt is a lot of work

    3. i finnaly checked webmaster tools on google and i see i have some errors
    hxtp://www.spletne-igre.com/forum/arcade/category-4/0.html,4xx error,"Jan 21, 2008"
    hxtp://www.spletne-igre.com/forum/members/applianceshoes.html,4xx error,"Jan 21, 2008"
    hxtp://www.spletne-igre.com/forum/a/,404 (Not found),"Jan 26, 2008"
    hxtp://www.spletne-igre.com/forum/526-post1.html,Network unreachable,"Jan 13, 2008"
    hxtp://www.spletne-igre.com/forum/calendar.php,URL restricted by robots.txt,"Jan 26, 2008"
    hxtp://www.spletne-igre.com/forum/index.php/register.php,URL restricted by robots.txt,"Jan 24, 2008"
    hxtp://www.spletne-igre.com/forum/index.php/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008"
    hxtp://www.spletne-igre.com/forum/index.php/sitemap/sitemap/register.php,URL restricted by robots.txt,"Jan 24, 2008"
    hxtp://www.spletne-igre.com/forum/memberlist.php,URL restricted by robots.txt,"Jan 16, 2008"
    hxtp://www.spletne-igre.com/forum/private.php,URL restricted by robots.txt,"Jan 26, 2008"
    hxtp://www.spletne-igre.com/forum/register.php,URL restricted by robots.txt,"Jan 24, 2008"
    hxtp://www.spletne-igre.com/forum/search.php,URL restricted by robots.txt,"Jan 23, 2008"
    hxtp://www.spletne-igre.com/forum/showgroups.php,URL restricted by robots.txt,"Jan 25, 2008"
    can someone tell me whay i get those errors?

    4. thank you for answers and help
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  2. 01-30-2008 06:28 PM #2
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118
    can anyone answer please?
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  3. 01-30-2008 10:09 PM #3
    Joe Ward
    Joe Ward is offline
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,847
    Blog Entries
    9
    1. Personally I do prefer to disable member profiles since I advocate focusing the search engines attention on core content within the threads and other valuable content pages on your site.

    vBSEO founder Juan Muriente has, however, provided an excellent argument as to why vBulletin member profile pages have SEO benefit. See also here.

    If you do decide to block member profile pages, you can do it with robots.txt for further redundancy.

    However, vBSEO supports the following rel=nofollow features within your vBSEO Control Panel (vbseocp.php):

    Add rel="nofollow" to Links pointing TO Member Profiles FROM Postbit
    Enable this option to prevent search engines from following links to member profiles found in posts.

    Add rel="nofollow" to Links pointing TO Member Profiles FROM Forumhome
    Enable this option to prevent search engines from following links to member profiles found in your Forum Homepage.
    2. If you can find alternative software to generate a sitemap for your games, you can copy/paste them into extra-urls.txt.

    You can also create a separate sitemap for that content and include its location in your robots.txt file. See here for discussion.

    3. Eliminating the robots.txt related entries, it seems you have very few errors. You should consider extracting those and either creating a support ticket or a new post for feedback on the remaining few errors from tech support.

    4. You are welcome. Apologies for the delay.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  4. 01-31-2008 12:04 AM #4
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118
    1. i blocked them and i have rel="nofollow" from the start:P
    2. i get all the urls from the database but have another question ... is it worth to put them in sitemap because can you check both bottom url and you will see that there is the same text but different page
    2a = forum: Slime Ball - Spletne Igre
    2b = game: Spletne Igre

    what do you think to put the game url in sitemap or not?

    3. will send a ticket
    4. thank you again for all answers
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  5. 01-31-2008 09:36 AM #5
    Joe Ward
    Joe Ward is offline
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,847
    Blog Entries
    9
    If the content is unique and valuable to your theme, then you should consider including it. If its along the same level of quality as member profile pages, then that is up to you to decide how you want to handle it.

    Note: The 2nd URL gave me a cookie error, but I have cookies enabled in my browser.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  6. 01-31-2008 09:44 AM #6
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118
    can you visit again and if you again get this error about cookie please just refresh and you will see tha whole page ... and then let me know is it ok to include those urls or not
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  7. 01-31-2008 09:47 AM #7
    Joe Ward
    Joe Ward is offline
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,847
    Blog Entries
    9
    Page worked for me this time.

    Well, it does have some content. It's really up to you. Google is likely going to find this content anyway.

    Allow me to suggest the following for efficiency purposes:

    If you can find software that will generate the sitemap for these URLs easily, then go ahead and add it. If, however, there is nothing currently available, or the process would be labor intensive/time consuming then don't do it.

    In scenario II (i.e. don't do it), just keep an eye on how well these pages get indexed naturally, and if they pull any traffic for you.

    If you are having trouble getting them crawled/indexed, then perhaps it might be best *at that stage* to make the effort to get the sitemap updated to include these gaming URLs too.

    Who`s round, green and slimy? You are. Grannies, skateboarders, slime and cherries. Mmmm yum. Dodge the ice-cream carts and bombs and see how far you can grow.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  8. 01-31-2008 09:59 AM #8
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118
    i find an easy way to get all the urls from the mysql in 1 minute ... but there is maybe another problem i put every game in the forum too ... if you compare those two links you will see that the text is the same ... thats why i waiting for you

    2a = forum: Slime Ball - Spletne Igre
    2b = game: Spletne Igre
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  9. 01-31-2008 10:06 AM #9
    Joe Ward
    Joe Ward is offline
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,847
    Blog Entries
    9
    Well, in that case, stick with the game listings in the forum only, and use robots.txt to block the others.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  10. 01-31-2008 10:16 AM #10
    mljask
    mljask is offline
    Senior Member
    Real Name
    Samo
    Join Date
    Jan 2006
    Location
    Slovenia
    Posts
    118
    thank you - i will stick with forum then

    ok what i done so far is that i block members / show posts in robots.txt and remove them from sitemap generator and fixed stuff in vbseocp ... i lost about 7.000 links ... i hope im doing right that way ... i hope google will like me more coz now im on #6 position on first page for my main keyword and i dont wannt lose it ... any more sugestions?
    Igre / Best 1st Games
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  11. 01-31-2008 01:36 PM #11
    Joe Ward
    Joe Ward is offline
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,847
    Blog Entries
    9
    One would expect that improving your SEO and removing redundant pages should help you to maintain or improve your existing ranking keywords. Keep us posted.
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
« Just a few questions. | robots.txt and 301 issue »

Similar Threads

  1. Google Webmaster tools- crawl rate
    By JADM in forum General Discussion
    Replies: 11
    Last Post: 01-11-2008, 05:26 PM
  2. Google webmaster tools - Network Uncreachable
    By OnR in forum Türkçe
    Replies: 1
    Last Post: 08-22-2007, 05:15 AM
  3. Google Webmaster Tools
    By OnR in forum Türkçe
    Replies: 2
    Last Post: 07-12-2007, 11:42 AM
  4. Weird entry in Google webmaster tools.
    By Dave Hybrid in forum General Discussion
    Replies: 5
    Last Post: 05-30-2007, 10:45 AM
  5. Google Webmaster Tools - Matt Cutts Video
    By Joe Ward in forum General Discussion
    Replies: 2
    Last Post: 11-01-2006, 01:33 AM

Tags for this Thread