remove url from site_map (block search engine bots to access url)

Is there a way to remove 2 urls from site_map or block 2 urls in robots.txt (or any other advice)

From Webmaster tools:

member.php?username='%5BNemanjA 503 error Apr 27, 2011

member.php?username='Tobijas%22 503 error May 1, 2011

Because of this i am getting errors from MySQL


Invalid SQL: SELECT postid FROM forumpost WHERE username=''[NemanjA'; MySQL Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '[NemanjA'' at line 3 Error Number : 1064 Request Date : Monday, May 9th 2011 @ 07:43:17 AM Error Date : Monday, May 9th 2011 @ 07:43:17 AM Script : URL Referrer : IP Address : 66.249.68.71 Username : '[NemanjA Classname : vB_Database MySQL Version :


Invalid SQL: SELECT postid FROM forumpost WHERE username=''Tobijas"'; MySQL Error : You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'Tobijas"'' at line 3 Error Number : 1064 Request Date : Monday, May 9th 2011 @ 03:31:39 AM Error Date : Monday, May 9th 2011 @ 03:31:39 AM Script : URL Referrer : IP Address : 66.249.68.71 Username : 'Tobijas" Classname : vB_Database MySQL Version :


Please advise

member.php urls should not be in the sitemap at all, as they should be something like members/name/ instead

You can block member.php in robots.txt safely.

Hello Brian,

Thank you for fast reply.

My current robots.txt is :

User-agent: Mediapartners-Google*
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /newthread.php
Disallow: /newreply.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showpost.php
Disallow: /external.php


Friend of mine use this:
User-agent: *
Disallow: /admincp/
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /images/
Disallow: /modcp/
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

Should i use his version?

After i change robots.txt, what should i do to fix this?
Do i need to re-submit anything?

Thanks,
D

Tutorial how to make a good robots.txt file - vBulletin SEO Forums


There is nothing to re-submit.

Thanks Brian.

So, after i fix my robots.txt i don't have to do anything else?
Search Bots will stop accessing that url ?

Regards

it won't be immediate, but yes, member.php should start to show up under 'restricted by robots.txt' instead of the current 404 area

Great !

Thank you so much for helping me out.

Best regards