all forum has restricted by robots.txt !

[mountainboarder21]

Hi dears

after changing robots.txt according [How To] Completely Turn Off the vBulletin Archive

I have errors in https://www.google.com/webmasters/tools/

and for resubmit http://forum.dehcadeh.com/sitemap_index.xml.gz

I see URL restricted by robots.txt message!

too, in Webmaster Tools --->Web crawl errors ---> URLs restricted by robots.txt

http://forum.dehcadeh.com/



forumhome restricted by robots.txt !!!

my robots.txt is like this :

# Allow Archiver
User-agent: ia_archiver
Allow: /


User-agent: Slurp
Crawl-delay: 60


User-agent: *
Disallow: *.js
Disallow: *.jsp
Disallow: *.cfm
Disallow: *.asp
Disallow: *.aspx
Disallow: *.cgi
Disallow: /usercp.php
Disallow: /calendar.php
Disallow: /search.php
Disallow: /online.php
Disallow: /album.php
Disallow: /profile.php
Disallow: /subscription.php
Disallow: /member.php?u=
Disallow: /register.php
Disallow: /printthread.php
Disallow: /sendmessage.php
Disallow: /post
Disallow: /showthread.php?p=
Disallow: /showthread.php?mode=
Disallow: /showthread.php?goto=newpost
Disallow: /?nojs=
Disallow: /announcements
Disallow: /misc.php?do=whoposted&t=
Disallow: /newthread.php?do=newthread&f=
Disallow: /newreply.php?do=newreply&p=
Disallow: /editpost.php?do=editpost&p=
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /faq.php
Disallow: /private.php
Disallow: /admincp/
Disallow: /modcp/
Disallow: /includes/
Disallow: /install/
Disallow: /customavatars/
Disallow: /archive/
Disallow: /sitemap/

Sitemap: http://forum.dehcadeh.com/sitemap_index.xml.gz

Is thit problem for Disallow: /sitemap/ ?

thanks for guidance

[Oleg Ignatiuk]

Hello,

your robots.txt looks good to me, I just checked it with Google's "Analyze robots.txt" tool as well and your forums home is reported as "allowed" by it.

[mountainboarder21]

thanks Oleg Ignatiuk

ok

why I have error in sitemap google webmaster and can't resubmit sitemap to google webmaster ?

[Oleg Ignatiuk]

What exactly is the error message? Can you post a screenshot?

[briansol]

Disallow: /?nojs=

might be the culprtit.

I would remove that rule and try again.