robots.txt

Hey - I posted the URL then changed my mind, I would like to keep it private... I'm sending it in a PM.

Thanks

Hello everyone,
I am also here to ask a standard configuration file of the robot. txt to VB Suite 4.+ Vbseo
I understand that each site has its own rules, but there will be a robot.txt which has optimized the rules and apply to everyone, then everyone will do his changes.

Thanks to all

Tutorial how to make a good robots.txt file

tis is my roborts.txt file

PHP Code:

User-agent: *
Disallow: forum/printthread
Disallow: forum/send message
Disallow: forum/register
Disallow: forum/login
Disallow: forum/new reply
Disallow: forum/subscription
Disallow: forum/private
Disallow: forum/misc
Disallow: forum/show post
Disallow: forum/report
Disallow: forum/new thread
Disallow: forum/calendar
Disallow: forum/poll
Disallow: forum/links
Disallow: forum/arcade
Disallow: forum/member list
Disallow: forum/members
Disallow: forum/search
Disallow: forum/FAQ
Disallow: forum/online
Disallow: forum/vb shout 
Disallow: forum/calendar.php
Disallow: forum/editpost.php
Disallow: forum/member.php
Disallow: forum/memberlist.php
Disallow: forum/misc.php
Disallow: forum/newreply.php
Disallow: forum/newthread.php
Disallow: forum/printthread.php
Disallow: forum/private.php
Disallow: forum/register.php
Disallow: forum/report.php
Disallow: forum/search.php
Disallow: forum/showgroups.php
Disallow: forum/usercp.php
Disallow: forum/impressum.php
Disallow: forum/admincp/
Disallow: forum/modcp/
Disallow: forum/online.php
Disallow: forum/subscription.php
Disallow: forum/sendtofriend.php
Disallow: forum/threadrate.php
Disallow: forum/poll.php
Disallow: forum/attachment.php
Disallow: forum/avatar.php
Disallow: forum/faq.php
Disallow: forum/usercp.php
Disallow: forum/profile.php 
Disallow: forum/http://www.webgozar.com/counter/stats.aspx?code=1645495
Disallow: forum/online.php
Disallow: forum/cv_rss_feeds.php
Disallow: forum/showgroups.php
Disallow: forum/admincp
Disallow: forum/modcp
Disallow: forum/usercp.php
Disallow: forum/calendar.php
Disallow: forum/faq.php
Disallow: forum/search.php
Disallow: forum/members/albums.html
Disallow: forum/groups
Disallow: forum/#
Disallow: forum/private.php
Disallow: forum/profile.php
Disallow: forum/clientscript
Disallow: forum/cpstyles
Disallow: forum/customavatars
Disallow: forum/customgroupicons
Disallow: forum/customprofilepics
Disallow: forum/htaccess
Disallow: forum/images
Disallow: forum/includes
Disallow: forum/signaturepics
Disallow: forum/infobar.css
Disallow: forum/login.php
Disallow: forum/ajax.php
Disallow: forum/attachment.php
Disallow: forum/calendar.php
Disallow: forum/cron.php
Disallow: forum/editpost.php
Disallow: forum/global.php
Disallow: forum/image.php
Disallow: forum/inlinemod.php
Disallow: forum/joinrequests.php
Disallow: forum/login.php
Disallow: forum/member.php
Disallow: forum/memberlist.php
Disallow: forum/misc.php
Disallow: forum/moderator.php
Disallow: forum/newattachment.php
Disallow: forum/newreply.php
Disallow: forum/newthread.php
Disallow: forum/online.php
Disallow: forum/poll.php
Disallow: forum/postings.php
Disallow: forum/printthread.php
Disallow: forum/private.php
Disallow: forum/profile.php
Disallow: forum/register.php
Disallow: forum/report.php
Disallow: forum/reputation.php
Disallow: forum/search.php
Disallow: forum/sendmessage.php
Disallow: forum/showgroups.php
Disallow: forum/subscription.php
Disallow: forum/threadrate.php
Disallow: forum/usercp.php
Disallow: forum/usernote.php
Disallow: forum/arcade.php
Disallow: forum/ajax.php
Disallow: forum/attachment.php
Disallow: forum/calendar.php
Disallow: forum/cron.php
Disallow: forum/editpost.php
Disallow: forum/global.php
Disallow: forum/image.php
Disallow: forum/inlinemod.php
Disallow: forum/joinrequests.php
Disallow: forum/login.php
Disallow: forum/member.php
Disallow: forum/memberlist.php
Disallow: forum/misc.php
Disallow: forum/moderator.php
Disallow: forum/newattachment.php
Disallow: forum/newreply.php
Disallow: forum/newthread.php
Disallow: forum/online.php
Disallow: forum/poll.php
Disallow: forum/postings.php
Disallow: forum/printthread.php
Disallow: forum/private.php
Disallow: forum/profile.php
Disallow: forum/register.php
Disallow: forum/report.php
Disallow: forum/reputation.php
Disallow: forum/search.php
Disallow: forum/sendmessage.php
Disallow: forum/showgroups.php
Disallow: forum/subscription.php
Disallow: forum/threadrate.php
Disallow: forum/usercp.php
Disallow: forum/usernote.php 
Disallow: forum/clientscript/
Disallow: forum/includes/
Disallow: forum/install/
Disallow: forum/cron.php
Disallow: forum/global.php
Disallow: forum/inlinemod.php
Disallow: forum/joinrequests.php
Disallow: forum/calendar.php
Disallow: forum/editpost.php
Disallow: forum/login.php
Disallow: forum/member.php
Disallow: forum/memberlist.php
Disallow: forum/misc.php
Disallow: forum/moderator.php
Disallow: forum/newreply.php
Disallow: forum/newthread.php
Disallow: forum/printthread.php
Disallow: forum/private.php
Disallow: forum/register.php
Disallow: forum/report.php
Disallow: forum/search.php
Disallow: forum/showgroups.php
Disallow: forum/usercp.php
Disallow: forum/impressum.php
Disallow: forum/admincp/
Disallow: forum/modcp/
Disallow: forum/online.php
Disallow: forum/subscription.php
Disallow: forum/sendtofriend.php
Disallow: forum/sendmessage.php
Disallow: forum/spiders.php
Disallow: forum/subscription.php
Disallow: forum/threadrate.php
Disallow: forum/poll.php
Disallow: forum/attachment.php
Disallow: forum/avatar.php
Disallow: forum/faq.php
Disallow: forum/usercp.php
Disallow: forum/usernote.php
Disallow: forum/profile.php
Disallow: forum/vbseocp.php
Disallow: forum/disclaimer.php
Disallow: forum/billspaypal.php
Disallow: forum/privacy.html
Disallow: forum/customavatars/
Disallow: forum/xmlrpc.php
Disallow: forum/archive/
Disallow: forum/sitemap/
Disallow: forum/cgi-bin/
Disallow: blog/wp-admin
Disallow: blog/http://www.parstools.com
Disallow: blog/http://www.webgozar.com/counter/stats.aspx?code=1582674
Disallow: blog/login.php


User-agent: Mediapartners-Google
Allow: /
 
User-agent: Adsbot-Google
Allow: /
 
User-agent: Googlebot-Image
Allow: /
 
User-agent: Googlebot-Mobile
Allow: /
 
User-agent: ia_archiver-web.archive.org
Disallow: /
 
Sitemap: http://www.mohadese.com/forum/sitemap.xml 


Originally Posted by ashkan 261

tis is my roborts.txt file

Hello,

I'm not seeing a license assigned to your account. If you purchased vBSEO and you still haven't received access to downloads area, please open a support ticket with your forum URL and payment ID, so we can assign your license to your account.