Robot Text Do I need it?

I'm sorry I'm new to this. Do I need a robot text file? It seems that the one I have is blocking lots of my posts out. Is there a generic robot text I should use? also what area of my site does the file go?

Thanks

also can you have a look at my site and tell me some tips if any? I have been working hard at membership and it has not really paid off so far!

PhotoChimper

this is my current

Code:

User-agent: *
Disallow: /administrator/
Disallow: /moderator/
Disallow: /cgi-bin/
Disallow: /clientscript/
Disallow: /includes/
Disallow: /install/
Disallow: /sitemap/
Disallow: /tags/
Disallow: /members/
Disallow: /stats/
Disallow: /nextsteps/
User-agent: *
Disallow: /printthread.php
Disallow: /subscription.php
Disallow: /payments.php
Disallow: /profile.php
Disallow: /faq.php
Disallow: /calendar.php
Disallow: /private.php
Disallow: /sendmessage.php
Disallow: /sendmessage.php?do=
Disallow: /showgroups.php
Disallow: /reputation.php
Disallow: /report.php
Disallow: /threadrate.php
Disallow: /postings.php
Disallow: /profile.php
Disallow: /newthread.php
Disallow: /search.php
Disallow: /newreply.php
Disallow: /register.php
Disallow: /login.php
Disallow: /faq.php
Disallow: /image.php
Disallow: /cron.php
Disallow: /joinrequests.php
Disallow: /usercp.php
Disallow: /vbseocp.php
Disallow: /credits.php
Disallow: /infraction.php

fyi, you don't need two user-agent: * rules
and the 2nd rule of sendmessage is redundant.

i use the following (forum in root)

Code:

User-agent: ia_archiver
Allow: /


User-agent: Slurp
Crawl-delay: 60


User-agent: *

Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /faq.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /payments.php
Disallow: /showpost.php
Disallow: /showgroups.php
Disallow: /spiders.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
Disallow: /admincp/
Disallow: /cgi-bin/
Disallow: /includes/
Disallow: /install/
Disallow: /modcp/
Disallow: /customavatars/
Disallow: /archive/
Disallow: /gallery/misc.php
Disallow: /gallery/ecard.php


Sitemap: http://mydomain.com/sitemap_index.xml.gz