.htaccess & Robot.txt..Help Plz

Hi. Can someone please guide me how to setup the right setting for .htaccess & Robot.txt? Cuase I'm very confused and I don't know what to do in there.

Hello Carlos ,

The only modification you can do to your .htaccess is to redirect domain.com to www.domain.com or vice versa. You can check the following thread for more information how to do it [How to] Setup www.yourdomain.com or yourdomain.com (www vs. non-www) - With .htaccess 301 redirects

You can additionally use the following robots.txt file

Code:

#ALL BOTS
User-agent: *

Disallow: /forums/subscriptions/
Disallow: /forums/customavatars/
Disallow: /forums/customprofilepics/
Disallow: /forums/announcement.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/faq.php
Disallow: /forums/frm_attach
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/payment_gateway.php
Disallow: /forums/payments.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/showpost.php
Disallow: /forums/subscription.php
Disallow: /forums/usercp.php
Disallow: /forums/threadrate.php
Disallow: /forums/usernote.php

Sitemap: http://xbox360union.com/forums/sitemap_index.xml.gz

I just realized that most of your forum sections are closed to guests. If guests cannot access those threads , bots cannot access also which means they cannot index those sections.Thats why i strongly advise you to open those sections to guest access.

Okay, thank you so much

You're welcome