robots.txt file - statisicon folder indexed

Hello

I have had bots scanning my statisicon folder and have been wondering why

I have had a look at what is indexed via Google by searching " site:crimecasefiles.com "
on the second page I have this indexed-
Index of /forum/images/skilltest/statusicon

Index of /forum/images/skilltest/statusicon. Parent Directory · announcement_new.gif · announcement_old.gif · forum_link.gif · forum_new.gif ...
crimecasefiles.com/forum/images/skilltest/statusicon/ -


For some reason this is the only "Index" I have indexed and want it not to be indexed.

How can I stop this? and why would it only be this folder indexed?


I have just added this robots.txt file

User-agent: *


Disallow: /arcade/
Disallow: /archive/
Disallow: /cgi-bin/
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /customavatars/
Disallow: /customgroupicons/
Disallow: /customprofilepics/
Disallow: /includes/
Disallow: /modcp/
Disallow: /packages/
Disallow: /signaturepics/
Disallow: /vb/
Disallow: /ajax.php
Disallow: /album.php
Disallow: /announcement.php
Disallow: /asset.php
Disallow: /assetmanage.php
Disallow: /attachment_inlinemod.php
Disallow: /blog_ajax.php
Disallow: /blog_external.php
Disallow: /blog_inlinemod.php
Disallow: /blog_report.php
Disallow: /blog_search.php
Disallow: /blog_subscription.php
Disallow: /blog_usercp.php
Disallow: /calendar.php
Disallow: /clear.gif
Disallow: /converse.php
Disallow: /cron.php
Disallow: /editor.php
Disallow: /editpost.php
Disallow: /external.php
Disallow: /faq.php
Disallow: /global.php
Disallow: /group_inlinemod.php
Disallow: /groupsubscription.php
Disallow: /infraction.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /list.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderation.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /payment_gateway.php
Disallow: /payments.php
Disallow: /picture.php
Disallow: /picture_inlinemod.php
Disallow: /picturecomment.php
Disallow: /posthistory.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /sendtofriend.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /threadtag.php
Disallow: /usercp.php
Disallow: /usernote.php
Disallow: /visitormessage.php
Disallow: /widget.php

It is located in my public_html/forum folder
Is this the right place for it? or should it go in my public_html folder which I would say is my root folder.?
I do have other subdirectorys in my public_html folder.

Any help would be great

I have had a big surge in bot activity mainly from msmbot / bing almost doubling by bandwidth usage up to 30GB per month. That is why I have added the robots file

Options -Indexes
in your htaccess file should clear this up. You may want to do it globally (root) or just in these folders if you wish

Thanks Brian,

I have never done anything to my htacess file, so if you could tell me what exactly to do it would be great

Here is what is in my htaccess file in my public_html/forum folder as my forum is a sub directory

Code:

RewriteEngine on
RewriteCond ${LeechProtect:/home/crimecas/public_html/forum:%{REMOTE_USER}:%{REMOTE_ADDR}:4} leech
RewriteRule .* www.google.com
# Comment the following line (add '#' at the beginning)
# to disable mod_rewrite functions.
# Please note: you still need to disable the hack in
# the vBSEO control panel to stop url rewrites.
# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root vB folder (i.e. RewriteBase /forums/)
#RewriteBase /
#RewriteCond %{HTTP_HOST} !^www\.yourdomain\.com
#RewriteRule (.*) http://www.yourdomain.com/forums/$1 [L,R=301]
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron)
RewriteRule ^((archive/)?(.*\.php(/.*)?)?)$ vbseo.php [L,QSA]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php [L,QSA]

I have a few files in my htaccess folder for my forum
this is what they are called

/public_html/forum/htaccess/htaccess.txt
/public_html/forum/htaccess/isapi_rewrite.txt
/public_html/forum/htaccess/isapi_rewrite2.txt
/public_html/forum/htaccess/lighttpd_rewrite.txt





/public_html/forum/htaccess/nginx.txt
/public_html/forum/htaccess/zeus_rewrite.txt


Is this correct?



This is my htaccess file that is located in my root folder

Code:

#RewriteEngine On
#RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

# BEGIN WordPress

# END WordPress


<Files 403.shtml>
order allow,deny
allow from all
</Files>

deny from 87.250.254.24

if you could give me an example I would appreciate it.

You should not have an /htaccess folder on your server at all.

/public_html/forum/.htaccess
is the only file that counts (on apache)


you can put Options -Indexes
as the very first line above
RewriteEngine on
in the forum folder htaccess file.