Can someone more knowledgeable than I take a look at my robots.txt and let me know if it's ok as is or if there's something that should be changed....
I am running vb, vbportal, photopost gallery, photopost reviews, vb blog. The robots.txt was part of the vbportal install i believe that I updated for showpost and sitemap as read on this forum.
What I dont understand is why the gallery and reviews sections are being disallowed?
Thank you in advance for your help!
# Allow Archiver
User-agent: ia_archiver
Allow: /
User-agent: *
Disallow: /cgi-bin/
Disallow: /forums/admincp/
Disallow: /forums/clientscript/
Disallow: /forums/cpstyles/
Disallow: /forums/customavatars/
Disallow: /forums/dlm/
Disallow: /forums/images/
Disallow: /forums/includes/
Disallow: /forums/install#/
Disallow: /forums/modcp/
Disallow: /forums/showpost.php
Disallow: /forums/subscriptions/
Disallow: /forums/themes/
Disallow: /To be removed/
Disallow: /XXpafaq/
Disallow: /amember/
Disallow: /banners/
Disallow: /cpdemo/
Disallow: /downloads/
Disallow: /gallery/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /modules/
Disallow: /portalcp/
Disallow: /ppclassifieds/
Disallow: /reviews/
Disallow: /store/
Disallow: /vbpinstall/
Disallow: /webalizer/
Disallow: banners.php
Disallow: footer.php
Disallow: global.php
Disallow: header.php
Disallow: mainfile.php
Disallow: user.php
Disallow: search.php
Disallow: modules.php
Disallow: articles.php
Disallow: external.php
Sitemap: http://www.mysite.com/forums/sitemap_index.xml.gz



LinkBack URL
About LinkBacks





Reply With Quote