robots.txt with vbSEO?

I was just wondering if the contents of our robots.txt should be changed due to rewritten URL's from vbSEO. Here are the partial contents of my robots.txt:

Code:

Disallow: /forum/admincp/
Disallow: /cgi-bin/
Disallow: /forum/clientscript/
Disallow: /forum/includes/
Disallow: /forum/install/
Disallow: /forum/modcp/
Disallow: /forum/printthread.php
Disallow: /forum/subscription.php
Disallow: /forum/payments.php
Disallow: /forum/profile.php
Disallow: /forum/faq.php
Disallow: /forum/calendar.php
Disallow: /forum/private.php
Disallow: /forum/sendmessage.php
Disallow: /forum/sendmessage.php?do=
Disallow: /forum/showgroups.php
Disallow: /forum/reputation.php
Disallow: /forum/report.php
Disallow: /forum/threadrate.php
Disallow: /forum/postings.php
Disallow: /forum/newthread.php
Disallow: /forum/newreply.php
Disallow: /forum/register.php
Disallow: /forum/login.php
Disallow: /forum/image.php
Disallow: /forum/cron.php
Disallow: /forum/joinrequests.php
Disallow: /forum/usercp.php

However, the printthread.php isn't really used since vbSEO is rewriting those pages, so should there be a different entry in this file to "block" SE's from visiting them?

You should turn off rewriting for print thread URLs, then you can block them via robots.txt.

Got an easy site: query to check to see what is already indexed as far as print threads?

site:www.reefland.com/forum/printthread.php - Google Search

looks like you have 12 pages, if thats remotely accurate.

either way, you don't want them indexed... you want your REAL content indexed (and the real content has ads on it :P )

Originally Posted by Keith Cohen

You should turn off rewriting for print thread URLs, then you can block them via robots.txt.

Isn't "Add rel="nofollow" to the Printthread links?" good enough?

Originally Posted by magnus

Isn't "Add rel="nofollow" to the Printthread links?" good enough?

Not really. Not all search engines pay attention to that (even Google ignores it at times).