Robots file and the rewritten urls....

Does it still work to say showthread.php since the urls do not have showthread.php in them?

Hi,

nope, these entries are applied to the original dynamic vB URLs only and vBSEO URLs are not affected by this.

Originally Posted by Oleg Ignatiuk

Hi,

nope, these entries are applied to the original dynamic vBulletin URLs only and vBSEO URLs are not affected by this.

So how do I go about restricting all the files I want to like showpost and private.php etc etc?

That depends on your URL formats, robots.txt entries should be aimed to the links your forum is using.
private.php is not rewritten though, for instance (and you can keep it as is).

You could turn off re-writing for the ShowPost URLs, then showpost.php in the robots.txt would work. That's what I do. Plus, it's that much less load on the server since all those links on each thread page don't have to be rewritten.

Do you have to put the /forum in front or just /printthread.php?

/forum/printthread.php
or
/printthread.php

If it's in the forum directory, you'll need the full path.

You can also set the "'Printthread' URL Format" to:

print/[forum_title]/[thread_id]-[thread_title].html

and then the entry in robots.txt will be:
Disallow: /forum/print/

Thanks to both of you

Here is my new file:

User-agent: *
Disallow: /forum/admincp/
Disallow: /cgi-bin/
Disallow: /forum/clientscript/
Disallow: /forum/includes/
Disallow: /forum/install/
Disallow: /gallery/showmembers.php
Disallow: /gallery/misc.php
Disallow: /gallery/comments.php?
Disallow: /forum/modcp/
Disallow: /forum/subscriptions/
Disallow: /forum/calendar.php
Disallow: /forum/cron.php
Disallow: /forum/editpost.php
Disallow: /forum/faq.php
Disallow: /forum/global.php
Disallow: /forum/image.php
Disallow: /forum/joinrequests.php
Disallow: /forum/login.php
Disallow: /forum/misc.php
Disallow: /forum/moderator.php
Disallow: /forum/newattachment.php
Disallow: /forum/newreply.php
Disallow: /forum/new-thread/
Disallow: /forum/online/
Disallow: /forum/payments.php
Disallow: /forum/postings.php
Disallow: /forum/print/
Disallow: /forum/private-messages/
Disallow: /forum/register/
Disallow: /forum/report.php
Disallow: /forum/reputation.php
Disallow: /forum/sendmessage.php
Disallow: /forum/member-groups/
Disallow: /forum/profile/
Disallow: /forum/showpost.php
Disallow: /forum/threadrate.php
Disallow: /forum/control-panel/