SEO

Hi There
i was looking at my SE Bots Activity Details today and i noticed that Googlebot still crawling members

member.php (Googlebot show 445,yahoo show172)
faq.php (Googlebot 12)
also i found ia_archiver and mediapartners

so how can i keep GoogleBot away from member.php,faq.php
and also ia_archiver
should i add this to robots.txt?

for members i have nofollow

robots.txt will work.

__________________
Joe Ward / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

thanx Joe Ward
if i prevent googlebot to visit member profile googlebot will crawl threads more...
right?

Yes - that's correct. If you eliminate large amounts of content, then it allows Googlebot to focus on the remaining threads.

__________________
Joe Ward / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Here is some feedback on Juan related to keeping member profiles open to search engines:
Disable the Printable version to avoid duplicate?

I weighted in briefly here:
Quality of the crawl

__________________
Joe Ward / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.