We're noticing that some of our most important keywords are coming from users' postbits (i.e. #posts, location, join date, etc.). How do we go about adding this to robots.txt?
This is a discussion on How to block postbit data? within the General Discussion forums, part of the vBulletin SEO Discussion category; We're noticing that some of our most important keywords are coming from users' postbits (i.e. #posts, location, join date, etc.). ...
We're noticing that some of our most important keywords are coming from users' postbits (i.e. #posts, location, join date, etc.). How do we go about adding this to robots.txt?
Robots.txt can only block whole urls, not parts of pages.
This is common and there's really no fix for it.
Google Sitemap Keyword Relevance - vBulletin SEO Forums
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Brian,
Thanks. Understood.