hey, i need some advice
how you block Bad Bots and Spiders , also
someone knows how Honey Pot works?
or what you do for fighting against bad crawlers?
Wget Spider is a bad bot?
This is a discussion on How to defend our sites within the General Discussion forums, part of the vBulletin SEO Discussion category; hey, i need some advice how you block Bad Bots and Spiders , also someone knows how Honey Pot works? ...
hey, i need some advice
how you block Bad Bots and Spiders , also
someone knows how Honey Pot works?
or what you do for fighting against bad crawlers?
Wget Spider is a bad bot?
You can block by IP range or by mime-header of the bot name it self. It's a lot of trail and error. There's many articles on the net about these things, so just run a simple search for terms like 'block *spidernamehere*'
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!