Hello,
we still have ~400 Yahoo Bots online at our site, which generally spoken is a good thing.
Even with their new Bot recently relaunched we have that many bots online.
But the performance impact is noticable, so we think of placing a crawl delay for the bot in our robots.txt, see:
Yahoo! Help -
We think of
Will that do any harm SEO-wise?Code:User-agent: Slurp Crawl-delay: 5
Will it help reducing the queries of Y Bot to reduce our server's load?
I guess so...
Thanks,
Lian


LinkBack URL
About LinkBacks





Reply With Quote