Good problem to have with yahoo slurp

ok, but where do you limit the slurps?

In robots.txt, for example, look in http://tntu.net/robots.txt

Code:

User-agent: Slurp
Crawl-delay: 240

You may want to try 60 for a few days, then 120, the only thing that reduced 30-40 slurp agents to the current 9 was using a crawl delay of 240.

I'll start with a delay of 60. Let's see what happens.

uh oh... yahoo slurp presence decreased, but today I couldn't see googlebot not google adsense crawling.

Plus, the sitemap stats are showing that googlebot indexed just 4 pages in the last 24 hours, from an average of 45K.

I'll remove that line.

Edit: Google Webmaster says:

We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

I believe that my robots.txt was the reason.