Had a look in Google webmaster tools today (been a while since I last looked) and found 'Crawl rate' under 'Setting' (last time I looked this was grayed out).
So I've put the crawl rate up 100% too 1 request every second (rather than 1 every 2 seconds which is default). I'm guesssing results should start appearing twice as fast now, right?
Obviously I'll be keeping an eye on server resources, but if it is negligiable would a higher crawl rate be preferable?


LinkBack URL
About LinkBacks





Reply With Quote
