Bot report with specific pages.

If it`s not too much. How about dispaying specific pages in the bot report instead of showthread, forumdisplay, index etc ?

To make it userfriendly, you could have links on each of the numbers in the current report. Those links will display specific pages for that file (ie. showthread.php) and engine.

Currently Sitemap Generator stores only summary info per "page type" and doesn't keep details on every request for performance reasons.

For big forums se bot hits number may easily reach (tens of) thousands and it would be too much to include all of them in reports (and not much of use also)

It will make sense when creating some kind of "site crawling coverage" reports, i.e. the number of unique pages crawled per se, but for the moment it is out of Sitemap Hack scope.

If you don`t have the data, I understand why you won`t.

Thanks,
Haakon

I agree, i mean my forum isnt that popular yet it attaining 5,000+ bot requests from Google and MSN alike since the start of the month, leading to a huge increase in server activity to have to record all this information.