Search Engine Bots Activity Log down a whole lot after 3.0 upgrade

I'm not sure if this is a bug or if search engines have nearly stopped indexing my site. I'm thinking the former. The Activity log shows a sharp drop after upgrading to 3.0.

Is there any spesific bots like bing yahoo not counted?

nope, they're all still being counted, but just significantly less.

Please ping your site via pingler.com and wait 2 more days we can be more sure it's stable lowered bot traffic. Then we can look SEO causes for it.

I don't think it's a bot crawling problem - I think there's something wrong in my installation of sitemap 3.0. In google webmaster tools there is no drop in crawl rate.

You might be right, i noticed a small bug recently discovered for not counting bing visits. I am not sure. If you open a support ticket they can help you more certainity.

I noticed something strange. The count actually went down. I think something is up with the file writing mechanism.

Make sure your files are chmodded correctly to be able to write to.

/data should be 777
downloads.dat should be 666

Ah, must've been the incorrect permissions on downloads.dat - fixed that, I think it's working now - thanks Brian.

The count is up more than it was before, but it's still a fraction of what it was before I upgraded. Any other thoughts?

Make sure you've added bing into the mix. This will ship with vbseo 3.6, but needs to be edited on 3.5.2 and lower to track bingbot.
see: Only Google Bot in Download Logs?

I'm seeing that the log file is being overwritten several times a day. I should note that the installed sitemap generator is a pre-release version. Was there a bug with this mechanism?

There are many changes in final. Please upgrade before troubleshooting further.

Originally Posted by tavenger5

The count is up more than it was before, but it's still a fraction of what it was before I upgraded. Any other thoughts?

Hello,
Do you solve your problem. I have feaced same problem for 3-4 days.
Do you use load balanced servers ? I think it is related with sync files between servers. BEcasue When I refresh bot activity log pages, numbers changes but sometimes decrease, somtimes increase. It is soo strange becaue, it looks like it changed only when I refresh report page. I think servers overwrite files. I have faced similar problem with sitemap genarator's sitemap files. when I look sitemap fıles from FTP client while they are genarating, I saw 3 sitemap files changes at the same time. I thought taht my 3 of servers run sitemap generators. and last sitemap generator session overwrite on others. And generally sitemap files are corrupted. (I solve this problem with run sitemap generator from command line / cron job)

So, I use glusterfs for file replication between my servers, Before I use NFS and store all off my files on my main server and other servers reache these files via NFS mount.

So I wonder how can I solve this problem
Any comment?

By the way I use VBseo 3.5.2 and Sitemap genarstor 3.0

The logs are no designed for multiple servers. it will write X file to whatever server it happens to hit at that moment.

ideally, you should move the sitemap to a single server, like your db server, and only let it run and track there.