Dead on midnight yesterday my logs stopped filling and are now empty, no spiders are showing as having crawled any pages.
All my other log sources suggest crawl access is normal.
Would appreciate any advice.
This is a discussion on Spiders stopped being logged within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Dead on midnight yesterday my logs stopped filling and are now empty, no spiders are showing as having crawled any ...
Dead on midnight yesterday my logs stopped filling and are now empty, no spiders are showing as having crawled any pages.
All my other log sources suggest crawl access is normal.
Would appreciate any advice.
Last edited by Dave Hybrid; 07-10-2009 at 03:10 AM.
I've added a pic, I don't see how it can be anything i've done as it stops dead on midnight...
![]()
Hello ,
We are still on July 10 therefore the logs will updated when July 10 is completed
Mert Gökçeimam / Crawlability Inc.
vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!
Twitter:@Depkac
Personal Blog : Mert Gökçeimam
They used to update in real time as the bots crawled, not daily. I use this all day long and am 1000% it is not normally like this.
I deleted yesterdays text file log via ftp and it's all working now, must have been corrupt or something.
Thanks.
This is back and seems to be happening more frequent.
The logs fill up in real time, then just stop dead and all data disappears, deleting the days text file restarts it.
It's almost as the text file is being corrupted, so cannot be read/written to. Happening all day, i delete the file and it logs for a few hours, then stops.
Please advise on how to fix this please.
Thanks.
Are you running out of disk space? what about /tmp ? Those are the only logical explinations to me as to why this would stop working randomly throughout the day.
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Thanks Brain. The file is being corrupted afaik, so cannot be accessed, read or written to, the bot logs just goes blank, blank data in vbseo. If I download the days file it is empty, although it was filling up for hours before. If i delete the file, it restarts until next time. Disk space is fine.
Next time it stops writing, attach the log file here for review (even if its blank). there may be a rogue character in it somewhere.
Also, what is your wait_timeout setting?
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Here is the file and screen, as you can see yesterday stopped again after i went to bed...
Edit; Can't seem to attach the log file, regardless it is empty, 0 bytes, and contains no rogue characters.
Hello,
please try to modify functions_vbseo_seo.php file:
find:and replace with:if (file_exists($hfilename))
if (file_exists($hfilename) && (filesize($hfilename) > 0))
Oleg Ignatiuk / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!