Page 1 of 2 1 2 LastLast
Results 1 to 15 of 18

what's happen with SE Bots Activity Log

This is a discussion on what's happen with SE Bots Activity Log within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; The situation was 2 or 3 per day that number of crawled pagea restarted to 0 in SE Bots activity ...

  1. #1
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times

    Angry what's happen with SE Bots Activity Log

    The situation was 2 or 3 per day that number of crawled pagea restarted to 0 in SE Bots activity Log. Exactly yesterday and today . Today when i saw this report about 7 am there was about 5000 crawled page but on 10:35 am there was restart once ( as i see in the downloaded sitemap report, the last downloaded today was about 10:25 am ) . Is this something wrong here in this Log . Detail in the picture

    googlebotactivity.jpg

  2. #2
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    can anybody help me on this ???

  3. #3
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    DO you have multiple webservers? there's no good reason why it should restart on any given day.

  4. #4
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    No, i have only 1 webserver. Yesterday it restart 3 . I don't know why but i fell that after every downloading sitemap, it restarted. is this bad for my website ?
    one more question : i have not included showpost in sitemap but in webmaster tool it still inform about crawl error in sitemap with showpost ???

  5. #5
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    It can't just delete by itself.... some process or task or human has to be interfering with it.
    It really has no bearing on seo though, as it's just a log file for you.


    @showpost, are you using the permalink option? if so, they are correct to 404.

  6. #6
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    thanks Brian. I don't know do i exactly understand your reply. do you mean that :
    1. Log file Se bots activity is only a report and eventhought it has a change ( restarting ) it will not cause problem on SEO ?
    2. if i am using the permalink option, there will be generate in webmaster tools account in crawl error section 404 errors ?

  7. #7
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    1) correct. That file just logs bot hits. If it's restarting, or never even existing, the bot still visited your site. The log of their activity is just in correct. You may have date issues or something with your server clock that may be causing this.

    2) yes, as showpost effectively no longer exists. This is normal and expected. In time, all of those 404s will remove themselves from the webmasters area.

  8. #8
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    thanks Brians
    1. Resolved but still don't know what's reason make the logs restarts. I've checked time on server and it is correct. But not important what is the reason. Important is that does not cause problem on SEO

    2. OK it mean that i have to wait to eliminate this errors from webmaster tools. But i'm still worry because there is a lot of errors that google crawled and 3/4 of this are errors on showpost. You can see detail in the picture
    crawlerrors.jpg
    i submited about 60.000 url, there is information in webmaster tools that urls indexed in website : 11,684 and errors about 25.000
    I have one more question because i still don't understand this thing. I got information in webmaster tools about numbr of url indexed ( 11,684 ) but when i try to check via site:forum.tech24.vn on google.com.vn there was onlye 3000 result. Do you know what is the reason

  9. #9
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Make sure you aren't including showpost urls (or archive) in your sitemap options as well. Otherwise, there's nothing to worry about. This is normal after installing vbseo..... It cleans up all the duplicate urls. 1 link to 1 resource.

  10. #10
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    ok thank you Brian. Showposts are not included in sitemap

  11. #11
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    great! just keep an on on your websmaters area, and you should see the 404s slowly drop out.

  12. #12
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    Brian i have one more question maybe will post here. Could you give me some ideo on this ?
    i submited about 60.000 url, there is information in webmaster tools that urls indexed in website : 11,684 and errors about 25.000
    I have one more question because i still don't understand this thing. I got information in webmaster tools about numbr of url indexed ( 11,684 ) but when i try to check via site:forum.tech24.vn on google.com.vn there was onlye 3000 result. Do you know what is the reason

  13. #13
    vBSEO Staff Marco Mamdouh's Avatar
    Real Name
    Marco Mamdouh
    Join Date
    May 2010
    Location
    Egypt
    Posts
    3,143
    Liked
    110 times
    Quote Originally Posted by hoinqbsg View Post
    Brian i have one more question maybe will post here. Could you give me some ideo on this ?
    i submited about 60.000 url, there is information in webmaster tools that urls indexed in website : 11,684 and errors about 25.000
    I have one more question because i still don't understand this thing. I got information in webmaster tools about numbr of url indexed ( 11,684 ) but when i try to check via site:forum.tech24.vn on google.com.vn there was onlye 3000 result. Do you know what is the reason
    site:domain.com command is not accurate : i loss my Topics In Google

  14. #14
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    webmaster tools will only account for and show the urls that are in your sitemap.
    using a site: command will display any url with your domain in it that may be old, duplicate, dead, or otherwise. Plus, the site: command is known to be inaccurate.

  15. #15
    Junior Member
    Real Name
    ngo quoc hoi
    Join Date
    Jun 2010
    Posts
    14
    Liked
    0 times
    ok thanks you. So can you tell me how can i see how many url from my website are indexed in google because through GWT i can see only url in sitemap are indexed but don't have information about what are these indexed url.

Page 1 of 2 1 2 LastLast

Similar Threads

  1. SE Bots Activity Log ?
    By susanarend3 in forum General Discussion
    Replies: 1
    Last Post: 05-01-2009, 04:21 AM
  2. SE Bots Activity Log
    By tobebest in forum General Discussion
    Replies: 3
    Last Post: 04-14-2009, 01:35 AM
  3. SE Bots Activity Log!!!!!!!!!
    By lovelyrose3003 in forum Troubleshooting
    Replies: 7
    Last Post: 08-15-2008, 08:22 AM
  4. SE Bots Activity
    By 7ayr.net in forum General Discussion
    Replies: 11
    Last Post: 12-04-2007, 09:49 AM
  5. SE Bots Activity Log
    By Itworx4me in forum Troubleshooting
    Replies: 12
    Last Post: 11-26-2006, 01:29 PM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •