Results 1 to 7 of 7

Only Google Bot in Download Logs?

This is a discussion on Only Google Bot in Download Logs? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Hi, Im my Download Logs, there are only Goolge Bot records. There is no Yahoo or Bing records? Is this ...

  1. #1
    Member
    Real Name
    Dinh Thanh
    Join Date
    Sep 2010
    Posts
    93
    Liked
    21 times

    Only Google Bot in Download Logs?

    Hi,

    Im my Download Logs, there are only Goolge Bot records. There is no Yahoo or Bing records? Is this an issue?

    I tried to submit sitemap_index.xml.gz manually to Bing/Yahoo, but there is no change.

  2. #2
    Senior Member webmastersitesi's Avatar
    Join Date
    Oct 2007
    Posts
    518
    Liked
    16 times
    Blog Entries
    3
    Maybe your server firewall, or mod security blocks the ips from bing or yahoo. Are you able to see the bots in the main forum?

  3. #3
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    In order for Bing to track properly, a file edit needs to be made to the core vbseo software. This will ship with the next vbseo version.

    functions_vbseo_pre.php around line 143

    find:

    Code:
    define('VBSEO_ROBOTS_LIST', 'appie|msnbot|jeeves|googlebot|mediapartners|harvest|htdig|yahoo|linkwalker|lycos_|scooter|ia_archiver|netcraft' . (VBSEO_EXTRA_ROBOTS?'|' . VBSEO_EXTRA_ROBOTS:''));
    replace with

    Code:
    define('VBSEO_ROBOTS_LIST', 'appie|msnbot|bingbot|jeeves|googlebot|mediapartners|harvest|htdig|yahoo|linkwalker|lycos_|scooter|ia_archiver|netcraft' . (VBSEO_EXTRA_ROBOTS?'|' . VBSEO_EXTRA_ROBOTS:''));
    Last edited by Brian Cummiskey; 11-15-2010 at 06:29 PM.
    Brian Cummiskey / Crawlability Inc.
    Security vbulletin - Patch Level for all supported versions released!

    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  4. #4
    Member
    Real Name
    Dinh Thanh
    Join Date
    Sep 2010
    Posts
    93
    Liked
    21 times
    @webmastersitesi
    I checked, there is no firewall setup in my site.

    @Brian
    Thanks! And how about Yahoo?
    I can see yahoo in this list. But there is no yahoo record in the Download logs (But many pages was downloaded by Yahoo in SE Bots Activity Details).

  5. #5
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    yahoo is bing-powered now. it is not uncommon to not see yahoo any more.

  6. #6
    Member
    Real Name
    Dinh Thanh
    Join Date
    Sep 2010
    Posts
    93
    Liked
    21 times
    After manually submit the sitemap to Bing/Webmaster Sitemap, I found some blank records in Download Logs with these Ips:

    65.54.247.142
    65.54.247.146
    65.54.247.147

    These IPs are from Microsoft.

  7. #7
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    If it was before the bot was added to the list, it makes sense.

Similar Threads

  1. Deleting Sitemap Download Logs
    By Lazer in forum General Discussion
    Replies: 4
    Last Post: 02-28-2010, 05:00 AM
  2. Sitemap Download Logs Error When Deleting
    By winjstar in forum Troubleshooting
    Replies: 1
    Last Post: 11-22-2009, 12:28 AM
  3. Google does not download
    By barbaro in forum General Discussion
    Replies: 7
    Last Post: 02-19-2009, 06:40 PM
  4. 2000 pages of Sitemap Download Logs!
    By GlitterKill in forum Troubleshooting
    Replies: 1
    Last Post: 05-04-2007, 01:31 AM
  5. Show 404 errors "Sitemap file not found" in Download Logs
    By Lian in forum Sitemap Features Archive
    Replies: 1
    Last Post: 07-25-2006, 06:44 AM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •