vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 6 of 6

How Many Spiders...?

This is a discussion on How Many Spiders...? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Hello Gang Just a quick one to see what kind of spider activitie you are getting to your websites. Its ...

  1. 04-19-2006 03:53 PM #1
    Paul Govier
    Paul Govier is offline
    Member
    Join Date
    Oct 2005
    Posts
    46

    How Many Spiders...?

    Hello Gang

    Just a quick one to see what kind of spider activitie you are getting to your websites.

    Its 9pm here (UK) so still 3 hours to go till midnight, but my spider log looks like this:

    Googlebot: 594
    Yahoo: 1,481
    MSNBot: 129
    Others: 249

    Total: 2,453

    Is this good? bad? normal?

    Anything i can do to get google up? msn up? or are these acceptible?

    Thanks

    Paul
    Paul Govier

    Http://www.uk-muscle.co.uk
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  2. 04-19-2006 03:56 PM #2
    Keith Cohen
    Keith Cohen is offline
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147

    Re: How Many Spiders...?

    It can vary, and it also depends on how many URLs you have in your sitemap.

    Here's a screenshot of my bot activity log from back in February:

    http://www.vbseo.com/attachments/f84...f?d=1139980171
    My Blog | GPS Discussion Forum
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  3. 04-19-2006 03:59 PM #3
    Paul Govier
    Paul Govier is offline
    Member
    Join Date
    Oct 2005
    Posts
    46

    Re: How Many Spiders...?

    Wow!!

    And i thought i had a lot

    Thanks Keith.
    Paul Govier

    Http://www.uk-muscle.co.uk
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  4. 04-20-2006 01:31 AM #4
    Brandon Sheley
    Brandon Sheley is offline
    Senior Member Brandon Sheley's Avatar
    Real Name
    Brandon Sheley
    Join Date
    Oct 2005
    Location
    Kansas
    Posts
    2,208
    Blog Entries
    1
    Send a message via AIM to Brandon Sheley Send a message via MSN to Brandon Sheley Send a message via Yahoo to Brandon Sheley

    Re: How Many Spiders...?

    more backlinks would help, I'd think.
    Are you on Twitter? @BrandonSheley | Social Media blog
    Latest projects: General Forums | TopekaTweetup
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  5. 05-18-2006 04:22 PM #5
    Sonnie
    Sonnie is offline
    Senior Member Sonnie's Avatar
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    208

    Re: How Many Spiders...?

    Keith, how can I see that type of log on my site?
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
  6. 05-18-2006 04:44 PM #6
    Keith Cohen
    Keith Cohen is offline
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147

    Re: How Many Spiders...?

    Sonnie,

    You need vBSEO (which you already have), and you need the free vBSEO Sitemap Generator plugin (vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.5.x & vBulletin 3.0.x - vBulletin.org Forum).

    In your vBSEO Control Panel, turn on the option to log spiders. Then you can access that report from the vBSEO Sitemap menu.
    My Blog | GPS Discussion Forum
    Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
    Reply With Quote Reply With Quote  
« Sitemap problem | Understanding Spiders, vBSEO, and Sitemap »

Similar Threads

  1. Forumjump drop down menu followed by spiders?
    By dutchbb in forum vBSEO Features Archive
    Replies: 5
    Last Post: 05-13-2007, 10:33 AM
  2. weeks after google spiders, still old pages in SERPs
    By Scott Mueller in forum General Discussion
    Replies: 4
    Last Post: 04-24-2006, 06:02 PM
  3. increasing yahoo slurp spiders
    By MentaL in forum General Discussion
    Replies: 0
    Last Post: 01-20-2006, 12:08 AM
  4. Yahoo only spiders external.php
    By caliman in forum General Discussion
    Replies: 2
    Last Post: 12-03-2005, 03:42 PM
  5. Question about spiders.
    By K4n4Dian-H4x0r in forum Off-Topic & Chit Chat
    Replies: 8
    Last Post: 11-17-2005, 11:08 AM