vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.

Results 1 to 6 of 6

How Many Spiders...?

This is a discussion on How Many Spiders...? within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Hello Gang Just a quick one to see what kind of spider activitie you are getting to your websites. Its ...

  1. #1
    Member
    Join Date
    Oct 2005
    Posts
    46

    How Many Spiders...?

    Hello Gang

    Just a quick one to see what kind of spider activitie you are getting to your websites.

    Its 9pm here (UK) so still 3 hours to go till midnight, but my spider log looks like this:

    Googlebot: 594
    Yahoo: 1,481
    MSNBot: 129
    Others: 249

    Total: 2,453

    Is this good? bad? normal?

    Anything i can do to get google up? msn up? or are these acceptible?

    Thanks

    Paul

  2. #2
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147

    Re: How Many Spiders...?

    It can vary, and it also depends on how many URLs you have in your sitemap.

    Here's a screenshot of my bot activity log from back in February:

    http://www.vbseo.com/attachments/f84...f?d=1139980171

  3. #3
    Member
    Join Date
    Oct 2005
    Posts
    46

    Re: How Many Spiders...?

    Wow!!

    And i thought i had a lot

    Thanks Keith.

  4. #4
    Senior Member Brandon Sheley's Avatar
    Real Name
    Brandon Sheley
    Join Date
    Oct 2005
    Location
    Kansas
    Posts
    2,208
    Blog Entries
    1

    Re: How Many Spiders...?

    more backlinks would help, I'd think.
    Are you on Twitter? @BrandonSheley | Social Media blog
    Latest projects: General Forums | TopekaTweetup

  5. #5
    Senior Member Sonnie's Avatar
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    208

    Re: How Many Spiders...?

    Keith, how can I see that type of log on my site?

  6. #6
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147

    Re: How Many Spiders...?

    Sonnie,

    You need vBSEO (which you already have), and you need the free vBSEO Sitemap Generator plugin (vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.5.x & vBulletin 3.0.x - vBulletin.org Forum).

    In your vBSEO Control Panel, turn on the option to log spiders. Then you can access that report from the vBSEO Sitemap menu.

Similar Threads

  1. Forumjump drop down menu followed by spiders?
    By dutchbb in forum vBSEO Features Archive
    Replies: 5
    Last Post: 05-13-2007, 10:33 AM
  2. weeks after google spiders, still old pages in SERPs
    By Scott Mueller in forum General Discussion
    Replies: 4
    Last Post: 04-24-2006, 06:02 PM
  3. increasing yahoo slurp spiders
    By MentaL in forum General Discussion
    Replies: 0
    Last Post: 01-20-2006, 12:08 AM
  4. Yahoo only spiders external.php
    By caliman in forum General Discussion
    Replies: 2
    Last Post: 12-03-2005, 03:42 PM
  5. Question about spiders.
    By K4n4Dian-H4x0r in forum Off-Topic & Chit Chat
    Replies: 8
    Last Post: 11-17-2005, 11:08 AM