Results 1 to 5 of 5

Custom Search Engines?

This is a discussion on Custom Search Engines? within the Sitemap Features Archive forums, part of the vBulletin Links & Resources category; Any way to let us define our own custom search engines that will be broken out of the "Other" grouping?...

  1. #1
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    13 times

    Custom Search Engines?

    Any way to let us define our own custom search engines that will be broken out of the "Other" grouping?

  2. #2
    vBSEO Staff Juan Muriente's Avatar
    Real Name
    Juan Carlos Muriente
    Join Date
    Jun 2005
    Location
    Puerto Rico
    Posts
    14,266
    Liked
    586 times
    To extract the robots data from those consolidated in the "Others" column, do the following:

    In the vbseo_sitemap/index.php file:
    FIND:
    Code:
     
    $main_bots_list = array(
    'Googlebot', 'Yahoo', 'msnbot'
    );
    and add the desired bots to the list.

    Currently supported robots are:
    appie, msnbot, jeeves,googlebot, mediapartners, harvest, htdig, yahoo, linkwalker, lycos_, scooter, ia_ archiver, netcraft

  3. #3
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    13 times
    Is there any way we can add additional ones? I assume vbSEO would have to support it too. Maybe a central custom config file that vbSEO and vbSEO sitemap both will look at, where we can add the user agent of any spider we wish to track?

  4. #4
    Senior Member
    Real Name
    Philipp Herbers
    Join Date
    Sep 2005
    Location
    Meppen, Germany
    Posts
    8,436
    Liked
    0 times
    Good idea

    I'm sure that the Pre-Release Team will love to test it :d

  5. #5
    vBSEO Staff Juan Muriente's Avatar
    Real Name
    Juan Carlos Muriente
    Join Date
    Jun 2005
    Location
    Puerto Rico
    Posts
    14,266
    Liked
    586 times
    /* NOTE: This feature has been adopted and will be included in vBSEO 2.4.1*/

    A new option for defining additional robots will be available via the config file

Similar Threads

  1. Search phrase selection
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 09:57 AM
  2. Techniques that are used to fool search engines
    By rob in forum Member Articles
    Replies: 0
    Last Post: 02-08-2006, 04:22 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •