Any way to let us define our own custom search engines that will be broken out of the "Other" grouping?
This is a discussion on Custom Search Engines? within the Sitemap Features Archive forums, part of the vBulletin Links & Resources category; Any way to let us define our own custom search engines that will be broken out of the "Other" grouping?...
Any way to let us define our own custom search engines that will be broken out of the "Other" grouping?
To extract the robots data from those consolidated in the "Others" column, do the following:
In the vbseo_sitemap/index.php file:
FIND:
and add the desired bots to the list.Code:$main_bots_list = array( 'Googlebot', 'Yahoo', 'msnbot' );
Currently supported robots are:
appie, msnbot, jeeves,googlebot, mediapartners, harvest, htdig, yahoo, linkwalker, lycos_, scooter, ia_ archiver, netcraft
Juan Muriente / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Is there any way we can add additional ones? I assume vbSEO would have to support it too. Maybe a central custom config file that vbSEO and vbSEO sitemap both will look at, where we can add the user agent of any spider we wish to track?
Good idea
I'm sure that the Pre-Release Team will love to test it :d
/* NOTE: This feature has been adopted and will be included in vBSEO 2.4.1*/
A new option for defining additional robots will be available via the config file![]()
Juan Muriente / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!