add sitemap to robots.txt for autodiscovery

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.tld/sitemap.xml

http://www.ysearchblog.com/archives/000437.html


so like..... good to know, but how does effect us vbSEOers or the vbSEO sitemap mod? or better yet.. how can we take advantage of it.

nice find.

This is perfect for the vbseo sitemap.... simply add the link to it in the robots.txt file as stated:

Sitemap: http://www.example.tld/sitemap_index.xml.gz

Discussion here also: Robots.txt now support the sitemap file