Results 1 to 2 of 2

crawlers appending .html

This is a discussion on crawlers appending .html within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I noticed today that google and msn are appending .html when it's crawling my site. Has anyone seen this happen ...

  1. #1
    Junior Member
    Real Name
    mike
    Join Date
    Oct 2008
    Posts
    5
    Liked
    0 times

    crawlers appending .html

    I noticed today that google and msn are appending .html when it's crawling my site. Has anyone seen this happen before?

    The same day I noticed that I also realized my sitemap rewrite was not working correctly and all sitemaps submitted were submitted with a link that generated a 404.

    could the 2 problems be related?

  2. #2
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Did the bad urls contain .html extentions?

Similar Threads

  1. Crawlers not showing indiviual thread in search engine
    By S7rik3R in forum General Discussion
    Replies: 1
    Last Post: 07-10-2009, 03:52 PM
  2. Crawlers/Spider numbers question
    By ssandgirls in forum General Discussion
    Replies: 1
    Last Post: 02-05-2008, 09:44 AM
  3. bots and crawlers NOT working
    By Fragmaster in forum Troubleshooting
    Replies: 5
    Last Post: 08-29-2007, 01:08 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •