Results 1 to 3 of 3

Disallow vbseo_sitemap

This is a discussion on Disallow vbseo_sitemap within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; What would happen if I disallowed the vbseo_sitemap folder? I'm getting a lot of crawl errors in GWT in the ...

  1. 07-30-2011 03:39 PM #1
    esther196
    esther196 is offline
    Member
    Real Name
    esther gastro
    Join Date
    Mar 2008
    Posts
    33
    Liked
    0 times

    Disallow vbseo_sitemap

    What would happen if I disallowed the vbseo_sitemap folder? I'm getting a lot of crawl errors in GWT in the vbseo_sitemap directory.

    Thanks.
    Reply With Quote Reply With Quote  
  2. 07-30-2011 04:32 PM #2
    Brian Cummiskey
    Brian Cummiskey is offline
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Nothing... all bots will see there is a login prompt. go ahead and block it.
    Brian Cummiskey / Crawlability Inc.
    Security vbulletin - Patch Level for all supported versions released!

    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
    Reply With Quote Reply With Quote  
  3. 08-01-2011 12:52 PM #3
    esther196
    esther196 is offline
    Member
    Real Name
    esther gastro
    Join Date
    Mar 2008
    Posts
    33
    Liked
    0 times
    thanks, i will add it to my robots.txt
    Reply With Quote Reply With Quote  
« SE Bots Activity Log | "Invalid Unicode value in one or more parameters" when using Social Bookmarking »

Similar Threads

  1. does it work? Disallow: /robots.txt
    By Julio in forum General Discussion
    Replies: 0
    Last Post: 04-20-2009, 12:32 PM
  2. Disallow vBulletin Blog?
    By Nikke23 in forum General Discussion
    Replies: 9
    Last Post: 12-19-2008, 07:42 AM
  3. Disallow Robots from Forum
    By Nuguru in forum General Discussion
    Replies: 3
    Last Post: 10-19-2008, 03:46 PM
  4. Disallow: newpost in robots.txt
    By mountainboarder21 in forum General Discussion
    Replies: 4
    Last Post: 10-08-2008, 04:16 PM
  5. Possible to use Disallow: /*?pp=10 in robots.txt?
    By PageUp in forum General Discussion
    Replies: 3
    Last Post: 11-03-2005, 09:01 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules