Results 1 to 8 of 8

New sitemap problem...

This is a discussion on New sitemap problem... within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I'm getting this error... URL restricted by robots.txt We encountered an error while trying to access your Sitemap. Please ensure ...

  1. #1
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times

    Unhappy New sitemap problem...

    I'm getting this error...

    URL restricted by robots.txt
    We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

    I resubmitted and got the same error.

    This is the sitemap URL I submitted:
    http://www.jdmuniverse.com/forums/sitemap_index.xml.gz

    Here is my robots.txt:

    User-agent: Mediapartners-Google*
    Disallow:
    # Allow Archiver
    User-agent: ia_archiver
    Allow: /
    User-agent: Slurp
    Crawl-delay: 60

    User-agent: *

    Disallow: /forums/ajax.php
    Disallow: /forums/attachment.php
    Disallow: /forums/calendar.php
    Disallow: /forums/cron.php
    Disallow: /forums/editpost.php
    Disallow: /forums/global.php
    Disallow: /forums/image.php
    Disallow: /forums/faq.php
    Disallow: /forums/inlinemod.php
    Disallow: /forums/joinrequests.php
    Disallow: /forums/login.php
    Disallow: /forums/misc.php
    Disallow: /forums/moderator.php
    Disallow: /forums/newattachment.php
    Disallow: /forums/newreply.php
    Disallow: /forums/newthread.php
    Disallow: /forums/online.php
    Disallow: /forums/poll.php
    Disallow: /forums/postings.php
    Disallow: /forums/printthread.php
    Disallow: /forums/private.php
    Disallow: /forums/profile.php
    Disallow: /forums/register.php
    Disallow: /forums/report.php
    Disallow: /forums/reputation.php
    Disallow: /forums/search.php
    Disallow: /forums/sendmessage.php
    Disallow: /forums/payments.php
    Disallow: /forums/showpost.php
    Disallow: /forums/showgroups.php
    Disallow: /forums/spiders.php
    Disallow: /forums/subscription.php
    Disallow: /forums/threadrate.php
    Disallow: /forums/usercp.php
    Disallow: /forums/usernote.php
    Disallow: /forums/admincp/
    Disallow: /cgi-bin/
    Disallow: /forums/includes/
    Disallow: /forums/install/
    Disallow: /forums/modcp/
    Disallow: /customavatars/
    Disallow: /forums/xmlrpc.php
    Disallow: /forums/archive/
    Disallow: /forums/sitemap/
    Disallow: /forums/gallery/member.php
    Disallow: /forums/gallery/showgallery.php?cat=
    Disallow: /forums/gallery/showgallery.php?limit=
    Disallow: /forums/gallery/comshow.php
    Disallow: /forums/gallery/search.php
    Disallow: /forums/gallery/*search.php
    Disallow: /forums/gallery/showframe.php
    Disallow: /forums/gallery/slideshow.php
    Disallow: /forums/gallery/*limit
    Disallow: /forums/gallery/*ppuser
    Disallow: /forums/gallery/*views
    Disallow: /forums/gallery/*date
    Disallow: /forums/gallery/*recent
    Disallow: /forums/gallery/*in
    Sitemap: http://www.jdmuniverse.com/forums/sitemap_index.xml.gz


    Any idea what's wrong? :(

    Miguel

  2. #2
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    Double Post.

  3. #3
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    Wow, I just used a robots.txt generator to allow all engines and I still get the error :(

    Here's my new robots.txt

    # robots.txt generated at International SEO | SEM | PPC - McAnerin International Inc.
    User-agent: *
    Disallow:
    Disallow: /cgi-bin/
    Disallow: /forums/ajax.php
    Disallow: /forums/attachment.php
    Disallow: /forums/calendar.php
    Disallow: /forums/cron.php
    Disallow: /forums/editpost.php
    Disallow: /forums/global.php
    Disallow: /forums/image.php
    Disallow: /forums/faq.php
    Disallow: /forums/inlinemod.php
    Disallow: /forums/joinrequests.php
    Disallow: /forums/login.php
    Disallow: /forums/misc.php
    Disallow: /forums/moderator.php
    Disallow: /forums/newattachment.php
    Disallow: /forums/newreply.php
    Disallow: /forums/newthread.php
    Disallow: /forums/online.php
    Disallow: /forums/poll.php
    Disallow: /forums/postings.php
    Disallow: /forums/printthread.php
    Disallow: /forums/private.php
    Disallow: /forums/profile.php
    Disallow: /forums/register.php
    Disallow: /forums/report.php
    Disallow: /forums/reputation.php
    Disallow: /forums/search.php
    Disallow: /forums/sendmessage.php
    Disallow: /forums/payments.php
    Disallow: /forums/showpost.php
    Disallow: /forums/showgroups.php
    Disallow: /forums/spiders.php
    Disallow: /forums/subscription.php
    Disallow: /forums/threadrate.php
    Disallow: /forums/usercp.php
    Disallow: /forums/usernote.php
    Disallow: /forums/admincp/
    Disallow: /cgi-bin/
    Disallow: /forums/includes/
    Disallow: /forums/install/
    Disallow: /forums/modcp/
    Disallow: /customavatars/
    Disallow: /forums/xmlrpc.php
    Disallow: /forums/archive/
    Disallow: /forums/sitemap/
    Disallow: /forums/gallery/member.php
    Disallow: /forums/gallery/showgallery.php?cat=
    Disallow: /forums/gallery/showgallery.php?limit=
    Disallow: /forums/gallery/comshow.php
    Disallow: /forums/gallery/search.php
    Disallow: /forums/gallery/*search.php
    Disallow: /forums/gallery/showframe.php
    Disallow: /forums/gallery/slideshow.php
    Disallow: /forums/gallery/*limit
    Disallow: /forums/gallery/*ppuser
    Disallow: /forums/gallery/*views
    Disallow: /forums/gallery/*date
    Disallow: /forums/gallery/*recent
    Disallow: /forums/gallery/*in
    Sitemap: http://www.jdmuniverse.com/forums/sitemap_index.xml.gz


    What on Earth could be the problem?

    Miguel

  4. #4
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    I just completely deleted robots.txt and I still get this error when trying to submit my sitemap!

    URL restricted by robots.txt
    We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

    Miguel

  5. #5
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    get rid of the blank disallow at the top.

  6. #6
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    Now I used Google's robots.txt generator and made a file with only this:

    User-Agent: *
    Allow: /


    I still get the same error. This is killing me.

    Miguel

  7. #7
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    I even added allows for all googles bots... :( Same error.

    # robots.txt generated at International SEO | SEM | PPC - McAnerin International Inc.
    User-agent: *
    User-Agent: *
    Allow: /
    User-Agent: Mediapartners-Google
    Allow: /
    User-Agent: Googlebot
    Allow: /
    User-Agent: Adsbot-Google
    Allow: /
    User-Agent: Googlebot-Image
    Allow: /
    User-Agent: Googlebot-Mobile
    Allow: /
    Disallow: /cgi-bin/
    Disallow: /forums/ajax.php
    Disallow: /forums/attachment.php
    Disallow: /forums/calendar.php
    Disallow: /forums/cron.php
    Disallow: /forums/editpost.php
    Disallow: /forums/global.php
    Disallow: /forums/image.php
    Disallow: /forums/faq.php
    Disallow: /forums/inlinemod.php
    Disallow: /forums/joinrequests.php
    Disallow: /forums/login.php
    Disallow: /forums/misc.php
    Disallow: /forums/moderator.php
    Disallow: /forums/newattachment.php
    Disallow: /forums/newreply.php
    Disallow: /forums/newthread.php
    Disallow: /forums/online.php
    Disallow: /forums/poll.php
    Disallow: /forums/postings.php
    Disallow: /forums/printthread.php
    Disallow: /forums/private.php
    Disallow: /forums/profile.php
    Disallow: /forums/register.php
    Disallow: /forums/report.php
    Disallow: /forums/reputation.php
    Disallow: /forums/search.php
    Disallow: /forums/sendmessage.php
    Disallow: /forums/payments.php
    Disallow: /forums/showpost.php
    Disallow: /forums/showgroups.php
    Disallow: /forums/spiders.php
    Disallow: /forums/subscription.php
    Disallow: /forums/threadrate.php
    Disallow: /forums/usercp.php
    Disallow: /forums/usernote.php
    Disallow: /forums/admincp/
    Disallow: /forums/includes/
    Disallow: /forums/install/
    Disallow: /forums/modcp/
    Disallow: /customavatars/
    Disallow: /forums/xmlrpc.php
    Disallow: /forums/archive/
    Disallow: /forums/sitemap/
    Disallow: /forums/gallery/member.php
    Disallow: /forums/gallery/showgallery.php?cat=
    Disallow: /forums/gallery/showgallery.php?limit=
    Disallow: /forums/gallery/comshow.php
    Disallow: /forums/gallery/search.php
    Disallow: /forums/gallery/*search.php
    Disallow: /forums/gallery/showframe.php
    Disallow: /forums/gallery/slideshow.php
    Disallow: /forums/gallery/*limit
    Disallow: /forums/gallery/*ppuser
    Disallow: /forums/gallery/*views
    Disallow: /forums/gallery/*date
    Disallow: /forums/gallery/*recent
    Disallow: /forums/gallery/*in
    Sitemap: http://www.jdmuniverse.com/forums/sitemap_index.xml.gz

  8. #8
    Member SIINSI's Avatar
    Real Name
    Miguel Diaz
    Join Date
    Sep 2008
    Location
    Palm Coast, FL
    Posts
    74
    Liked
    0 times
    OK, when I go into tools of G's site and click analyze robots.txt, it still shows the file in the first post. It says last downloaded 14 hours ago. I guess I have to wait until it DL's it again. Hopefully then I can submit my sitemap.

    Miguel

Similar Threads

  1. Sitemap Problem... Please help me...
    By MorYeL in forum Troubleshooting
    Replies: 3
    Last Post: 04-19-2008, 07:02 PM
  2. Sitemap Problem
    By sokorelis in forum Troubleshooting
    Replies: 13
    Last Post: 02-22-2008, 01:49 PM
  3. Sitemap-Problem
    By fide in forum Deutsch
    Replies: 28
    Last Post: 12-21-2007, 06:36 AM
  4. Problem with Sitemap!
    By MUAHHH in forum Troubleshooting
    Replies: 7
    Last Post: 05-03-2007, 05:36 AM
  5. Sitemap problem
    By vargrider in forum General Discussion
    Replies: 3
    Last Post: 05-17-2006, 07:38 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •