The allow: / is usually not needed. This should suffice:
Code:User-Agent: * Disallow: /sitemap/ Disallow: /archive/
This is a discussion on Problems metadescripciones within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; The allow: / is usually not needed. This should suffice: Code: User-Agent: * Disallow: /sitemap/ Disallow: /archive/...
The allow: / is usually not needed. This should suffice:
Code:User-Agent: * Disallow: /sitemap/ Disallow: /archive/
This does not???????
User-Agent: *
Allow: /
Yes, it's not needed usually. Because the bots will crawl your whole site (/) by default. And you would only need to specify which pages to block (via Disallow: ) specifically.
So, the Allow: / is kinda redundant.
You can keep it in place if you want, though.
CORRECT THIS OPTION?
User-Agent: *
Disallow: / sitemap /
Disallow: / archive /
THANK YOU FOR YOUR HELP
no spaces... and no leading slash.
User-Agent: *
Disallow: sitemap/
Disallow: archive/
file needs to be in root.
so if your fourm is in /forums, you need to address as:
User-Agent: *
Disallow: forums/sitemap/
Disallow: forums/archive/
IN httpdocs / robots.txt
the problem is still more
it will take a few days for webmasters to update.
updated every day, watching the image capture
http://www.vbseo.com/attachments/f44...nes-dibujo.jpg
It still includes old found issues as well. You should click the details to find out if there are recent entries reported.
Oleg Ignatiuk / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Yesterday, the day 8 / 2009 duplicate metadescripciones 1425
Today 9 / 2009 duplicate metadescripciones 1671
There's a bit of a problem with the language barrier here.
Fernando, I'll attempt to help you over at the spanish forums. Please continue the discussion via this thread:
http://www.vbseo.com/f81/metadescrip...licadas-31923/
Juan Muriente / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!