Hi All,
I logged into my adsense account and found out that the 'Robots.txt' is blocking visits. However, I am unable to find the robots.txt for the forums.
Where is it?
This is a discussion on Robots.txt for forums & vBSEO within the General Discussion forums, part of the vBulletin SEO Discussion category; Hi All, I logged into my adsense account and found out that the 'Robots.txt' is blocking visits. However, I am ...
Hi All,
I logged into my adsense account and found out that the 'Robots.txt' is blocking visits. However, I am unable to find the robots.txt for the forums.
Where is it?
vb/vbseo do not ship with this file. If you made one, it was made by yourself. it ONLY functions in your site root...
site.com/robots.txt
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
This is what I have: -
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
It stays at root url like sitename.com/robots.txt if you have a 404 page he tries t read content and if the bot sees any words like disallow // obey it rule.
I think adsense bot try to enter /template/and it's blocked? What's the url it's blocked can you check?
mediapartners bot is for adsense only. you are not blocking any crawler robots.
Brian Cummiskey / Crawlability Inc.
Security vbulletin - Patch Level for all supported versions released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Seems like there is nothing blocked in there where you should lose Adsense income.