Results 1 to 5 of 5

Adsense 0n Blocked Pages?

This is a discussion on Adsense 0n Blocked Pages? within the General Discussion forums, part of the vBulletin SEO Discussion category; I have adsense banners on my site and was wondering if stopping spiders (i.e. Mediapartners) from accessing member profiles and ...

  1. #1
    Member
    Real Name
    Mike Warner
    Join Date
    Feb 2006
    Posts
    82
    Liked
    1 times

    Question Adsense 0n Blocked Pages?

    I have adsense banners on my site and was wondering if stopping spiders (i.e. Mediapartners) from accessing member profiles and other pages via robots.txt would have an effect on targeted advertising? Do Mediapartners ignore the robots.txt file and check each page showing adsense? If not, how can I change the robots.txt file to allow Mediapartners full access?

    Many thanks.
    Mike

  2. #2
    Senior Member
    Real Name
    Dhillon
    Join Date
    Apr 2006
    Posts
    341
    Liked
    1 times
    add this to your robots.txt
    Code:
    User-agent: Mediapartners-Google
    Disallow:

  3. #3
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    the google bot is seperate from the adsense bot.

  4. #4
    Member mdvaldosta's Avatar
    Real Name
    Joe Hayes
    Join Date
    Aug 2006
    Posts
    86
    Liked
    0 times
    Allowing bots but disallowing guests may be considered cloaking. You're best off either removing Adsense from those pages or letting it display PSA's or generally generic to your website type advertising that Adsense often does when it can't crawl a page.
    Submit you're vBSEO'd forum to these quality web directories: Azook, a Paid Directory, Linkature Directory, Free Website Directory, and GoGlance.

  5. #5
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    that's not cloaking....

    cloaking is DISPLAYING different CONTENT to bots vs humans.

    robots.txt has no bearing on content display.

    I see no issue in this at all, as like i said before, the adsense bot is an entirely different crawler from googlebot.

Similar Threads

  1. Googlebot blocked from forum - cant figure out how?
    By chris06 in forum General Discussion
    Replies: 1
    Last Post: 10-26-2007, 10:52 AM
  2. Blocked from del.icio.us
    By serphog in forum Troubleshooting
    Replies: 8
    Last Post: 11-25-2006, 08:44 AM
  3. Can robots read if forum is blocked?
    By majordude in forum General Discussion
    Replies: 4
    Last Post: 08-27-2006, 04:59 AM
  4. Currently Indexed Pages, Analytics, Adsense, PR...
    By NeutralizeR in forum Pre-Sales Questions
    Replies: 56
    Last Post: 03-12-2006, 04:06 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •