vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Adsense 0n Blocked Pages?

This is a discussion on Adsense 0n Blocked Pages? within the General Discussion forums, part of the vBulletin SEO Discussion category; I have adsense banners on my site and was wondering if stopping spiders (i.e. Mediapartners) from accessing member profiles and ...

Go Back   vBulletin SEO Forums > vBulletin SEO Discussion > General Discussion

Adsense 0n Blocked Pages? Adsense 0n Blocked Pages?

Enhancing 80 million pages.

 Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read

Reply

 

LinkBack Thread Tools
  #1  
Old 05-28-2008, 04:24 AM
Member
  
Real Name: Mike Warner
Join Date: Feb 2006
Posts: 51
Question Adsense 0n Blocked Pages?
I have adsense banners on my site and was wondering if stopping spiders (i.e. Mediapartners) from accessing member profiles and other pages via robots.txt would have an effect on targeted advertising? Do Mediapartners ignore the robots.txt file and check each page showing adsense? If not, how can I change the robots.txt file to allow Mediapartners full access?

Many thanks.
Mike
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 05-28-2008, 07:42 AM
Senior Member
Big Board Administrator
  
Real Name: Dhillon
Join Date: Apr 2006
Location: Chandigarh/Glasgow
Posts: 290
add this to your robots.txt
Code:
User-agent: Mediapartners-Google
Disallow:
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 05-28-2008, 03:03 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
  
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,546
the google bot is seperate from the adsense bot.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 05-28-2008, 05:01 PM
mdvaldosta's Avatar
Member
vBSEO Pre-Release TeamBig Board Administrator
  
Real Name: Joe Hayes
Join Date: Aug 2006
Posts: 86
Allowing bots but disallowing guests may be considered cloaking. You're best off either removing Adsense from those pages or letting it display PSA's or generally generic to your website type advertising that Adsense often does when it can't crawl a page.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 05-28-2008, 05:26 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
  
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,546
that's not cloaking....

cloaking is DISPLAYING different CONTENT to bots vs humans.

robots.txt has no bearing on content display.

I see no issue in this at all, as like i said before, the adsense bot is an entirely different crawler from googlebot.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

« Move Copyright? | H1, H2 & H3 tags »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads

Thread Thread Starter Forum Replies Last Post
Googlebot blocked from forum - cant figure out how? chris06 General Discussion 1 10-26-2007 11:52 AM
Blocked from del.icio.us cmeinck Troubleshooting 8 11-25-2006 09:44 AM
Can robots read if forum is blocked? majordude General Discussion 4 08-27-2006 05:59 AM
Currently Indexed Pages, Analytics, Adsense, PR... NeutralizeR Pre-Sales Questions 56 03-12-2006 05:06 AM


All times are GMT -4. The time now is 01:43 AM.

Contact Us - vBSEO Home - Site Map - Top

Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.