I have adsense banners on my site and was wondering if stopping spiders (i.e. Mediapartners) from accessing member profiles and other pages via robots.txt would have an effect on targeted advertising? Do Mediapartners ignore the robots.txt file and check each page showing adsense? If not, how can I change the robots.txt file to allow Mediapartners full access?
Many thanks.
Mike


LinkBack URL
About LinkBacks





Reply With Quote