Results 1 to 5 of 5

spider on member profile

This is a discussion on spider on member profile within the General Discussion forums, part of the vBulletin SEO Discussion category; been more than a month since i set the robot.txt but google keep going to the members profile. this is ...

  1. #1
    Member
    Real Name
    RAFAEL
    Join Date
    Sep 2005
    Posts
    37
    Liked
    0 times

    spider on member profile

    been more than a month since i set the robot.txt but google keep going to the members profile.


    this is my robot.txt :

    User-agent: *
    User-agent: Slurp
    User-agent: Mediapartners-Google*
    Disallow: /forums/referrers.php
    Disallow: /forums/arcade.php
    Disallow: /forums/ajax_cron.php
    Disallow: /forums/ajax.php
    Disallow: /forums/attachment.php
    Disallow: /forums/calendar.php
    Disallow: /forums/cron.php
    Disallow: /forums/editpost.php
    Disallow: /forums/global.php
    Disallow: /forums/image.php
    Disallow: /forums/inlinemod.php
    Disallow: /forums/joinrequests.php
    Disallow: /forums/login.php
    Disallow: /forums/member.php
    Disallow: /forums/memberlist.php
    Disallow: /forums/misc.php
    Disallow: /forums/moderator.php
    Disallow: /forums/newattachment.php
    Disallow: /forums/newreply.php
    Disallow: /forums/newthread.php
    Disallow: /forums/online.php
    Disallow: /forums/poll.php
    Disallow: /forums/postings.php
    Disallow: /forums/printthread.php
    Disallow: /forums/private.php
    Disallow: /forums/post_thanks.php
    Disallow: /forums/payment_gateway.php
    Disallow: /forums/profile.php
    Disallow: /forums/register.php
    Disallow: /forums/report.php
    Disallow: /forums/reputation.php
    Disallow: /forums/rules.php
    Disallow: /forums/search.php
    Disallow: /forums/sendmessage.php
    Disallow: /forums/showgroups.php
    Disallow: /forums/subscription.php
    Disallow: /forums/threadrate.php
    Disallow: /forums/usercp.php
    Disallow: /forums/nasgods/
    Disallow: /forums/infernoshout.php
    Disallow: /forums/redbar
    Disallow: /forums/chat
    Sitemap:http://www.domain.com/forums/sitemap_index.xml.gz
    any ideas

  2. #2
    Senior Member
    Real Name
    Michael Biddle
    Join Date
    Jan 2007
    Location
    Southern California
    Posts
    7,097
    Liked
    5 times
    Can you link us to a members page? If it is yoursite.com/members/membername/, you will need to add a rule such as:

    Disallow: /forums/members/
    The Forum Hosting - Forum Hosting from the Forum Experts

  3. #3
    Member
    Real Name
    RAFAEL
    Join Date
    Sep 2005
    Posts
    37
    Liked
    0 times

  4. #4
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    you will need to add

    Disallow: /forums/member-*

  5. #5
    Member
    Real Name
    RAFAEL
    Join Date
    Sep 2005
    Posts
    37
    Liked
    0 times
    thanks

Similar Threads

  1. Member Profile rewrite help
    By schlottke in forum URL Rewrite Settings
    Replies: 2
    Last Post: 06-17-2008, 01:23 AM
  2. member profile rewriting
    By nebu in forum Troubleshooting
    Replies: 4
    Last Post: 05-09-2007, 06:29 PM
  3. How do i customize me Member Profile
    By Neutral Singh in forum URL Rewrite Settings
    Replies: 0
    Last Post: 03-18-2007, 10:02 AM
  4. Member Profile Redirecting?
    By O'NEAL in forum Custom Rewrite Rules
    Replies: 1
    Last Post: 01-07-2007, 12:05 PM
  5. member profile address
    By jeffinj in forum Pre-Sales Questions
    Replies: 7
    Last Post: 12-24-2006, 06:46 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •