Results 1 to 3 of 3

Robot.txt and Google

This is a discussion on Robot.txt and Google within the General Discussion forums, part of the vBulletin SEO Discussion category; Hi im runing vb 3.8 and vbgallery on my forum and im wanting to block googlebot and the others to ...

  1. #1
    Junior Member
    Real Name
    Steven Gourlay
    Join Date
    Jan 2009
    Location
    Ullapool
    Posts
    21
    Liked
    0 times

    Robot.txt and Google

    Hi im runing vb 3.8 and vbgallery on my forum and im wanting to block googlebot and the others to stop accessing the gallery, i have uploaded my robot.txt file but i can still see google going through the gallery?

    Any reason why googlebot is ignoring the command, have i made a mistake should there be a / at the end?

    THe urls to the forum is http://www.ultimatenaturegear.co.uk/forum


    Disallow:
    Disallow: /forum/tag
    Disallow: /forum/ajax.php
    Disallow: /forum/attachment.php
    Disallow: /forum/calendar.php
    Disallow: /forum/cron.php
    Disallow: /forum/editpost.php
    Disallow: /forum/global.php
    Disallow: /forum/image.php
    Disallow: /forum/inlinemod.php
    Disallow: /forum/joinrequests.php
    Disallow: /forum/login.php
    Disallow: /forum/member.php
    Disallow: /forum/memberlist.php
    Disallow: /forum/misc.php
    Disallow: /forum/moderator.php
    Disallow: /forum/newattachment.php
    Disallow: /forum/newreply.php
    Disallow: /forum/newthread.php
    Disallow: /forum/online.php
    Disallow: /forum/poll.php
    Disallow: /forum/postings.php
    Disallow: /forum/printthread.php
    Disallow: /forum/private.php
    Disallow: /forum/profile.php
    Disallow: /forum/register.php
    Disallow: /forum/report.php
    Disallow: /forum/reputation.php
    Disallow: /forum/search.php
    Disallow: /forum/sendmessage.php
    Disallow: /forum/showgroups.php
    Disallow: /forum/subscription.php
    Disallow: /forum/threadrate.php
    Disallow: /forum/usercp.php
    Disallow: /forum/usernote.php
    Disallow: /forum/gallery
    Disallow: /forum/gallery/misc.php

  2. #2
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    you should use the trailing slash for directories, ie
    Disallow: /forum/gallery/

    and the file should be called 'robots.txt' not 'robot.txt'

    and, robots.txt is merely a 'suggestion'. it doesn't 100% stop anything.

  3. #3
    Junior Member
    Real Name
    Steven Gourlay
    Join Date
    Jan 2009
    Location
    Ullapool
    Posts
    21
    Liked
    0 times
    Cheers its was a typo it was robots.txt, cheers for you help Brian.

Similar Threads

  1. Robot.txt
    By susanarend3 in forum Pre-Sales Questions
    Replies: 8
    Last Post: 09-02-2008, 05:01 PM
  2. Google says i have a robot.txt but i dont....
    By xCorn.Dogx in forum Troubleshooting
    Replies: 13
    Last Post: 07-25-2008, 06:33 PM
  3. Robot Text Do I need it?
    By photochimper in forum General Discussion
    Replies: 2
    Last Post: 05-20-2008, 11:31 PM
  4. vbseo and robot.txt?
    By Julio in forum General Discussion
    Replies: 4
    Last Post: 12-31-2007, 05:25 PM
  5. Robot.txt file
    By BamaStangGuy in forum General Discussion
    Replies: 3
    Last Post: 06-17-2006, 12:09 PM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •