LinkBack URL
About LinkBacksI want to block the memberlist pages from being indexed as they are all junk but keep member profiles indexed.
Is this correct?
Disallow: /members/list/
Thanks guys.
Results 1 to 3 of 3
Robots.txt help
This is a discussion on Robots.txt help within the General Discussion forums, part of the vBulletin SEO Discussion category; I want to block the memberlist pages from being indexed as they are all junk but keep member profiles indexed. ...
-
05-28-2007 08:27 PM #1Senior Member
- Real Name
- Dave Hybrid
- Join Date
- Mar 2007
- Location
- UK
- Posts
- 400
- Liked
- 8 times
Robots.txt help
-
05-29-2007 09:36 AM #2Senior Member
- Real Name
- Dave Hybrid
- Join Date
- Mar 2007
- Location
- UK
- Posts
- 400
- Liked
- 8 times
-
05-29-2007 11:16 AM #3vBSEO Staff
- Real Name
- Oleg Ignatiuk
- Join Date
- Jun 2005
- Location
- Belarus
- Posts
- 25,689
- Liked
- 157 times
Hello,
yes, your code is correct (assuming that your forum is in domain root).Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.6.0 GOLD Released!
Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!
Reply With QuoteSimilar Threads
-
Robots.txt now support the sitemap file
By Mohamed Mostafa in forum General DiscussionReplies: 35Last Post: 08-24-2007, 10:33 AM -
googlebot ignoring robots.txt
By Doug Nelson in forum General DiscussionReplies: 16Last Post: 05-08-2007, 11:30 AM -
add sitemap to robots.txt for autodiscovery
By GrendelKhan{TSU} in forum General DiscussionReplies: 2Last Post: 04-13-2007, 03:21 PM -
MSNbot - robots.txt
By curriertech in forum General DiscussionReplies: 1Last Post: 10-05-2006, 09:29 AM -
Temp robots.txt Brand New Forum?
By rmjvol in forum Pre-Sales QuestionsReplies: 7Last Post: 08-26-2006, 02:53 AM
