LinkBack URL
About LinkBacksHi,
I don't understand why I'm seeing everywhere member.php in robots.txt... Aren't those pages including content from visitors messages since vbulletin 3.6 and from that could be as efficient as threads for SEO?
member.php and search.php are the 2 main targets for the bots here, I'm going to block robots on search.php but wondering about member.php that's why I'm asking
Thanks!
Guy
Results 1 to 7 of 7
Why adding "disallow : member.php" to robots.txt?
This is a discussion on Why adding "disallow : member.php" to robots.txt? within the General Discussion forums, part of the vBulletin SEO Discussion category; Hi, I don't understand why I'm seeing everywhere member.php in robots.txt... Aren't those pages including content from visitors messages since ...
-
03-12-2009 10:09 AM #1Junior Member
- Real Name
- Blacklava
- Join Date
- Mar 2009
- Posts
- 25
- Liked
- 0 times
Why adding "disallow : member.php" to robots.txt?
-
03-12-2009 10:50 AM #2Junior Member
- Real Name
- Roman
- Join Date
- Sep 2008
- Location
- Europe
- Posts
- 24
- Liked
- 0 times
I don't know why, but many members use profile for spam links. Also "hide spam"
There are many pornolinks in such "profiles".
-
03-12-2009 10:54 AM #3Junior Member
- Real Name
- Blacklava
- Join Date
- Mar 2009
- Posts
- 25
- Liked
- 0 times
I'm having 4 times more visits from bots on member.php than on showthreads.php so I'm wondering if it's good to disallow member.php...
Is it a math between server load gain and small additionnal SEO and I should weight carefully both or am I missing something?
Thanks I see your point about porn links but haven't got such links recently
-
03-12-2009 11:19 AM #4Senior Member
- Real Name
- Shadab
- Join Date
- Oct 2007
- Location
- Bhopal
- Posts
- 821
- Liked
- 0 times
- Blog Entries
- 12
I don't block the profile pages.
[ Getting rid of profile pages in SE Index ]
-
03-12-2009 01:14 PM #5
-
03-12-2009 01:23 PM #6Senior Member
- Real Name
- Brian
- Join Date
- Apr 2006
- Location
- Central CT, USA
- Posts
- 6,981
- Liked
- 8 times
Odds are, you re-wrote the memeber pages to something like /members/username-123/
thus, member.php should not be used anymore
-
03-12-2009 02:16 PM #7Junior Member
- Real Name
- Blacklava
- Join Date
- Mar 2009
- Posts
- 25
- Liked
- 0 times
Thanks for that, simply the best answer to my question
Originally Posted by Joe Ward
Reply With QuoteSimilar Threads
-
Disallow Robots from Forum
By Nuguru in forum General DiscussionReplies: 3Last Post: 10-19-2008, 04:46 PM -
Disallow: newpost in robots.txt
By mountainboarder21 in forum General DiscussionReplies: 4Last Post: 10-08-2008, 05:16 PM -
Adding a hack to robots.txt
By trw44 in forum General DiscussionReplies: 1Last Post: 06-19-2008, 01:40 PM -
Disallow links from particular domain
By Metal-R-US in forum Off-Topic & Chit ChatReplies: 0Last Post: 09-02-2006, 01:19 PM -
Possible to use Disallow: /*?pp=10 in robots.txt?
By PageUp in forum General DiscussionReplies: 3Last Post: 11-03-2005, 10:01 PM
