vBulletin Search Engine Optimization
This is a discussion on Yahoo Slurp Spider emailing members? within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I noticed several of the Yahoo spiders emailing members... of course it was getting a red stop sign... but it's ...
| |||||||
Enhancing 80 million pages. | Register | FAQ | Members List | Social Groups | Calendar | Search | Today's Posts | Mark Forums Read |
|
#1
| ||||
| ||||
| Yahoo Slurp Spider emailing members?
I noticed several of the Yahoo spiders emailing members... of course it was getting a red stop sign... but it's wasting time going through all my members trying to email them. How can I prevent this? Thanks! |
|
#2
| ||||
| ||||
| Re: Yahoo Slurp Spider emailing members?
Hello Sonnie, perhaps adding the following to robots.txt will prevent yahoo bot from doing so: Code: Disallow: /forums/sendmessage.php
__________________ Oleg Ignatiuk / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#3
| ||||
| ||||
| Re: Yahoo Slurp Spider emailing members?
Thanks Oleg, Yeah... I had /sendmessage.php in there but didn't have the /forums/ in there. My robots.txt file is in my root directory and there are some root folders and files that I assume I won't need to insert the /forums/ in front of. I also assume I need to keep the robots.txt file in the root and not move it to /forums. Am I assuming all this correctly? |
|
#4
| ||||
| ||||
| Re: Yahoo Slurp Spider emailing members?
Yes, confirming - you should keep robots.txt in the domain root and add /forums/ for the vB pages definition.
__________________ Oleg Ignatiuk / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#5
| ||||
| ||||
| Re: Yahoo Slurp Spider emailing members?
Thank you kindly... I think I got it all fixed now... hopefully.
|
|
#6
| ||||
| ||||
| Re: Yahoo Slurp Spider emailing members?
Great!
__________________ Oleg Ignatiuk / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#7
| |||
| |||
|
I hate to revive a zombie thread, but I searched, honest I did! This is the only good piece of advice that I could find on the subject of Yahoo slurps attempting to email vBulletin members. I had never heard of it before today, but I saw it, it does happen. My question to any of the posters of this thread who are still alive (!) Did this work? Code: Disallow: /forums/sendmessage.php |
|
#8
| ||||
| ||||
|
robots is merely a suggestion. you should enable captcha or another human verification for guests on the email system. |
|
#9
| |||
| |||
|
Thanks, Brian! We are using captcha and email send/receive verification. The slurps are not registering as users, they are attempting and failing to send email to our users.
|
| Thread Tools | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| yahoo slurp | xpfUK | General Discussion | 7 | 07-21-2007 11:22 PM |
| increasing yahoo slurp spiders | MentaL | General Discussion | 0 | 01-20-2006 01:08 AM |
| VBSEO and YAHOO Slurp | MentaL | General Discussion | 6 | 11-02-2005 11:11 AM |