vBulletin Search Engine Optimization
This is a discussion on About robots.txt within the General Discussion forums, part of the vBulletin SEO Discussion category; Hello everyone, I want to block certain threads manually via robots.txt and I have a question doing so: eg. if ...
| |||||||
Enhancing 80 million pages. | Register | FAQ | Members List | Social Groups | Calendar | Search | Today's Posts | Mark Forums Read |
|
#1
| |||
| |||
| About robots.txt
Hello everyone, I want to block certain threads manually via robots.txt and I have a question doing so: eg. if I want to include a thread with several pages into robots.txt like this: www.mysite.com/forums/1234-testthread.html www.mysite.com/forums/1234-testthread-2.html www.mysite.com/forums/1234-testthread-3.html is it possible to have a syntax like this to include all pages of the thread without typing everyone? www.mysite.com/forums/1234-* I tried this one but without success. Can someone help me out? Thank you so much in advance Diver |
|
#2
| ||||
| ||||
|
the * should work. but you shouldn't include your .com. just relative path from root. not sure if you can end in a *, but the * is valid. try Disallow: /forums/1234-testthread*.html -=------------- also, keep in mind that it may take a month before this gets acknowledged. it's certainly not an instant process. |
| Thread Tools | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| robots.txt | Zenith | General Discussion | 46 | 10-21-2008 02:00 PM |
| robots.txt | wolf32 | General Discussion | 0 | 06-30-2007 10:29 PM |
| Robots.txt help | Dave Hybrid | General Discussion | 2 | 05-29-2007 11:16 AM |
| No Robots.txt | friendly | Troubleshooting | 1 | 10-26-2006 11:30 AM |
| robots.txt | croportal | General Discussion | 1 | 02-05-2006 01:31 PM |