vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.
This is a discussion on Briansol's Ultimate Guide to vBSEO within the General Discussion forums, part of the vBSEO SEO Plugin category; Originally Posted by briansol Threads are auto-301'ed, however forumdisplay are not. And yes, you can simply import the settings file ...
Does google get the 301s to the rewritten URLs, when one disallow *.php in robots.txt?
In other words: Does robots.txt apply to new and indexed URLs, or only to new (just found on page by crawling) URLs?
(BTW: Imho blank lines are not allowed in robots.txt, except before "user agent"...)
Last edited by Julian.; 08-25-2008 at 07:51 PM.
Arcor User Forum
Das inoffizielle Arcor Forum
blocking via robots.txt will keep the bots off the old .php pages, be it in it's index already or linked via an old site. If you're pages indexed in google have 90%or more moved to the new urls, it's safe to use the *.php rule (again, provided everything you want indexed is re-written)
Blank lines are not an issue.
Checking robots.txt - Webmaster Help Center
Arcor User Forum
Das inoffizielle Arcor Forum
One question, I have a fair few showposts indexed and have now disabled it as per your recommendations but should I still submit showposts in the generator to get google to remove these old showposts quicker or will it make no difference?
http://www.edugeek.net - The I.T. Professionals Life Line
Don't worry about page rank... it does nothing and means nothing.
no, do not submit showpost urls in the sitemap.
good post thanks
but i want to ask you
you add in robots.txt this
Disallow: *.html
Disallow: *.htm
this i think tell search engine not indexing html pages like post etc ..
is right or ?
If you use Brian's suggestions, your posts, and threads will not end in .html.
Hello Brian
i have imported your xml file and the urls on my site are: t640/#post1372
I would like to know how i can to rewrite the urls to have this result: forum_title/thread_title/ without the #post in the end of the urls
Thanks
Thank YOU!
Ok thanks Brian but there is a way to have not it at the end?
i have tried to use this in Last Post in Thread' Redirect
[forum_title]/[thread_title]-[thread_id]-last/
and this in Newest Post in Thread' Redirect
[forum_title]/[thread_title]-[thread_id]-new/
It's correct for to have forum_title/thread_title-id showed in the urls?
"#" parts don't get spidered by the engines. So having a #324324 at the end, won't generate any double content or anything. No need to change this.
Arcor User Forum
Das inoffizielle Arcor Forum
Ok thanks solved