Indexing of posts - Duplicate content

Ive posted about this on a few occasions and have never got a decent answer.

Site command on Live search reports that my individual posts are being indexed.

Live Search: site:www.thecomputerforums.co.uk

Is this causing duplicate content as more than one URL is using the same text.

Please can a member of staff respond to this asap.

I advise you to block showpost.php from robots.txt in order to prevent duplicate content and donot add them to your sitemaps.

I have been doing so since day 1.

If you look at the link its the permalinks that are being indexed not the old php URLs.

So doing what you say is irrelevent in this case.

You can change that by changing the following setting Enable "Permalink" indicators in Postbits to Replace post number link with Permalink

LOL, please read my post fully.

I have permalinks set to replace post numbers, i have since 3 months ago when i started my forum.

MSN is indexing the PERMALINKS which it shouldn't be, that's the issue here.

I read your post and i gave you a solution to that.

No. You didn't.

You gave me a solution to stop showpost.php being indexed.

I want to know why permalinks are being indexed.

There's a big difference.

I thought the whole point of permalinks was to keep the vBulletin functionality but stop posts being indexed.

Hello,

do you mean the links like:

Code:

http://www.thecomputerforums.co.uk/f37/pokemon-diamond-pearl-3976-post16596/

Those are the "goto post" links displayed on the homepage (not showpost pages). vBSEO 301-redirects them to the corresponding showthread page.

You ca try the following to disable indexing:
- define "'Go To Post in Thread' Redirect URL Format" in vbseocp to (as an example):

Code:

gotopost/[forum_title]/[thread_id]-[thread_title]-post[post_id].html

- add the following in robots.txt:

Code:

Disallow: /gotopost/

Ok that should fix it.

But i still dont have an answer as to why vBSEO allows this out of the box.

Isnt this a major flaw... why have a permalink option if it performs the same as the standard vB setting.

Originally Posted by Oleg Ignatiuk

Go To Post in Thread

I take it ill need to do all the goto post redirects like:

'Newest Post in Thread'
'Last Post in Thread'
Multiple page 'Go To Post in Thread'

In order for this to work properly?

That doesn't work anyway.

All this method does is stop the forum home links being followed.

The permalinks in posts are still accessible and create multiple URLs for the same page.

But i still dont have an answer as to why vBSEO allows this out of the box.

It is required to have "goto post" functionality and at the same time to avoid additional db queries that would affect server performance.

It doesn't perform the same as standard vBulletin in this case - vBSEO redirects the URLs to the main showthread page (the URLs should not be indexed normally in this case, like in Google).

The permalinks in posts are still accessible and create multiple URLs for the same page.

Permalinks are the same URLs as main showthread links, since '#xxx' is not a part of URL: http://www.ietf.org/rfc/rfc1738.txt

Originally Posted by Oleg Ignatiuk

Permalinks are the same URLs as main showthread links, since '#xxx' is not a part of URL: http://www.ietf.org/rfc/rfc1738.txt

Thats what i wanted to hear, thanks.