Results 1 to 5 of 5

Disallow: newpost in robots.txt

This is a discussion on Disallow: newpost in robots.txt within the General Discussion forums, part of the vBulletin SEO Discussion category; Hi dears Indexing different url with same contents is not good for google we have very duplicate url for new ...

  1. #1
    Junior Member
    Real Name
    Catherine L Wright
    Join Date
    Sep 2008
    Posts
    27
    Liked
    0 times

    Disallow: newpost in robots.txt

    Hi dears

    Indexing different url with same contents is not good for google

    we have very duplicate url for new post show

    for example :

    below address
    Code:
    http://www.vbseo.com/f9/lock-forumhome-index-html-27572/
    is different with this

    Code:
    http://www.vbseo.com/f9/lock-forumhome-index-html-27572-new/
    but both have same content

    OR
    Code:
    http://www.vbseo.com/f9/lock-forumhome-index-html-27572/#post172088
    new post show create many duplicate url

    How do I disallow just new post url in robots.txt ?

    Disallow: /f9/lock-forumhome-index-html-27572-new ?!!!

  2. #2
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    'new post' and 'goto last post' are simply re-directors. you will NEVER be in a browser at /xxxx-new/. it get's 301'ed to the destination.

    no robots changes are required

  3. #3
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,744
    Liked
    168 times
    Hello,

    http://www.vbseo.com/f9/lock-forumho...tml-27572-new/ is not displayed itself, but is 301 redirected to Lock forumhome to index.html.
    The "#post172088" is not a part of "URL" and is NOT indexed by Google as a separate page, so there is nothing to worry about.

  4. #4
    Junior Member
    Real Name
    Catherine L Wright
    Join Date
    Sep 2008
    Posts
    27
    Liked
    0 times
    Code:
    http://www.vbseo.com/f9/lock-forumhome-index-html-27572/
    and

    Code:
    http://www.vbseo.com/f9/lock-forumhome-index-html-27572/#post172088
    aren't duplicate url ?!!

    maybe


    but newpost is part of URL in my setting vbseo

    I have
    Code:
    http://domain.com/t10241-sql-server.html
    and

    Code:
    http://domain.com/t10241-sql-server.html#post32190
    are these duplicate url ?


    no robots changes are required for me ?

  5. #5
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    # are called "bookmarks" and represent a "scrolled" position on the SAME page.

    They have been a part of html since nearly the beginning.

    Google knows this.

    It doesn't index #bookmarks in any urls


    ie, #top is a very popular bookmark.


    #top - Google Search


    do you see any results with #top in them on the top 10?

Similar Threads

  1. Disallow links from particular domain
    By Metal-R-US in forum Off-Topic & Chit Chat
    Replies: 0
    Last Post: 09-02-2006, 12:19 PM
  2. Cookies, newpost, lastpost #anchor jumping
    By buro9 in forum Bug Reporting
    Replies: 7
    Last Post: 06-04-2006, 10:54 AM
  3. Possible to use Disallow: /*?pp=10 in robots.txt?
    By PageUp in forum General Discussion
    Replies: 3
    Last Post: 11-03-2005, 09:01 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •