Page 2 of 2 FirstFirst 1 2
Results 16 to 17 of 17

googlebot ignoring robots.txt

This is a discussion on googlebot ignoring robots.txt within the General Discussion forums, part of the vBSEO SEO Plugin category; Some excellent suggestions, thanks. But most are over my head. I ended up replacing the individual post link with the ...

  1. #16
    Senior Member
    Real Name
    Doug Nelson
    Join Date
    Sep 2006
    Posts
    141
    Liked
    0 times
    Some excellent suggestions, thanks. But most are over my head. I ended up replacing the individual post link with the permalink, and dropping showpost.php from my sightmap (duh!).

    The problem was that I just upgraded to vb3.6.5 from vb3, and it handles showpost very differently. Instead of keeping the post in context, it shows just the post. And those were getting better ranking than the threads themselves on google (and with no ads).

  2. #17
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    13 times
    vB 3.0.x and 3.6.5 handle showpost the same way. Both showed just the post.

    With vBSEO, using the Permalink option, it converts them show the whole thread, and jump to the anchor tag on the appropriate post.

Page 2 of 2 FirstFirst 1 2

Similar Threads

  1. add sitemap to robots.txt for autodiscovery
    By GrendelKhan{TSU} in forum General Discussion
    Replies: 2
    Last Post: 04-13-2007, 02:21 PM
  2. quick site map question
    By sross in forum Troubleshooting
    Replies: 8
    Last Post: 01-09-2007, 10:50 PM
  3. Server Overload
    By AcornDomains.co.uk in forum Troubleshooting
    Replies: 5
    Last Post: 03-05-2006, 02:20 PM
  4. Googlebot activity in the vbSEO log
    By buro9 in forum Bug Reporting
    Replies: 18
    Last Post: 12-17-2005, 03:27 PM
  5. Googlebot not following the sitemap?
    By psico in forum Troubleshooting
    Replies: 4
    Last Post: 11-26-2005, 10:53 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •