Results 1 to 7 of 7

Crawl Errors in Google Analytics

This is a discussion on Crawl Errors in Google Analytics within the Troubleshooting forums, part of the vBSEO SEO Plugin category; Hi Guys, I have checked the Google stats and analytics and see the following errors I wonder if you could ...

  1. #1
    Member RoyMogg's Avatar
    Real Name
    Roy
    Join Date
    Dec 2007
    Posts
    39
    Liked
    0 times

    Post Crawl Errors in Google Analytics

    Hi Guys,

    I have checked the Google stats and analytics and see the following errors I wonder if you could help.

    1.0 Several hundred not found URLS returning 404's to the crawler - I expect these are from a deleted forum (I shook out some spammers just before the big crawl!). They could be tagged as in the Archive as they all have the form '9020-post1.html'. How can I remove these error reports - I have purged threads already and re-built forum info.

    2.0 In the content analysis you see more than 2000 duplicate Meta Descriptions - this was possibly due to a forum name change between crawls. When will this right itself?

    3.0 A peculiar one - I see duplicate title tags mainly from Blogs where the crawler has looked at dates for blog entries from members in the range 1975 to 2035 and not found quite a few missing as you would expect. How can I prevent this from happening??

    cheers and thanks

    Roy

  2. #2
    Member RoyMogg's Avatar
    Real Name
    Roy
    Join Date
    Dec 2007
    Posts
    39
    Liked
    0 times

    Question Anything??

    Hi has anyone some clues on this one?

  3. #3
    Senior Member briansol's Avatar
    Real Name
    Brian
    Join Date
    Apr 2006
    Location
    Central CT, USA
    Posts
    6,981
    Liked
    8 times
    1) 9020-post1.html are showpost pages, not the archive.
    2) this is also caused by showpost

    to solve both,
    go to your vbseo options, expand the (+) to show the rules.
    change showpost to NOT be re-written. (select no)
    then do these 3 things:
    Too many pages indexed?

    you don't want showpost in the SE's at all IMO.
    3) no idea...

  4. #4
    Member RoyMogg's Avatar
    Real Name
    Roy
    Join Date
    Dec 2007
    Posts
    39
    Liked
    0 times

    Smile Too many URLS

    Hi briansol,

    Many thanks for the direction.

    I have:

    1.0 robot.txt with disallow on showpost.php
    2.0 Rules changed not to rewrite showpost
    3.0 removed showpost from generator
    4.0 could'nt find exact phrase 'replace showpost with permalink' in permalink section - where is this?

    cheers and thanks

    RoyMogg

  5. #5
    Senior Member MadK's Avatar
    Real Name
    Leo
    Join Date
    Jun 2008
    Location
    Canada
    Posts
    140
    Liked
    0 times
    Blog Entries
    2
    1.0 You don't need to disallow robots to scan showpost.php because showpost.php has no content to scan if you tell vBSEO to replace showpost with a permalink.
    4.0 Hit ctrl+F and type in 'showpost' (without the quotes) and within that box, you will have the choice to 'replace post number link with permalink' . It can be found in vbseocp.php

    Do it, it really helps and much better, too!

  6. #6
    Member RoyMogg's Avatar
    Real Name
    Roy
    Join Date
    Dec 2007
    Posts
    39
    Liked
    0 times

    Smile Crawl errors

    Hi MadK,

    Many thanks tis done - hopefully this should now sort the crawler issues.

    cheers

    Roy

  7. #7
    Senior Member MadK's Avatar
    Real Name
    Leo
    Join Date
    Jun 2008
    Location
    Canada
    Posts
    140
    Liked
    0 times
    Blog Entries
    2
    Quote Originally Posted by RoyMogg View Post
    Hi MadK,

    Many thanks tis done - hopefully this should now sort the crawler issues.

    cheers

    Roy
    No problem, I am glad my help has helped you achieve what you wanted to do, in the first place.

Similar Threads

  1. Google Webmaster tools- crawl rate
    By JADM in forum General Discussion
    Replies: 11
    Last Post: 01-11-2008, 06:26 PM
  2. can google crawl private forums?
    By _d3v1L in forum General Discussion
    Replies: 4
    Last Post: 07-19-2007, 01:01 AM
  3. Can Google Etc... Stil Crawl Forums If Not Got Permission?
    By micky007 in forum Pre-Sales Questions
    Replies: 1
    Last Post: 06-23-2007, 04:55 AM
  4. Replies: 5
    Last Post: 02-05-2007, 09:58 AM
  5. Google Crawl Logik
    By KoC in forum Deutsch
    Replies: 2
    Last Post: 12-04-2006, 02:17 PM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •