Page 1 of 2 1 2 LastLast
Results 1 to 15 of 16
Like Tree1Likes

Crawl errors

This is a discussion on Crawl errors within the General Discussion forums, part of the vBulletin SEO Discussion category; i have signup for google webmaster tool and i have allot of errors Show URLs: Not found ‎(6,519) So what ...

  1. #1
    Senior Member
    Real Name
    Kristijan
    Join Date
    Oct 2005
    Location
    Zagreb
    Posts
    284
    Liked
    1 times

    Crawl errors

    i have signup for google webmaster tool and i have allot of errors

    Show URLs: Not found ‎(6,519)

    So what to do with this, i have make custom 404 redirect page on site, and on forum if the url its not find you get the message, this thread doesnt exists.

    my custom 404 page is this http://www.croportal.net/custom_stranica

    Any suggestions what to do? Maybe some redirection, and not custom 404 page?

    Also one more thing. Restricted by robots.txt ‎(100,000)‎

    I have restricted to robots.txt that cannot access to profile members in my forum.

    Is this good idea or not?


    And last crawl errors is Unreachable ‎(1,044)‎

    example:

    For this link Veliki koncert Dubioze, Elementala i RHS-a u Koprivnici i have this Description: Truncated response

    And the link is normally working

    And also for this link: Jug uspje description is Connection refused

    And the link is normally working.

    Thanks

  2. #2
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    The main one to worry about is the 'In sitemaps" tab.

    Things in robots and other 404's are normal if they aren't in your sitemap. Do you have anything under the in sitemaps tab?

  3. #3
    Senior Member
    Real Name
    Kristijan
    Join Date
    Oct 2005
    Location
    Zagreb
    Posts
    284
    Liked
    1 times
    i didnt submit sitemap

    my sitemap is on this link www.croportal.net/forum/mapa-stranice/

    and when i submit it report errors because its in html

  4. #4
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    You should install the vbseo sitemap generator. It's free and in the downloads section.

  5. #5
    Senior Member
    Real Name
    Kristijan
    Join Date
    Oct 2005
    Location
    Zagreb
    Posts
    284
    Liked
    1 times
    and what about links on my forum home page in the footer Croportal Forum - is this necesarry or not? because this is map of the site?

    its visible only to guests?

  6. #6
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2

  7. #7
    Senior Member
    Real Name
    Kristijan
    Join Date
    Oct 2005
    Location
    Zagreb
    Posts
    284
    Liked
    1 times
    thanks Brian, and can u explain me what is the main reason of disabling archive and enabling vbseo sitemap? what is difference between theese two. What i get, what i loose.

    Thanks

  8. #8
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    The xml sitemap is FAR more powerful as it can be submitted to google/etc directly in their webmaster tools.

    The archive is just duplicate content/links that already exist elsewhere.

  9. #9
    Member
    Real Name
    Erik
    Join Date
    Jul 2010
    Location
    Sweden
    Posts
    61
    Liked
    0 times
    After reading this I checked my webmaster tools and found 3 crawl errors in the site map... They are all redirect errors.

    The Lounge

    Good afternoon

    Welcome - Blogs - Design Forums - OnlyDesigned.com

    I have disabled the archives and I am using the vbseo sitemap generator.

    How do I fix them?

  10. #10
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    23,100
    Liked
    622 times
    Blog Entries
    4
    What are you trying to remove ?
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

  11. #11
    Member
    Real Name
    Erik
    Join Date
    Jul 2010
    Location
    Sweden
    Posts
    61
    Liked
    0 times
    Fix them or make them disappear I mean =)

  12. #12
    vBSEO.com Webmaster Mert Gökçeimam's Avatar
    Real Name
    Lizard King
    Join Date
    Oct 2005
    Location
    Istanbul, Turkey, Turkey
    Posts
    23,100
    Liked
    622 times
    Blog Entries
    4
    Those pages are loading correct , if they continue to load correct Google will remove them in time.
    Mert Gökçeimam / Crawlability Inc.

    vBSEO 3.6.0 Alpha Önizlemesi - Including Like Tree
    Unveiling the NEW vBSEO Sitemap Generator 3.0 - available NOW for vBSEO Customers!


    Twitter:@Depkac
    Personal Blog : Mert Gökçeimam

  13. #13
    Member
    Real Name
    Erik
    Join Date
    Jul 2010
    Location
    Sweden
    Posts
    61
    Liked
    0 times
    Ok Thank you

  14. #14
    vBSEO Staff Brian Cummiskey's Avatar
    Real Name
    Brian Cummiskey
    Join Date
    Jul 2009
    Location
    btwn NYC and Boston
    Posts
    12,789
    Liked
    657 times
    Blog Entries
    2
    Make sure your sitemap setting is set for 'vbseo installed' to yes. Those old vb-style default urls should not be included in the sitemap

  15. #15
    Member
    Real Name
    Erik
    Join Date
    Jul 2010
    Location
    Sweden
    Posts
    61
    Liked
    0 times
    Ok, I checked and it is set to "yes". Why I was asking about these 3 urls were because they have been in the crawl errors for a very long time now, they don't seem to disappear.

    Thank you again for your amazing help.

Page 1 of 2 1 2 LastLast

Similar Threads

  1. Crawl Errors
    By mike40324 in forum Troubleshooting
    Replies: 20
    Last Post: 10-21-2011, 12:18 PM
  2. Crawl Errors
    By goaliecrease in forum General Discussion
    Replies: 2
    Last Post: 01-07-2011, 11:05 AM
  3. 'Not Followed' Crawl Errors
    By insidedesign in forum General Discussion
    Replies: 26
    Last Post: 04-26-2010, 11:21 PM
  4. 262 Crawl errors
    By matthewhotdude in forum General Discussion
    Replies: 18
    Last Post: 08-14-2009, 10:23 AM
  5. Web crawl errors
    By Rav in forum Troubleshooting
    Replies: 7
    Last Post: 06-01-2009, 12:30 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •