Page 1 of 3 1 2 3 LastLast
Results 1 to 15 of 40

URL's not followed... possible errors in redirect..

This is a discussion on URL's not followed... possible errors in redirect.. within the Troubleshooting forums, part of the vBSEO SEO Plugin category; Checking the Google Webmaster Tools it appears I may possible have a Redirect error... This page lists URLs from your ...

  1. #1
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times

    URL's not followed... possible errors in redirect..

    Checking the Google Webmaster Tools it appears I may possible have a Redirect error...

    This page lists URLs from your site that Googlebot had trouble crawling. Googlebot found these pages either in your Sitemap or by following links from other pages during a discovery crawl. Choose a category of errors to view:
    URLs not followed (4726)

    Here are just a sample of the 4726 URL's listed... they appear to be valid links when I click on them...
    Code:
     http://www.hometheatershack.com/forums/archive/index.php/t-1001.html  	 Redirect error   [?]  	 Sep 14, 2006
    http://www.hometheatershack.com/forums/archive/index.php/t-1002.html 	Redirect error   [?] 	Sep 13, 2006
    http://www.hometheatershack.com/forums/archive/index.php/t-1003.html 	Redirect error   [?] 	Sep 15, 2006
    http://www.hometheatershack.com/forums/archive/index.php/t-1006.html 	Redirect error   [?] 	Sep 15, 2006

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,744
    Liked
    169 times
    Strange.. the redirect looks fine for me. Do you see this for a long time?

  3. #3
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    I don't understand what you mean by "a long time". I go to Google Webmaster Tools and it gives me a report of all the pages crawled at my site. Here's the latest report:

    HTTP errors (0)
    Not found (9)
    URLs not followed (4845)
    URLs restricted by robots.txt (33)
    URLs timed out (0)
    Unreachable URLs (14)


    I can click on any of those and see the specific URL's. There just happens to be a bunch of them under "URLs not followed".

    The report period begins on September 4, 2006. There are URL's from yesterday all the way back to that date.

    Below is the explanations it gives:

    This category lists URLs that we were unable to completely follow, along with some information as to why. In general, keep in the mind the following to ensure Google's spiders can follow links in your site:

    * Use a text browser such as Lynx to examine your site, since many search engines see your site much as Lynx would. If features such as Javascript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine spiders may have trouble crawling your site.
    * Don't use &ID= as a parameter in your URLs.
    * If you use dynamic pages (for instance, the URL contains a ? character), be aware that not all search engine spiders crawl dynamic and static pages. It helps to keep the parameters short and the number of them few.
    * If you are permanently redirecting from one page to another, use a permanent redirect (301).
    * Where possible, use absolute rather than relative links. (For instance, when linking to another page in your site, link to www.example.com/mypage.html rather than simply mypage.html).

    URLs not followed /Redirect error

    Google was unable to completely follow the redirects from this page. Our guidelines suggest that you make every page on your site reachable from at least one static text link, so that we can access these pages easily. Below are some suggestions about using redirects:

    * Minimize the number of redirects needed to follow a link from one page to another.
    * Make sure your redirect timer is set for a relatively short period of time.
    * Avoid using meta refreshes in the <head> statement of your pages.
    That's a lot of pages that are not getting indexed... no wonder I don't have anymore pages on Google than I do.

  4. #4
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,744
    Liked
    169 times
    I don't understand what you mean by "a long time". I go to Google Webmaster Tools and it gives me a report of all the pages crawled at my site. Here's the latest report:
    I meant whether you saw these errors before or not. Also, do you see similar errors for other (non-archive) links?

  5. #5
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    This is the first time I've used the Google Webmaster Tools... but I know that at least go back to September 4.

    They are not just the archives... here are a few more samples:

    http://www.hometheatershack.com/foru...ating-bfd-new-... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...ating-bfd-new-... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...w-nsd-pre-post... Redirect error [?] Sep 14, 2006

    http://www.hometheatershack.com/foru...l-carcinoma.ht... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...-australia-pos... Redirect error [?] Sep 13, 2006
    http://www.hometheatershack.com/foru...-australia.htm... Redirect error [?] Sep 17, 2006
    The SWAMP! - Volume One|Chat Box|Page 10|Home Theater Shack Redirect error [?] Sep 17, 2006
    The SWAMP! - Volume One|Chat Box|Page 13|Home Theater Shack Redirect error [?] Sep 17, 2006
    The SWAMP! - Volume One|Chat Box|Page 2|Home Theater Shack Redirect error [?] Sep 17, 2006

    http://www.hometheatershack.com/foru...591-congrats-o... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...620-episode-15... Redirect error [?] Sep 14, 2006
    http://www.hometheatershack.com/foru...620-episode-15... Redirect error [?] Sep 16, 2006
    http://www.hometheatershack.com/foru...65-favourite-c... Redirect error [?] Sep 9, 2006

    http://www.hometheatershack.com/foru...er-subwoofer-e... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...er-subwoofer-e... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...ch-sw-12a-page... Redirect error [?] Sep 17, 2006
    http://www.hometheatershack.com/foru...ch-sw-12a-page... Redirect error [?] Sep 17, 2006

  6. #6
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,744
    Liked
    169 times
    Mm.. may be there were some server issues at your host?
    Did anyone else experience this problem?

  7. #7
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    I recently changed host since getting these errors and I'm still getting them...

    URLs not followed (4966)

    This has to be an issue with vBSEO. Do I need to open a support ticket?

  8. #8
    vBSEO Staff Juan Muriente's Avatar
    Real Name
    Juan Carlos Muriente
    Join Date
    Jun 2005
    Location
    Puerto Rico
    Posts
    14,266
    Liked
    586 times
    Hello Sonnie,

    I've been researching further upon this issue and was unable to find a link between the rewrites and the error reported. At this point, I suspect it might be a bug with google webmaster tools. You might want to report it via their webmaster group for further feedback from Google (Google Groups: Google Webmaster Help)

    Please keep us updated on the outcome, thanks-you.

  9. #9
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    Have you checked this site (vbseo.com) to see if you have URL's not followed due to rewrite errors?

    Wouldn't it make sense that if it was a Google Webmaster Tool bug that it would be happening to more than just my site?

    I'm heard or seen of no one else having this problem, except me.

    I opened a ticket on this over 24 hours ago and no one has responded to that ticket. No one has offered to look at my vbseocp.php and/or .htaccess files.

    I'm curious as to how you could have researched this issue thuroughly.

  10. #10
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    13 times
    If the links works when clicked, then vBSEO is handling it correctly. It only makes sense that it's some issue with Google's tool. Are they continuing to show up, or are they all old dates like the samples posted?

  11. #11
    vBSEO Staff Juan Muriente's Avatar
    Real Name
    Juan Carlos Muriente
    Join Date
    Jun 2005
    Location
    Puerto Rico
    Posts
    14,266
    Liked
    586 times
    We are not showing this for vbseo.com - I'll post in the usergroup and see what they have to say.

  12. #12
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    Quote Originally Posted by Keith Cohen View Post
    Are they continuing to show up, or are they all old dates like the samples posted?
    The last ones to show are from 9/20/06 which appears to be the last time the Googlebot crawled our site, which doesn't make sense.

    Googlebot last successfully accessed your home page on Sep 20, 2006 .
    We may not know about all the pages of your site. Submit a Sitemap to tell us more about your site.
    It looks like it's not getting the sitemap, but I get an email everyday that says the sitemap was sent to Google and the ping was sucessful. Google spiders are on our site daily.


    All of the problem URL's appear to be from the public_html/forums directory ... none are from the public_html.

    Here's the .htaccess file in the /forums/ directory:

    RewriteEngine On

    RewriteCond %{HTTP_HOST} ^hometheatershack.com
    RewriteCond %{REQUEST_URI} ^/forums/
    RewriteRule (.*) http://www.hometheatershack.com/forums/$1 [R=301,L]

    RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

    RewriteCond %{REQUEST_FILENAME} -f
    RewriteCond %{REQUEST_FILENAME} (admincp|modcp|clientscript|cpstyles|images)/

    RewriteRule ^(.*)$ $1 [L]
    RewriteCond %{QUERY_STRING} !vbseourl=
    RewriteCond %{REQUEST_FILENAME} !chat
    RewriteRule ^(.*\.php)$ vbseo.php?vbseourl=$1&%{QUERY_STRING} [L]

    RewriteRule ^(archive/.*)$ vbseo.php?vbseourl=$1&%{QUERY_STRING} [L]

    RewriteCond %{REQUEST_FILENAME} !-f
    RewriteCond %{REQUEST_FILENAME} !-d
    RewriteRule ^(.+)$ vbseo.php?vbseourl=$1&%{QUERY_STRING} [L]

    I have also posted in the Google Group... last night, but no helpful response as of yet.

  13. #13
    Senior Member
    Real Name
    Keith Cohen
    Join Date
    Jul 2005
    Location
    Raleigh, NC USA
    Posts
    6,147
    Liked
    13 times
    Do you have your sitemaps added to your webmaster account? That should show if the sitemaps have been downloaded. Also, the Download Log in vBSEO Sitemap should show Google hitting all your individual sitemaps.

  14. #14
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    This is on the Download Sitemap Log for the last three days:

    557 2006-09-24 19:46 sitemap_index.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    558 19:49 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    559 2006-09-25 00:49 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    560 00:49 sitemap_index.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    561 01:09 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    562 16:15 sitemap.txt.gz Yahoo 74.6.72.233 Mozilla/5.0 (compatible; Yahoo! Slurp; Yahoo! Help -) Remove record

    563 17:03 sitemap_index.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    564 17:23 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    565 2006-09-26 00:49 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    566 00:49 sitemap_index.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

    567 01:14 sitemap_1.xml.gz Googlebot 66.249.72.45 Mozilla/5.0 (compatible; Googlebot/2.1; +Webmaster Help Center) Remove record

  15. #15
    Senior Member
    Real Name
    Sonnie
    Join Date
    May 2006
    Location
    L.A. (Lower Alabama)
    Posts
    307
    Liked
    2 times
    There are no sitemaps listed on the Webmaster Account. My individual sites are listed but not sitemaps.

    Do I need to add a sitemap? I didn't think this was necessary.

Page 1 of 3 1 2 3 LastLast

Similar Threads

  1. Sitemap generating a lot more urls
    By poprulz in forum Troubleshooting
    Replies: 13
    Last Post: 02-28-2007, 04:15 PM
  2. Google Sitemap-Listing of old url's option-from 1.7
    By T2DMan in forum Member Articles
    Replies: 0
    Last Post: 04-02-2006, 08:46 AM
  3. Redirect old URLs to index (phpBB)
    By MikeF in forum Custom Rewrite Rules
    Replies: 3
    Last Post: 02-07-2006, 02:40 PM
  4. Best way to redirect when moving URLS?
    By Spitfire in forum General Discussion
    Replies: 1
    Last Post: 11-03-2005, 08:50 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •