Results 1 to 9 of 9

Sitemap format + wrong mime.

This is a discussion on Sitemap format + wrong mime. within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Hi, my text sitemap is not being generated properly... http://www.worldfootballforums.com/sitemap.txt.gz It asks to download the file (good so far), but ...

  1. #1
    rob
    rob is offline
    Senior Member rob's Avatar
    Real Name
    Rob
    Join Date
    Oct 2005
    Location
    Eastbourne, UK
    Posts
    982
    Liked
    2 times

    Sitemap format + wrong mime.

    Hi, my text sitemap is not being generated properly...

    http://www.worldfootballforums.com/sitemap.txt.gz

    It asks to download the file (good so far), but you cant open it in winrar or anything else.... you can only open it in notepad (therefore, it's normal text... not gzip).... it's not a valid gz archive.

    Also, when hitting all the other xml sitemaps (gzipped versions), they open INSIDE the browser window.... so, serving with wrong mime type AND obviously not a gzip archive.

    This happens on both domains I am running vbseo on:-http://www.worldfootballforums.com
    http://www.webforumz.com

    Please let me know if I have done something wrong.
    Rob - SEO Specialist

  2. #2
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    Hi Rob,

    the browsers support the "Content-Encoding: gzip" header which allows to transfer files compressed with gzip but they are uncompressed on-the-fly by browser.

    You can check that when you request sitemaps with download manager software (not browser), the files are transferred and stored compressed.
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  3. #3
    rob
    rob is offline
    Senior Member rob's Avatar
    Real Name
    Rob
    Join Date
    Oct 2005
    Location
    Eastbourne, UK
    Posts
    982
    Liked
    2 times
    Quote Originally Posted by Oleg Ignatiuk
    Hi Rob,

    the browsers support the "Content-Encoding: gzip" header which allows to transfer files compressed with gzip but they are uncompressed on-the-fly by browser.

    You can check that when you request sitemaps with download manager software (not browser), the files are transferred and stored compressed.
    Oleg, by FTP'ing the files directly in the data directory and checking them out, I can confirm that everything is ok.... however, there really is an issue with the text version.... if you dont believe me, click the link in my post above and see what you make of it.
    Rob - SEO Specialist

  4. #4
    rob
    rob is offline
    Senior Member rob's Avatar
    Real Name
    Rob
    Join Date
    Oct 2005
    Location
    Eastbourne, UK
    Posts
    982
    Liked
    2 times
    in fact....

    http://www.vbseo.com/sitemap.txt.gz

    Save it to you PC, then try open it with a archive app.

    Same issue.
    Rob - SEO Specialist

  5. #5
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    I just downloaded the http://www.worldfootballforums.com/sitemap.txt.gz file with Download manager and have the following
    sitemap.txt.gz 37750 bytes (which is correct)

    As I mentioned, browsers accept the HTTP_ACCEPT_ENCODING behaviour, so they uncompress it on request.

    But if you are confused with it AND don't want to take advantage of viewing the sitemap files directly in your browser, you can modify the vbseo_sitemap/vbseo_getsitemap.php file

    FIND:
    if($ext=='gz' && ($umatch[1] || !strstr($_SERVER['HTTP_ACCEPT_ENCODING'],'gzip')) )
    {
    @header( 'Content-Type: ' . $content_types[$ext] );
    }else
    {
    @header('Content-Type: '.($content_types[$preext] ? $content_types[$preext] : $content_types[$ext]) );
    if($ext=='gz')
    @header('Content-Encoding: gzip' );
    }
    REPLACE WITH:
    @header( 'Content-Type: ' . $content_types[$ext] );
    EDIT

    in fact....

    http://www.vbseo.com/sitemap.txt.gz

    Save it to you PC, then try open it with a archive app.

    Same issue.
    Same as above, saved:
    sitemap.txt.gz 58796 bytes (compressed file on disk)
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  6. #6
    rob
    rob is offline
    Senior Member rob's Avatar
    Real Name
    Rob
    Join Date
    Oct 2005
    Location
    Eastbourne, UK
    Posts
    982
    Liked
    2 times
    I think you are not understanding me... or I am not understanding you.

    I can obviously save it to my PC also.... but why can I NOT open this in winrar or anything else? It's says it's not a valid archive.

    Surely if you are serving a file as .gz then it should be a valid archive?
    Rob - SEO Specialist

  7. #7
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    Mm.. is the file you downloaded of the same size as I wrote in previous post?
    Which software do you use to download the files?

    (I can open both files correctly in winrar after downloading)
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


  8. #8
    rob
    rob is offline
    Senior Member rob's Avatar
    Real Name
    Rob
    Join Date
    Oct 2005
    Location
    Eastbourne, UK
    Posts
    982
    Liked
    2 times
    Weird.... I save it in firefox and it's ok.

    Anyway, why can I not submit it to yahoo?

    I try and submit these:-
    http://www.worldfootballforums.com/sitemap.txt.gz
    http://www.webforumz.com/sitemap.txt.gz

    and it always throws this back:-

    The following resulted when trying to access your document: timeout

    Is this an issue with yahoo?
    Rob - SEO Specialist

  9. #9
    vBSEO Staff Oleg Ignatiuk's Avatar
    Real Name
    Oleg Ignatiuk
    Join Date
    Jun 2005
    Location
    Belarus
    Posts
    25,689
    Liked
    157 times
    It may take several tries to submit without timeout:
    Timeout error when submitting to Yahoo

    Please give it a try

    Edit: I've just submitted both your URLs to Yahoo at http://submit.search.yahoo.com/free/request without "timeout message".
    Oleg Ignatiuk / Crawlability Inc.
    vBSEO 3.6.0 GOLD Released!
    Unveiling the NEW vBSEO Sitemap Generator 3.0. - available NOW for vBSEO Customers!


Similar Threads

  1. Memory Problem:
    By TraumTeam in forum Troubleshooting
    Replies: 1
    Last Post: 04-06-2006, 09:24 AM
  2. Google says sitemap format not supported
    By Lerris in forum Troubleshooting
    Replies: 2
    Last Post: 02-24-2006, 04:15 PM
  3. Replies: 0
    Last Post: 12-17-2005, 02:11 PM
  4. adding my vbadvanced pages....
    By BamaStangGuy in forum General Discussion
    Replies: 8
    Last Post: 12-12-2005, 11:18 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •