vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Sitemap format + wrong mime.

This is a discussion on Sitemap format + wrong mime. within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; Hi, my text sitemap is not being generated properly... http://www.worldfootballforums.com/sitemap.txt.gz It asks to download the file (good so far), but ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > Troubleshooting

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 12-21-2005, 06:21 AM
rob's Avatar
rob rob is offline
Senior Member
vBSEO Pre-Release Team
 
Real Name: Rob
Join Date: Oct 2005
Location: Eastbourne, UK
Posts: 862
Send a message via MSN to rob Send a message via Skype™ to rob
Sitemap format + wrong mime.

Hi, my text sitemap is not being generated properly...

http://www.worldfootballforums.com/sitemap.txt.gz

It asks to download the file (good so far), but you cant open it in winrar or anything else.... you can only open it in notepad (therefore, it's normal text... not gzip).... it's not a valid gz archive.

Also, when hitting all the other xml sitemaps (gzipped versions), they open INSIDE the browser window.... so, serving with wrong mime type AND obviously not a gzip archive.

This happens on both domains I am running vbseo on:-http://www.worldfootballforums.com
http://www.webforumz.com

Please let me know if I have done something wrong.
__________________
Rob Collyer - SEO Specialist
StudentMidwife.NET
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 12-21-2005, 08:35 AM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Re: Sitemap format + wrong mime.

Hi Rob,

the browsers support the "Content-Encoding: gzip" header which allows to transfer files compressed with gzip but they are uncompressed on-the-fly by browser.

You can check that when you request sitemaps with download manager software (not browser), the files are transferred and stored compressed.
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 12-21-2005, 08:40 AM
rob's Avatar
rob rob is offline
Senior Member
vBSEO Pre-Release Team
 
Real Name: Rob
Join Date: Oct 2005
Location: Eastbourne, UK
Posts: 862
Send a message via MSN to rob Send a message via Skype™ to rob
Re: Sitemap format + wrong mime.

Quote:
Originally Posted by Oleg Ignatiuk
Hi Rob,

the browsers support the "Content-Encoding: gzip" header which allows to transfer files compressed with gzip but they are uncompressed on-the-fly by browser.

You can check that when you request sitemaps with download manager software (not browser), the files are transferred and stored compressed.
Oleg, by FTP'ing the files directly in the data directory and checking them out, I can confirm that everything is ok.... however, there really is an issue with the text version.... if you dont believe me, click the link in my post above and see what you make of it.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 12-21-2005, 08:43 AM
rob's Avatar
rob rob is offline
Senior Member
vBSEO Pre-Release Team
 
Real Name: Rob
Join Date: Oct 2005
Location: Eastbourne, UK
Posts: 862
Send a message via MSN to rob Send a message via Skype™ to rob
Re: Sitemap format + wrong mime.

in fact....

http://www.vbseo.com/sitemap.txt.gz

Save it to you PC, then try open it with a archive app.

Same issue.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 12-21-2005, 08:50 AM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Re: Sitemap format + wrong mime.

I just downloaded the http://www.worldfootballforums.com/sitemap.txt.gz file with Download manager and have the following
sitemap.txt.gz 37750 bytes (which is correct)

As I mentioned, browsers accept the HTTP_ACCEPT_ENCODING behaviour, so they uncompress it on request.

But if you are confused with it AND don't want to take advantage of viewing the sitemap files directly in your browser, you can modify the vbseo_sitemap/vbseo_getsitemap.php file

FIND:
Quote:
if($ext=='gz' && ($umatch[1] || !strstr($_SERVER['HTTP_ACCEPT_ENCODING'],'gzip')) )
{
@header( 'Content-Type: ' . $content_types[$ext] );
}else
{
@header('Content-Type: '.($content_types[$preext] ? $content_types[$preext] : $content_types[$ext]) );
if($ext=='gz')
@header('Content-Encoding: gzip' );
}
REPLACE WITH:
Quote:
@header( 'Content-Type: ' . $content_types[$ext] );
EDIT

Quote:
in fact....

http://www.vbseo.com/sitemap.txt.gz

Save it to you PC, then try open it with a archive app.

Same issue.
Same as above, saved:
sitemap.txt.gz 58796 bytes (compressed file on disk)
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 12-21-2005, 11:58 AM
rob's Avatar
rob rob is offline
Senior Member
vBSEO Pre-Release Team
 
Real Name: Rob
Join Date: Oct 2005
Location: Eastbourne, UK
Posts: 862
Send a message via MSN to rob Send a message via Skype™ to rob
Re: Sitemap format + wrong mime.

I think you are not understanding me... or I am not understanding you.

I can obviously save it to my PC also.... but why can I NOT open this in winrar or anything else? It's says it's not a valid archive.

Surely if you are serving a file as .gz then it should be a valid archive?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 12-21-2005, 12:04 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Re: Sitemap format + wrong mime.

Mm.. is the file you downloaded of the same size as I wrote in previous post?
Which software do you use to download the files?

(I can open both files correctly in winrar after downloading)
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 12-21-2005, 12:14 PM
rob's Avatar
rob rob is offline
Senior Member
vBSEO Pre-Release Team
 
Real Name: Rob
Join Date: Oct 2005
Location: Eastbourne, UK
Posts: 862
Send a message via MSN to rob Send a message via Skype™ to rob
Re: Sitemap format + wrong mime.

Weird.... I save it in firefox and it's ok.

Anyway, why can I not submit it to yahoo?

I try and submit these:-
http://www.worldfootballforums.com/sitemap.txt.gz
http://www.webforumz.com/sitemap.txt.gz

and it always throws this back:-

The following resulted when trying to access your document: timeout

Is this an issue with yahoo?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 12-21-2005, 12:24 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Re: Sitemap format + wrong mime.

It may take several tries to submit without timeout:
Timeout error when submitting to Yahoo

Please give it a try

Edit: I've just submitted both your URLs to Yahoo at http://submit.search.yahoo.com/free/request without "timeout message".
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Memory Problem: TraumTeam Troubleshooting 1 04-06-2006 09:24 AM
Google says sitemap format not supported Lerris Troubleshooting 2 02-24-2006 04:15 PM
vBSEO Google/Yahoo Sitemap Generator for vBulletin 3.6.x, vBulletin 3.5.x & vBulletin 3.0.x Joe Ward General Discussion 0 12-17-2005 02:11 PM
adding my vbadvanced pages.... BamaStangGuy General Discussion 8 12-12-2005 11:18 AM


All times are GMT -4. The time now is 09:27 PM.


Powered by vBulletin Version 3.8.0 Release Candidate 2
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.