Keep getting red X's in Webmaster tools, 110,000 pages indexed to just 10,000

Hi,

I keep getting red X's in Google Webmaster tools, don't really know why the sitemap has errors, here is some info:

htaccess:

Code:

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap/) 
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteEngine On

####Charset
AddDefaultCharset Off 

####Gzip
<IfModule mod_rewrite.c>
RewriteCond %{REQUEST_FILENAME} -f
RewriteRule ^(.*)(js|css)$ redir.php?file=$1$2&type=$2 [L]
</IfModule>

####ETags
FileETag None

####Expires
<IfModule mod_expires.c>
ExpiresActive On
ExpiresByType image/gif A2592000
ExpiresByType image/jpeg A2592000
ExpiresByType image/png A2592000
ExpiresByType application/x-shockwave-flash A2592000
ExpiresByType text/css A2592000
ExpiresByType application/x-javascript A2592000
</IfModule>

RewriteEngine On 
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^view_(.*).htm$ view.php?pg=$1


ErrorDocument 400 /400_forum.php
ErrorDocument 401 /401_forum.php
ErrorDocument 403 /403_forum.php
ErrorDocument 404 /404_forum.php
ErrorDocument 500 /500_forum.php

Options +FollowSymLinks
RewriteEngine On
RewriteCond %{HTTP_HOST} ^phornixx\.com$
RewriteRule ^(.*)$ http://www.phornixx.com/$1 [R=301,L]

Admincp snapshot:









Please I need to find a solution almost the half of my traffic is gone.

Thanks in advanced!

Hello,

Where are the red x's showing? What is the exact error?

Te red X's are in the Webmaster tools Sitemaps area:

The error is the next:

Parsing error
We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

This error just appears in one of the subsitemaps, I mean this:




Thanks!

Hello,

Please click on sitemap_8.xml.gz and it should show you the errors.

Code:

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap/) 
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteEngine On

is incorrect.

The sitemap rule must come AFTER you turn the engine on, and i don't know where you got the vBSEO core product htaccess from, but that too should not be there.

Code:

RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

should replace what you have.

Originally Posted by Michael Biddle

Hello,

Please click on sitemap_8.xml.gz and it should show you the errors.

The error is in my previous post:

Code:

Parsing error
We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

Originally Posted by Brian Cummiskey

Code:

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|vbseo_sitemap/) 
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteEngine On

is incorrect.

The sitemap rule must come AFTER you turn the engine on, and i don't know where you got the vBSEO core product htaccess from, but that too should not be there.

Code:

RewriteEngine On
RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

should replace what you have.

I've made the change, do you think that was the source of the error?


Thanks!

This sitemaps were probably not accessible before.

But, if they somehow were, the error is not related to a parse error.

It sounds like your script is timing out. I would suggest either increasing your memory_limit and/or wait_timeout settings so that the script fully completes.

But the problem is not everyday, it just happens once or twice a week. Most of the days the sitemaps are Ok.

Which makes sense... sometimes your server will have more users/load on it than others. When its slow, the sitemap will likely complete. When its busy and it runs, there might not be enough resources.

Ok, I will check it with my host and I reply back, thankyou very much.

Well, the time is not the issue now (I've increased the time to 600 secs which is enough), but the sitemap randomly generates with errors. One week it generates fine and the other start with problems.

Here is what google says:

222007 Parsing error
We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

The file:

http://www.phornixx.com/sitemap_9.xml.gz

The other files generate just fine.


Thanks!!

Sitemap file looks ok, try to remove sitemap entry in webmaster account and then resubmit it.