vBSEO Sitemap Generator 2.2 Released

I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?

thanks,

/me installed

Originally Posted by tavenger5

I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?

kinda discussing that here:
Sitemap-cronjob-error - "MySQL-server has gone away"

installed.. no issues what so ever.

Something is wrong at me.

I become a 403 at http://www.politikstube.de/forum/vbs...urllist.txt.gz for the Yahoo Sitemap-URL and the other one.

If i go to http://www.politikstube.de/forum/vbs...php?sitemap=$1 i get :

Sitemap File not found

But nothing has changed and before 2.2 everything works fine.

upgraded .

Generated the sitemaps . everything works fine but as u can see in attachment non of search engines notified ! ( it was working well before )

Any Idea ?

Try to regenerate sitemap again.

Originally Posted by Oleg Ignatiuk

Try to regenerate sitemap again.

I did more then one Time.

My Forum is in /forum/.

I used this in /forum/ .htaccess (the same like vBSEO):

Code:

RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

The data Folder has CHMOD 777.

It works before vBSEO 3.2 and Sitemap 2.2. But as i have updated the Sitemap today i see that Yahoo and Google no longer found the Sitemap. I am not really sure if it is a Problem of vBSEO or the Sitemap. Because between both Updates it did not check.

So i checked it with direct Path by myself and with http://www.politikstube.de/forum/vbseo_getsitemap.php?sitemap=$1 and http://www.politikstube.de/vbseo_getsitemap.php?sitemap=$1

Allways 403. The outgoing Ping works well to all Searchmachines - but the incoming then fails.

if you're getting a 403 (not a 404) you should be seeing 'permission denied'. When i go to your site, it re-directs me to the homepage, so i'm going to assume that's the standard action for a 404.

/forums/vbseo_sitemap/ works
/forums/vbseo_sitemap/data/ does not.

it appears that there is some restriction on the data folder itself.
is there an htaccess file in the data folder?
have you enabled anything via cpanel, etc to protect that directory?

Originally Posted by briansol

if you're getting a 403 (not a 404) you should be seeing 'permission denied'.

You will if you use the URL to the Files with a Downloadmanager.

Originally Posted by briansol

When i go to your site, it re-directs me to the homepage, so i'm going to assume that's the standard action for a 404.

It´s my Standardaction for every Errorcode.

Originally Posted by briansol

/forums/vbseo_sitemap/ works
/forums/vbseo_sitemap/data/ does not.

it appears that there is some restriction on the data folder itself.

No - it is completely (including Files in 777).

Originally Posted by briansol

is there an htaccess file in the data folder?
have you enabled anything via cpanel, etc to protect that directory?

Yes - and believe me i have no idea where it comes from.

Code:

deny from all

After deleting this .htaccess both Files are downloadable by direct URL.

But:

http://www.politikstube.de/forum/sitemap_index.xml.gz

and

http://www.politikstube.de/forum/urllist.txt.gz

as Redirects are still not working.

Any Idea to fix this second Problem?

I did more then one Time.

My reply was to "mecho" user.
What is your .htaccess file contents in forum folder?

Originally Posted by Oleg Ignatiuk

My reply was to "mecho" user.

Ups....

Please read my last Posting again above your Reply. Just a few Minutes ago the Problem is going smaller and only the Redirect Problem persists. And http://www.politikstube.de/forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 brings still back:

Sitemap file not found

Code:

DirectoryIndex index.php
ErrorDocument 400 http://www.politikstube.de/400.php
ErrorDocument 401 http://www.politikstube.de/401.php
ErrorDocument 403 http://www.politikstube.de/403.php
ErrorDocument 404 http://www.politikstube.de/404.php
ErrorDocument 500 http://www.politikstube.de/500.php

# Comment the following line (add '#' at the beginning)
# to disable mod_rewrite functions.
# Please note: you still need to disable the hack in
# the vBSEO control panel to stop url rewrites.
RewriteEngine On

# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root vB folder (i.e. RewriteBase /forums/)
# RewriteBase /

RewriteCond %{HTTP_HOST} !^www\.politikstube\.de
RewriteRule (.*) http://www.politikstube.de/forum/$1 [L,R=301]

RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|redir\.php)
RewriteRule ^((archive/)?(.*\.php(/.*)?)?)$ vbseo.php [L,QSA]

RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php [L,QSA]

####Charset
AddDefaultCharset Off 

####Gzip
<IfModule mod_rewrite.c>
RewriteCond %{REQUEST_FILENAME} -f
RewriteRule ^(.*)(js|css)$ redir.php?file=$1$2&type=$2 [L]
</IfModule>

####ETags
FileETag None

####Expires
<IfModule mod_expires.c>
ExpiresActive On
ExpiresByType image/gif A2592000
ExpiresByType image/jpeg A2592000
ExpiresByType image/png A2592000
ExpiresByType application/x-shockwave-flash A2592000
ExpiresByType text/css A2592000
ExpiresByType application/x-javascript A2592000
</IfModule>

Try to add "vbseo_sitemap" into this line:

Code:

RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images|vbseo_sitemap)/

thanks

Originally Posted by Oleg Ignatiuk

Try to add "vbseo_sitemap" into this line:

Code:

RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images|vbseo_sitemap)/

Sorry - still "Sitemap not found" with http://www.politikstube.de/forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1.