I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?
vBulletin 4, the most powerful community software + vBSEO 3.5, the ultimate SEO solution = Your ultimate platform for 2010 and beyond. Click below to learn more.
This is a discussion on vBSEO Sitemap Generator 2.2 Released within the vBSEO Announcements forums, part of the Announcements & Pre-Sales category; I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or ...
I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?
thanks,
/me installed![]()
Are you on Twitter? @BrandonSheley | Social Media blog
Latest projects: General Forums | TopekaTweetup
kinda discussing that here:
Sitemap-cronjob-error - "MySQL-server has gone away"
installed.. no issues what so ever.![]()
AshfordTalk.co.uk - Coming Soon
Something is wrong at me.
I become a 403 at http://www.politikstube.de/forum/vbs...urllist.txt.gz for the Yahoo Sitemap-URL and the other one.
If i go to http://www.politikstube.de/forum/vbs...php?sitemap=$1 i get :
But nothing has changed and before 2.2 everything works fine.Sitemap File not found![]()
upgraded .
Generated the sitemaps . everything works fine but as u can see in attachment non of search engines notified ! ( it was working well before )
Any Idea ?
Try to regenerate sitemap again.
Oleg Ignatiuk / Crawlability Inc.
Sneek Preview Video of the new Control Panel
vBSEO 3.5 RC2 (Final)- Released for your Evaluation
I did more then one Time.
My Forum is in /forum/.
I used this in /forum/ .htaccess (the same like vBSEO):
The data Folder has CHMOD 777.Code:RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
It works before vBSEO 3.2 and Sitemap 2.2. But as i have updated the Sitemap today i see that Yahoo and Google no longer found the Sitemap. I am not really sure if it is a Problem of vBSEO or the Sitemap. Because between both Updates it did not check.
So i checked it with direct Path by myself and with http://www.politikstube.de/forum/vbseo_getsitemap.php?sitemap=$1 and http://www.politikstube.de/vbseo_getsitemap.php?sitemap=$1
Allways 403. The outgoing Ping works well to all Searchmachines - but the incoming then fails.
Last edited by redlabour; 07-07-2008 at 07:12 PM.
if you're getting a 403 (not a 404) you should be seeing 'permission denied'. When i go to your site, it re-directs me to the homepage, so i'm going to assume that's the standard action for a 404.
/forums/vbseo_sitemap/ works
/forums/vbseo_sitemap/data/ does not.
it appears that there is some restriction on the data folder itself.
is there an htaccess file in the data folder?
have you enabled anything via cpanel, etc to protect that directory?
You will if you use the URL to the Files with a Downloadmanager.
It´s my Standardaction for every Errorcode.
No - it is completely (including Files in 777).
Yes - and believe me i have no idea where it comes from.
After deleting this .htaccess both Files are downloadable by direct URL.Code:deny from all
But:
http://www.politikstube.de/forum/sitemap_index.xml.gz
and
http://www.politikstube.de/forum/urllist.txt.gz
as Redirects are still not working.
Any Idea to fix this second Problem?
My reply was to "mecho" user.I did more then one Time.
What is your .htaccess file contents in forum folder?
Oleg Ignatiuk / Crawlability Inc.
Sneek Preview Video of the new Control Panel
vBSEO 3.5 RC2 (Final)- Released for your Evaluation
Ups....
Please read my last Posting again above your Reply. Just a few Minutes ago the Problem is going smaller and only the Redirect Problem persists. And http://www.politikstube.de/forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 brings still back:
Sitemap file not foundCode:DirectoryIndex index.php ErrorDocument 400 http://www.politikstube.de/400.php ErrorDocument 401 http://www.politikstube.de/401.php ErrorDocument 403 http://www.politikstube.de/403.php ErrorDocument 404 http://www.politikstube.de/404.php ErrorDocument 500 http://www.politikstube.de/500.php # Comment the following line (add '#' at the beginning) # to disable mod_rewrite functions. # Please note: you still need to disable the hack in # the vBSEO control panel to stop url rewrites. RewriteEngine On # Some servers require the Rewritebase directive to be # enabled (remove '#' at the beginning to activate) # Please note: when enabled, you must include the path # to your root vB folder (i.e. RewriteBase /forums/) # RewriteBase / RewriteCond %{HTTP_HOST} !^www\.politikstube\.de RewriteRule (.*) http://www.politikstube.de/forum/$1 [L,R=301] RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L] RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|redir\.php) RewriteRule ^((archive/)?(.*\.php(/.*)?)?)$ vbseo.php [L,QSA] RewriteCond %{REQUEST_FILENAME} !-f RewriteCond %{REQUEST_FILENAME} !-d RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/ RewriteRule ^(.+)$ vbseo.php [L,QSA] ####Charset AddDefaultCharset Off ####Gzip <IfModule mod_rewrite.c> RewriteCond %{REQUEST_FILENAME} -f RewriteRule ^(.*)(js|css)$ redir.php?file=$1$2&type=$2 [L] </IfModule> ####ETags FileETag None ####Expires <IfModule mod_expires.c> ExpiresActive On ExpiresByType image/gif A2592000 ExpiresByType image/jpeg A2592000 ExpiresByType image/png A2592000 ExpiresByType application/x-shockwave-flash A2592000 ExpiresByType text/css A2592000 ExpiresByType application/x-javascript A2592000 </IfModule>
Try to add "vbseo_sitemap" into this line:
Code:RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images|vbseo_sitemap)/
Oleg Ignatiuk / Crawlability Inc.
Sneek Preview Video of the new Control Panel
vBSEO 3.5 RC2 (Final)- Released for your Evaluation
thanks![]()