vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Team: Hot or Not? Ready for Traffic Explosion? vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! vBSEO Helps Forum Earn $100/day from Google AdSense Discover the Power of "Long Tail Search" Crawlability Inc. Files for SEO Technology Patent
se sw

vBSEO Sitemap Generator 2.2 Released

This is a discussion on vBSEO Sitemap Generator 2.2 Released within the vBSEO Announcements forums, part of the Announcements & Pre-Sales category; I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or ...

Go Back   vBulletin SEO Forums > Announcements & Pre-Sales > vBSEO Announcements

Enhancing 80 million pages.

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Reply

 

LinkBack Thread Tools
  #16  
Old 07-07-2008, 11:16 AM
Senior Member
Big Board Administrator
 
Real Name: John
Join Date: Dec 2005
Posts: 349
I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #17  
Old 07-07-2008, 11:17 AM
Loco's Avatar
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Brandon Sheley
Join Date: Oct 2005
Location: Kansas
Posts: 1,851
Blog Entries: 1
Send a message via AIM to Loco Send a message via MSN to Loco Send a message via Yahoo to Loco
thanks,

/me installed
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #18  
Old 07-07-2008, 12:03 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 4,724
Quote:
Originally Posted by tavenger5 View Post
I noticed that running the sitemap takes significantly longer (1300 seconds). Is there any way to speed this up or is that just how it is with over a million pages?
kinda discussing that here:
Sitemap-cronjob-error - "MySQL-server has gone away"
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #19  
Old 07-07-2008, 02:23 PM
Martyn's Avatar
Senior Member
 
Real Name: Martyn Day
Join Date: Dec 2005
Location: Kent - UK
Posts: 430
Blog Entries: 1
Send a message via MSN to Martyn Send a message via Skype™ to Martyn
installed.. no issues what so ever.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #20  
Old 07-07-2008, 02:46 PM
redlabour's Avatar
Senior Member
 
Real Name: André
Join Date: Sep 2005
Location: Germany, NRW
Posts: 259
Something is wrong at me.

I become a 403 at http://www.politikstube.de/forum/vbs...urllist.txt.gz for the Yahoo Sitemap-URL and the other one.

If i go to http://www.politikstube.de/forum/vbs...php?sitemap=$1 i get :

Quote:
Sitemap File not found
But nothing has changed and before 2.2 everything works fine.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #21  
Old 07-07-2008, 03:48 PM
Member
 
Real Name: Mecho
Join Date: Dec 2007
Posts: 46
upgraded .

Generated the sitemaps . everything works fine but as u can see in attachment non of search engines notified ! ( it was working well before )

Any Idea ?
Attached Thumbnails
noitfy.gif  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #22  
Old 07-07-2008, 06:39 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 20,438
Blog Entries: 1
Try to regenerate sitemap again.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #23  
Old 07-07-2008, 06:49 PM
redlabour's Avatar
Senior Member
 
Real Name: André
Join Date: Sep 2005
Location: Germany, NRW
Posts: 259
Quote:
Originally Posted by Oleg Ignatiuk View Post
Try to regenerate sitemap again.
I did more then one Time.

My Forum is in /forum/.

I used this in /forum/ .htaccess (the same like vBSEO):

Code:
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
The data Folder has CHMOD 777.

It works before vBSEO 3.2 and Sitemap 2.2. But as i have updated the Sitemap today i see that Yahoo and Google no longer found the Sitemap. I am not really sure if it is a Problem of vBSEO or the Sitemap. Because between both Updates it did not check.

So i checked it with direct Path by myself and with http://www.politikstube.de/forum/vbseo_getsitemap.php?sitemap=$1 and http://www.politikstube.de/vbseo_getsitemap.php?sitemap=$1

Allways 403. The outgoing Ping works well to all Searchmachines - but the incoming then fails.

Last edited by redlabour; 07-07-2008 at 07:12 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #24  
Old 07-07-2008, 07:51 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 4,724
if you're getting a 403 (not a 404) you should be seeing 'permission denied'. When i go to your site, it re-directs me to the homepage, so i'm going to assume that's the standard action for a 404.

/forums/vbseo_sitemap/ works
/forums/vbseo_sitemap/data/ does not.

it appears that there is some restriction on the data folder itself.
is there an htaccess file in the data folder?
have you enabled anything via cpanel, etc to protect that directory?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #25  
Old 07-07-2008, 08:20 PM
redlabour's Avatar
Senior Member
 
Real Name: André
Join Date: Sep 2005
Location: Germany, NRW
Posts: 259
Quote:
Originally Posted by briansol View Post
if you're getting a 403 (not a 404) you should be seeing 'permission denied'.
You will if you use the URL to the Files with a Downloadmanager.

Quote:
Originally Posted by briansol View Post
When i go to your site, it re-directs me to the homepage, so i'm going to assume that's the standard action for a 404.
It´s my Standardaction for every Errorcode.

Quote:
Originally Posted by briansol View Post
/forums/vbseo_sitemap/ works
/forums/vbseo_sitemap/data/ does not.

it appears that there is some restriction on the data folder itself.
No - it is completely (including Files in 777).

Quote:
Originally Posted by briansol View Post
is there an htaccess file in the data folder?
have you enabled anything via cpanel, etc to protect that directory?
Yes - and believe me i have no idea where it comes from.

Code:
deny from all
After deleting this .htaccess both Files are downloadable by direct URL.

But:

http://www.politikstube.de/forum/sitemap_index.xml.gz

and

http://www.politikstube.de/forum/urllist.txt.gz

as Redirects are still not working.

Any Idea to fix this second Problem?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #26  
Old 07-07-2008, 08:25 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 20,438
Blog Entries: 1
Quote:
I did more then one Time.
My reply was to "mecho" user.
What is your .htaccess file contents in forum folder?
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #27  
Old 07-07-2008, 08:28 PM
redlabour's Avatar
Senior Member
 
Real Name: André
Join Date: Sep 2005
Location: Germany, NRW
Posts: 259
Quote:
Originally Posted by Oleg Ignatiuk View Post
My reply was to "mecho" user.
Ups....

Please read my last Posting again above your Reply. Just a few Minutes ago the Problem is going smaller and only the Redirect Problem persists. And http://www.politikstube.de/forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 brings still back:

Quote:
Sitemap file not found
Code:
DirectoryIndex index.php
ErrorDocument 400 http://www.politikstube.de/400.php
ErrorDocument 401 http://www.politikstube.de/401.php
ErrorDocument 403 http://www.politikstube.de/403.php
ErrorDocument 404 http://www.politikstube.de/404.php
ErrorDocument 500 http://www.politikstube.de/500.php

# Comment the following line (add '#' at the beginning)
# to disable mod_rewrite functions.
# Please note: you still need to disable the hack in
# the vBSEO control panel to stop url rewrites.
RewriteEngine On

# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root vB folder (i.e. RewriteBase /forums/)
# RewriteBase /

RewriteCond %{HTTP_HOST} !^www\.politikstube\.de
RewriteRule (.*) http://www.politikstube.de/forum/$1 [L,R=301]

RewriteRule ^((urllist|sitemap).*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]

RewriteCond %{REQUEST_URI} !(admincp/|modcp/|cron|redir\.php)
RewriteRule ^((archive/)?(.*\.php(/.*)?)?)$ vbseo.php [L,QSA]

RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images)/
RewriteRule ^(.+)$ vbseo.php [L,QSA]

####Charset
AddDefaultCharset Off 

####Gzip
<IfModule mod_rewrite.c>
RewriteCond %{REQUEST_FILENAME} -f
RewriteRule ^(.*)(js|css)$ redir.php?file=$1$2&type=$2 [L]
</IfModule>

####ETags
FileETag None

####Expires
<IfModule mod_expires.c>
ExpiresActive On
ExpiresByType image/gif A2592000
ExpiresByType image/jpeg A2592000
ExpiresByType image/png A2592000
ExpiresByType application/x-shockwave-flash A2592000
ExpiresByType text/css A2592000
ExpiresByType application/x-javascript A2592000
</IfModule>
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #28  
Old 07-07-2008, 09:20 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 20,438
Blog Entries: 1
Try to add "vbseo_sitemap" into this line:
Code:
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images|vbseo_sitemap)/
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

vBSEO Google Sitemap Generator - Version 2.2 Released Mandatory Upgrade for vBSEO 3.2.0 GOLD

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #29  
Old 07-07-2008, 10:58 PM
Junior Member
 
Real Name: Yaqoob
Join Date: Dec 2007
Posts: 6
thanks
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #30  
Old 07-08-2008, 02:11 AM
redlabour's Avatar
Senior Member
 
Real Name: André
Join Date: Sep 2005
Location: Germany, NRW
Posts: 259
Quote:
Originally Posted by Oleg Ignatiuk View Post
Try to add "vbseo_sitemap" into this line:
Code:
RewriteCond %{REQUEST_FILENAME} !^(admincp|modcp|clientscript|cpstyles|images|vbseo_sitemap)/
Sorry - still "Sitemap not found" with http://www.politikstube.de/forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Tags
2.2, sitemap, sitemap generator

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads

Thread Thread Starter Forum Replies Last Post
vBSEO Sitemap Generator ile album sayfalari icin sitemap olusturma ABDALWAHID Türkçe 4 05-13-2008 11:08 AM
vBSEO Sitemap Generator generated incorrect sitemap URL X1C3W5 Troubleshooting 2 01-02-2008 11:45 AM
vBSEO Sitemap Generator 2.0 Released Juan Muriente vBSEO Announcements 18 12-11-2007 01:44 PM
vBSEO Google/Yahoo Sitemap Generator Released at vBulletin.org Joe Ward vBSEO Announcements 0 11-09-2005 02:03 AM


All times are GMT -4. The time now is 11:22 AM.


Powered by vBulletin Version 3.7.3
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0 ©2008, Crawlability, Inc.