vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Site Map Too Big

This is a discussion on Site Map Too Big within the Troubleshooting forums, part of the vBSEO Google/Yahoo Sitemap category; I'm using vbSEO 3.0 and vbSEO -Sitemap 2.0 with vBulletin 3.6.4. vbSEO -Sitemap is creating, splitting up, and indexing the ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > Troubleshooting

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 05-24-2007, 11:34 AM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
Site Map Too Big

I'm using vbSEO 3.0 and vbSEO-Sitemap 2.0 with vBulletin 3.6.4.

vbSEO-Sitemap is creating, splitting up, and indexing the normal sitemap fine however, the url re-written file it's creating is not splitting up and is way to big for Google and is causing errors.

I've had a look through all the options in both and can't find anything to tell it to split up the file and create a sitemap index file for it.

Also, I've told vbSEO-Sitemap to create the sitemap files in the site root folder but it insists on defaulting to the /vbSEO-Sitemap/data folder.

As usual, any words of wisdom greatly appreciated.

Thanks

Dave

Last edited by AIUK; 05-24-2007 at 11:45 AM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 05-24-2007, 11:53 AM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
In case it helps, this is the normal sitemap that vbSEO-sitemap writes (I moved it to the site root):

http://www.archery-interchange.com/sitemap_index.xml.gz

And this is the one it created with all the re-written urls:

http://www.archery-interchange.com/urllist.txt.gz

Ah, just noticed that the second one's a txt file and the re-written urls do appear in the main split of the generated sitemap...



So as not to waste this thread, what is the urllist.txt? And how do I get it to save the sitemap in the root rather than the data folder?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 05-24-2007, 12:03 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
What is the error you get from Google?

Quote:
Also, I've told vbSEO-Sitemap to create the sitemap files in the site root folder but it insists on defaulting to the /vbSEO-Sitemap/data folder.
Files should be stored in data/ folder, but they are still accessible via forums root using rewrite rules in .htaccess.
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 05-24-2007, 12:23 PM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
Quote:
Originally Posted by Oleg Ignatiuk View Post
What is the error you get from Google?
Cheers, Oleg, I think I've got the Google problem sorted now.


Quote:
Files should be stored in data/ folder, but they are still accessible via forums root using rewrite rules in .htaccess.
Sorry to be a pain, but could you give me a few pointers as to what should be in the .htaccess file and in which location should it be placed (I'm presuming root, but I have been wrong before... )
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 05-24-2007, 12:34 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Default vBSEO's .htaccess already includes required rewrite rule, so you should not change anything to get it working
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 05-24-2007, 12:57 PM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
This is what's already contained in the /forum/vbseo_sitemap/data/.htaccess file (seems to be the same code as the default .htaccess supplied with vbSEO):

Code:
RewriteEngine On
RewriteRule ^(sitemap.*\.(xml|txt)(\.gz)?)$ vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
But it doesn't seem to be writing the sitemap files to root
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 05-24-2007, 01:54 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Quote:
This is what's already contained in the /forum/vbseo_sitemap/data/.htaccess file (seems to be the same code as the default .htaccess supplied with vbSEO):
You should upload default .htaccess file from vBSEO Sitemap Generator package and do not modify it. There is no need to modify any .htaccess files if you already have vBSEO installed.

Quote:
But it doesn't seem to be writing the sitemap files to root
It should never write sitemap files to the root. As mentioned above, all files are stored in the data/ folder.
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 05-25-2007, 07:06 AM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
Cheers, Oleg, it's all starting to slowly sink in

So, I submit the url http://www.mysite.com/forum to Google
The sitemap is stored in vbseo_sitemap/data
The .htaccess file directs Google to the sitemap files in the data folder
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 05-25-2007, 02:36 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
Yes, but:
1. you submit http://www.mysite.com/forum as a new *site* in webmaster account
2. then submit http://www.mysite.com/forum/sitemap_index.xml.gz for that site
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #10  
Old 05-25-2007, 08:12 PM
Junior Member
 
Real Name: Dave
Join Date: May 2007
Location: UK
Posts: 14
Cheers, Oleg. I've done all that, now I'm getting errors from Google saying that
Quote:
Originally Posted by Google
Unsupported file format
Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.
All 7 sitemap files pointed to by sitemap_index.xml.gz are "xml.gz" format.

Yet it seemed to read them fine when I was moving them into the site root!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #11  
Old 05-25-2007, 08:51 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 21,923
I just submitted http://www.archery-interchange.com/f...p_index.xml.gz and got no errors:
Quote:
sitemap_index.xml.gz Sitemap Index Web 12 minutes ago 10 minutes ago OK –
__________________
Oleg Ignatiuk / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
The vBSEO LinkBacks User Guide - vBSEO 3.0 GOLD Joe Ward General Discussion 25 06-05-2008 12:04 PM


All times are GMT -4. The time now is 09:50 PM.


Powered by vBulletin Version 3.8.0 Release Candidate 2
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.