vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now!
vBSEO 2.0 Style Released vBSEO 3.3.0 GOLD Launched vBSEO's "LiveStats" for Google Analytics vB Sitemap Generator, Version 2.5 Success with vBSEO = 600ore Web Visitors + $1400 in a Day!

Crawl rate - Google webmaster tools

This is a discussion on Crawl rate - Google webmaster tools within the Analysis: Traffic & SERPS forums, part of the vBulletin SEO Discussion category; Had a look in Google webmaster tools today (been a while since I last looked) and found 'Crawl rate' under ...

Go Back   vBulletin SEO Forums > vBulletin SEO Discussion > Analysis: Traffic & SERPS

Crawl rate - Google webmaster tools Crawl rate - Google webmaster tools

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read

Reply

 

LinkBack Thread Tools
  #1  
Old 01-06-2009, 01:28 PM
Senior Member
Big Board Administrator
  
Real Name: Stewart
Join Date: Apr 2007
Posts: 443
Crawl rate - Google webmaster tools
Had a look in Google webmaster tools today (been a while since I last looked) and found 'Crawl rate' under 'Setting' (last time I looked this was grayed out).

So I've put the crawl rate up 100% too 1 request every second (rather than 1 every 2 seconds which is default). I'm guesssing results should start appearing twice as fast now, right?

Obviously I'll be keeping an eye on server resources, but if it is negligiable would a higher crawl rate be preferable?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 01-06-2009, 03:11 PM
briansol's Avatar
Senior Member
  
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 7,090
neato. mine has the new tool too.

i was default at 1/1 when i opened it up.

i bumped mine to 2.0/.5 and we'll see what happens.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 01-06-2009, 04:49 PM
nfn nfn is online now
Senior Member
  
Real Name: Nuno
Join Date: Feb 2008
Location: Portugal
Posts: 258
Hi,

I have my forum at domain.com/forum and my sitemap at domain.com/forum/sitemap_index.xml.gz

Because of this i can't use this feature since the sitemap isn't in the domain root (domain.com)

What should I do? Should I rewite domain.com/forum/sitemap_index.xml.gz to domain.com/sitemap_index.xml.gz?

I test it with this rule and this is the site map index:

Code:
RewriteRule ^((urllist|sitemap_).*\.(xml|txt)(\.gz)?)$ forum/vbseo_sitemap/vbseo_getsitemap.php?sitemap=$1 [L]
The site maps are shown as follow:

Code:
<sitemapindex xsi:schemaLocation="             http://www.sitemaps.org/schemas/sitemap/0.9             http://www.sitemaps.org/schemas/sitemap/09/siteindex.xsd">
−
<sitemap>
−
<loc>
http://www.portaldasviagens.com/forum/sitemap_1.xml.gz
</loc>
<lastmod>2009-01-06T02:08:28+00:00</lastmod>
</sitemap>
</sitemapindex>
Can this be a problem? some help will be appreciated
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 01-06-2009, 04:59 PM
Senior Member
Big Board Administrator
  
Real Name: Stewart
Join Date: Apr 2007
Posts: 443
don't think this has anything to do with sitemaps
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 01-06-2009, 05:18 PM
nfn nfn is online now
Senior Member
  
Real Name: Nuno
Join Date: Feb 2008
Location: Portugal
Posts: 258
Well, If I add a site "domain.com" it tells me that sitemap can't be located at "domain.com/forum/sitemap_index.xml.gz" only at "domain.com/sitemap_index.xml.gz"

If i submit "domain.com/forum/" everything is ok, but then it says "Crawl rate Setting is restricted to root level domains only"

What should I do?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 01-06-2009, 05:36 PM
nfn nfn is online now
Senior Member
  
Real Name: Nuno
Join Date: Feb 2008
Location: Portugal
Posts: 258
Ok .. I'v tested again and it's working.
Maybe my fault.

Should I delete the old one?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 01-11-2009, 12:31 PM
Junior Member
  
Real Name: jimmy
Join Date: Dec 2008
Posts: 11
Crawl rate could be the frequency at which search engines visit your website. However, it has little effect on SEO.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 01-13-2009, 02:50 PM
Member
  
Real Name: Luke McCoy
Join Date: Oct 2007
Posts: 45
I'd like to hear more about this and what it does before messing with any of the settings but I did see it in there yesterday.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

« A decrease of traffic, ranking. | Huge Traffic Drop. Lost keywords in SERPs »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads

Thread Thread Starter Forum Replies Last Post
Google Webmaster Tools reporting that 404 is a 200 Kanustep Troubleshooting 2 05-15-2008 10:38 PM
Sitemap 2.1 - google webmaster tools mljask General Discussion 10 01-31-2008 01:36 PM
Google Webmaster tools- crawl rate JADM General Discussion 11 01-11-2008 05:26 PM
Google Webmaster Tools OnR Türkçe 2 07-12-2007 11:42 AM


All times are GMT -4. The time now is 03:55 PM.

Contact Us - vBSEO Home - Site Map - Top

Powered by vBulletin Version 3.8.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.3.0 ©2009, Crawlability, Inc.