vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now!
vBSEO 2.0 Style Released vBSEO 3.3.0 GOLD Launched vBSEO's "LiveStats" for Google Analytics vB Sitemap Generator, Version 2.5 Success with vBSEO = 600ore Web Visitors + $1400 in a Day!

Confused a bit

This is a discussion on Confused a bit within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; If you would be able to shed some light on this because I am a little confused. SE Bots Activity ...

Go Back   vBulletin SEO Forums > vBSEO Google/Yahoo Sitemap > General Discussion

Enhancing 80 million pages.


Reply

 

LinkBack Thread Tools
  #1  
Old 02-12-2007, 06:56 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
Confused a bit

If you would be able to shed some light on this because I am a little confused.

SE Bots Activity Log



That shows no logs. So does that mean no bots have visited my site?
I have a sitemap of over 18,000 pages - and only a few of them are shown in googles index (I thought a spider NEEDS to visit before its included in google)

Sitemap Downloads Log

This shows 6th feb 2007 - to 10 feb 2007 - there are 45 entries in this log. Mostly googlebot. So this means my sitemap has been downloaded 45 times between these dates?

Reports List

I have only got 1 report - I thought the sitemap updated itself with all the new content with the CRON? Is this correct.

If someone could please let me know what these each do and answer the questions i have above I would thank you very much - if you dont know then i just thank you for reading this! See how nice I am! ha ha.
__________________
www.rs2000-16v.net - The largest RS2000-16v Dedicated Community
100% Working thanks to vBSEO
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 02-12-2007, 06:59 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
Reports List
You should have one report per day. Download and install the latest vBSEO Sitemap (1.7RC4) from the Downloads area. If you're running vBulletin 3.6.x it will create the scheduled task for you, and will run nightly. If you're running an earlier version of vBulletin you'll need to manually create the scheduled task using the instructions provided.

SE Bots Activity Log
Make sure you have the vBSEO option enabled that tracks bot activity. ( http://yourforumsurl/vbseocp.php )
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 02-12-2007, 07:12 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
I only downloaded it a few days ago - I don't mind creating the scheduled task (which I thought I had done) however it just doesn't seem to be working or updating as it were.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 02-12-2007, 07:14 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
Also - I have enabled the spider option in the CP - so take it this means that no spiders have visited, so how is it included (only 8 pages from over 18,000 links in sitemap) are shown in google any ideas?

Willing to give you details do you can check if you want to?

Thanks
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 02-12-2007, 07:18 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
Quote:
Originally Posted by HappyDJ View Post
I only downloaded it a few days ago - I don't mind creating the scheduled task (which I thought I had done) however it just doesn't seem to be working or updating as it were.
You have vBSEO Sitemap 1.5 installed. You need to get 1.7RC4 from the downloads area here. Make sure you delete the extra scheduled task if you created it.
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 02-12-2007, 07:18 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
Quote:
Originally Posted by HappyDJ View Post
Also - I have enabled the spider option in the CP - so take it this means that no spiders have visited, so how is it included (only 8 pages from over 18,000 links in sitemap) are shown in google any ideas?

Willing to give you details do you can check if you want to?

Thanks
You need the new version of vBSEO Sitemap. After installing that, wait a couple of days and check your SE Bots Log then.
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 02-12-2007, 07:37 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
Do i need to install just the sitemaps - just because the only link I can find is the 1.6.1 zip file from the .org forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 02-12-2007, 07:38 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
Click "Downloads" at the top of this page. 1.7 is only available here.
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 02-12-2007, 07:42 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
OK thank you

You have been a great help so far - do you think that this is why in my sitemaps page in google - there are no links (you know in that internal/external links bit)
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #10  
Old 02-12-2007, 08:25 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
I have upgraded,

Now seeing this:

SE Bots Activity Details - 2007-02-13

SE Bot / Page all Googlebot Yahoo total 42 22 20 showthread.php 16 - 16 showpost.php 16 16 - external.php 4 4 - home 2 2 - member.php 2 - 2 archive/index.php 1 - 1 forumdisplay.php 1 - 1
Is there any reason they arn't crawling all of my site and its just these?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #11  
Old 02-12-2007, 08:38 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
Those are the the ones you want it to crawl... Give it time though.
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #12  
Old 02-12-2007, 08:50 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
Ah right, I thought it would list every page in the forum type thing. I think this is where I may have misunderstood. Because I wasn't seeing every page in thr forum, yet over 18,000 pages were included in the sitemap, I thought something was wrong.

so as far as you can see Keith - everything here now is set-up and configured OK?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #13  
Old 02-12-2007, 08:53 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
That only shows the pages that the spiders are viewing. For example, showthread.php will represent any/all of your threads. You won't see each individual thread URL. However, that doesn't guarantee that they will show up in the search engine's index. It's just a tool to let you know what the spiders are viewing.

Make sure you have submitted this sitemap URL in your Google Webmaster account and you should be all set: http://www.rs2000-16v.net/forum/sitemap_index.xml.gz
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #14  
Old 02-12-2007, 09:06 PM
Member
 
Real Name: Paul Whittle
Join Date: Apr 2006
Posts: 32
OK I think thats correct - Under my sites I have:

RS2000-16v Forum - Powered by vBulletin - then under that I have for the sitemap: sitemap_index.xml.gz

When I click on that it says google last downloaded 7 mins ago (about 20 minutes after i ran my cron) and it said it indexed 183,641

thing is, when i ran it (the new sitemap with v1.7 - the new sitemap says (according to the report from vbseo_sitemaps page) number of URLs is: 186,069

I would have thought google would have downloaded my newest sitemap (including the new pages etc) (+2,428)

Also - it says google last spidered my site on: Googlebot last successfully accessed your home page on Feb 2, 2007.

But in the spider log in vbseo it says:

SE Bots Activity Details - 2007-02-13

SE Bot / Page all Yahoo Googlebot total 78 39 39 showpost.php 32 - 32 showthread.php 26 26 - member.php 7 7 - external.php 4 - 4 home 4 1 3 forumdisplay.php 3 3 - search.php 1 1 - archive/index.php 1 1 -
Is everything OK here - just because im either not reading it right, or something is wrong because they dont tally?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #15  
Old 02-12-2007, 09:08 PM
Senior Member
vBSEO Pre-Release TeamBig Board Administrator
 
Real Name: Keith Cohen
Join Date: Jul 2005
Location: Raleigh, NC USA
Posts: 6,319
The data shown on the Google Webmaster account isn't realtime, so that information will never match exactly. Just so it updates occasionally you know that it's hitting your site.
__________________
My Blog | GPS Discussion Forum
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
IonCube Install on 64 Bit Machine ocer Troubleshooting 1 02-15-2006 03:36 PM
Confused. Fender963 General Discussion 1 02-01-2006 04:21 AM
Confused Ashley Troubleshooting 11 12-21-2005 03:52 PM
Confused: Custom Rewrites for simple "Top Referrals" Mod vissa Custom Rewrite Rules 6 11-23-2005 08:12 AM


All times are GMT -4. The time now is 08:59 PM.


Powered by vBulletin Version 3.8.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.3.0 ©2009, Crawlability, Inc.