Confused a bit

HappyDJ · #1 02-12-2007, 06:56 PM

If you would be able to shed some light on this because I am a little confused.

SE Bots Activity Log

That shows no logs. So does that mean no bots have visited my site?
I have a sitemap of over 18,000 pages - and only a few of them are shown in googles index (I thought a spider NEEDS to visit before its included in google)

Sitemap Downloads Log

This shows 6th feb 2007 - to 10 feb 2007 - there are 45 entries in this log. Mostly googlebot. So this means my sitemap has been downloaded 45 times between these dates?

Reports List

I have only got 1 report - I thought the sitemap updated itself with all the new content with the CRON? Is this correct.

If someone could please let me know what these each do and answer the questions i have above I would thank you very much - if you dont know then i just thank you for reading this! See how nice I am! ha ha.

Keith Cohen · #2 02-12-2007, 06:59 PM

Reports List
You should have one report per day. Download and install the latest vBSEO Sitemap (1.7RC4) from the Downloads area. If you're running vBulletin 3.6.x it will create the scheduled task for you, and will run nightly. If you're running an earlier version of vBulletin you'll need to manually create the scheduled task using the instructions provided.

SE Bots Activity Log
Make sure you have the vBSEO option enabled that tracks bot activity. ( http://yourforumsurl/vbseocp.php )

HappyDJ · #3 02-12-2007, 07:12 PM

I only downloaded it a few days ago - I don't mind creating the scheduled task (which I thought I had done) however it just doesn't seem to be working or updating as it were.

HappyDJ · #4 02-12-2007, 07:14 PM

Also - I have enabled the spider option in the CP - so take it this means that no spiders have visited, so how is it included (only 8 pages from over 18,000 links in sitemap) are shown in google any ideas?

Willing to give you details do you can check if you want to?

Thanks

Keith Cohen · #5 02-12-2007, 07:18 PM

Quote:

Originally Posted by HappyDJ

I only downloaded it a few days ago - I don't mind creating the scheduled task (which I thought I had done) however it just doesn't seem to be working or updating as it were.

You have vBSEO Sitemap 1.5 installed. You need to get 1.7RC4 from the downloads area here. Make sure you delete the extra scheduled task if you created it.

Keith Cohen · #6 02-12-2007, 07:18 PM

Quote:

Originally Posted by HappyDJ

Also - I have enabled the spider option in the CP - so take it this means that no spiders have visited, so how is it included (only 8 pages from over 18,000 links in sitemap) are shown in google any ideas?

Willing to give you details do you can check if you want to?

Thanks

You need the new version of vBSEO Sitemap. After installing that, wait a couple of days and check your SE Bots Log then.

HappyDJ · #7 02-12-2007, 07:37 PM

Do i need to install just the sitemaps - just because the only link I can find is the 1.6.1 zip file from the .org forum

Keith Cohen · #8 02-12-2007, 07:38 PM

Click "Downloads" at the top of this page. 1.7 is only available here.

HappyDJ · #9 02-12-2007, 07:42 PM

OK thank you

You have been a great help so far - do you think that this is why in my sitemaps page in google - there are no links (you know in that internal/external links bit)

HappyDJ · #10 02-12-2007, 08:25 PM

I have upgraded,

Now seeing this:

SE Bots Activity Details - 2007-02-13

SE Bot / Page all Googlebot Yahoo total 42 22 20 showthread.php 16 - 16 showpost.php 16 16 - external.php 4 4 - home 2 2 - member.php 2 - 2 archive/index.php 1 - 1 forumdisplay.php 1 - 1
Is there any reason they arn't crawling all of my site and its just these?

Keith Cohen · #11 02-12-2007, 08:38 PM

Those are the the ones you want it to crawl... Give it time though.

HappyDJ · #12 02-12-2007, 08:50 PM

Ah right, I thought it would list every page in the forum type thing. I think this is where I may have misunderstood. Because I wasn't seeing every page in thr forum, yet over 18,000 pages were included in the sitemap, I thought something was wrong.

so as far as you can see Keith - everything here now is set-up and configured OK?

Keith Cohen · #13 02-12-2007, 08:53 PM

That only shows the pages that the spiders are viewing. For example, showthread.php will represent any/all of your threads. You won't see each individual thread URL. However, that doesn't guarantee that they will show up in the search engine's index. It's just a tool to let you know what the spiders are viewing.

Make sure you have submitted this sitemap URL in your Google Webmaster account and you should be all set: http://www.rs2000-16v.net/forum/sitemap_index.xml.gz

HappyDJ · #14 02-12-2007, 09:06 PM

OK I think thats correct - Under my sites I have:

RS2000-16v Forum - Powered by vBulletin - then under that I have for the sitemap: sitemap_index.xml.gz

When I click on that it says google last downloaded 7 mins ago (about 20 minutes after i ran my cron) and it said it indexed 183,641

thing is, when i ran it (the new sitemap with v1.7 - the new sitemap says (according to the report from vbseo_sitemaps page) number of URLs is: 186,069

I would have thought google would have downloaded my newest sitemap (including the new pages etc) (+2,428)

Also - it says google last spidered my site on: Googlebot last successfully accessed your home page on Feb 2, 2007.

But in the spider log in vbseo it says:

SE Bots Activity Details - 2007-02-13

SE Bot / Page all Yahoo Googlebot total 78 39 39 showpost.php 32 - 32 showthread.php 26 26 - member.php 7 7 - external.php 4 - 4 home 4 1 3 forumdisplay.php 3 3 - search.php 1 1 - archive/index.php 1 1 -
Is everything OK here - just because im either not reading it right, or something is wrong because they dont tally?

Keith Cohen · #15 02-12-2007, 09:08 PM

The data shown on the Google Webmaster account isn't realtime, so that information will never match exactly. Just so it updates occasionally you know that it's hitting your site.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
IonCube Install on 64 Bit Machine	ocer	Troubleshooting	1	02-15-2006 03:36 PM
Confused.	Fender963	General Discussion	1	02-01-2006 04:21 AM
Confused	Ashley	Troubleshooting	11	12-21-2005 03:52 PM
Confused: Custom Rewrites for simple "Top Referrals" Mod	vissa	Custom Rewrite Rules	6	11-23-2005 08:12 AM

SEO

Confused a bit

Confused a bit

Similar Threads