vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now! HACKER SAFE certified sites prevent over 99.9% of hacker crime.
ne nw
vBSEO Total Support Team Launches DeskPro New vBSEO Discount Level for Network Builders vBSEO 3.2.0 GOLD Has Landed Success with vBSEO = 600ore Web Visitors + $1400 in a Day! Crawlability Inc. Files for SEO Technology Patent
se sw

Google webmaster tools - Errors for URLs in Sitemaps 4094URLs restricted by robots.txt 5201

This is a discussion on Google webmaster tools - Errors for URLs in Sitemaps 4094URLs restricted by robots.txt 5201 within the Analysis: Traffic & SERPS forums, part of the vBulletin SEO Discussion category; Errors for URLs in Sitemaps 4094 Don't like the sound of that, I've looked into this and I've changed my ...

Go Back   vBulletin SEO Forums > vBulletin SEO Discussion > Analysis: Traffic & SERPS

Enhancing 80 million pages.

Register FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
  #1  
Old 07-19-2008, 02:15 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
Thumbs down Google webmaster tools - Errors for URLs in Sitemaps 4094

Errors for URLs in Sitemaps 4094

Don't like the sound of that, I've looked into this and I've changed my permalinks to how it's meant to be set up now, so hopefully the errors will start to decrease?

URLs restricted by robots.txt 5201 - is there anyway I can stop the robots from looking at private forums? would this decrease the amount of errors in the sitemap URLS?

Also the amount of pages indexed has gone down by about 2000 recently? does anyone know what would cause this when no settings had been changed?


thanks if you can help

Last edited by squeak; 07-19-2008 at 02:27 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 07-19-2008, 03:13 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
anyone know?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 07-19-2008, 03:22 PM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,538
its ok. a 404 or a robots restriction is not ALWAYS a bad thing. it simply means google isn't going to index it. If it's truely not there, or not accessible, this is exactly what you want to see.


NEVER judge your site by # of indexed pages. Juge by measuring your search engine traffic.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 07-19-2008, 03:24 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
thats the thing, past few days the search engine traffic has suddenly dropped? Not sure why, maybe it'll pick back up soon

it's gone from like 6000 to 200? (google)
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 07-20-2008, 03:17 AM
briansol's Avatar
Senior Member
vBSEO Pre-Release TeamDesign for SEOBig Board Administrator
 
Real Name: Brian
Join Date: Apr 2006
Location: Central CT, USA
Posts: 5,538
did you sell links in your footer?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 07-20-2008, 08:10 AM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
nope, never have done. it's gone down to 80 today so far from google?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #7  
Old 07-21-2008, 01:55 PM
Joe Ward's Avatar
vBSEO Staff
vBSEO Total Customer SupportvBSEO Documenter
 
Real Name: Joseph Ward
Join Date: Jun 2005
Location: Puerto Rico
Posts: 19,746
Blog Entries: 7
Have you made any changes? It would seem like you were penalized or something is wrong. What is the contents of your robots.txt?
__________________
Joe Ward / Crawlability Inc.
Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service

vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations

6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You.

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #8  
Old 07-21-2008, 01:57 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
User-agent: *
Disallow: /monoslideshow/
Disallow: /vsadmin/
Disallow: /shop/
Disallow: /members/
Disallow: /forums/admincp/
Disallow: /forums/clientscript/
Disallow: /forums/includes/
Disallow: /forums/install/
Disallow: /forums/modcp/
Disallow: /forums/subscription.php
Disallow: /forums/payments.php
Disallow: /forums/profile.php
Disallow: /forums/faq.php
Disallow: /forums/calendar.php
Disallow: /forums/search.php
Disallow: /forums/private.php
Disallow: /forums/online.php
Disallow: /forums/sendmessage.php
Disallow: /forums/sendmessage.php?do=
Disallow: /forums/showgroups.php
Disallow: /forums/reputation.php
Disallow: /forums/report.php
Disallow: /forums/threadrate.php
Disallow: /forums/postings.php
Disallow: /forums/newthread.php
Disallow: /forums/newreply.php
Disallow: /forums/register.php
Disallow: /forums/login.php
Disallow: /forums/faq.php
Disallow: /forums/image.php
Disallow: /forums/cron.php
Disallow: /forums/joinrequests.php
Disallow: /forums/printthread.php
Disallow: /forums/showpost.php
Disallow: /forums/archive/
Sitemap: http://www.skyline-owners-club.com/f...p_index.xml.gz
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #9  
Old 07-21-2008, 01:58 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
I hope this is correct to how it should be
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #10  
Old 07-21-2008, 06:52 PM
Senior Member
 
Real Name: Lee
Join Date: Sep 2006
Location: Costa Blanca
Posts: 280
On your sitemaps over view page are you showing any errors there?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #11  
Old 07-21-2008, 07:04 PM
Member
 
Real Name: squeak
Join Date: Jun 2008
Location: UK
Posts: 36
No errors at all, the numbers have started to rise though, not sure what was causing it but if they continue to rise I'll let you guys know. Thank you so far for you time
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Indexed URLs in Sitemap (Google Webmaster Tools) MikeWarner General Discussion 0 05-01-2008 04:27 AM
Multiple sitemaps in Google Webmaster Tools cmeinck General Discussion 2 03-14-2008 04:34 PM
Google Webmaster Tools OnR Türkçe 2 07-12-2007 12:42 PM
URLs restricted by robots.txt= 27187 :( Bydigi Türkçe 3 12-03-2006 06:53 AM


All times are GMT -4. The time now is 10:08 PM.


Powered by vBulletin Version 3.8.0 Beta 4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.5 ©2008, Crawlability, Inc.