vBulletin Search Engine Optimization
This is a discussion on Google webmaster tools - Errors for URLs in Sitemaps 4094URLs restricted by robots.txt 5201 within the Analysis: Traffic & SERPS forums, part of the vBulletin SEO Discussion category; Errors for URLs in Sitemaps 4094 Don't like the sound of that, I've looked into this and I've changed my ...
| |||||||
Enhancing 80 million pages. | Register | FAQ | Members List | Social Groups | Calendar | Search | Today's Posts | Mark Forums Read |
|
#1
| |||
| |||
|
Errors for URLs in Sitemaps 4094 URLs restricted by robots.txt 5201 - is there anyway I can stop the robots from looking at private forums? would this decrease the amount of errors in the sitemap URLS? Also the amount of pages indexed has gone down by about 2000 recently? does anyone know what would cause this when no settings had been changed? thanks if you can help Last edited by squeak; 07-19-2008 at 02:27 PM. |
|
#2
| |||
| |||
|
anyone know?
|
|
#3
| ||||
| ||||
|
its ok. a 404 or a robots restriction is not ALWAYS a bad thing. it simply means google isn't going to index it. If it's truely not there, or not accessible, this is exactly what you want to see. NEVER judge your site by # of indexed pages. Juge by measuring your search engine traffic. |
|
#4
| |||
| |||
|
thats the thing, past few days the search engine traffic has suddenly dropped? Not sure why, maybe it'll pick back up soon it's gone from like 6000 to 200? (google) |
|
#5
| ||||
| ||||
|
did you sell links in your footer?
|
|
#6
| |||
| |||
|
nope, never have done. it's gone down to 80 today so far from google?
|
|
#7
| ||||
| ||||
|
Have you made any changes? It would seem like you were penalized or something is wrong. What is the contents of your robots.txt?
__________________ Joe Ward / Crawlability Inc. Support Team Launches New DeskPro Powered Tool Enhanced Support at Your Service vBSEO 3.2.0 Launched - Maximum Overdrive for Your Web Traffic! Over 100 Instant SEO Optimizations 6X Traffic - $1400 in One Day with vBSEO! Imagine What the vBSEO Patent Pending Technology Can Do For You. |
|
#8
| |||
| |||
|
User-agent: * Disallow: /monoslideshow/ Disallow: /vsadmin/ Disallow: /shop/ Disallow: /members/ Disallow: /forums/admincp/ Disallow: /forums/clientscript/ Disallow: /forums/includes/ Disallow: /forums/install/ Disallow: /forums/modcp/ Disallow: /forums/subscription.php Disallow: /forums/payments.php Disallow: /forums/profile.php Disallow: /forums/faq.php Disallow: /forums/calendar.php Disallow: /forums/search.php Disallow: /forums/private.php Disallow: /forums/online.php Disallow: /forums/sendmessage.php Disallow: /forums/sendmessage.php?do= Disallow: /forums/showgroups.php Disallow: /forums/reputation.php Disallow: /forums/report.php Disallow: /forums/threadrate.php Disallow: /forums/postings.php Disallow: /forums/newthread.php Disallow: /forums/newreply.php Disallow: /forums/register.php Disallow: /forums/login.php Disallow: /forums/faq.php Disallow: /forums/image.php Disallow: /forums/cron.php Disallow: /forums/joinrequests.php Disallow: /forums/printthread.php Disallow: /forums/showpost.php Disallow: /forums/archive/ Sitemap: http://www.skyline-owners-club.com/f...p_index.xml.gz |
|
#9
| |||
| |||
|
I hope this is correct to how it should be
|
|
#10
| |||
| |||
|
On your sitemaps over view page are you showing any errors there?
|
|
#11
| |||
| |||
|
No errors at all, the numbers have started to rise though, not sure what was causing it but if they continue to rise I'll let you guys know. Thank you so far for you time |
| Thread Tools | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Indexed URLs in Sitemap (Google Webmaster Tools) | MikeWarner | General Discussion | 0 | 05-01-2008 04:27 AM |
| Multiple sitemaps in Google Webmaster Tools | cmeinck | General Discussion | 2 | 03-14-2008 04:34 PM |
| Google Webmaster Tools | OnR | Türkçe | 2 | 07-12-2007 12:42 PM |
| URLs restricted by robots.txt= 27187 :( | Bydigi | Türkçe | 3 | 12-03-2006 06:53 AM |