Whoa! Went from 155,000 Pages Indexed to 21,000!!!

What am I doing wrong? I pretty much followed every single tip, settings and optimization you guys have recommended. Is this normal? Kinda scary...

Thanks,
Miguel

Most people loose their pages before getting reindexed. I would say that it is quite normal.

Also, I have like 4,077 pages blocked by robots.txt including this one which I don't see why...

You Think Your Wheels Are Rare???!!!!! Then Take A Look!! - Page 4 - JDM Universe.com

This is my robots.txt

User-agent: Mediapartners-Google*
Disallow:
# Allow Archiver
User-agent: ia_archiver
Allow: /

User-agent: Slurp
Crawl-delay: 60

User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/faq.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/payments.php
Disallow: /forums/showpost.php
Disallow: /forums/showgroups.php
Disallow: /forums/spiders.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
Disallow: /forums/admincp/
Disallow: /cgi-bin/
Disallow: /forums/includes/
Disallow: /forums/install/
Disallow: /forums/modcp/
Disallow: /customavatars/
Disallow: /forums/xmlrpc.php
Disallow: /forums/archive/
Disallow: /forums/sitemap/

#use the following if you have photopost:
Disallow: /forums/gallery/member.php
Disallow: /forums/gallery/showgallery.php?cat=
Disallow: /forums/gallery/showgallery.php?limit=
Disallow: /forums/gallery/comshow.php
Disallow: /forums/gallery/search.php
Disallow: /forums/gallery/*search.php
Disallow: /forums/gallery/showframe.php
Disallow: /forums/gallery/slideshow.php
Disallow: /forums/gallery/*limit
Disallow: /forums/gallery/*ppuser
Disallow: /forums/gallery/*views
Disallow: /forums/gallery/*date
Disallow: /forums/gallery/*recent
Disallow: /forums/gallery/*in
Sitemap: http://www.jdmuniverse.com/forums/sitemap_index.xml.gz

I'm also getting 404 errors for pages that exist :(

Like this one...
JDM Universe.com - View Profile: 00lsvtechatch

Thanks,
Miguel

The drop is normal. It's actually a good sign. Just sit tight while google does it's thing.


Make sure google has a recent robots file. its dated in webmasters tools. you may need to re-submit your site.

That's good to hear... Thanks.

What about the block URLS and 404's?

Miguel

Looks like it's already going up! 128,000 Now.

BTW: OT But, my Pageviews have TRIPLED since installing VBSeo.

I just wanna get the whole sitemap thing figured out with these 404 errors and blocked pages...

Miguel

I am now getting ZERO errors and warnings

Miguel

yeah, the robots file is a little delayed in cache.