Is it pretty common to take a couple months for a site to start getting indexed by google? My site has been live since 4/28, and vBSEO was installed on 5/19. Since then I've been applying alot of the wonderful ideas here:
- SEO version of the welcome headers.
- Relevent replacements for the forumdisplay and showthread.
- Requested 2.45 and installed the sitemap generator, submitted them to google.
I'm running vBadvanced and the forum both in root, url rewrites use the default settings (CRU's aren't the same as here though), I did change file not found redirects to home, setup custom rewrites for the vba index, and ecdownloads.
I grabbed a robots.txt from here to use:Code:'^showgroups\.php$' => 'forumleaders.html' '^index\.php\?page=(\w+)$' => 'index-$1.html' '^downloads\.php$'=> 'files.html' '^downloads\.php\?do=cat&id=(\d+)'=>'cat$1.html' '^downloads\.php\?do=file&id=(\d+)'=>'file$1.html' '^downloads\.php\?do=stats'=>'filestats.html' '^downloads\.php\?do=my'=>'myfiles.html' '^downloads\.php\?do=manfiles'=>'managefiles.html' '^downloads\.php\?do=search'=>'filesearch.html' '^downloads\.php\?do=add&cat='=>'addfilecat.html' '^forums\.php' => 'forums.html' '^online\.php' => 'online.html'
The reason I'm a little concerned is because google still doesn't have any of my site indexed. Whenever I notice a googlebot on my site (they are on alot now), it's always sitting on the index while the other bots are viewing threads. I figured it would be best to ask rather than wait to find out I'd done something wrong that was stopping the googlebots from indexing.Code:# All robots will spider the domain # Disallow directory User-agent: * Disallow: /admincp/ Disallow: /ajax.php Disallow: /articlebot/ Disallow: /attachment.php Disallow: /attachments/ Disallow: /clientscript/ Disallow: /cpstyles/ Disallow: /customavatars/ Disallow: /customprofilepics/ Disallow: /calendar.php Disallow: /cgi-bin/ Disallow: /cron.php Disallow: /editpost.php Disallow: /external.php Disallow: /favicon.ico Disallow: /images/ Disallow: /includes/ Disallow: /inlinemod.php Disallow: /install/ Disallow: /joinrequests.php Disallow: /login.php Disallow: /member.php? Disallow: /memberlist.php Disallow: /misc.php Disallow: /modcp/ Disallow: /moderator.php Disallow: /modules/ Disallow: /newattachment.php Disallow: /newreply.php Disallow: /newthread.php Disallow: /online.php Disallow: /payment_gateway.php Disallow: /payments.php Disallow: /poll.php Disallow: /postings.php Disallow: /private.php Disallow: /profile.php Disallow: /register.php Disallow: /report.php Disallow: /reputation.php Disallow: /search.php Disallow: /sendmessage.php Disallow: /showgroups.php Disallow: /subscription.php Disallow: /usercp.php Disallow: /threadrate.php Disallow: /usercp.php Disallow: /usernote.php
My site: getpwnd.com


LinkBack URL
About LinkBacks





Reply With Quote


