Results 1 to 6 of 6

Google Crawling - Sitemap.

This is a discussion on Google Crawling - Sitemap. within the General Discussion forums, part of the vBSEO Google/Yahoo Sitemap category; Searched for similar threads to this and saw quite a few from people whose pages had been crawled but weren't ...

  1. #1
    Junior Member
    Real Name
    Derek
    Join Date
    Jun 2007
    Posts
    11
    Liked
    0 times

    Arrow Google Crawling - Sitemap.

    Searched for similar threads to this and saw quite a few from people whose pages had been crawled but weren't yet in the index. This question is slightly different.

    I uploaded my sitemap to Google webmaster and it verified just fine, just over 5,000 urls in the sitemap. Since then Google has downloaded my sitemap every few hours, but hasn't yet crawled a single page in the sitemap. No errors reported, it just doesn't seem to be paying much attention to the sitemap. Yahoo on the other hand is all over the site.

    I know that once Google crawls your forum it can take a while for the pages to get indexed, but how long does it usually take before Google even starts to crawl the URLs in the map? It's been a few days now, should I be concerned?

  2. #2
    Junior Member
    Real Name
    Citizen Kained jnr
    Join Date
    Jun 2007
    Posts
    10
    Liked
    0 times
    I'm interested in this too. Please rply someone.

    Thanks

  3. #3
    Senior Member
    Real Name
    Joseph Ward
    Join Date
    Jun 2005
    Posts
    23,845
    Liked
    36 times
    Blog Entries
    9
    Usually it's pretty quick, but I'd give it a week or so, and continue to monitor the activity.

  4. #4
    Junior Member
    Real Name
    Citizen Kained jnr
    Join Date
    Jun 2007
    Posts
    10
    Liked
    0 times
    My issue is..

    Google and yahoo are crawling my site which is all good.

    However no pages are getting submitted in the search engine... Ie its only the .com index.

    So if someone does a search on a keyword my site will never be listed.

    How long before google adds your content into its results.

    I've been waiting about 3 weeks...

    Thanks

  5. #5
    Junior Member
    Real Name
    Derek
    Join Date
    Jun 2007
    Posts
    11
    Liked
    0 times
    Quote Originally Posted by Citizen Kained View Post
    My issue is..

    Google and yahoo are crawling my site which is all good.

    However no pages are getting submitted in the search engine... Ie its only the .com index.

    So if someone does a search on a keyword my site will never be listed.

    How long before google adds your content into its results.

    I've been waiting about 3 weeks...

    Thanks

    Google did start crawling my site a few days later, slowly, but its crawling around 300-500 posts a day now - the pages seem to show up in the search index itself fairly quickly after that.

    Keep in mind this is a 1999 site with some level of "authority" in its field, I would imagine it takes longer for a completely new site to start to appear.

  6. #6
    Junior Member
    Real Name
    Citizen Kained jnr
    Join Date
    Jun 2007
    Posts
    10
    Liked
    0 times
    My site is very new, anyone got a hint as to when google will crawl the threads and enter them into its search index.

    Many Thanks

    CK

Similar Threads

  1. Google Now Reporting Anchor Text Phrases
    By Eros in forum General Discussion
    Replies: 4
    Last Post: 02-11-2009, 03:42 PM
  2. Replies: 2
    Last Post: 03-16-2007, 12:58 PM
  3. Google Sitemap Error
    By Exitilus in forum Troubleshooting
    Replies: 3
    Last Post: 01-18-2007, 04:23 PM
  4. Replies: 0
    Last Post: 12-17-2005, 01:11 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •