vBulletin SEO Forums

SEO

vBulletin Search Engine Optimization

Buy vBSEO Now!
vBSEO 2.0 Style Released vBSEO 3.3.0 GOLD Launched vBSEO's "LiveStats" for Google Analytics vB Sitemap Generator, Version 2.5 Success with vBSEO = 600ore Web Visitors + $1400 in a Day!

Php script that sends requests to Google

This is a discussion on Php script that sends requests to Google within the Off-Topic & Chit Chat forums, part of the Focus on Members category; Hi there, Just decided that it would be fruitful to make a script that checks how many pages from my ...

Go Back   vBulletin SEO Forums > Focus on Members > Off-Topic & Chit Chat

Enhancing 80 million pages.

  #1  
Old 12-11-2006, 11:41 PM
Anatoliy's Avatar
Member
 
Real Name: Anatoliy
Join Date: Nov 2006
Location: Planet Earth
Posts: 35
Php script that sends requests to Google

Hi there,

Just decided that it would be fruitful to make a script that checks how many pages from my web-site are listed in Google (site:www.mysite.com) and saves results.

How can it be done? I got Google API key, but not sure that I'm on the right way. Google AJAX Search API is Greek for me... Do I really need to use it to get what I want?

May be there is a less complicated way? (I hope ).
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #2  
Old 12-12-2006, 03:42 PM
Senior Member
vBSEO Pre-Release Team
 
Real Name: Nick Le Mouton
Join Date: Nov 2005
Location: New Zealand
Posts: 400
This doesn't use the API, but here's a script I wrote to check how many pages/backlinks my site had:

Noodles’ Blog » Blog Archive » Google datacenter check
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #3  
Old 12-12-2006, 07:01 PM
Anatoliy's Avatar
Member
 
Real Name: Anatoliy
Join Date: Nov 2006
Location: Planet Earth
Posts: 35
Thanks Noodles,

I wrote something similar to your script by myself (it gets the page using fsockopen() function). However as you indicated on your page: "Google would ban my server’s IP"... I'd like to build it the way it should be built and not be afraid of being caught for making "pirate's" requests.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #4  
Old 12-12-2006, 07:25 PM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer Support
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 23,637
google search api php - Google Search
Quote:
However as you indicated on your page: "Google would ban my server’s IP"
There is still a limit of 1,000 requests per day per api key though.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO Styles: Version 1.0 PRO For Everyone Version 2.0 For vBSEO Customers

vBSEO 3.3.0 Gold Released with New "Virtual HTML Display" Feature Available for Download Now

6X Traffic - $1400 in One Day with vBSEO! Max Out Your SEO

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #5  
Old 12-12-2006, 08:20 PM
Anatoliy's Avatar
Member
 
Real Name: Anatoliy
Join Date: Nov 2006
Location: Planet Earth
Posts: 35
Quote:
Originally Posted by Oleg Ignatiuk View Post
google search api php - Google Search
There is still a limit of 1,000 requests per day per api key though.
1,000 requests per day is more than enough for me But how to build such an application with Google AJAX Search API?

You guys probably use SOAP API. Ufortunately from 5th of December Google doesn't give keys for SOAP API anymore and sends everyone to Google AJAX Search API.

SOAP API looked complicated for me. But I changed my mind after took a look at docs for Google AJAX Search API...

Last edited by Anatoliy; 12-12-2006 at 08:43 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
  #6  
Old 12-13-2006, 05:44 AM
Oleg Ignatiuk's Avatar
vBSEO Staff
vBSEO Total Customer Support
 
Real Name: Oleg Ignatiuk
Join Date: Jun 2005
Location: Belarus
Posts: 23,637
Basically, with AJAX search api doesn't have limitations of soap version, since all requests are performed on client side, not from a single server IP.

It would be still possible to use it in similar way as "old approach" extracting ajax request URLs, like:
HTML Code:
http://www.google.com/uds/GwebSearch?callback=GwebSearch.RawCompletion&context=0&lstkp=0&rsz=small&hl=en&sig=12f87b457bdbba45b248d920a09f1429&q=VW%20GTI&key=internal&v=1.0
and then manually process returned js code, although it's not designed to work in this way.
__________________
Oleg Ignatiuk / Crawlability Inc.
vBSEO Styles: Version 1.0 PRO For Everyone Version 2.0 For vBSEO Customers

vBSEO 3.3.0 Gold Released with New "Virtual HTML Display" Feature Available for Download Now

6X Traffic - $1400 in One Day with vBSEO! Max Out Your SEO

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Share on Facebook!
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads

Thread Thread Starter Forum Replies Last Post
Google Reinclusion Requests - Matt Cutt Video Joe Ward SEO Buzz 3 08-07-2006 04:29 PM
Google is All About Search: 4 New Products Joe Ward SEO Buzz 0 05-16-2006 01:52 PM
Some extreme issues need help on fixing. pspcrazy Troubleshooting 14 03-14-2006 03:40 AM


All times are GMT -4. The time now is 04:22 AM.


Powered by vBulletin Version 3.8.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.3.0 ©2009, Crawlability, Inc.