Last week Aaron Wall of SEOBook.com published his analysis of a significant change in the Google search engine. In late January, a marketer in the SEOBook private forum had observed changes in the Google search results, seemingly favoring larger brands over heavily optimized smaller brands. A minor discussion ensued, since this action appeared to reward big businesses for reasons other than the quality-based scores Google usually cites as its “reasons” for ranking some sites above others.
Aaron investigated more thoroughly and put together his findings in a well communicated blog post. Clearly, Aaron demonstrated, Google had made a significant change, either based on a new set of factors unknown to optimizers, or based on corporate directive at Google. Since Google’s CEO had previously promised such changes, it is quite likely that Aaron’s research reveals Google’s operational efforts to deliver on that promise, effective January 18, 2009.
We all know Google dislikes such exposure.
Aaron used a tool from RankPulse.com which had been set up to query Google on a set of searches of interest, researching trends. Since Google is a public service, with significant (if not overwhelming) impact on the global Internet economy, such research is essential (for us) even if uncomfortable for Google. According to the RankPulse web site, the tool:
The RankPulse Index (RPI) provides an overall glimpse into the daily fluctuations of Google results. The value of the index on any given day represents the number of positions websites moved within the top ten for a particular keyword among the 1000 keywords that we track.
each search performed with the API must be the direct result of a user action. Automated searching is strictly prohibited, as is permanently storing any search results.
This is not the first time Google has threatened to shut off its API, nor is it the first time Google expressly forbids automated access. But it does appear to be a case of the world catching up with Google, accurately revealing Google’s operational activities despite Google’s efforts to forbid such scrutiny. Changes made around January 18th were noted in a professional search forum within days, and outlined in detail by Aaron Wall a month later. The RankPulse tool expedited the research, but was not essential. It was, however, key to our ability to analyze and disseminate information about Google’s operations in a timely fashion. You might say that Google’s API,via custom third-party innovations like RankPulse.com, enabled us to “organize the world’s information and make it universally accessible and useful” (which is Google’s corporate mission statement, by the way).
It sure seems contradictory for Google, a company based on the collection and storage of others’ web page content, to forbid others from doing the same. It is also quite egregious for Google to expect to operate secretly, with no accountability (such as might be obtained through archiving of Google results), when Google exerts so much influence over Internet commerce.
Every time I see governments of the world grant leeway to Google because of some “greater good” that comes from enabled search, I feel more confident that we are moving forward in our efforts to build a better world. But when I see Google take actions to shut down innovations that don’t directly benefit Google’s corporate agenda, at the expense of our wider global economy and the free dissemination of information, I cringe. Clearly we need to support search. But perhaps we are all supporting the wrong search engine?