August 11, 2009 1:14 PM PDT

Google's Caffeine: A jolt to search rankings?

by Tom Krazit
  • Font size
  • Print
  • 25 comments

One of the largest behind-the-scenes updates to Google's search technology in three years is under way, as the company reworks its computing muscle.

On Monday evening, Google quietly began soliciting feedback for "Caffeine," a new system for Web searches that is being tested completely separately from the live search results currently found through Google.com.

Google makes almost constant changes to its search algorithms and infrastructure, but it hasn't made an update of this magnitude since 2006, said Matt Cutts, a principal engineer at Google who is considered one of the driving forces behind its approach to search.

Think of Caffeine as a redeployment of the computing network that Google uses to connect searchers and results. "We want to make a system that is more robust, that can do more--and do more faster," Cutts said.

Google said it is not changing the user interface as part of the Caffeine update, nor does the update affect the ranking of ads on the search engine. So the average user trying to find a new digital camera or directions to the restaurant likely won't be surprised by how the results are presented.

But they might notice that things have gotten a little faster: speed is a side benefit of the decision to focus on improving how documents are indexed with the new update, Cutts said.

Those responsible for search engine optimization at their companies or clients, however, are just starting to get busy. The changes to Google's indexing methods will likely have an impact on the way Web sites are presented on the extremely important first page of search results, hence the need for testing and feedback.

For example, search blogs such as SearchEngineWatch.com noted that Wikipedia results seem to have been pushed a little further down the page in the sandboxed search system.

That's not necessarily indicative of how the results would be presented, once Caffeine goes live, but it is evidence that the update will require those dependent on Google to drive traffic to their sites to study the changes. For now, Google is not sharing many details regarding how it reworked its back-end architecture and indexing process with Caffeine.

Cutts said the changes that are coming along with Caffeine have been in the works for months, implying that the launch of Microsoft's Bing and Yahoo's subsequent decision to finally pull the plug on its own search efforts had little to do with the planning for Caffeine. But it does illustrate that while search is a constantly evolving product, serious infrastructure updates are needed to keep the trains running on time. This was perhaps what Yahoo CEO Carol Bartz had in mind as she reviewed what it would cost to just maintain Yahoo's current search commitment, let alone a renewed effort to gain share: Yahoo expects to save a ton in capital expenditures as a result of the outsourcing deal.

Google designs much of its own infrastructure, developing its own servers and piling them together in modular shipping containers. It's not clear whether any changes are being made to the basic Google server itself, but Cutts observed on his own blog that "Caffeine is a radical revamp (more like a complete rewrite) of large parts of our system," which may entail more than just updating the search index.

The Caffeine preview can be found here, and feedback is encouraged, both to Google, and right on this page.

Tom Krazit writes about the ever-expanding world of Internet search, including Google, Yahoo, online advertising, and portals, as well as the evolution of mobile computing. He has written about traditional PC companies, chip manufacturers, and mobile computers, spending the last three years covering Apple. E-mail Tom.
Add a Comment (Log in or register) (25 Comments)
  • prev
  • 1
  • next
by ybfishel August 11, 2009 2:21 PM PDT
terrific, absolutely. like the fact that it lists news sources first.
Reply to this comment
by FutureGuy August 11, 2009 2:48 PM PDT
absolutely ingenious, wait it does look any different and behaves the same but its say's it?s from Google so it must be a terrific update and I don't know how I lived without it.
by rstinnett August 11, 2009 2:46 PM PDT
Sorry Google, you lost me. Bing saved us over $350 on our vacation, while Google did nothing to help us find deals -- but sure was good at putting up the paid/spam links!
Reply to this comment
by t8 August 11, 2009 3:31 PM PDT
Microsoft gave away a free domain for life with Office Live. Then they reneged.

They dangle a little cash and only a few take it.

Microsoft need to pay people in order to gain an extra percent.

How about innovating and inventing.
That is why Google doesn't need to pay people to use their stuff.
It is just better.
by Vegaman_Dan August 11, 2009 3:39 PM PDT
@T8:

Google just uses your personal information for their own marketing purposes. If your company stores data in their systems, this too is examined by Google and any other third party companies they choose to share it with for marketing/advertising purposes. Not exactly 'better' in my opinion.
by Dalkorian August 11, 2009 4:08 PM PDT
@Dan: If you think you can convince even one person that your beloved evil M$ doesn't do the exact same thing, you need help. The difference is you have to go to Google for them to capture your data. If you're enslaved to the M$ "operating system" (the name that's to evil to be spoken aloud), M$ is capturing your data CONSTANTLY, no matter what you're doing.

Hmm, I'm not sure I'd trust any rapist, but if I had a choice between the agoraphobic rapist and the public stalking rapist, I know which one I'd pick.
by tenbosch August 11, 2009 4:49 PM PDT
You morons are arguing over two evil empires. Gosh, give me a break. Also, if you don't think Google is an evil empire, just wait a couple of years when the government and all the other tech companies come down on them.
by monkeyfun14 August 11, 2009 7:13 PM PDT
@t8

Microsoft did innovate with Bing what are you talking about?

@Dalkorian

Really? Got any sources?
by hutwarmer August 12, 2009 5:08 AM PDT
I always kind of get a kick out of this 'Google is harvesting and examining your personal information' arguement. I use a lot of Google services and guess what? I don't get any additional junk mail, I don't get any additional marketing calls, I don't notice any different ads on the sites that I visit, (not that I really pay attention anyway) and I don't notice any different ads on the TV shows I watch. Hell, I barely receive any spam in my gmail account. So what exactly are they doing with all of this personal information? Geez, if they could actually be somewhat successful in targeting advertisements to me that I would actually be interested in, I would consider that helpful to me. As for all the people who argye that they don't want to be advertised to, take a good look around. Your are advertised to 24/7. So why is this any different? Oh sorry, I forgot. It really isn't.
by Jamasama August 13, 2009 1:02 AM PDT
Imagine you've just eaten a blackberry from a bush that was already peed on by a dog. Sure, you've washed it, you and you're not gonna get any illnesses, or turn into a dog. But would you still eat it knowing a dog had done his business on it?

Sure, you don't get anymore spam, or people at your door trying to sell you parrots when companies share your details. So hey, let's all put up big signs giving out our private info, but kindly ask people not to talk to about it. Just ask them to do what they want, use it and manipulate it how they want, without bothering you.
by FF2009 August 11, 2009 3:58 PM PDT
Vegaman_Dan

Like M$ doesn't do that with its Live search and now Bing and Yahoo? you be a fool if you think other wise. Yahoo also was caught red handed with exposing your Yahoo searches not long ago.

There is no privacy on search engines.
Reply to this comment
by doubleshotweb August 11, 2009 4:11 PM PDT
This shows the difference in search results in the two algorithms. Could be good for SEO...www.comparegoogle.com
Reply to this comment
by icemanx1979 August 11, 2009 10:14 PM PDT
i can definitely see that the new site is faster which is great, but i worried about seo. a lot of people have been trying to get up the SERPS of google, and hopefully people strategies won't kill them in the new engine
Reply to this comment
by whonoes1 August 12, 2009 9:37 AM PDT
I am NOT happy at all seeing these results... Search for "commercial real estate Lake of the Ozarks" for example. Most all results on first page are Lake of the Ozarks.... If I wanted to search for Lake of the Ozarks real estate surly I am smart enough to do so.
Reply to this comment
by ClarityQuest August 12, 2009 11:29 AM PDT
So far we have not seen a huge difference in rankings on Caffeine vs. the current search. In all cases where we did see a change, the results were positive for our B2B clients' sites.
Reply to this comment
by Neal_Saferstein August 12, 2009 1:01 PM PDT
I am starting not to be impressed with google search. This should be good.

Neal Saferstein
http://nealsaferstein.com
Reply to this comment
by nuswfc August 12, 2009 1:46 PM PDT
we have been perparing for Caffeine over a month now. We have all the confiedince that we will continue to show high results with our clients.
Reply to this comment
by nuswfc August 12, 2009 1:50 PM PDT
wow I can not spell - - - confidence*
but again Caffeine will change the way that content is picked by Google, we are ready are you?
by GEO2003 August 12, 2009 2:42 PM PDT
How Ironic, that he actually mentions that the changes have been going on for months and it has nothing to do with BING or MS Yahoo search agreement.

Please, they feeling the pressure, not just about BING, but the fact that people are becoming more aware of their underlying tactics to keep user's information for years and link it to the users actual IP address, and I don't mean, the general IP given by your broadband provider.

Infringement on Privacy rights - Anyone ?

I already switch my whole family to BING.

Faster does not necessarily translate to better.
Reply to this comment
by knowles2 August 13, 2009 2:34 AM PDT
An you sure Microsoft not doing the same or will do it once they have dominated the market. I am not. I rather stick with the beast I know, who so far has not cause me hassle to one who always causing me hassle.
by sar10538 August 13, 2009 5:59 AM PDT
Remember the debacle a year or two back when the government demanded users searches from the major search sites? M$ and Yahoo rolled over straight away and showed their soft underbellies. Google held out. And you talk about privacy rights as if M$ is going to protect you! I guess the marketing department of M$ does a great job of brainwashing people into thinking that they are the good guys but if you look at the history of this company it's one of the most cut-throat, non-ethical enterprise in all of history. Bill would have sold his old grandmother out for a buck if he could.
by MaddieR16 August 12, 2009 4:08 PM PDT
Interesting news, but I still prefer Infospace.com. I get Bing, Google, Ask and Yahoo results and twitter.
Reply to this comment
by Harrison912 August 13, 2009 8:39 AM PDT
As a web site owner of safety and security products, I rely on the search engines to drive traffic to my site so any improvements are usually a good thing. Thanks, Tom.
Reply to this comment
by prophead51 September 30, 2009 11:26 AM PDT
Bing is generating more traffic to the website http://www.hcgcompletediet.com than Google is by 2 to 1
Reply to this comment
by Web_Developer- November 9, 2009 10:55 PM PST
My name is James.. I was just testing Google caffeine for search results and got this message seems to be great news? I think the new Google is incredibly faster and has more accurate search results.

http://www.google.com/errors/caffeine/unavailable.html

We appreciate all the feedback from people who searched on our Caffeine sandbox.

Based on the success we?ve seen, we believe Caffeine is ready for a larger audience. Soon we will activate Caffeine more widely, beginning with one data center. This sandbox is no longer necessary and has been retired, but we appreciate the testing and positive input that webmasters and publishers have given.
Reply to this comment
(25 Comments)
  • prev
  • 1
  • next
advertisement

About Webware

Say No to boxed software! The future of applications is online delivery and access. Software is passé. Webware is the new way to get things done.

Add this feed to your online news reader

Webware topics

15 sites that went kaput in 2009

Web sites launch all the time, but they also shut their doors. We highlight 15 that bit the dust this year.

Top 10 news stories of the decade

Let the debate begin: Was the iPhone more important than iTunes? Was anything bigger than Google finding a great business model? CNET offers its list of the 10 most important stories of the '00s.

Inside CNET News

Scroll Left Scroll Right