March 3, 2005 4:00 AM PST

Google's secret of success? Dealing with failure

Related Stories

Eclipse shines light on future projects

March 1, 2005
BURLINGAME, Calif.--The technical wizardry behind Google's successful search engine may come down to a blindingly obvious insight: PCs crash.

On Wednesday, Urs Hoelzle, a vice president of engineering and of operations at the search giant, shed some light on how Google's data centers operate. Many people consider the company's operations expertise more valuable than the actual search algorithms that launched the enterprise.

Hoelzle spoke at EclipseCon, a conference for application programmers that's going on till Thursday here.

News.context

What's new:
At EclipseCon, Urs Hoelzle, a vice president of engineering and of operations at the search giant, shed some light on how Google's data centers operate.

Bottom line:
According to Hoelzle, Google has inexpensively built out its computing infrastructure by using thousands of "commodity" servers, instead of fewer high-end, and high-priced, machines. The trick is to make these racks of hardware work together and to ensure that the failure of one machine doesn't derail an operation.

More stories about Google

The way Google has been able to build out its computing infrastructure for millions, rather than tens of millions, of dollars is by buying relatively cheap machines. Looking at hardware costs, company engineers saw that purchasing a few high-end servers, with eight or more powerful processors, costs significantly more than dozens of simpler "commodity" servers.

The trick is to make these racks of hardware operate in tandem and to ensure that the failure of one machine does not derail an operation, such as returning a search query or serving up an ad.

Consider a home PC, Hoelzle said. Optimistically, a consumer PC might crash once in three years from a software glitch or hardware problem.

"At Google scale...if you have thousands of PCs, you can expect one (failure) a day," he said. "So you better deal with that in an automated way, or you will have service outages."

Google, known for its rigorous hiring practices aimed at attracting the brightest minds in computer science, has created a number of software tools to handle its computing installation.

The company wrote its own file system, called Google File System, which is optimized for handling large, 64 megabyte blocks of data. Significantly, the file system was designed to assume that a failure, such as a failed disk or unplugged network cable, can happen at any time.

Data is replicated in three places, and there is a "master" machine that

CONTINUED:
Page 1 | 2

22 comments

Join the conversation!
Add your comment (Log in or register)
Crash once every three years?????
He obviously has not been using Windows.
Posted by unixrules (21 comments )
Reply Link Flag
Yeah!
And god knows he doesn't have racks of MACs to deal with.

NWLB
*****
<a class="jive-link-external" href="http://www.nwlbnet.blogspot.com" target="_newWindow">http://www.nwlbnet.blogspot.com</a>
Posted by NWLB (318 comments )
Link Flag
right
You are right, he's not using Windows. He's using Linux, and he claims to have systems crash every single day.
Posted by David Arbogast (1712 comments )
Link Flag
Crash once every three years?????
He obviously has not been using Windows.
Posted by unixrules (21 comments )
Reply Link Flag
Yeah!
And god knows he doesn't have racks of MACs to deal with.

NWLB
*****
<a class="jive-link-external" href="http://www.nwlbnet.blogspot.com" target="_newWindow">http://www.nwlbnet.blogspot.com</a>
Posted by NWLB (318 comments )
Link Flag
right
You are right, he's not using Windows. He's using Linux, and he claims to have systems crash every single day.
Posted by David Arbogast (1712 comments )
Link Flag
Are Google's SERPs as Relevant as they were 2 Years Ago?
The Bottom line is relevancy. The labs add-ons are certainly very helpful. But - has Google's SERPs decreased in relevancy in the past two years.

It seems that between suddenly dropped sites and too much emphasis on link analysis, it is becoming more of an effort to get good results for some searches.
Posted by aa (3 comments )
Reply Link Flag
Are Google's SERPs as Relevant as they were 2 Years Ago?
The Bottom line is relevancy. The labs add-ons are certainly very helpful. But - has Google's SERPs decreased in relevancy in the past two years.

It seems that between suddenly dropped sites and too much emphasis on link analysis, it is becoming more of an effort to get good results for some searches.
Posted by aa (3 comments )
Reply Link Flag
Yahoo already did this.
I mean they're not as sophisticated as google, but Yahoo has pretty much done the same thing already for many years.
Posted by (4 comments )
Reply Link Flag
Yahoo already did this.
I mean they're not as sophisticated as google, but Yahoo has pretty much done the same thing already for many years.
Posted by (4 comments )
Reply Link Flag
Not all that new news...
One of there engeneers were talking about this 4 months ago... the video is here <a class="jive-link-external" href="http://www.uwtv.org/programs/displayevent.asp?rid=2459" target="_newWindow">http://www.uwtv.org/programs/displayevent.asp?rid=2459</a>
Posted by (3 comments )
Reply Link Flag
Not all that new news...
One of there engeneers were talking about this 4 months ago... the video is here <a class="jive-link-external" href="http://www.uwtv.org/programs/displayevent.asp?rid=2459" target="_newWindow">http://www.uwtv.org/programs/displayevent.asp?rid=2459</a>
Posted by (3 comments )
Reply Link Flag
 

Join the conversation

Add your comment

The posting of advertisements, profanity, or personal attacks is prohibited. Click here to review our Terms of Use.

Inside CNET News

1-2 of 12

Scroll Left Scroll Right

What's Hot

Discussions

Shared

RSS Feeds

Add headlines from CNET News to your homepage or feedreader.

Markets

Market news, charts, SEC filings, and more

Related quotes

Google (1.04%) 6.29 612.20
Dow Jones Industrials (0.57%) 72.81 12,874.04
S&P 500 (0.68%) 9.13 1,351.77
NASDAQ (0.95%) 27.51 2,931.39
CNET TECH (0.84%) 17.13 2,049.14
  Symbol Lookup