• On TechRepublic: Five super-secret features in Windows 7
August 1, 2007 4:54 PM PDT

365 Main blames data center outage on generator maker

by Elinor Mills
  • Font size
  • Print
  • 2 comments

A week after a slew of popular Web sites were knocked offline temporarily by a power outage in San Francisco, the data center for the Web sites has finally disclosed what went wrong.

Basically, backup generators made by a Dutch company called Hitec failed to work, according to an update posted to the Web site of data center 365 Main.

Here's what happened: transformer breakers at a San Francisco Pacific Gas & Electric power station unexpectedly opened, causing a power surge that cut off electricity to a portion of the city. (PG&E does not know why the breakers opened.) Three out of 10 of 365 Main's 2.1-megawatt backup generators failed to start up, cutting power to equipment of more than 40 percent of the data center's customers for up to 45 minutes.

And why exactly did the backup generators fail to, well, provide backup like they were supposed to? According to the technical mumbo jumbo, the problem was attributed to "weakness in a small but essential component in the back-up system known as a DDEC (Detroit Diesel Electronic Controller)...(there was) a setting in the DDEC that was not allowing the component to correctly reset its memory. Erroneous data left in the DDEC's memory subsequently caused misfiring or engine start failures on the next diesel engine call to start."

Right.

Not to worry, Craigslist, Yelp and the others, you'll get refunds on your rent for the inconvenience.

Even with the outage, the San Francisco facility offers 99.9942 percent uptime, the company said. Personally, I'm holding out for five 9s.

Elinor Mills covers Internet security and privacy. She joined CNET News in 2005 after working as a foreign correspondent for Reuters in Portugal and writing for The Industry Standard, the IDG News Service, and the Associated Press. E-mail Elinor.
Recent posts from News Blog
Nvidia puts NForce chipset development on hold
Opera 10 browser is here
Neil Young Archives Blu-ray: Rip off?
Acronis revises survey results about backup habits
Acronis miscalculates data on users' bad backup habits
Flickr co-founder presses beta button
Comcast, Sony open retail store
Cox to try coaxing the Internet into submission
Add a Comment (Log in or register)
amazes me...
by cchenoweth6 August 1, 2007 7:17 PM PDT
I run a much smaller company than most of these guys and I have 2 mirrored server centers connected across two geographically different areas.
Reply to this comment
The real fault...
by zanely August 2, 2007 4:25 AM PDT
...lies not with the equipment, but with the people who acquire a critical system component and then don't test it adequately. If you use a UPS system, a generator or any kind backup system, and don't perform periodic switch-overs, then you don't know what you don't know until it's too late.
Reply to this comment
advertisement

A CNET Conversation with Eric Schmidt

CNET's Tom Krazit and Molly Wood sit down with Google CEO Eric Schmidt to discuss the future of Android, the Chrome OS, the problem of real-time search indexing, and more.

Verizon tests sending RIAA copyright notices

The No. 2 phone company, known for its reluctance to intervene in antipiracy cases, strikes an agreement to forward copyright notices on behalf of the music industry.

About News Blog

Recent posts on technology, trends, and more.

Add this feed to your online news reader

advertisement
advertisement
Click Here

Inside CNET News

Scroll Left Scroll Right