IBM data center gets deep energy retrofit

SOUTHBURY, Conn.--IBM's "green" data center here is kind of like a techie version of the "This Old House" television show. But in this case, the project was to build a showcase for energy-efficiency computing, rather than construct a new addition for a suburban home.

IBM's main problem was data center sprawl. Five years ago, internal IT staff could barely keep up with growing demand for computing resources from employees, causing an expansion from one data center location to four--a situation that was costly and inefficient.

Now, those four data centers have been consolidated into a single spot with the latest in energy-efficient tech gear, including a network of 200 sensors and water-cooled servers. It also uses what are considered the best practices for physically laying out a data center, with close attention to everything from cabling to air flow.

Photos: Inside IBM's deep green data center

Making data centers more energy efficient has been a growing priority for technology managers for the past few years, as companies seek to trim spending on electricity and reduce their environmental footprint. The Environmental Protection Agency in 2007 estimated that data centers alone use about 1.5 percent of all electricity in the U.S. and are on a pace to double consumption in the coming years. In IBM's case, it deals with high volumes--its wikis are used by 365,000 people--and a growing number of applications.

IBM's tech staff did what many others in their position have done: they consolidated their computing workload with virtualization and upgraded to new, more energy-efficient hardware.

But packing more servers--each with multicore processors--into smaller spaces creates more heat, exacerbating the challenge of keeping the space cool. IBM is using a number of techniques to cool efficiently, but the guiding principle is to match the cooling with the required heating load.

"You have to physically integrate the IT and physical (cooling) equipment so you can adjust the air conditioning to match the thermal load--the system should be very dynamic," said Peter Guasti, program director for IBM's Green Innovations Data Center.

Just office buildings or hotels heat or cool rooms even when there are no people in them, many data centers operators don't have fine-grained control over cooling systems. That means the temperature can be set lower than it needs to be or a "hot spot" emerges when one piece of equipment has a heavy computing load.

Combining IT and building architecture
To keep the air conditioning well tuned, IBM is gathering lots of data. Sensors are placed behind, in front of, and top of server and storage racks to monitor the temperature. The data is collected and analyzed so that the air and water cooling systems can be automatically adjusted as needed, Guasti explained.

Operators can get a "thermal map" of the data center based on the sensor data to help find trouble spots. They are also beta testing an upcoming version of IBM's Tivoli Energy Management software, which will be able to incorporate the sensor data into the systems management program.

"The bright idea is not so much putting the sensors in. It's what you do with the data--you get reams of information so you have to try to figure out what's important and not," Guasti said.

Air flows along a predetermined path with "cold aisles" pumping cooled air to the front of equipment from the floor and hot air behind server fans being sucked upward from the ceiling in "hot aisles."

To lighten the overall cooling load, IBM is using its liquid-cooling systems, originally code-named Cool Blue, which fit onto the back of server racks. These heat exchangers cool the hot air coming from servers' fans by circulating cold water through coils, which absorb the server heat and then are cooled using the building's chiller.

IBM is looking at a variety of other ways to lower energy consumption, including using solid-state hard drives and using outside air--filtered to clean out contaminants and humidity--to cool the building, Guasti said.

Saving green or green PR?
The Green Innovation Data Center was designed for tours so customers can get some ideas on how to lighten their own data centers' energy load. But it's not just for show--the center runs applications used by thousands of people.

And the investments IBM made in making the center more efficient are "very cost justified," said Patrick Toole, the company's newly named chief information officer, in an interview. IBM as a company has wrung $3 billion in costs over the past year, which it plans to continue, he said.

But the company measures the "payback" from upgrading its data center not only with energy savings and environmental benefits. It's also measured in business process improvements, Toole said.

For example, the data center allows IBM to operate an internal "cloud computer." Employees can procure computing resources--server processing and storage space, for example--for a certain amount of time on a subscription basis. In the past, employees asked the IT group to install a server for each new application, which is less efficient than a shared-resources model.

Also, the influx of data on energy use lets data center managers better track related costs.

"The instrumentation we have with what is going on is so much more granular than before. We haven't had dashboards with regard to the green aspects before," Toole said. "Now we can see things like energy on a smartphone and we're able to manage that."

Updated at 7:15 A.M. PT with corrected title for Toole and video added.

[JesseThe]

Misleading news on the IBM data center AS A GREEN ENERGY project. All it discusses is the elaborate cooling system, but NOTHING actually innovative on the green side!

[kieranmullen]

Why not convert the entire site to 12V so 12V power supplies are not needed for each server?

[TechSlap]

We could use some of these sensors and software for our data center. Anybody know how to get a hold of this tech? Aside from searching google?

[laribeiro]

Automated Logic have the best technology for that. They were the option of IBM for that project. www.automatedlogic.com

[dustinfowler]

There is so much energy to be saved and IBM is doing just that. What a great idea. IBM appears to be setting the pace for green data centers. I feel there will be great loyalty toward IBM from the social media due to their great contributions to a greener society.

[andrewchriss]

This article is very interesting. I didn't know that data centers consume 1.5 of the U.S. electricity. It seems like energy management is a big issue. Its amazing how the arrangement of servers and the engineering of cable layouts and sensors to control the cooling and heating, could make such a difference in energy consumption. I like the achievements IBM is making to lower energy use. I believe with advancements like this it will cause many other companies to change their data centers.

[holme501]

I think IBM is very innovative and if it costs more right now, they will definitely make up for the increased costs in the long run. Their thermal monitoring and the dynamic cooling system seem to be some of the highlights of what they are doing. Hopefully, other companies will follow in IBM's steps and attempt to become more green and not only save money in the long run, but also the environment.

[patzigp7]

IBM is saving lots of enrgy every day. They set new standarts around the would how it gets done to save the enviroment. They not only save the enviroment no they even became more cost efficient. Every company should take IBM as a example.

[falskenj]

I think IBM is doing a great thing here. The high cost now will definitely save them in the long run and will gain much support. I think they will be a company to look to in the furture for enery saving and cost efficiency.

[biggse]

For a more in depth knowledge you can now visit a virtual version of the green data center on Second Life. It is a great resource with a lot of information on IBM's thought process into building the facility and some info on how it works.

[ashpash21]

IBM has taken many steps into becoming green, but they still looking to find more ways to lower energy consumption. It really shows their dedication to becoming more eco friendly. They really set the example as for what other companies should be working toward.

[fort_hawkeye]

Being green only from not running air conditioners at maximum for cooling, you would think that taking a water-based cooling system and using it for data center cooling would have caught on earlier. Where's the dollar figure on outfitting a data center with this equipment? Sprawl's been a problem, but now that companies are getting caught up in the green revolution, what's it going to take to become "green."

[chayr539]

Saving energy is not only cost-efficient for a company ,but also environmentally friendly. IBM has invested millions of dollars in sensors and water-cooled servers in order to accomplish their energy-efficiency goal.Through the idea of a GREEN data center, IBM is setting the standard for other big corporations around the world in the pursuit of a greener society. Hopefully, other companies follow this initiative.

[brookie_ast]

I think that it is schocking that it is predicted that datat centers will be eventually using 3% of all energy in the U.S.! However it is great that companies like IBM are being conseious of the energy they are consuming and implementing measures like heat seansors, thermal maps, and cooling isles to reduce their eco footprint.

[kasho0o]

Its great to see large companies like IBM making an effort to be energy effiecient. The Green Data Center is a good step in using less energy in the future. Hopefully other compaines that use these large data centers will follow in the footsteps of IBM and do their best to be energy efficient. It will make a major different to our enviornment!

[Turtelcifuentes]

In my opinion, IBM is very innovative. IBM has done many steps for becoming green, but they keep trying to improve in order to lower energy consumption. It would be really positive that other companies follow this initiative, hopefully they will do it and will take better care of our environment.

[Delforgc]

It seems like energy management is a big issue these days with everything trying to be pushed towards more "green" activities. I like the achievements IBM is making to lower energy use and I believe with advancements like this it will cause many other companies to change their data centers. I believe that IBM is very innovative and more companies need to follow thier example.

[Masusinho]

Since scientists have predicted Global Warming, many companies are going "green" to stop or to alter the anticipated trend. Personally, I like the approach of IBM to decrease its energyexpenditures so that the environment can be better off. IBM?s Green Data Center is innovative, prevents environmental pollution, and lift up the public image of the company. Hopefully, other companies go the same way in order to serve the environment.

[Whirlybrd827]

IBM seems to really be leading the way in green business and energy management. More businesses should follow IBM with this innovative and cost-saving practice. I think in today's business world, it is just as important to have a "green" image as it is to make money. It just so happens that having a "green" image will save you money, therefore making you money. Well done IBM.

[MeganNoel]

IBM has set the path for companies to get on the Green movement, with their IBM Green Data Center. Other companies can view their center through Second life, which I believe has helped others extremely. It shows that they are truly dedicated to going green,. and helping others go green as well.

[enloek]

The article is very interesting and shows how companies can get on this wave of creating green data centers. IBM hopefully can lead the way by making this open to the public. By going green with our data centers that will not only save money but will potentially take a chunk out of the a 1.5% of energy that we rely on for our data centers in the US.