Cloud computing: How we got here

For the last decade, Salesforce.com CEO Marc Benioff has promoted his pet idea that traditional application software was destined for obsolescence.

He was a few years early, but Benioff understood computer history better than his detractors.

Most of the hosted on-demand application vendors, or ASPs as we called them back then, crashed and burned. Not only did they burn through money at a frightful clip, but the technology they used was thin, relying on single-tenant, non-scalable computing architecture models that left a trail of dissatisfied customers.

In the post-Internet bubble world, however, the proliferation of cheap hardware combined with an abundance of Internet infrastructure created ripe conditions for Benioff and others to figure out how to do it the right way. Oracle, Microsoft and other big software makers weren't in immediate peril, but they caught on to the new reality: More customers were accessing the Internet to subscribe to programs like customer management software

With roots in computer clustering and grid computing, the technology that first sprouted during the ASP era of the late 1990s is now the computing topic du jour. There's understandable reason for the excitement but advocates of cloud computing now have to battle the inevitable hype that attends any major technology shift.

So what is cloud computing? The definition game can lead you down a rabbit's hole. After all, isn't the Web itself a form of cloud computing? As Greg Cruey noted, we're all accessing Web pages that reside in the cloud. But the buzz in 2009 about cloud computing isn't so much about a computing architecture as it is a style of computing.

For the IT world, the promise is a a faster, easier, and more affordable way to provision computing resources. Gartner thinks about cloud computing as a system where massively scalable IT capabilities would get delivered as a service. The important advantage for enterprise-level customers is that would have the ability to scale up and down, depending upon the amount of computing resources they might need.

The pay-as-you-go model embraced by Amazon and a host of others is one approach. Another is the platform as a service model embodied by the likes of Force.com from Salesforce and AppEngine from Google. And, of course, there are the myriad end user apps which reside in the cloud used by hundreds of millions of people each day.

"What is cloud computing? " said Tien Tzuo, the CEO of Zuora, a start up which specializes in subscriptions as a service. "Anything where you don't need to own your own physical infrastructure--simply write your code and deploy it on someone else's servers."

Tzuo points to a confluence of factors which have helped usher in the change. Bandwidth is finally everywhere, the security and privacy issues around storing data online don't raise as many hackles among individuals and companies (though they still linger), and the widespread adoption of technologies like open source means that inexpensive hosted software components are now ubiquitous.

You see what that means in the field every day. A company no longer needs to buy software--or a big data center, for that matter. Instead, it can launch applications by choosing among different types of Internet infrastructure, such as AppEngine or Salesforce.

That's a big deal in an economic downturn, when a lot of start-ups in business simply are too strapped for funding to divert money to buy and staff their own computing infrastructure.

So how did we arrive here?
Like most technology transitions, this was a gradual evolution with antecedents in attempts to move beyond EDI toward a world of Internet scale distributed computing with Web services. Much of the 1990s was dominated by esoteric debates over alphabet soup-style technical standards to help further this along. Then computer scientists Ian Foster, Steven Tuecke and Carl Kesselman authored a paper on how to extend the clustering concept. (Clustering was a popular IT technique that allowed a system to automatically decide which CPU should run a particular piece of code.) In practice, their road map for the grid was akin to a metered utility service where a company plugs into the electricity grid and pays only for what it uses.

But before moving off the drawing board, lingering infrastructure issues still needed to get resolved. Paul Wallis, the CTO of Stroma Software, has a very good analysis summing this up:

One of the hurdles that had to be jumped with the move from clustering to grid was data residency. Because of the distributed nature of the Grid the computational nodes could be situated anywhere in the world. It was fine having all that CPU power available, but the data on which the CPU performed its operations could be thousands of miles away, causing a delay (latency) between data fetch and execution. CPUs need to be fed and watered with different volumes of data depending on the tasks they are processing. Running a data intensive process with disparate data sources can create a bottleneck in the I/O, causing the CPU to run inefficiently, and affecting economic viability.

Storage management, security provisioning and data movement became the nuts to be cracked in order for grid to succeed. A toolkit, called Globus, was created to solve these issues, but the infrastructure hardware available still has not progressed to a level where true grid computing can be wholly achieved.

By the early part of this decade, some of those infrastructure issues began to get resolved with the emergence of huge data center services. Cloud implementations adopted by Amazon and others featured the grid idea's payer-per-use concept. It also proved a boon to small developers who now did not need to own their own physical infrastructures. They simply could write their code and then deploy it on someone else's servers

Of course, nothing in computing moves in a smooth progression from A to Z. And with the emergence of cloud computing have come calls to standardize both the APIs as well as the platform services which underlie those services. Otherwise, some caution, you run the risk of cloud computing vendor lock-in. Microsoft's Dare Obasanjo put it bluntly in a post on the topic last fall:

The APIs provided by Amazon's cloud computing platform (EC2/S3/EBS/etc) are radically different from those provided by Google App Engine (Datastore API/Python runtime/Images API/etc). For zero lock-in to occur in this space, there need to be multiple providers of the same underlying APIs. Otherwise, migrating between cloud computing platforms will be more like switching your application from Ruby on Rails and MySQL to Django and PostgreSQL (i.e. a complete rewrite).

If history is a guidepost, most of these petty disputes will get smoothed over in time. Not so much because the vendors will feel compelled to do the right thing but because customers will force them to act in their enlightened self interest. The more difficult question to consider is how long it will take before businesses regularly tap cloud services to make money. That's when you'll know it's become part of the computing mainstream.

See also:
• Salesforce.com: Pondering the next 10 years
• The three routes to cloud computing's future

[N1MIE_1]

No thanks. You can keep it. I don't want some vendor hidden away to dictate what application or application version I am using. I don't want it to go away when a business fails. I want programs installed on my laptop or desktop at my beck and call. There may be some advantages of cloud computing, but I don't see it being a success in my world.

[charlie cooper]

A lot of people in IT share that view. Out of curiosity, what's your big concern? Security?

[jspencer09]

not the original poster, but, to answer your question: yes, security is a huge concern. The concept that the hosting company might be doing "data mining" on my files is a concern. They might turn around and sell that mined data to a third party. I'm sure they will offer "privacy" guarantees, but I could easily foresee a time when they abruptly change their policies and because of a dip in quarterly profits, decide to sell that data.
What if a company goes out of business? How do I get my files back?
System Uptime?
What if the company randomly decides that I'm not paying enough for me to access my critical data, and suddenly decides they need to raise the rates? If this is mission critical data, I don't have time to argue price, it's pay first... and then good luck getting a refund. In short there would be way too much control being placed in the hands of these hosting companies, and concordantly, way too much opportunity for abuse. If you don't think it could happen, just look at the way companies act today. I could easily foresee any of these scenarios playing out.

[cginzel]

i haven't read anyone make this point, but isn't the creation of open source VM software the final cornerstone to the realization of cloud computing?

[yepperdepper]

Yep, Thatz what I want.
There is nothing I would like better than to have ALL of my company's data floating out side the firewalls and physical walls of my company, just floating around in "cyberspace" to be siphoned off at will. How naive can we be to buy into the "IT'S SECURE DOGMA". Security is an illusion, always was, always will be. In our Private lives, in our financial dealings, or on the world wide web, its all an illusion.

Reality check.

[Len Bullard]

It isn't security, Charlie. There is no free lunch. Cheaper for what? If they coarsen the services, find the price of the cheaper piece. They get to renegotiate this every year and if you take the five year plan, at the end all of the technology will have been changed just enough that you MUST accept the new deal on their terms. You've given away all of your leverage.

Charlie, step away from the technology. Put down your i-Thingie. Look out your window. Do you see those shuttered buildings? See those people in line at the job fairs? This despite all optimism is a global crunch. In times like these, the people with the most to lose are the people most in hock. If the prices supporting the vig can't rise, they sink.

Cloud computing is NOT about selling technology. It is about selling content and services OVER that content. It is a neat trick because it takes your business and leaves you as a management shell fronting yet-another-guys-server-farm. Cluetrain, Dude: that is how Microsoft absorbed other software houses, how Google absorbed other businesses, and how the mega-news houses absorbed your studios in San Francisco. Big Fish turn lakes into scum ponds by getting rid of all the little fish that keep the bottom clean. That is why journalism is going to hell fast, the bankers are taking our retirements and laughing at us, that is why Bonus is two words, not one.

So yes, put your nuts in the crackerbarrel and see what you get back. The CONTENT is the key. We have to host the maps. Geo-locating we can buy as a service if it is competitive. What was the price of Google hit bundles a year ago and today? Can you buy ESRI geolocating without buying a coarser service bundle? Who are their competitors and are they competing on price or also coarsening the services?

[Len Bullard]

"faster, easier, and more affordable" - Better. Faster. Cheaper. Where have we heard that before: NASA just before they sent the Mars orbiter crashing into the planet and fried a crew on re-entry.

Cloud Computing Fact: if you are a third party relying on cloud services to deliver to your customer through your product you are a slave to their terms of bundling which will grow increasingly coarse and force you to pay for what your customer doesn't need. As ad revenues drop, content prices soar. The guys who own the servers aren't giving up their private jets.

If you open the source but refuse to sell the content to be hosted and redistributed, you took the major impediment to mediocrity out of the equation: real competition.

[Mr. Dee]

On the Broadband ubiquity - I don't agree. I am writing this from a Computer in the Caribbean using a GPRS connection. The new Facebook is slow, web apps are slow, the web is slow. The only thing that loads quick is my Windows Live Messenger contact list and I had to do some configuring for that to happen.