With infrastructure services like Amazon EC2, Rackspace, and VMware making it easy to take advantage of the flexibility, portability, and reduced costs of cloud computing, it seems obvious to jump on the cloud bandwagon for new IT projects.
But, developers are generally left on their own to deal with the pain of deploying their apps to the cloud: configuring application servers, libraries, disk partitions, networking, clustering, service connections, and virtual private networks. After they get their app installed they also need to install management agents that run on top of the application layer.
If you really want to take advantage of the cloud and optimize return on investment, you'll want the on-boarding process to be easy and fast and you won't install that agent. Agent-based solutions are inherently inflexible. Deploying agent-based solutions in a cloud-based environment, which is, by definition, highly flexible, is often like trying to fit a square peg in a round hole. In agent-based solutions, hard-coded agents are installed on every machine to monitor the application. If a change to the application configuration occurs--such as the IT department adds a node or upgrades a component--the agents must be updated as well.
Each agent and management server must be configured separately with management and monitoring solutions generally not portable. When every change to an environment requires installation of multiple agents on each server and configuration of multiple management servers, it becomes a tall order to move an application from a traditional infrastructure to the cloud, or from one cloud infrastructure to another: private to public, public to hybrid, or hybrid to private.
How do you get around this so you can actually capitalize on the benefits of cloud computing? Go virtual. Move application management, including easy on-boarding, from above the application stack into the underlying virtual layer, along with the rest of the cloud infrastructure.
I was recently briefed by webappVM CEO Isaac Roth on how the company is pioneering this new approach. He said the virtual path allows you to actually realize all of the flexibility, portability, and reduced costs that come with the promise of cloud computing.
... Read moreThe Tennessee Valley Authority is the nation's largest public power provider serving approximately 9 million consumers in seven southeastern states. The organization also happens to be a big supporter of open-source projects, including Hadoop, a tool designed for deep analysis and transformation of very large data sets.
Earlier this year, the Tennessee Valley Authority (TVA) announced that it open sourced its data system used to collect data from smart grid devices called Phasor measurement units (PMUs). The data collection system is known in the industry as a Super Phasor Data Concentrator (SuperPDC), which can be used to determine the health of a power grid.
The open-source version of the SuperPDC is now called the "OpenPDC." I spoke to both Ritchie Carroll (RC), the project's creator, and Josh Patterson (JP), the person responsible for introducing Hadoop to the project, to discuss what the OpenPDC is and why TVA turned to Hadoop in building the system.
What sort of data volumes are you working with?
RC: Currently there is around 20 TB of archived data, we expect this to grow quickly as a result of the SmartGrid stimulus funding which includes the addition of 850 phasor measurement devices. This may well grow the archive to half a Petabyte within the next few years.
How is this data currently captured and managed? Is any data discarded?
JP: Data is collected directly from field devices at 30 times per second. This data is then time-aligned and processed in real-time--all data gets captured into a binary data file as time-series data for mass processing by Hadoop.
RC: No data is currently discarded, if we get to the point of needing to discard data because of cost--this will be a decision based on weighed importance of collected data. It is likely the data around major events will never be deleted because it will always be valuable for future student researchers. There is also value in being able to go back in time and look for newly discovered event signatures to see how long they might have been occurring.
... Read more
Microsoft released on Thursday a new position paper, "Privacy in the Cloud Computing Era: A Microsoft Perspective," that includes information about the remote storage and processing of personal information.
Privacy and security concerns continue to be a primary argument that cloud naysayers use against storing data and applications on the Internet. Big IT vendors and service providers like Microsoft and Hewlett-Packard will sooner or later be forced to take the cloud seriously or risk missing out on the whole next wave of IT consumption. And their large enterprise customers will expect them to offer cloud services with the appropriate levels of privacy and security measures in line with their business needs.
The interesting thing about this paper is that Microsoft takes surprisingly minimal responsibility for the data it will manage:
... Read more
(Credit:
IBM)
IBM on Wednesday announced a program designed to help educators and students pursue cloud-computing initiatives and better take advantage of collaboration technology in their studies.
The IBM Cloud Academy, announced at the Educause annual conference, includes a global roster of educational institutions as initial participants. Educause is a nonprofit association whose mission is to advance higher education by promoting the intelligent use of information technology.
IBM will provide the cloud-based infrastructure for the program, with some basic collaboration tools available at the outset. IBM's LotusLive service provides the basis for the new offering. Participants will immediately be able to do some very basic tactical functions on the new system:
- Create working groups on areas of interest to the education industry
- "Jam" on new innovations for clouds in education-related areas with IBM developers
- Work jointly on technical projects across institutions
- Share research findings and exchange new research ideas
Shared research across universities and other higher-learning institutions remains a vital part of technological innovation, but many programs don't have formal tool sets in place. Cloud services are a logical place to run these types of programs, especially as international groups need immediate access to data from their partners.
... Read moreOne of the less appealing aspects of using cloud services is integrating various applications--both those in the cloud and those in your enterprise in an easily manageable way. A practical use case is the ability to use one CRM (customer relationship management) system and a different file storage system, both in the cloud.
So, Friday when I saw that Box.net was directly integrating its cloud-based storage service with Salesforce.com, I saw the confluence of two major trends, cloud storage and integration appear all in one fell swoop.
Salesforce.com has been the leader in cloud services and has consistently offered users ways to integrate other services into their SF.com installation. And Salesforce has also become the prime target for vendors who want to tap into their enormous customer base already using on-demand services.
But, Salesforce is far from infallible with certain aspects, such as storing files somewhat clunky and definitely costly when you start making it your system of record.
With the new offering, Box.net business users will now be able to add a Box.net app to their Salesforce accounts, allowing them to access their documents, media, and other files from directly within their SF.com instance. And they'll have unlimited storage for their files.
... Read more
With the launch of Windows 7 many signs point to the fact that Microsoft seems to have gotten its operating system engineering in order. That's obviously good news for its OS business unit and also good news for PC manufacturers and software companies that develop for Windows.
A rising tide of Windows adoption is not a bad thing for the technology industry in economic terms but it doesn't yet do a lot to enhance the way we use computers and applications in our every day lives.
The main problem is that Windows 7 reinforces a desktop centric-paradigm for 93 percent of the market and continues to exert a certain level of misguided design principles in the way the system handles data and file structures. And while it's a giant leap forward in terms of customization, visual effects, and security there is a missed opportunity in the cross-border approach of combining the desktop and cloud services.
Cloud-based applications and storage are still so nascent that Microsoft could jump in and usurp much of the power and market share while shoring up its cloud story for the future. Having the dominant desktop landing pad gives Microsoft a huge advantage over upstarts--even Google and Apple, if it can focus on integrating the services.
Here are a few ways Microsoft could assert its dominant desktop position to compete with Google and Amazon as a cloud player:
... Read more
Iron Mountain, a longtime provider of physical- and digital-records management, on Wednesday announced a cloud storage API that enables developers to take advantage of Iron Mountain's off-site storage facilities.
Despite the recent issues related to T-Mobile/Danger/Microsoft's data loss, cloud-based storage is not only here to stay, it's a good use case for organizations that don't have the internal processes or means to deal with off-site data management.
And while you can never know all of the things that can go wrong with your data (meaning that no one would have expected Danger to lose the T-Mobile data), established vendors like Iron Mountain have not only the customer base to support their abilities but also the processes to support customers effectively.
Iron Mountain's cloud storage application programming interface is the next evolutionary step beyond a cloud NAS (network-attached storage) that we've seen from providers like Mozy and others. The cloud storage API is similar in function to Amazon's Simple Storage Service interfaces, enabling developers to access data using restful interactions.
... Read moreStoring files on your hard drive alone is risky since hardware failures can result in losing of all your data. The best way to back up your information is to store it in the cloud--or at least somewhere other than your local system. And there are plenty of options to choose from if you go the cloud route--online storage is hardly an underserved area.
I was recently briefed by U.K.-based start-up Livedrive, which is targeting consumers and small businesses and boasts more than half a million customers.
Even though it's not marketed as a replacement for the vast and sundry applications we rely on daily, Livedrive is effectively turning the browser into an operating system. Customers can share their files between all of their computers and securely access them online from anywhere, including mobile devices like the iPhone.
This is a fairly crowded market with companies like Mozy and Box.net offering various services, but Livedrive's offering looks a lot more what we expect to see from the mythical GDrive--Google's supposed online storage system
... Read moreNew data from IDC's Cloud Services Forecast shows that cloud services will outpace traditional IT spending over the next five years and will represent $44.2 billion, or roughly 10 percent, of all IT spending by 2013.
However, the missing link in this data set is that these numbers account only for IDC's cloud services taxonomy (Application Software, Application Development and Deployment Software, Systems Infrastructure Software, and Server and Disk Storage capacity) and don't represent private clouds.
Private clouds--or at least internal enterprise applications that use the same principles--will undoubtedly become a major trend over the next five years. In addition to the cost savings of using existing compute power, the ease of use of cloud APIs will work their way into the enterprise quickly, now that developers are comfortable with public cloud services like Amazon S3 and EC2.
If public cloud services will be 10 percent of all IT money spent, that represents a blisteringly fast growth rate. And while we certainly don't wish the recession to continue, it's interesting to see how companies have adapted their IT plans to take advantage of services that require far less capital expenditure. From IDC:
The five-year growth outlook remains strong, with a five-year annual growth rate of 26 percent--over six times the rate of traditional IT offerings. In spite of the challenging economy--or more accurately, because of it--this growth rate advantage expanded from last year's forecast, in which cloud services were forecast to grow at over five times traditional offerings.
There is no question that cloud services are in their infancy and that the market is ripe for further disruption. The challenge going forward will be to accurately measure just what applications and services are internal, external, cloud, or otherwise.
In the meantime, let's all just be glad to see IT spending on the rise.
If recent research is any indication, Amazon.com and Google are winning the cloud game.
Evans Data on Tuesday released a report (registration required) on how developers perceive cloud service providers related to cloud services offerings, including their completeness and the companies' ability to execute on the vision.
Janel Garvin, the founder of Evans Data and the author of the report, provides excellent insight into the current state of the market and how quickly things could change, if certain large vendors (notably AT&T and Microsoft) got their acts together more quickly.
Given their robust services, it isn't surprising that Amazon and Google top the list. And although IBM, VMware, and Microsoft trail, each offers important components of cloud infrastructure.
... Read more
