Coming Attractions to a Cloud Near You

Discrete and Routine Uses

Today's Cloud are used mostly for two type of scenarios. One is the "Cloud Natives" where new ventures would start their computing infrastructure in the Cloud. The other is one-off projects like the New York Times digitizing its archive using Cloud Computing. These provide real use cases with tangible benefits and help to deepen the supporting eco-system for Cloud.

Industrial Strength Applications

As more established enterprises with large customer bases start to consider Cloud Computing, abilities in these areas are likely to propel the industry forward.

Deep Monitoring Tools: As the recent Amazon outage experience shows, the ability to identify the source and scale of a problem is something that few people have had to deal with until now. While Netflix is cobbling together various services for this purpose, they have noted that no single vendor provides the level of granularity and integrated view that meet the needs at their scale today.

Cloud Bursting: enterprises have expressed a good deal of interests in Private Cloud to keep part of the data and processing in-house due to regulatory and other considerations. At the same time, the ability to tap into an external Cloud on an as-needed basis, aka Cloud Bursting, offers a rather compelling degree of flexibility and cost advantage that will likely become the norm. Eucalyptus Systems has been a forerunner on both private cloud and cloud bursting.

Verticalized Industry Value-Add: Network service providers, e.g. telco such as BT and Verizon, are exploring industry-specific services that would offer differentiated Cloud solutions from the current offerings from the likes of Amazon, Google, Rackspace, and Microsoft. Some of the potential markets that have been named include financial markets, global commerce, consumer package goods, government, and health care.

Cloud Standards and Watering Holes

Talking about Standards

It is a delicate issue. On one hand, Cloud is still evolving rapidly so participants do not want to commit to a standard in order to avoid a potential VHS vs Beta-like confrontation. On the other, without standards, it is difficult to get the enterprise-class users with the enterprise-class budget to actively engage with Cloud.

For now, a growing number of talking shops have been established each with different focuses.

• ATIS Cloud Services Forum: www.atis.org/cloud/index.asp
• Cloud Security Alliance: cloudsecurityalliance.org
• Cloud Standards Customer Council: cloudstandardscustomercouncil.org
• Distributed Management Task Force (DMTF) Cloud Management Standards: dmtf.org
• IEEE Cloud Computing Standards Study Group: www.computer.org/portal/web/sab/cloud
• Open Datacenter Alliance: www.opendatacenteralliance.org

Meeting Cloudsters

Similarly, a number of industry conferences and regional groups are creating Cloud related activities to both engage with the early adopters and to evangelize Cloud use cases.

• Carrier Cloud Forum (Interop): www.interop.com/lasvegas/conference/carrier-cloud-forum.php
• Cloud Computing World (CeBIT): www.cebit.de/en/about-the-trade-show/programme/highlights/cloud-computing-world
• Cloud Camp: www.cloudcamp.org
• Cloud Connect: www.cloudconnectevent.com
• CTIA Wireless: www.ctiawireless.com/exhibit/index.cfm/cloud-computing-pavilion
• Mobile Cloud Computing Forum: www.mobilecloudcomputingforum.com
• Silicon Valley Cloud Computing Group: www.meetup.com/cloudcomputing

In short, a new eco-system is literally taking shape before our eyes.

Cloud Computing for the Rest of Us

Use Cases

Given Cloud's nascent nature, there is a need to identify use case to help people to both understand Cloud Computing and see what are the appropriate Cloud applications to build. The Cloud Computing Use Case Discussion Group was formed to capture specific use cases as a way to describe and benchmark the emerging Cloud usage in the wild. Their most recent v4 white paper (link below) is worth a look.

At the very fundamental level, some combination of the four potentially actors - End user, Enterprise, Public Cloud, and Private Cloud - constitute a Cloud usage. There are two scenarios that I believe will become increasingly prevalent over time. One is the idea of "cloud bursting" whereby demand spike is met by accessing the public cloud. An use case was an insurance company expecting to process a large volume of claim after a natural disaster. Instead of putting the extra load onto the existing infrastructure and causing a system wide impact on other businesses and regions, it used the public cloud to handle excess traffic instead of investing in additional internal IT infrastructure that would have sat idle after the event.

The second scenario is to use the cloud for machine-to-machine process with no end user in mind. In the use case, an agency needs to conduct computing intensive processes over a growing large dataset. Instead of building up a physical infrastructure for the job, it was able to achieve the same result at 50% of the cost and without the setup time require for their own datacenter.

A Business Tool

The hot issues surrounding Cloud Computing are not technical in nature. For example, security and SLA (Service Level Agreement) speak to the nature of the user's business processes and needs. Only the business operators have the appropriate context to determine if a vendor's security and SLA are sufficient.

Newly enacted legal and professional requirements related to the location of the data and users are likely to be felt by enterprises as they expand market coverage through the Cloud. Different countries and regions have regulations on where specific data can reside physically. Similarly, contractual agreements such as digital rights management will also determine where and how a consumer can access information delivered through cloud.

http://cloudusecases.org/

Digital Publishing as a Platform

A New Platform

After talking with Steve Kobrin about Wharton Digital Press (WDP), it really got me thinking about what this could mean as a platform. More specifically, what are the areas of "experimentation" that may be worth trying.

Some Experiment Ideas

Hardware design: Since Kindle last much longer than iPad, but iPad can do the razzle-dazzle graphics, what makes for a better consumption experience and what are the trade-off's. It would be interesting to see if there are logical segmentation in terms of who would find which device "better" under what circumstances. And, most importantly, why.

Hardware business-model: since majority of cost comes from physical distribution, a national news-media firm is thinking about giving subscribers fancy tablet to cut cost over the mid/long term. A major financial firm is thinking about giving their bankers tablets as a way to eliminate the $10k average spend per year per banker in printing. With PoD, printing and distribution may not be a pain point for WDP per se, but this could be an opportunity to explore alliance with organizations who may be interested in providing subsidized hardware.

Software: interactivity is clearly one of the major benefits of going digital. It would be interesting to explore what are the key aspects that are important to readers and authors. The result could be fed into a process to create a framework/suit that makes the process easier in the creation chain.

Immersive relationship: with the hardware and content having interactivity through sensors and data trail, this is the first time that a publisher/author can have an on-going relationship with the readership. How should this work? For example, with the machines understanding what readers prefer in actual consumption, this could provide a venue for recommendation not unlike what Netflix Challenge has done but for reading.

For readers: I take a lot of notes when reading. Until now, this has been a very cumbersome process especially for retrieving specific detail and consolidating across volumes. Some sort of vault would be nice. Better yet, a way to automate cross referencing as I search for past notes would be sweet.

I could go on. This is going to be an interesting space to watch in the years to come.

What Happens when a Cloud Turns Dark

April 21st, 2011: when Amazon's East Zone went Dark

Amazon EC2 (Elastic Compute Cloud) went dark for a few days in the US East Coast on Apr 21st. The impact was wide and widely noticed. So much so that Economist, a publication that I read avidly but not for its technology coverage, noted the breakdown in an article a few days later.

The fact that one data center went offline is not a surprise per se. (Without any hint of callousness and acknowledging the real impact on the businesses involved,) it just happens. What is more interesting is to consider the famed Warren Buffett quote and find out who has NOT been swimming naked in the rising Cloud.

Chaos Monkey and other Lessons

Netflix is one of the organizations that had fared well in the outage even though, given its large customer footprint, one would reasonably expect them to suffer all sorts of problems since they have moved their infrastructure to the Amazon Cloud. In their Tech Blog (below), Netflix team talked about how they dealt with it.

Instead of just moving their datacenter onto EC2 through VM, Netflix made architectural changes to take advantage of the inherit flexibility (and instability) of Cloud Computing. Nobody is perfect though and they did not account for the possibility of an entire zone/datacenter going out. In other words, switching over to other active zones was a time consuming and error-prone manual process.

The most interesting part for me is the Lessons Learned section. In addition to build up the ability to handle failover and recover at the Zone level, Netflix will scale up random disruptions, from Chaos Monkey to Chaos Gorilla, to introduce more failure as an on-going part of its system-wide robustness design.

An effective, albeit brutal, solution that could not be fathomed before Cloud Computing.

Lessons Netflix Learned from the AWS Outage