Cloud Computing Paradigm Julio Guijarro Automated Infrastructure Lab HP Labs Bristol, UK 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice 16 / September / 2010
What Is Cloud Computing?
The Third Wave of Connected Computing reach The Cloud The Web everything as a service The Internet connectivity information & e-commerce 1970 1980 1990 2000 2005 2010 2020 time
Definitions Cloud Computing Cloud computing is Internet-based ("cloud") development and use of computer technology ("computing"). It is a style of computing in which IT-related capabilities are provided as a service, allowing users to access technologyenabled services from the Internet ("in the cloud") without knowledge of, expertise with, or control over the technology infrastructure that supports them. http://en.wikipedia.org/wiki/cloud_computing A pool of abstracted, highly scalable, and managed infrastructure capable of hosting end-customer applications and billed by consumption Cloud computing is a style of computing where massively scalable IT-enabled capabilities are delivered as a service to external customers using Internet technologies. Gartner, Cloud Computing: Defining and Describing an Emerging Phenomenon (G00156220) Cloud is an emerging style of Information Technology infrastructure designed for rapid delivery of computing resources. The cloud is IT as a Service, delivered by IT resources that are independent of location The 451 Group The terms cloud computing and utility computing are often used to mean the same thing. But experts say the cloud is an advance on utility computing. Yes, it will also provide pooled resources on demand. Yet the point of difference is that clouds will be purpose built, ultra-powerful new infrastructures where tailored solutions are designed, deployed and run extreme-performance virtual applications. Further, they will be sharing resources and able to dynamically go up and down in size, while offering fail-safe redundancy. HP, Sky s the limit for cloud computing Forrester IBM
Cloud Embodies a Confluence of Technologies and Concepts Grid computing, utility computing, virtualization, SOA Because Cloud Computing is a conceptual service model, where: Services are delivered remotely from a logical resource The details behind the scenes are hidden; may use the techs. above Are paid for based on how much service is consumed Are genuinely on-demand Cloud computing is a real trend driven by The ubiquity of internet connectivity Low-cost commodity hardware and open source software Figuring out a bunch of technical stuff
IT as a Service, Delivered by the Cloud Backup Media sharing Business Apps Management Apps Search Email Mobile Services Productivity Apps Location-Based Services Social Networking Platform on Demand Infrastructure on Demand Storage on Demand
And... At massive scale Millions of users With unprecedented flexibility Mash-ups, aggregation, enhancing services, flexing up and down,... Offering evolving APIs to exploit and extend At breakthrough cost levels Economies of scale New revenue models Eliminating old sources of cost (SaaS vs. CD)
15 Ways to Tell it s not a Cloud If you peel back the label and it s says Grid or OGSA underneath it s not a cloud If you need to send a 40 page requirements document to the vendor then it s not cloud If you can t buy it on your personal credit card it s not a cloud If they are trying to sell you hardware it s not a cloud. If there is no API it s not a cloud. If you need to re-architect your systems for it it s not a cloud. If it takes more than ten minutes to provision it s not a cloud If you can t de-provision in less than ten minutes it s not a cloud If you know where the machines are it s not a cloud If there is a consultant in the room it s not a cloud If you need to specify the number of machines you want upfront it s not a cloud If it only runs one operating system it s not a cloud If you can t connect to it from your own machine it s not a cloud If you need to install software to use it it s not a cloud If you own all the hardware it s not a cloud James Governor, Redmonk
Get ready for the Cloud
Following the Hype Cycle - 2008
Following the Hype Cycle - 2009
Following the Hype Cycle - 2010 Source: Gartner August 2010
A definition
Cloud Computing IT delivered as a logical service, available on demand, charged by usage Logical Service: details of delivery hidden On demand: scales up and down immediately and seamlessly Charged by usage: metering and billing of services, pay for what you use
Cloud Taxonomies
Cloud Types Consumers 4 1 Public Clouds Hybrid Cloud 3 Users Private Cloud 2 Enterprises Hybrid Cloud 17
Cloud Workloads Legacy workloads Can we move today s IT applications to the cloud? Cloud-ready workloads The cloud is ushering in new styles of application development Large data-sets, parallel computation, very high scalability Context-driven applications: many cloud services sharing context information from multiple sources
Cloud Service Layers Service Users Cloud End-User Services (SaaS) Cloud Platform Services (PaaS) Cloud Infrastructure Services (IaaS) Physical Infrastructure
Why Cloud Computing?
Why Cloud Computing? Consumer View Convenience Cost Collaboration Connect anywhere Constant improvement Configuration simplicity Protection of valuable data Choice of services Access from a range of devices
Why Cloud Computing? Business View Cost management Benefit from economies of scale Predictability of spend Avoids cost of over-provisioning Reduction in up-front capital investment But be careful: costs can fluctuate. Risk reduction Someone else worries about running the data-centre, protecting your data, and providing disaster recovery Reduces risk of under-provisioning Flexibility Add/remove services Scale up and down as needed rapidly Service Evolution Services evolve and improve behind the scenes, no time-consuming local upgrades Ubiquity Access from any place, any device, any time
Barriers to Business Adoption Security Trust in the service vendors Service levels Stability Geographic presence ISV support not widespread Few have taken the plunge in a big way Customizability of service offerings for specific needs of each enterprise Concerns about lock-in, lack of multi-vendor options Regulatory concerns Data locality Challenge of migrating from in-house (or outsourced) apps Vested interests
The cloud hype is around cost; The cloud reality is about new value Service providers Cost Service users? What s new? Value New access: everything is a service New capabilities: multi-tenant software New connections: information in context
Performance Cloud Computing: A Disruptive Technology? Disruptive Technology Time
Where is the catch?
Cloud Computing changes how applications are delivered how applications are designed how teams work
Cloud Eliminates Buying hardware based on predicted load 2+ week lead time on new hardware, storage High Availability Homogeneity Static machine names, addresses and capabilities Stable machines A fast private network Someone in the datacentre who cares about you
Assumptions that are now invalid (1/3) Systems have a long lifespan It is slow/expensive to create a new system It is expensive to duplicate one Systems can/should be managed by hand Clocks proceed at the same rate Physical RAM doesn t get swapped out Running machines can't be moved/cloned
Assumptions that are now invalid (2/3) System failure is an unusual event 100% availability can be achieved Data is always near the server You need physical access to the servers Databases are the best form of storage You need millions of $/ / to play
Assumptions that are now invalid (3/3) Terabyte datasets are hard to work with Code runs on a single machine Sequential code is better than parallel code RAID hardware is the best way to store data Databases are better than filesystems Low-value data isn't worth collecting even if you don't have a use for it now
Example Service: Map/Reduce Commodity data processing for commodity data
Example Service: Hadoop Apache Hadoop Map/Reduce framework Enabling new types of large-scale, parallelised, data-intensive applications Scale: Hadoop test cluster at Yahoo! == 4000 8-core nodes, 16PB data-set
Summary Cloud Computing is here to stay It will bring new business opportunities. Most of them are unknown today. Revisit your assumptions about what is and what is not possible. There is a learning curve: start now. But: be careful, some things got easier, others changed radically. Thanks!
35 14 September, 2010
Cloud Computing in HP Labs
HPL Cloud Infrastructure Research: Cells An infrastructure-level Cloud service Delivering secure, isolated virtual infrastructures Cells to multiple customers simultaneously Offering enterprisegrade properties Running on large-scale, flexible and modular physical infrastructures Cell Manager Cell Cell Cell Cell
Building on Cells: Cloud Platform Capabilities System modelling and design: component configuration, dimensioning, etc. Dynamic constraint solving for resource allocation, etc. Cell Cell Manager Automatic system deployment Autonomic responses to changing conditions System management: adaptation, upgrade, removal Deep telemetry: VMs, networks, storage, performance, billing, failures, etc. System orchestration and automation
Example Service: Hadoop Apache Hadoop Map/Reduce framework Enabling new types of large-scale, parallelised, data-intensive applications Scale: Hadoop test cluster at Yahoo! == 4000 8-core nodes, 16PB data-set
Dynamic Hadoop as a Service Configuration, automated deployment and management using HP Labs SmartFrog Create and manage a Hadoop service in a dynamic Cell Offer as a service to other applications