Cloud Computing: The Next Revolution in Information Technology 1
Market-Oriented Cloud Computing: Opportunities and Challenges Dr. Rajkumar Buyya Cloud Computing and Distributed Systems (CLOUDS) Lab Dept. of Computer Science and Software Engineering The University of Melbourne, Australia www.cloudbus.org www.buyya.com www.manjrasoft.com Innovative Solutions for Cloud Computing Dr Rajkumar Buyya Chief Executive Officer Pty Ltd Room 5.31, ICT Building, 111, Barry Street, Carlton, Melbourne, VIC 3053, Australia P: +61-3-8344 1344 F : +61-3-9348 1184 E: raj@manjrasoft.com http://www.manjrasoft.com Major Sponsors/Supporters
The Next Revolution in IT The Big Switch in IT Every 18 months? Classical Computing Buy & Own Hardware, System Software, Applications often to meet peak needs. Install, Configure, Test, Verify Manage.. Finally, use it $$$$...$(High CapEx) Cloud Computing Subscribe Use $ - pay for what you use, based on QoS 3
Outline Computer Utilities Vision and Promising IT Paradigms/Platforms Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange Aneka: A Cloud Application Platform Summary and Thoughts for Future 4
5 Computer Utilities Vision: Implications of the Internet 1969 Leonard Kleinrock, ARPANET project As of now, computer networks are still in their infancy, but as they grow up and become sophisticated, we will probably see the spread of Computer Utilities, which, like present electric and telephone utilities, will service individual homes and offices across the country. During the last 40 years, several advances have taken place in both computing and communications areas that are turning the vision of Computer Utilities in to a reality.
Computing Paradigms and Attributes: Realizing the Computer Utilities Vision Web Data Centres Service Computing Grid Computing P2P Computing Market-Oriented Computing.. Cloud Computing Paradigms + -Ubiquitous -Reliable -Scalable -Autonomic -Dynamic discovery - Composable -QoS -SLA - -Trillion $ business 6 Attributes/Capabilities
Outline Computer Utilities Vision and Promising IT Paradigms/Platforms Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange Aneka: A Cloud Application Platform Summary and Thoughts for Future 7
Very popular: too many are In Search of Cloud Computing Legend: Grid computing Cloud computing 8
Open Data Center Alliance (ODCA) for Cloud Computing 9
Defining Clouds: There are many views for what is cloud computing? Over 20 definitions: http://cloudcomputing.sys-con.com/read/612375_p.htm Renting remote storage backup Renting remote server hosting Web server Renting remote more servers to manage large workload Buyya s Scientific definition of Cloud Computing 10 Cloud is a market-oriented distributed computing system consisting of a collection of inter-connected and virtualised computers that are dynamically provisioned and presented as one or more unified computing resources based on servicelevel agreements (SLAs) established through negotiation between the service provider and consumers. SLA = {negotiated and agreed QoS parameters + rewards + penalties for violation of agreement...}
Subscription-Oriented Cloud Services: X{compute, apps, data,..} as a Service (..aas) Public Clouds Applications Cloud Manager Development and Runtime Platform Storage Compute Clients Private Cloud Other Cloud Services Govt. Cloud Services 11
Cloud Services Infrastructure as a Service (IaaS) CPU, Storage: Amazon.com, Nirvanix, GoGrid. Platform as a Service (PaaS) Google App Engine, Microsoft Azure, Aneka.. Software as a Service (SaaS) SalesForce.Com Software as a Service (SaaS) Platform as a Service (PaaS) Infrastructure as a Service (IaaS)... 12
Cloud Deployment Models Public/Internet Clouds Private/Enterprise Clouds Hybrid/Inter Clouds 3rd party, multi-tenant Cloud infrastructure & services: * available on subscription basis Cloud model run within a company s own Data Center / infrastructure for internal and/or partners use. Mixed usage of private and public Clouds: Leasing public cloud services when private cloud capacity is insufficient 13
Cloud Applications Scientific/Tech Applications Business Applications Consumer/Social Applications Science and Technical Applications Business Applications 14 Consumer/Social Applications
Cloud Biz Potential: a trillion $ business/year by 2020? 2000 600? 30% 1000? 50% 120? 15% 15 2016 2020? 2020? Buyya s Guestimate!
Cloud Computing Challenges: Dealing with too many issues Scalability Reliability Billing Utility & Risk Management Programming Env. & Application Dev. Uhm, I am not quite clear Yet another complex IT paradigm? Software Eng. Complexity 16
Outline Computer Utilities Vision and Promising IT Paradigms/Platforms Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange Aneka: A Cloud Application Platform Summary and Thoughts for Future 17
Market-Oriented Cloud Architecture: QoS negotiation and SLA-based Resource Allocation Users/ Brokers SLA Resource Allocator Service Request Examiner and Admission Control - Customer-driven Service Management - Computational Risk Management - Autonomic Resource Management Pricing Accounting VM Monitor Dispatcher Service Request Monitor Virtual Machines (VMs) Physical Machines 18
Cloud to expand (lease more resources) with increase in demand Users/ Brokers SLA Resource Allocator Service Request Examiner and Admission Control - Customer-driven Service Management - Computational Risk Management - Autonomic Resource Management Pricing Accounting VM Monitor Dispatcher Service Request Monitor Virtual Machines (VMs) Physical Machines 19
Cloud to shrink (unlease resources) with decrease in demand Users/ Brokers SLA Resource Allocator Service Request Examiner and Admission Control - Customer-driven Service Management - Computational Risk Management - Autonomic Resource Management Pricing Accounting VM Monitor Dispatcher Service Request Monitor Virtual Machines (VMs) Physical Machines 20
Many Cloud Offerings: Good, but new issues- vendor lock in, scaling across clouds IBM Cloud Aneka Complex decisions to make? 21
InterCloud: Federation of Clouds for Scaling Application Services Compute Cloud Broker 1 Storage Cloud Request Capacity Negotiate/Bid Publish Offers Enterprise Resource Manager (Proxy).... Broker N Directory Auctioneer Bank Global Cloud Exchange Compute Cloud Enterprise IT Consumer Storage Cloud 22
Outline Computer Utilities Vision and Promising IT Paradigms/Platforms Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange Aneka: A Cloud Application Platform Summary and Thoughts for Future Software as a Service (SaaS) Platform as a Service (PaaS) Infrastructure as a Service (IaaS) 23
Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps (Available as Product) 24 Lightweight Container hosting multiple services. All programming models available from within the same container (unlike others) SDK containing APIs for multiple programming models and tools Runtime Environment for managing application execution management Suitable for Development of Enterprise Cloud Applications Cloud enabling legacy applications Portability for Customer Apps: Enterprise Public Clouds Multiple Applications Thread Task... MapReduce Multi-core Cluster Grid Cloud 2100 2100 2100 2100 2100 2100 2100 2100 Aneka.NET/Win Mono/Linux Multiple Infrastructures 1. SDK 2. Runtime
Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps (Available as Product) 25 Lightweight Container hosting multiple services. All programming models available from within the same container (unlike others) SDK containing APIs for multiple programming models and tools Patent Runtime Environment for (PCT) managing application execution management Suitable for Development of Enterprise Cloud Applications Cloud enabling legacy applications Portability for Customer Apps: Enterprise Public Clouds.NET/Win Mono/Linux Container Programming Models Application Software Development Kit APIs Programming Models Design Explorer Management Kit Management Administration Studio Portal SLA-Negotiation Management Web Services Web Services Task Model Thread Model Map Reduce Model Other Models Foundation Services Membership Reservation Storage License Accounting Services Services Services Services Services Fabric Services Dynamic Resource Provisioning Services Hardware Profile Services Infrastructure.NET @ Windows Mono @ Linux Physical Machines/Virtual Machines Amazon Private Cloud Microsoft Google IBM LAN network Data Center Persistence Security
Aneka as a Cloud Application Platform Applications & Services Application Development Bag of Tasks Dist. Threads MapReduce Cloud Middleware Platform SLA & QoS User Management Application Management Aneka Scheduling & Execution Monitoring Dynamic Provisioning Billing Infrastructure Datacenters 26 Clusters Desktop PCs Public Clouds
Aneka - Dynamic Management of Application Tasks and Cloud Resources Application Aneka Application Aneka Workker/Executor Aneka Manager Aneka Threads Manager / Executor 27
Customer/Deployment Case Studies
(GoFront: A unit of China Southern Railway Group) Application: Locomotive design CAD rendering Aneka Maya Renderer GoFront Private Aneka Cloud Use private Aneka Cloud LAN network (Running Maya Batch Mode on demand) Case 2: Aneka Enterprise Cloud Time (in hrs) Raw Locomotive Design Files (Using AutoDesk Maya) Case 1: Single Server Using Maya Graphical Mode Directly Single Server Aneka Cloud 29 4 cores server Aneka utilizes idle desktops (30) to decrease task time from days to hours
Indian Space Research Organization (ISRO) - ADRIN Distribution Aneka Cloud Receiving station processing 30 Private Cloud Citrix Xen Archiving Public Cloud Amazon AWS
Health Care: SaaS Cloud for ECG Sensor Data Analysis A User User Requests Millions of users Wireless ECG Sensor Embedded Bluetooth Enabled Data Processor & Communication Module User Requests 4 3 Wireless/ Mobile 3G Network PaaS 2 Dynamic Scalable Runtime User QoS based Scaling of Compute Resources IaaS Bluetooth connectivity 1 ECG Data Analysis Software SaaS ECG Sensor Module 5 6 31
IEEE Scalable Computing Challenge at CCGrid 2010 Conference 32
Global Recognition for Aneka: Frost, Telstra. -> 2010 Frost & Sullivan "New Product Innovation" Award -> 2011 Telstra Innovation Challenge, People s Choice Award 33
manjrasoft.com 34
Outline Computer Utilities Vision and Promising IT Paradigms/Platforms Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange Aneka: A Cloud Application Platform Summary and Thoughts for Future 35
Summary 36 Several Computing Paradigms have promised to deliver Computing Utilities vision: Cloud Computing is the most recent kid in the block promising to turn vision into reality Many exciting business and consumer applications Aneka is a rapidly emerging as a platform for: Building Clouds and their Apps rapidly reducing the cost/time of application Software Engineering. Already used in engineering, life science, gaming, and business intelligence applications. Market-oriented Clouds starting to become real. Amazon Cloud Marketplace, Virtual Appliance,
Dozens of Open Research Issues 37 (Application) Software Licensing Seamless integration of private and Cloud resources Security, Privacy and Trust Cloud Lock-In worries and Interoperability Application Scalability Across Multiple Clouds Clouds Federation and Cooperative Sharing Global Cloud Exchange and Market Maker Dynamic Pricing Dynamic Negotiation and SLA Management Energy Efficient Resource Allocation and User QoS Power-Cost and CO 2 emission issues Use renewable energy: follow Sun and wind? Regulatory and Legal Issues
Thanks for your attention! Are there any Questions? Comments/Suggestions We welcome you to: Study/Research with Us Do Business with us! http:/www.cloudbus.org www..com rbuyya@unimelb.edu.au raj@manjrasoft.com 38
Platform for Market-Oriented Cloud Computing 39
Cloudbus @CLOUDS Lab: Melbourne Cloud Computing Initiative Market-Oriented Clouds SLA-based Resource Management Global Cloud Exchange Aneka.NET-based Cloud Application Platform PaaS for Enterprise and Public Clouds InterCloud - Scaling Across Clouds (Meta Brokering) Federation of clouds for application scaling and reliability 3 rd Party Cloud Services (e.g., MetaCDN) Content Delivery Networks using different vendors Storage Clouds Workflow Engine for Cloud Computing Scheduling applications with multiple interlinked tasks and dependencies Green Clouds / Data Centers Energy Efficient and QoS Oriented Resource Allocation CloudSim: Toolkit for Simulation of Clouds Evaluation of resource management policies & algorithms IoT (Internet of Things) for Smart Cities 40
IoT (Internet of Things) Cloud for Smart Cities City of Melbourne 41