Managing the Performance of Clouds and Cloud Based Applications

Transcription

1 Managing the Performance of Clouds and Cloud Based s Alan Clark, Telchemy alan.d.clark@telchemy.com IEEE CQR 2012

2 Outline Model for Cloud based s Cloud Performance Typical Cloud SLA What Cloud Infrastructure and Cloud providers need to measure

3 Why run applications in the Cloud? Flexible/ Elastic Computing on Demand Transactions Cost savings Available Capacity Required Capacity Cost savings Time

4 Model of a Cloud Based Cloud Based User VM VM VM VM VM Distributed Computation Layer Requests Access BW Broker/ Manager IaaS (Infrastructure as a Service)

5 Cloud Model Cloud Based Measured Cloud Performance Measurable QoE for Users Impacted by load, available resources.. User Distributed Computation Layer Requests Access BW Broker/ Manager IaaS (Infrastructure as a Service)

6 Cloud Model Cloud Based Measured Cloud Performance Measurable QoE for Users Impacted by load, available resources.. User Distributed Computation Layer Implicit or Explicit Cloud Performance Model Requests Relates number of users, user driven activity to computing resources required Determines when to request Broker/ add/drop resources based on predicted load Manager Objective least usage of cloud resources required to provide acceptable Access performance BW to users IaaS (Infrastructure as a Service)

7 Flexing Transactions Performance model drives resource requests Actual Capacity Time

8 Flexing potential issues Prediction of resource requirements may be too aggressive or conservative Allocation Delay Billing period may be 5 minutes or 1 hour Transactions Degraded Performance $$ Unnecessary cost Time

9 Cloud Infrastructure typical SLA Typical SLA Availability Amazon EC2 SLA - > 99.5% availability over 365 days Verizon Terremark service credit for each 15 minute outage Typical performance metrics (not part of SLA) CPU capacity allocated Percentage usage of CPU capacity Access BW Broker/ Manager IaaS (Infrastructure as a Service)

10 What should a Cloud SLA guarantee? Cloud Based Distributed Computation Layer Elastic Computing service should have SLA that supports Elastic Computing - Do resources get allocated - Delay to provide resources - Are correct resources being provided Availability guarantees should be short term e.g. minutes of outage per hour Cloud SLA - Service Availability (Short/ Long Term) - Dynamic Availability - Allocation Response Time - Allocation Accuracy

11 What should the Provider measure? Measured by Cloud Cloud Based Distributed Computation Layer Performance seen by user - Availability - Response time - Transaction time - User QoE Performance Model - Model accuracy - Model tuning Performance of Cloud API - Availability - Requests - Failure rate - Response time - Usage

12 Summary Model for Cloud based s Cloud Performance Typical Cloud SLA What Cloud Infrastructure and Cloud providers need to measure Related information NIST Cloud Computing Definition DMTF Cloud Management WG ATIS Cloud Services Forum ITU-T Cloud Focus Group Amazon CloudWatch OpenStack

13 About Telchemy Leading provider of technology for real time analysis of VoIP, Videoconferencing, IPTV and Video Streaming services Pioneered distributed performance management model for real time services, using endpoint based agents. Over 100 million agents deployed in IP phones, media gateways, CPE routers, MTA s, set top boxes, soft clients Performance Management solutions for IP Centrex/ Hosted PBX, Residential triple play, Mobile, Enterprise, Government