Positioning Performance Testing to Cut Costs of Cloud Computing

Transcription

1 Positioning Performance Testing to Cut Costs of Cloud Computing Thomas Barns 1 Agenda Benefits of cloud computing Performance, capacity and cost Testing and Modelling Case study 2

2 Cloud Computing Benefits Why use cloud computing? Reduced cost Increased flexibility? 3 Physical Capacity Management Compare to Requirements Measure Capacity Plan Provision Order 4

3 Physical Capacity Management Compare to Requirements Measure Capacity Plan Provision Order 5 Cloud Capacity Management Compare to Requirements Measure Capacity Plan Launch instances 6

4 Cloud Capacity Management Compare to Requirements Measure Capacity Plan Launch instances 7 Cloud Capacity Management This can even be automated Compare to Requirements Measure Launch instances And so 8

5 No more capacity planning!? When the Associated Press (AP) wanted the flexibility for application hosting and cloud data storage in the cloud, they turned to the Windows Azure platform from Microsoft. "Capacity planning is the thing that stands out as the biggest advantage of the Microsoft cloud model. The Windows Azure platform takes that out of the equation for us, unlike the other cloud providers." - Jonathan Malek, Chief Architect and Director of Research, Associated Press See how Windows Azure helped the AP develop a new global API through easy scalability that removed the need for costly and time-consuming capacity planning. Microsoft.com 9 Physical vs Cloud Physical Cloud

6 The key questions How many servers? Physical How much will it cost? Cloud 11 How many servers? The key questions Physical Understand the application Model future user demand Model utilisation Understand acceptable utilisation thresholds Plan how many servers to buy and when 12

7 How much will it cost? The key questions Cloud Understand the application Model future user demand Model utilisation Understand acceptable utilisation thresholds Plan how much to spend and when 13 Capacity Planning and Budgeting Capacity planning is as necessary as ever to calculate the budget to plan ahead 14

8 Testing and Modelling Testing Modelling Application Hardware/Cloud Infrastructure Usage Scenarios 15 Performance Testing Understand the application Testing and Modelling Understand how the application relates to infrastructure/cost Modelling Understand user behaviour Understand how user behaviour relates to infrastructure/cost 16

9 Performance, Capacity, Cost The performance of the system impacts Utilisation of available capacity And cost! Performance Capacity Cost 17 Performance to Cost Performance Improving performance by reducing resource costs reduces resource utilisation Capacity Reducing the utilisation of resources means that less resources are required Cost Reduced resource requirements should result in real cost savings 18

10 Case study: Background A client set up a mobile site to provide a better experience for customers during periods of peak demand This site was to be hosted as a cloud based service The usage of the site would start off low and scale up to unknown levels depending on the scale of high demand peaks 19 Performance Testing To ensure that User response times will be within performance SLAs System will provide value for money within budgets Find/Fix Code Defects Determine and Optimise Response s Determine and Optimise Costs 20

11 Step 1: Finding Code Defects Before response times and costs can be measured, defects introducing non-linearity must be found and fixed Memory leaks Data growth Logical bottlenecks Locking 21 Step 1: Finding Code Defects 22

12 Step 2: Determining Response Response times are the measure of performance seen by the user What will they see? Are times within SLAs and guidelines? 23 Step 2: Determining Response Average Before fix Average After fix 1 Average After fix 2 Average SLA 24

13 Step 3: Cutting Costs Costs are a key measure of performance seen by the business rather than the user What is the resource cost of key transactions? This needs to be modelled to understand the total forecast costs Improvements should be made to approach cost optimality 25 Step 3: Cutting Costs Performance tests could now achieve, on a single instance 2 user visits a second With CPU at 75% Isn t that good enough? 26

14 Step 3: Cutting Costs Cloud We can (probably) handle initial load with one instance Because it s on the cloud, we can scale it easily by adding in more instances if we need them 27 Step 3: Cutting Costs Cloud But will those instances be added in time? And how much will they cost? 28

15 Step 3: Cutting Costs After optimisation, tests could achieve 10 user visits a second With CPU at 15% So at 75% CPU we could now handle 50 user visits a second, rather than 2 29 Step 3: Cutting Costs Cloud 25 cloud servers? Or 1? 30

16 Summary Cloud computing has benefits, if used correctly Capacity management is as necessary as ever Performance testing is key to successful outcomes and cutting costs of cloud computing 31 Questions? Thomas Barns Consultant 32