Predictive Cloud Behavior Meeting Client Demand with Performance Value. Presented by Kenny Li Co-founder, Cloud Spectator

Size: px

Start display at page:

Download "Predictive Cloud Behavior Meeting Client Demand with Performance Value. Presented by Kenny Li Co-founder, Cloud Spectator"

Silas Parker
8 years ago
Views:

1 Predictive Cloud Behavior Meeting Client Demand with Performance Value Presented by Kenny Li Co-founder, Cloud Spectator

2 Why Performance Matters Exhibit B Performance is a rising demand in the public cloud industry, and cannot be ignored.

3 Addicted to Performance Why Performance Matters 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 58 Yes DO YOU HESTITATE TO USE OR SLOW YOUR ADOPTION TO CLOUD COMPUTING BECAUSE OF YOUR CONCERNS ABOUT APPLICATION PERFORMANCE? COMPUWARE GOMEZ 2011 SURVEY

OR SLOW YOUR ADOPTION TO CLOUD COMPUTING BECAUSE OF YOUR

4 BYTE-ERFLY EFFECT TRADEMARKED 2013 KENNY LI

5 DELAY IN RESPONSE Addicted to Performance Why Performance Matters

6 Addicted to Performance Why Performance Matters REDUCTION IN REVENUE PER USER SOURCE: BING

7 Addicted to Performance Why Performance Matters SHOPZILLA DECREASED PAGE LOAD-TIME FROM 7 TO 2 SECONDS

8 Addicted to Performance Why Performance Matters AND SAW A 7% to 12% INCREASE IN CONVERSION RATE

9 Addicted to Performance Why Performance Matters

10 Addicted to Performance Why Performance Matters AVERAGE REVENUE LOST DUE TO PERFORMANCE PROBLEMS WITH CLOUD SOURCE: COMPUWARE

11 New Benchmarks in Cloud Exhibit C Benchmark methods in public cloud environments must be approached differently to be meaningful.

12 WHY THE OLD WAYS DON T WORK

13 SINGLE TENANT SERVERS

14 MULTI TENANT SERVERS

15 NOISY NEIGHBOR EFFECT OVER PROVISIONING FAULTY SCRIPTING INFINITE LOOPS CLOGGED SERVERS SLOW APPS

16 CONCERNS INSIDE THE SERVER

21 THE OLD WAY Random Read Ops/S Disk IO Performance Amazon EC2 Rackspace OpenCloud Tested on 2/19/2013

22 THE NEW STANDARD Disk IO Performance Random Read Ops/S AMAZON EC2 RACKSPACE OPENCLOUD 12-Feb 13-Feb 14-Feb 15-Feb 16-Feb 17-Feb 18-Feb 19-Feb 20-Feb 21-Feb 22-Feb 23-Feb

23 Cautions Exhibit D The rules of benchmarking: what can and cannot be assumed from the data.

24 Synthetic Tests Real-world Tests

25 Synthetic Tests Real-world Tests Provides a relative result Great for comparing specifics Easy to replicate precisely Results cannot be generalized TEST PROVIDER AVG SCORE Compressing RazorServers 9,720 MIPS Compiling CloudProviderUSA 1,886 Score

26 Synthetic Tests Real-world Tests Provides a relative result Great for comparing specifics Easy to replicate precisely Results cannot be generalized Runs the actual application Great for comparing generally Hard to replicate precisely Results cannot be generalized TEST PROVIDER AVG SCORE Compressing RazorServers 9,720 MIPS Compiling CloudProviderUSA 1,886 Score TEST PROVIDER AVG SCORE MySQL Hosting.com 15 Seconds PostGRESQL LunaCloud 1,886 Score

27 Benchmarks will measure what they are designed to measure. -AMD

28 Presenting the Value Exhibit E How to translate performance statistics into an understandable value proposition for clients.

29 PRICING PERFORMANCE [Provider s Test Result] / [Provider Cost] = Provider Ratio [Provider Ratio] / [Largest Provider Ratio] = Price/Performance Result [Price/Performance Result] x 100 = % Comparison to Best Provider

30 The Calculation [Provider s Test Result] / [Provider Cost] = Provider Ratio PROVIDER TEST RESULT COST PER HOUR Amazon 127 OPS/S $0.48 Rackspace 211 OPS/S $0.90 Rackspace = [Provider s Test Result] / [Provider Cost] = Amazon = [Provider s Test Result] / [Provider Cost] =

31 The Calculation [Provider s Test Result] / [Provider Cost] = Provider Ratio PROVIDER TEST RESULT COST PER HOUR Amazon 127 OPS/S $0.48 Rackspace 211 OPS/S $0.90 Rackspace = 211 / [Provider Cost] = Amazon = 127 / [Provider Cost] =

32 The Calculation [Provider s Test Result] / [Provider Cost] = Provider Ratio PROVIDER TEST RESULT COST PER HOUR Amazon 127 OPS/S $0.48 Rackspace 211 OPS/S $0.90 Rackspace = 211 /.90 = Amazon = 127 /.48 =

33 The Calculation [Provider s Test Result] / [Provider Cost] = Provider Ratio PROVIDER TEST RESULT COST PER HOUR Amazon 127 OPS/S $0.48 Rackspace 211 OPS/S $0.90 Rackspace = 211 /.90 = Amazon = 127 /.48 =

34 The Calculation [Provider Ratio] / [Largest Provider Ratio] = Price/Performance Result Rackspace = Amazon = (Largest Ratio) Rackspace = [Provider Ratio] / [Largest Provider Ratio] = Amazon = [Provider Ratio] / [Largest Provider Ratio] =

35 The Calculation [Provider Ratio] / [Largest Provider Ratio] = Price/Performance Result Rackspace = Amazon = (Largest Ratio) Rackspace = / = Amazon = / =

36 The Calculation [Provider Ratio] / [Largest Provider Ratio] = Price/Performance Result Rackspace = Amazon = (Largest Ratio) Rackspace = / = 0.89 Amazon = / = 1

37 [Price/Performance Result] x 100 = % Comparison to Best Provider Rackspace = 0.89 Amazon = 1

38 [Price/Performance Result] x 100 = % Comparison to Best Provider Rackspace = 0.89 Amazon = 1 Rackspace = 0.89 x 100 Amazon = 1 x 100

39 [Price/Performance Result] x 100 = % Comparison to Best Provider Rackspace = 0.89 Amazon = 1 Rackspace = 0.89 x 100 Amazon = 1 x 100 Rackspace = 89% Amazon = 100%

40 % PERFORMANCE DISK I/O For every [unit of currency] spent at Amazon, you receive 11% less disk I/O performance from Rackspace. 0 Rackspace Amazon

41 Conclusion Exhibit F Wrapping up the presentation.

42 Summary Performance Matters Proactively measure to understand performance Translate performance into value for clients

43 Questions?

Comparing major cloud-service providers: virtual processor performance. A Cloud Report by Danny Gee, and Kenny Li

Comparing major cloud-service providers: virtual processor performance A Cloud Report by Danny Gee, and Kenny Li Comparing major cloud-service providers: virtual processor performance 09/03/2014 Table