Cost-Benefit Analysis of Cloud Computing versus Desktop Grids Derrick Kondo, Bahman Javadi, Paul Malécot, Franck Cappello INRIA, France David P. Anderson UC Berkeley, USA
Cloud Background Vision Hide complexity of hardware and software management from a user by offering computing as a service Benefits Pay as you go Scale up or down dynamically No hardware management, less software management
Platform Performance vs. Costs high Cost low low Performance high
Platform Performance vs. Costs high Supercomputer Grid Cluster Cost low low Performance high
Platform Performance vs. Costs high Supercomputer Grid Cluster Cost low low Performance Desktop Grids (DG) high
Platform Performance vs. Costs high Supercomputer Grid Cluster Cost low low Cloud Performance What is the relationship? Desktop Grids (DG) high
Platform Performance vs. Costs high Supercomputer Grid Cluster Cost low low Cloud Performance What is the relationship? Desktop Grids (DG) DG + Cloud? high
Outline Performance tradeoffs Monetary tradeoffs Client hosting Server hosting
Apples to Apples Loosely-coupled, high-throughput, compute-intensive applications Tightly-coupled, data-intensive real-time applications low complexity high complexity
Apples to Apples Loosely-coupled, high-throughput, compute-intensive applications Tightly-coupled, data-intensive real-time applications low complexity high complexity DG s
Apples to Apples Loosely-coupled, high-throughput, compute-intensive applications Tightly-coupled, data-intensive real-time applications low complexity high complexity DG s Clouds
Apples to Apples Loosely-coupled, high-throughput, compute-intensive applications Tightly-coupled, data-intensive real-time applications low complexity high complexity DG s Clouds Comparison assuming embarrassingly parallel, compute-intensive applications
Method Use real performance measurements Exported BOINC (middleware for desktop grids) project data Use real costs Large/small BOINC projects (SETI@home / XtremLab) Amazon Elastic Computing Cloud (EC2)
Platform Construction Stages of Project &
Stages of Project & Platform Construction Deployment
Stages of Project & Platform Construction Deployment Execution
Stages of Project & Platform Construction Deployment Execution Completion
Platform Construction Deployment Execution Completion How long before I get X TeraFLOPS?
Platform Construction Deployment Execution Completion How long before I get X TeraFLOPS? 10 6 10 3 Number of cloud nodes 10 5 10 4 10 2 10 1 TeraFLOPS 10 3 0 5 10 15 20 25 30 Months for registration
Platform Construction Deployment Execution Completion How long before I get X TeraFLOPS? Number of cloud nodes 10 6 10 5 10 4 Can get over 20 TeraFLOPS within 6 months 10 3 10 2 10 1 TeraFLOPS 10 3 0 5 10 15 20 25 30 Months for registration
Platform Construction Deployment Execution Completion How long before I get X TeraFLOPS? Strategy: Add to BOINC project list Press releases Forum Announcements Google Ad Sense Respond to users (leverage volunteers) Number of cloud nodes 10 6 10 5 10 4 Can get over 20 TeraFLOPS within 6 months 10 3 0 5 10 15 20 25 30 Months for registration 10 3 10 2 10 1 TeraFLOPS
Platform Construction Deployment Execution Completion How long to deploy my batch of tasks needing faster response time?
Platform Construction Deployment Execution Completion How long to deploy my batch of tasks needing faster response time? 7,82/9*,34.4:*,.;*:3)4,6<!" '!" &!"!!" ".!"!!.!"".4=6>6!""".4=6>6!"""".4=6>6!" #!" $!" % ()*+,-./0.1/2)34,,-.3/5,6
Platform Construction Deployment Execution Completion How long to deploy my batch of tasks needing faster response time? 7,82/9*,34.4:*,.;*:3)4,6<!" '!" &!"!!" "!"!!.!"".4=6>6!""".4=6>6!"""".4=6>6 For 1000 tasks, ~10 minutes with 10 5 hosts!" #!" $!" % ()*+,-./0.1/2)34,,-.3/5,6.
Platform Construction Deployment Execution Completion How long to deploy my batch of tasks needing faster response time? Strategy: Specify lower latency bounds [Heien et al.] 7,82/9*,34.4:*,.;*:3)4,6<!" '!" &!"!!" "!"!!.!"".4=6>6!""".4=6>6!"""".4=6>6 For 1000 tasks, ~10 minutes with 10 5 hosts!" #!" $!" % ()*+,-./0.1/2)34,,-.3/5,6.
Platform Construction Deployment Execution Completion
Platform Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node?
Platform Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node?
Platform Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node? 2.8 active volunteer hosts per 1 cloud node. (Total performance still orders of magnitude better)
Platform Construction Deployment Execution Completion How many volunteer nodes are equivalent to 1 cloud node? 2.8 active volunteer hosts per 1 cloud node. (Total performance still orders of magnitude better) Strategy: Use statistical prediction of availability
Platform Construction Deployment Execution Completion
Platform Construction Deployment Execution Completion How long should I wait for task completion?
Platform Construction Deployment Execution Completion How long should I wait for task completion?
Platform Construction Deployment Execution Completion How long should I wait for task completion? Median project latency bound: 9 days for 3.7 hour work unit (on 3GHz host). Ratio of lat. bound / exec time > 5. Good success rates: 96.1% of WCG tasks met out of 227,000 tasks
Platform Construction Deployment Execution Completion How long should I wait for task completion? Strategy: See BOINC Catalog for typical deadlines and compute/comm/mem ratios. Median project latency bound: 9 days for 3.7 hour work unit (on 3GHz host). Ratio of lat. bound / exec time > 5. Good success rates: 96.1% of WCG tasks met out of 227,000 tasks
Monetary Tradeoffs Client hosting on cloud Not worth it and never will Server hosting on the cloud Possible solution
Monthly Project Costs
EC2 Pricing
What about Client Hosting on the Cloud?
Cost of Clouds versus DG How long until DG s more cost effective than Clouds?
Cost of Clouds versus DG How long until DG s more cost effective than Clouds? 7,8./9,)/:;<( #!!## #!!#$ #!!#% #!!#' F#'!'/G*HI8.,,)/8*3,5 2'J&/-H*I3/8*3,56 '"&$/G*HI8.,,)/8*3,5 2#&#$/-H*I3/8*3,56 =.),>;0? @ABCDE*>, A7$ / #!!#" #!!#& /! " #! #" $! $" %! ()*+,-./01,/230456
Cost of Clouds versus DG How long until DG s more cost effective than Clouds? 7,8./9,)/:;<( #!!## #!!#$ #!!#% #!!#' F#'!'/G*HI8.,,)/8*3,5 2'J&/-H*I3/8*3,56 '"&$/G*HI8.,,)/8*3,5 2#&#$/-H*I3/8*3,56 =.),>;0? @ABCDE*>, A7$ / #!!#" After ~13 days #!!#& /! " #! #" $! $" %! ()*+,-./01,/230456
Cost of Clouds versus DG (2) What are total costs over time?
Cost of Clouds versus DG (2) 8 x 104 What are total costs over time? Total cost 7 6 5 4 3 2 1 EC2 100n EC2 1000n EC2 10000n XtremLab SETI@home 0 0 5 10 15 20 Platform age (days)
Cost of Clouds versus DG (2) 8 x 104 What are total costs over time? Total cost 7 6 5 4 3 2 1 After 3 days, DG is cheaper EC2 100n EC2 1000n EC2 10000n XtremLab SETI@home 0 0 5 10 15 20 Platform age (days)
Cost of Clouds versus DG (3) How many months of DG can X months of Cloud buy me?
Cost of Clouds versus DG (3) How many months of DG can X months of Cloud buy me? Months with VC 3500 3000 2500 2000 1500 1000 Xtremlab / 1000n EC2 SETI@home / 1000n EC2 Xtremlab / 10000n EC2 SETI@home / 10000n EC2 500 0 0 5 10 15 20 25 Months with EC2
Cost of Clouds versus DG (3) How many months of DG can X months of Cloud buy me? Months with VC 3500 3000 2500 2000 1500 1000 Xtremlab / 1000n EC2 SETI@home / 1000n EC2 Xtremlab / 10000n EC2 SETI@home / 10000n EC2 12 months of Cloud can pay for > 125 DG years. DG way more sustainable. 500 0 0 5 10 15 20 25 Months with EC2
Equivalent Clouds given BOINC Costs Given BOINC costs, what size Cloud can I buy?
Equivalent Clouds given BOINC Costs Given BOINC costs, what size Cloud can I buy?
Equivalent Clouds given BOINC Costs 1.75 TeraFLOPS, 7 TeraBytes Given BOINC costs, what size Cloud can I buy?.75 TeraFLOPS, 3 TeraBytes
Equivalent Clouds given BOINC Costs Given BOINC costs, what size Cloud can I buy? 1.75 TeraFLOPS, 7 TeraBytes 2 orders of magnitude lower than BOINC.75 TeraFLOPS, 3 TeraBytes
What about Server Hosting on the Cloud?
Number of Hosts over Time
Number of Hosts over Time Load variation exits w/ publicity, projects run out of work, etc. Clouds take care of server management. Potential to exploit clouds.
Server Costs on a Cloud How much to host BOINC server on cloud?
Server Costs on a Cloud How much to host BOINC server on cloud?
Server Costs on a Cloud How much to host BOINC server on cloud? (versus 43K +12K/month) (versus {4,1}K + {5,1}K/month)
Server Costs on a Cloud How much to host BOINC server on cloud? 1.7-16.5 times cheaper to host on Cloud, but bandwidth is expensive. (versus 43K +12K/month) (versus {4,1}K + {5,1}K/month)
Cloud Resources with Given Budget How big of a server can I support with given budget?
Cloud Resources with Given Budget How big of a server can I support with given budget?
Cloud Resources with Given Budget How big of a server can I support with given budget? 4 Mbps, 2 TB 12 Mbps, 2 TB
Cloud Resources with Given Budget How big of a server can I support with given budget? Many project servers are sustainable on the cloud 4 Mbps, 2 TB 12 Mbps, 2 TB
Summary
Performance tradeoffs Summary 20 DG TeraFLOPS within 6 months
Summary Performance tradeoffs 20 DG TeraFLOPS within 6 months Monetary tradeoffs Client hosting After 13 days, DG more cost effective Server hosting DG server on cloud is cost-effective Best for small-medium sized projects Savings of at least 40% http://mescal.imag.fr/membres/derrick.kondo/cloud_calc.xlsx
Summary Performance tradeoffs 20 DG TeraFLOPS within 6 months Monetary tradeoffs Client hosting After 13 days, DG more cost effective Server hosting DG server on cloud is cost-effective Best for small-medium sized projects Savings of at least 40% http://mescal.imag.fr/membres/derrick.kondo/cloud_calc.xlsx BOINC server image for EC2 / Xen available http://boinc.berkeley.edu/trac/wiki/cloudserver
Future Work Clouds@home Statistical and predictive methods for ensuring host availability Lightweight mechanisms for virtual machine migration
wu flop calc bw in cloud how is cloud equiv calculated