Comparing Cloud Computing Resources for Model Calibration with PEST

Size: px
Start display at page:

Download "Comparing Cloud Computing Resources for Model Calibration with PEST"

Transcription

1 Comparing Cloud Computing Resources for Model Calibration with PEST CWEMF Annual Meeting March 10, 2015 Charles Brush Modeling Support Branch, Bay-Delta Office California Department of Water Resources, Sacramento, CA

2 Outline Problem Statement Computing Options Performance Issues & Metrics Systems Tested Test Results Cost Comparison Conclusions

3 IWFM Parameters 3

4 IWFM Parameters Saturated Zone Conductivity (K h, K v ) Storage (S y, S s ) Subsidence (S e, S i ) Unsaturated Zone Porosity Conductivity Water Management Diversion losses Irrigation efficiency Re-use factors Land Surface Field capacity Porosity Recharge factor Curve Numbers River nodes Conductance Small Watersheds Field capacity Porosity Conductivity Recession coefficients

5 PEST Optimization Iteration Calculate Jacobian matrix (run model at least once for each adjustable parameter) Calculate several sets of new parameter values Select the parameter set with the lowest objective function value

6 Saturated Zone Conductivity (K h, K v ) Storage (S y, S s ) Subsidence (S e, S i ) Unsaturated Zone Porosity Conductivity Water Management Diversion losses Irrigation efficiency Re-use factors Pilot Points

7 137 Pilot Points

8 394 Pilot Points

9 1392 Model Nodes

10 Over 30,000 Fine Grid Nodes

11 One PEST Iteration Pilot Points PEST Parameters Compter Run Time Total 137 3, PCs 3 min 1 week 394 8, PCs 3 min 3 weeks 1,393 28, PCs 3 min 16 weeks 1,393 28,892 Carver 1.5 min 2 weeks

12 One PEST Iteration Pilot Points PEST Parameters Compter Run Time Total 137 3, PCs 3 min 1 week 394 8, PCs 3 min 3 weeks 1,393 28, PCs 3 min 16 weeks 1,393 28,892 Carver 1.5 min 2 weeks 30, ,708 Carver 1.5 hr years

13 Calibration Options Calibration Strategy Pilot Points Regularization SVD Assist Super-Parameters? More Robust Computers In-House Linux Cluster Cloud Computing

14 Cloud Computing Options Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Software as a Service (SaaS) Desktop as Service (DaaS) Backend as a Service (BaaS) Information Technology Management as a Service (ITMaaS) 14

15 Cloud Computing Options HyperVisor Software Kernel Hardware 15

16 Cloud Computing Options Computational Resources (IaaS) HyperVisor Software Kernel Hardware 16

17 Cloud Computing Options Software Environment (PaaS) Computational Resources (IaaS) HyperVisor Software Kernel Hardware 17

18 Cloud Computing Options Cloud Applications (SaaS) Software Environment (PaaS) Computational Resources (IaaS) HyperVisor Software Kernel Hardware 18

19 Cloud Computing Options Cloud Applications (SaaS) Software Environment (PaaS) Computational Resources (IaaS) HyperVisor Software Kernel Hardware 19

20 Computing Options Multiple Office PCs Private Cluster USDOE NERSC Cluster Cloud Computer Systems Commodity Cloud System Proprietary Cloud System

21 Office PC System 21

22 In-House Cluster

23 USDOE Carver System

24 Cloud Systems

25 Amazon EC2

26 Windstream HS

27 Performance Issues Contention Two or more processes attempting to use one resource at the same time Latency Time interval between signal and response 27

28 Hardware Contention 28

29 Hardware Contention 29

30 Hardware Contention 30

31 Hardware Contention 31

32 Performance Issues Contention No CPU sharing: Guarantee only one App per core. 32

33 Data Center Servers To Network Network Interface Servers 33

34 Data Center Servers 34

35 Data Center Servers Grouped Into Network Subnets 35

36 Servers Subnet 36

37 Network Latency 37

38 Network Latency 38

39 Network Latency 39

40 Performance Issues Contention No CPU sharing, guarantee only one App per core. Latency All allocated servers must be on the same physical subnet. 40

41 Performance Metrics Wall Time CPU Time Speedup Scaling Efficiency t c = t * n s = t 1 / t n η = c 1 / c n Ignoring setup time and queuing latency 41

42 Systems Tested BeoPEST on Office PCs MPEST on USDOE super computers PPEST on Amazon EC2 PPEST on Windstream HS

43 Systems Tested System Processor Cores RAM (GB) OS Storage Network Office PC BDOHY-034 Intel Xeon CPU 2.9 GHz 8 16 Windows 7 64-bit Hard disk DWR BDOHY-024/025 BDOHY-027 Intel Xeon CPU 2.33 GHz Intel Xeon CPU 3.0 GHz 4 4 Windows 7 64-bit Hard disk DWR 4 4 Windows 7 64-bit Hard disk DWR Windstream VM Windstream VM unknown 8/VM 32 Windows 2012 Server 40GB HD Cisco Nexus Amazon AWS VM c3.8xlarge unknown 32/VM 60 Windows 2012 Server 2x320GB SSD 10 Gigabit NERSC Carver Intel Xeon 2.67 GHz 8/node 24/node Scientific Linux (Red Hat) FS 4X QDR InfiniBand, 32 GB/s

44 Test Problem C2VSim-CG calibration exercise 100 hydraulic conductivity parameters Two parameter estimation iterations Run PEST with master plus 1 to 64 clients Record Wall Time and CPU Time 44

45 Wall Time NERSC Carver Windstream Office PCs Amazon EC Wall time (hr) Number of CPUs

46 CPU Time NERSC Carver Windstream Office PCs Amazon EC Computation time (hr) Number of CPUs

47 Speedup NERSC Carver Windstream Office PCs Amazon EC Speedup Number of CPUs

48 Scaling Efficiency NERSC Carver Windstream Office PCs Amazon EC2 100% 90% 80% 70% Scaling Efficiency 60% 50% 40% 30% 20% 10% 0% Number of CPUs

49 Costs - AWS Item Description Unit Quantity Total ELASTIC COMPUTE CLOUD US East (Northern Virginia) Region EBS $0.095 per GB-Month of snapshot data stored - US East $ $0.05 US West (Northern California) Region ECC Windows $0.752 per On Demand Windows c3.2xlarge Instance Hour $ $4, EBS $0.08 per GB-month of Magnetic provisioned storage - US West $ $8.00 $0.105 per GB-Month of snapshot data stored - US West $ $10.50 $0.12 per GB-month of General Purpose SSD storage - US West $ $12.00 DATA TRANSFER US West (Northern California) Region AWS Data Transfer USW1-CloudFront-Out-Bytes $0.02 per GB data transfer out of US West to CloudFront $ $0.00 AWS Data Transfer USW1-EU-AWS-Out-Bytes $0.02 per GB - US West data transfer to EU (Ireland) $ $0.00 AWS Data Transfer USW1-USE1-AWS-Out-Bytes $0.02 per GB - US West data transfer to US East $ $0.02 AWS Data Transfer USW1-USW2-AWS-Out-Bytes $0.02 per GB - US West (CA) data transfer to US West (OR) $ $0.20 Bandwidth $0.000 per GB - data transfer in per month $ $0.00 $0.000 per GB - first 1 GB of data transferred out per month $ $0.00 $0.010 per GB - regional data transfer - in/out/between EC2 AZs $ $0.01 TOTAL $4, Appx. Cost per CPU-Hour: $

50 Costs Windstream HS Item Description Unit Quantity Total SETUP WCS Enterprise Virtual Data Center Setup Fee $ $ WCS Anti-virus/Anti-malware Setup fee $ $ WCA SAN Storage Setup fee $ $0.00 RECURRING WCS Enterprise Virtual Data Center Virtual firewall, private VLAN, secure VPN capability, $ $ secure SSL, 600GB data transfer WCS Enterprise Virtual Data Center Data transfer >600GM/mo, per GB $ $0.00 WCS Compute vcpu w/2.5gb RAM, base 32 vcpus $ $2, WCS Compute vcpu w/2.5gb RAM, additional resources per vcpu-hour $ $0.00 WCS Anti-virus/Anti-malware Base $ $ WCS Anti-virus/Anti-malware Additional VMs >32 $ $0.00 WCS SAN Storage Primary storage for VMs, including daily backups w/30- $ $ day retention SETUP $ RECURRING $2, Monthly Base Cost per CPU-Hour: $

51 Costs - AWS 32 vcpus/1 mo 64 CPUs/1 mo 96 vcpus/1mo BASE 0 vcpus base 0 vcpus base 0 vcpus base ADDITIONAL 32 vcpus 64 vcpus 96 vcpus 30 days 30 days 30 days US East Storage 0.5 $ $ $0.05 US West Instance-hrs 5,760 $4, ,520 $8, ,280 $12, Storage 100 $ $ $ $ $ $ $ $ $12.00 US West Data 0.1 $ $ $ $ $ $ $ $ $ $ $ $0.20 Bandwidth 2 $ $ $ $ $ $ $ $ $0.01 Cost/Mo $4, $8, $13, Cost per CPU-Hour: $0.19 $0.19 $

52 Costs - Windstream HS 32 vcpus/1 mo 64 CPUs/1 mo 96 vcpus/1mo BASE 32 vcpus base 32 vcpus base 32 vcpus base Additional 0 vcpus 32 vcpus 64 vcpus 0 days/mo 30 days/mo 30 days/mo CPU-Hours 23,040 CPU-hours 46,080 CPU-hours 69,120 CPU-hours VDC/data 1 $ $ $ Compute 32 $2, $2, $2, Compute 0 $ $2, $4, Anti-virus 16 $ $ $ Anti-virus 0 $ $ $ Storage 500 $ $ $ Cost/Mo $2, $5, $7, Cost per CPU-Hour: $0.12 $0.11 $

53 Scale-Up Costs $160,000 AWS EC2 Windsream CS $140,000 $120,000 Estimated Cost $100,000 $80,000 $60,000 $40,000 $20,000 $ PEST Parameter Estimation Iterations 53

54 Conclusion Cloud Computing Advantages - Nearly Infinite Scalability - No Capital Cost, Immediate Availability - Fast, Flexible Cloud Computing Challenges - Reduce Contention and Latency - Payment Mechanisms - Initial Set-Up

Vintage IT Services MSRP Pricing PaaS Catalog Pricing Service Categories MSRP Pricing

Vintage IT Services MSRP Pricing PaaS Catalog Pricing Service Categories MSRP Pricing Vintage IT Services MSRP Pricing PaaS Catalog Pricing Service Categories MSRP Pricing Windows Server 2008 R2 Enterprise 64 bit $110.00 / Month / VM Windows Server 2008 R2 Standard 64 bit $25.00 / Month

More information

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index (per Amendment 6)

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index (per Amendment 6) Infrastructure as a DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index (per Amendment 6) All customer data is located entirely in the contiguous United States. When required the data will be located

More information

Cloud Computing and Amazon Web Services

Cloud Computing and Amazon Web Services Cloud Computing and Amazon Web Services Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. An Overview of Cloud Computing 2. Amazon Web Services 3. Amazon EC2 Tutorial 4. Conclusions 2 CLOUD

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Using ArcGIS for Server in the Amazon Cloud Randall Williams, Esri Subrat Bora, Esri Esri UC 2014 Technical Workshop Agenda What is ArcGIS for Server on Amazon Web Services Sounds good! How much does it

More information

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index Infrastructure as a Service DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index All customer data is located entirely in the contiguous United States. When required the data will be located in a

More information

Building a Private Cloud with Eucalyptus

Building a Private Cloud with Eucalyptus Building a Private Cloud with Eucalyptus 5th IEEE International Conference on e-science Oxford December 9th 2009 Christian Baun, Marcel Kunze KIT The cooperation of Forschungszentrum Karlsruhe GmbH und

More information

PERFORMANCE CLOUD SERVERS...

PERFORMANCE CLOUD SERVERS... ATTACHMENT 10 RACKSPACE PRICING G-CLOUD V Date: 10 th April 2014 UK SALES: +44 (0)20 8712 6507 UK SUPPORT: +44 20 8734 2700 WWW.RACKSPAE.CO.UK RACKSPACE HOSTING 5 MILLINGTON ROAD HAYES, UB3 4AZ, UNITED

More information

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer PRIVATE CLOUD November 6, 2013 Kay Metsker & Dan Mercer Agenda Deployment Milestones Service Strategy Service Benefits Feature Comparison Future Features Feature Set Matrix Consumption Models Financial

More information

FOR SERVERS 2.2: FEATURE matrix

FOR SERVERS 2.2: FEATURE matrix RED hat ENTERPRISE VIRTUALIZATION FOR SERVERS 2.2: FEATURE matrix Red hat enterprise virtualization for servers Server virtualization offers tremendous benefits for enterprise IT organizations server consolidation,

More information

Scientific Computing Data Management Visions

Scientific Computing Data Management Visions Scientific Computing Data Management Visions ELI-Tango Workshop Szeged, 24-25 February 2015 Péter Szász Group Leader Scientific Computing Group ELI-ALPS Scientific Computing Group Responsibilities Data

More information

How To Create A Cloud Based System For Aaas (Networking)

How To Create A Cloud Based System For Aaas (Networking) 1 3.1 IaaS Definition IaaS: Infrastructure as a Service Through the internet, provide IT server, storage, computing power and other infrastructure capacity to the end users and the service fee based on

More information

Economic Cloud Computing What to keep in mind when using the Cloud...

Economic Cloud Computing What to keep in mind when using the Cloud... Economic Cloud Computing What to keep in mind when using the Cloud... Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. Introduction 2. Uncontrollable Cloud Costs 3. Human Factors Affecting

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Federal GIS Conference February 9 10, 2015 Washington, DC Using ArcGIS for Server in the Amazon Cloud Bonnie Stayer, Esri Amy Ramsdell, Blue Raster Session Outline AWS Overview ArcGIS in AWS Cloud Builder

More information

Data Centers and Cloud Computing

Data Centers and Cloud Computing Data Centers and Cloud Computing CS377 Guest Lecture Tian Guo 1 Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing Case Study: Amazon EC2 2 Data Centers

More information

The Cloud as a Computing Platform: Options for the Enterprise

The Cloud as a Computing Platform: Options for the Enterprise The Cloud as a Computing Platform: Options for the Enterprise Anthony Lewandowski, Ph.D. Solutions Architect Implicate Order Consulting Group LLC 571-606-4734 alewandowski@implicateorderllc.com The origins

More information

Deep Dive: Maximizing EC2 & EBS Performance

Deep Dive: Maximizing EC2 & EBS Performance Deep Dive: Maximizing EC2 & EBS Performance Tom Maddox, Solutions Architect 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved What we ll cover Amazon EBS overview Volumes Snapshots

More information

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman

A Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman A Very Brief Introduction To Cloud Computing Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman What is The Cloud Cloud computing refers to logical computational resources accessible via a computer

More information

Migrating from Amazon AWS to OpenStack

Migrating from Amazon AWS to OpenStack Migrating from Amazon AWS to OpenStack Steve Curry FOUNDER AND PRESIDENT, METACLOUD, INC. Why? The Pros: Easy start Fully managed Credit card, mouse click, Go! The Cons: Expensive at scale Zero availability

More information

Data Centers and Cloud Computing. Data Centers

Data Centers and Cloud Computing. Data Centers Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises

More information

Restricted Document. Pulsant Technical Specification

Restricted Document. Pulsant Technical Specification Pulsant Technical Specification Title Pulsant Government Virtual Server IL2 Department Cloud Services Contributors RR Classification Restricted Version 1.0 Overview Pulsant offer two products based on

More information

Comparison of Windows IaaS Environments

Comparison of Windows IaaS Environments Comparison of Windows IaaS Environments Comparison of Amazon Web Services, Expedient, Microsoft, and Rackspace Public Clouds January 5, 215 TABLE OF CONTENTS Executive Summary 2 vcpu Performance Summary

More information

Efficiency Analysis of AWS Offering Vs. Private/Hybrid Implementations or Traditional Colo

Efficiency Analysis of AWS Offering Vs. Private/Hybrid Implementations or Traditional Colo Efficiency Analysis of AWS Offering Vs. Private/Hybrid Implementations or Traditional Colo It is just so easy to jump on AWS cloud. Create an account, input your credit card info, and you can start building

More information

Vocera Voice 4.3 and 4.4 Server Sizing Matrix

Vocera Voice 4.3 and 4.4 Server Sizing Matrix Vocera Voice 4.3 and 4.4 Server Sizing Matrix Vocera Server Recommended Configuration Guidelines Maximum Simultaneous Users 450 5,000 Sites Single Site or Multiple Sites Requires Multiple Sites Entities

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Yvonne@CS Course evaluation forgotten Please assign one volunteer

More information

Consolidated Technology Services PRIVATE CLOUD SERVICE. March 2014

Consolidated Technology Services PRIVATE CLOUD SERVICE. March 2014 Consolidated Technology Services PRIVATE CLOUD SERVICE March 2014 Topics Service Strategy Features and Benefits Service Options Rates Deployment Strategy Next Steps 2 Private Cloud Service Strategy Transform

More information

Building a cost-effective and high-performing public cloud. Sander Cruiming, founder Cloud Provider

Building a cost-effective and high-performing public cloud. Sander Cruiming, founder Cloud Provider Building a cost-effective and high-performing public cloud Sander Cruiming, founder Cloud Provider 1 Agenda Introduction of Cloud Provider Overview of our previous cloud architecture Challenges of that

More information

Amazon Web Services Primer. William Strickland COP 6938 Fall 2012 University of Central Florida

Amazon Web Services Primer. William Strickland COP 6938 Fall 2012 University of Central Florida Amazon Web Services Primer William Strickland COP 6938 Fall 2012 University of Central Florida AWS Overview Amazon Web Services (AWS) is a collection of varying remote computing provided by Amazon.com.

More information

System Requirements Version 8.0 July 25, 2013

System Requirements Version 8.0 July 25, 2013 System Requirements Version 8.0 July 25, 2013 For the most recent version of this document, visit our documentation website. Table of Contents 1 System requirements 3 2 Scalable infrastructure example

More information

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain

More information

Appendix C to DIR Contract Number DIR-TSO-2736 SunGard Availability Services Discount Level: 25% Managed Data Center Services - Cloud Hosting

Appendix C to DIR Contract Number DIR-TSO-2736 SunGard Availability Services Discount Level: 25% Managed Data Center Services - Cloud Hosting Resource Pool for ECS/Managed Cloud. Order in 2GB increments. Storage added separately Level: 25% Min RAM Max RAM Cloud Resource Pool (1 GB RAM /.5 vcpu) 1 2 32 26% 2 33 64 26% 3 65 128 26% 4 129 N/A 26%

More information

Own your own Enterprise Cloud with. FlexCloud

Own your own Enterprise Cloud with. FlexCloud Own your own Enterprise Cloud with FlexCloud What Problem do we solve? Traditional Virtualization Stack Data protection software applications PDU Backup Servers + Virtualization Storage Switch HA shared

More information

Cloud Computing through Virtualization and HPC technologies

Cloud Computing through Virtualization and HPC technologies Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC

More information

TELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE PRICING GUIDE SINGAPORE

TELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE PRICING GUIDE SINGAPORE TELSTRA CLOUD SERVICES CLOUD INFRASTRUCTURE PRICING GUIDE SINGAPORE WELCOME TO TELSTRA CLOUD SERVICES Our cloud infrastructure solutions are made up of a combination of scalable cloud resources, including

More information

Amazon Elastic Compute Cloud Getting Started Guide. My experience

Amazon Elastic Compute Cloud Getting Started Guide. My experience Amazon Elastic Compute Cloud Getting Started Guide My experience Prepare Cell Phone Credit Card Register & Activate Pricing(Singapore) Region Amazon EC2 running Linux(SUSE Linux Windows Windows with SQL

More information

Parallels Plesk Automation

Parallels Plesk Automation Parallels Plesk Automation Contents Compact Configuration: Linux Shared Hosting 3 Compact Configuration: Mixed Linux and Windows Shared Hosting 4 Medium Size Configuration: Mixed Linux and Windows Shared

More information

ACANO SOLUTION VIRTUALIZED DEPLOYMENTS. White Paper. Simon Evans, Acano Chief Scientist

ACANO SOLUTION VIRTUALIZED DEPLOYMENTS. White Paper. Simon Evans, Acano Chief Scientist ACANO SOLUTION VIRTUALIZED DEPLOYMENTS White Paper Simon Evans, Acano Chief Scientist Updated April 2015 CONTENTS Introduction... 3 Host Requirements... 5 Sizing a VM... 6 Call Bridge VM... 7 Acano Edge

More information

Definition of the Metrics, Elements and Actions of the SLAC Language

Definition of the Metrics, Elements and Actions of the SLAC Language August 3, 2014 Definition of the Metrics, Elements and Actions of the SLAC Language Rafael Brundo Uriarte rafael.uriarte@imtlucca.it IMT Lucca Francesco Tiezzi francesco.tiezzi@imtlucca.it IMT Lucca Rocco

More information

Stratusphere Solutions

Stratusphere Solutions Stratusphere Solutions Deployment Best Practices Guide Introduction This guide has been authored by experts at Liquidware Labs in order to provide a baseline as well as recommendations for a best practices

More information

Pierre Riteau University of Chicago

Pierre Riteau University of Chicago Infrastructure Clouds for Science and Educa3on: Infrastructure Cloud Offerings Pierre Riteau University of Chicago 12/11/2012 NIMBUS 1 IaaS Clouds Multitude of IaaS providers available Most are following

More information

Cloud Computing. Alex Crawford Ben Johnstone

Cloud Computing. Alex Crawford Ben Johnstone Cloud Computing Alex Crawford Ben Johnstone Overview What is cloud computing? Amazon EC2 Performance Conclusions What is the Cloud? A large cluster of machines o Economies of scale [1] Customers use a

More information

ArcGIS for Server: In the Cloud

ArcGIS for Server: In the Cloud DevSummit DC February 11, 2015 Washington, DC ArcGIS for Server: In the Cloud Bonnie Stayer, Esri Session Outline Cloud Overview - Benefits - Types of clouds ArcGIS in AWS - Cloud Builder - Maintenance

More information

How To Compare Amazon Ec2 To A Supercomputer For Scientific Applications

How To Compare Amazon Ec2 To A Supercomputer For Scientific Applications Amazon Cloud Performance Compared David Adams Amazon EC2 performance comparison How does EC2 compare to traditional supercomputer for scientific applications? "Performance Analysis of High Performance

More information

wu.cloud: Insights Gained from Operating a Private Cloud System

wu.cloud: Insights Gained from Operating a Private Cloud System wu.cloud: Insights Gained from Operating a Private Cloud System Stefan Theußl, Institute for Statistics and Mathematics WU Wirtschaftsuniversität Wien March 23, 2011 1 / 14 Introduction In statistics we

More information

OTM in the Cloud. Ryan Haney

OTM in the Cloud. Ryan Haney OTM in the Cloud Ryan Haney The Cloud The Cloud is a set of services and technologies that delivers real-time and ondemand computing resources Software as a Service (SaaS) delivers preconfigured applications,

More information

Private Distributed Cloud Deployment in a Limited Networking Environment

Private Distributed Cloud Deployment in a Limited Networking Environment Private Distributed Cloud Deployment in a Limited Networking Environment Jeffrey Galloway, Susan Vrbsky, and Karl Smith The University of Alabama jmgalloway@crimson.ua.edu, vrbsky@cs.ua.edu, smith102@crimson.ua.edu

More information

Amazon Web Services. 18.11.2015 Yu Xiao

Amazon Web Services. 18.11.2015 Yu Xiao Amazon Web Services 18.11.2015 Yu Xiao Agenda Introduction to Amazon Web Services(AWS) 7 Steps to Select the Right Architecture for Your Web Applications Private, Public or Hybrid Cloud? AWS Case Study

More information

RED HAT ENTERPRISE VIRTUALIZATION FOR SERVERS: COMPETITIVE FEATURES

RED HAT ENTERPRISE VIRTUALIZATION FOR SERVERS: COMPETITIVE FEATURES RED HAT ENTERPRISE VIRTUALIZATION FOR SERVERS: COMPETITIVE FEATURES RED HAT ENTERPRISE VIRTUALIZATION FOR SERVERS Server virtualization offers tremendous benefits for enterprise IT organizations server

More information

System Requirements. Version 8.2 November 23, 2015. For the most recent version of this document, visit our documentation website.

System Requirements. Version 8.2 November 23, 2015. For the most recent version of this document, visit our documentation website. System Requirements Version 8.2 November 23, 2015 For the most recent version of this document, visit our documentation website. Table of Contents 1 System requirements 3 2 Scalable infrastructure example

More information

THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES

THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES Introduction Amazon Web Services (AWS), which was officially launched in 2006, offers you varying cloud services that are not only cost effective, but also

More information

A Gentle Introduction to Cloud Computing

A Gentle Introduction to Cloud Computing A Gentle Introduction to Cloud Computing Source: Wikipedia Platform Computing, Inc. Platform Clusters, Grids, Clouds, Whatever Computing The leader in managing large scale shared environments o 18 years

More information

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Scaling in the Cloud with AWS By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Welcome! Why is this guy talking to us? Please ask questions! 2 What is Scaling anyway? Enabling

More information

How To Get Atos Paas For Free

How To Get Atos Paas For Free G-Cloud Pricing Atos PaaS Accredited Secure+ Contents 1. Introduction... 3 2. Pricing... 4 2.1 Standard Feature Pricing... 4 2.2 Atos PaaS Accredited Secure+ Virtual Machines... 4 2.3 Atos PaaS Accredited

More information

State of the Art Cloud Infrastructure

State of the Art Cloud Infrastructure State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014 Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks

More information

Cloud Computing and E-Commerce

Cloud Computing and E-Commerce Cloud Computing and E-Commerce Cloud Computing turns Computing Power into a Virtual Good for E-Commerrce is Implementation Partner of 4FriendsOnly.com Internet Technologies AG VirtualGoods, Koblenz, September

More information

StACC: St Andrews Cloud Computing Co laboratory. A Performance Comparison of Clouds. Amazon EC2 and Ubuntu Enterprise Cloud

StACC: St Andrews Cloud Computing Co laboratory. A Performance Comparison of Clouds. Amazon EC2 and Ubuntu Enterprise Cloud StACC: St Andrews Cloud Computing Co laboratory A Performance Comparison of Clouds Amazon EC2 and Ubuntu Enterprise Cloud Jonathan S Ward StACC (pronounced like 'stack') is a research collaboration launched

More information

Performance measurement of a private Cloud in the OpenCirrus Testbed

Performance measurement of a private Cloud in the OpenCirrus Testbed Performance measurement of a private Cloud in the OpenCirrus Testbed 4th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '09) Euro-Par 2009 Delft August 25th 2009 Christian Baun KIT

More information

Outline. Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models

Outline. Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 1 2 Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 3 Introduction What is Virtualization Station? Allows users to create and operate

More information

Cisco Prime Home 5.0 Minimum System Requirements (Standalone and High Availability)

Cisco Prime Home 5.0 Minimum System Requirements (Standalone and High Availability) White Paper Cisco Prime Home 5.0 Minimum System Requirements (Standalone and High Availability) White Paper July, 2012 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public

More information

OVERVIEW. The complete IaaS platform for service providers

OVERVIEW. The complete IaaS platform for service providers OVERVIEW The complete IaaS platform for service providers The complete IaaS platform for service providers With OnApp you can sell more services, automate more of your infrastructure and extend your reach

More information

Virtualization and Cloud Computing

Virtualization and Cloud Computing Written by Zakir Hossain, CS Graduate (OSU) CEO, Data Group Fed Certifications: PFA (Programming Foreign Assistance), COR (Contracting Officer), AOR (Assistance Officer) Oracle Certifications: OCP (Oracle

More information

Cloud Computing in Action - for Better Service and Better Life

Cloud Computing in Action - for Better Service and Better Life Cloud Computing in Action - for Better Service and Better Life Dr. P. T. Ho Deputy Director, Computer Centre The University of Hong Kong IET ICT Conference 2012, 14 September 2012, Hong Kong 1 2 Agenda

More information

Overview. The OnApp Cloud Platform. Dashboard APPLIANCES. Used Total Used Total. Virtual Servers. Blueprint Servers. Load Balancers.

Overview. The OnApp Cloud Platform. Dashboard APPLIANCES. Used Total Used Total. Virtual Servers. Blueprint Servers. Load Balancers. Overview The OnApp Cloud Platform Dashboard APPLIANCES Virtual Servers Blueprint Servers Load Balancers Bare Metal Smart Servers Hypervisors Assets Integrated Storage COMPONENTS DNS Templates Blueprints

More information

DataCenter optimization for Cloud Computing

DataCenter optimization for Cloud Computing DataCenter optimization for Cloud Computing Benjamín Barán National University of Asuncion (UNA) bbaran@pol.una.py Paraguay Content Cloud Computing Commercial Offerings Basic Problem Formulation Open Research

More information

Cornell University Center for Advanced Computing

Cornell University Center for Advanced Computing Cornell University Center for Advanced Computing David A. Lifka - lifka@cac.cornell.edu Director - Cornell University Center for Advanced Computing (CAC) Director Research Computing - Weill Cornell Medical

More information

Managed Hosting is a managed service provided by MN.IT. It is structured to help customers meet:

Managed Hosting is a managed service provided by MN.IT. It is structured to help customers meet: Managed Hosting Service Description Version 1.10 Effective Date: 3/3/2015 Purpose This Service Description is applicable to Managed Hosting services (MH) offered by MN.IT Services (MN.IT) and described

More information

What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1

What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1 What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1 SouthGrid in numbers CPU [cores] RAM [TB] Disk [TB] Manpower [FTE] Power [kw] 5100 10.2 3000 7 1.5 x

More information

IaaS Performance and Value Analysis A study of performance among 14 top public cloud infrastructure providers

IaaS Performance and Value Analysis A study of performance among 14 top public cloud infrastructure providers IaaS Performance and Value Analysis A study of performance among top public cloud infrastructure providers By Cloud Spectator and the Cloud Advisory Council October 5, 3 Table of Contents Executive Summary

More information

Unlimited Virtual Computing Capacity using the Cloud for Automated Parameter Estimation

Unlimited Virtual Computing Capacity using the Cloud for Automated Parameter Estimation Unlimited Virtual Computing Capacity using the Cloud for Automated Parameter Estimation Joseph Luchette 1, Gregory K. Nelson 2, Charles F. McLane III 3, Liliana I. Cecan 4 1 McLane Environmental, LLC.,

More information

Virtualization with Windows

Virtualization with Windows Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group Agenda Current status of IT-IS group virtualization service Server Self Service New virtualization features in

More information

Network Performance Between Geo-Isolated Data Centers. Testing Trans-Atlantic and Intra-European Network Performance between Cloud Service Providers

Network Performance Between Geo-Isolated Data Centers. Testing Trans-Atlantic and Intra-European Network Performance between Cloud Service Providers Network Performance Between Geo-Isolated Data Centers Testing Trans-Atlantic and Intra-European Network Performance between Cloud Service Providers Published on 4/1/2015 Network Performance Between Geo-Isolated

More information

Enabling Technologies for Distributed and Cloud Computing

Enabling Technologies for Distributed and Cloud Computing Enabling Technologies for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Multi-core CPUs and Multithreading

More information

WWW.PROFITBRICKS.COM. The Secret World of Cloud IaaS Pricing: How to Compare Apples and Oranges Among Cloud Providers

WWW.PROFITBRICKS.COM. The Secret World of Cloud IaaS Pricing: How to Compare Apples and Oranges Among Cloud Providers The Secret World of Cloud IaaS Pricing: How to Compare Apples and Oranges Among Cloud Providers TABLE OF CONTENTS Executive Summary:...3 Part 1: The Current State of Cloud Computing IaaS Pricing and Packaging...3

More information

How AWS Pricing Works

How AWS Pricing Works How AWS Pricing Works (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction... 3 Fundamental

More information

Data Centers and Cloud Computing. Data Centers. MGHPCC Data Center. Inside a Data Center

Data Centers and Cloud Computing. Data Centers. MGHPCC Data Center. Inside a Data Center Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises

More information

CISCO CLOUD SERVICES PRICING GUIDE AUSTRALIA

CISCO CLOUD SERVICES PRICING GUIDE AUSTRALIA CISCO CLOUD SERVICES PRICING GUIDE AUSTRALIA WELCOME TO CISCO CLOUD SERVICES Cisco Cloud Services is a public cloud infrastructure offering from Telstra which includes a range of compute, storage and network

More information

EEDC. Scalability Study of web apps in AWS. Execution Environments for Distributed Computing

EEDC. Scalability Study of web apps in AWS. Execution Environments for Distributed Computing EEDC Execution Environments for Distributed Computing 34330 Master in Computer Architecture, Networks and Systems - CANS Scalability Study of web apps in AWS Sergio Mendoza sergio.mendoza@est.fib.upc.edu

More information

Viswanath Nandigam Sriram Krishnan Chaitan Baru

Viswanath Nandigam Sriram Krishnan Chaitan Baru Viswanath Nandigam Sriram Krishnan Chaitan Baru Traditional Database Implementations for large-scale spatial data Data Partitioning Spatial Extensions Pros and Cons Cloud Computing Introduction Relevance

More information

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012) 1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.

More information

Solutions as a Service N.Konstantinidis Technical Director - MNG

Solutions as a Service N.Konstantinidis Technical Director - MNG Med Nautilus Greece Connected World April 10, 2014 Solutions as a Service N.Konstantinidis Technical Director - MNG MedNautilus Greece Solutions as a Service 2014 SINCE 2002 Data Center Physical Colocation

More information

2015 Techstravaganza The Microsoft Cloud

2015 Techstravaganza The Microsoft Cloud 2015 Techstravaganza The Microsoft Cloud http://virtuallycloud9.com @tommy_patterson http://aka.ms/tplinkedin Tommy.Patterson@Microsoft.com http://aka.ms/mshostingbw Leaders in Gartner Magic Quadrants

More information

Cloud Computing For Bioinformatics

Cloud Computing For Bioinformatics Cloud Computing For Bioinformatics Cloud Computing: what is it? Cloud Computing is a distributed infrastructure where resources, software, and data are provided in an on-demand fashion. Cloud Computing

More information

Microsoft Azure. Rich Lilly Project Leadership Associates

Microsoft Azure. Rich Lilly Project Leadership Associates Microsoft Azure Rich Lilly Project Leadership Associates http://www.linkedin.com/in/rich04 rlilly@projectleadership.net b-richl@microsoft.com 8.5 trillion stored objects 900K request/sec on average (2.3+

More information

A Cloud Computing Approach for Big DInSAR Data Processing

A Cloud Computing Approach for Big DInSAR Data Processing A Cloud Computing Approach for Big DInSAR Data Processing through the P-SBAS Algorithm Zinno I. 1, Elefante S. 1, Mossucca L. 2, De Luca C. 1,3, Manunta M. 1, Terzo O. 2, Lanari R. 1, Casu F. 1 (1) IREA

More information

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop SURFsara HPC Cloud Workshop www.cloud.sara.nl Tutorial 2014-06-11 UvA HPC and Big Data Course June 2014 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current

More information

Proactively Secure Your Cloud Computing Platform

Proactively Secure Your Cloud Computing Platform Proactively Secure Your Cloud Computing Platform Dr. Krutartha Patel Security Engineer 2010 Check Point Software Technologies Ltd. [Restricted] ONLY for designated groups and individuals Agenda 1 Cloud

More information

Cbeyond Cloud Server Packages

Cbeyond Cloud Server Packages ? A. Cloud Servers Cbeyond Cloud Server Packages Now your small business can get the big benefits of a cloud server without the hidden fees and complex pricing structures. VIRTUAL SERVERS l Provides small

More information

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect on AWS Services Overview Bernie Nallamotu Principle Solutions Architect \ So what is it? When your data sets become so large that you have to start innovating around how to collect, store, organize, analyze

More information

Pricing Guide. Service Overview

Pricing Guide. Service Overview Service Overview tolomy s G Cloud services are designed to give you the best possible degree of control and transparency over your costs. To maximise cost efficiency on offer to our customers a wide range

More information

PES. Batch virtualization and Cloud computing. Part 1: Batch virtualization. Batch virtualization and Cloud computing

PES. Batch virtualization and Cloud computing. Part 1: Batch virtualization. Batch virtualization and Cloud computing Batch virtualization and Cloud computing Batch virtualization and Cloud computing Part 1: Batch virtualization Tony Cass, Sebastien Goasguen, Belmiro Moreira, Ewan Roche, Ulrich Schwickerath, Romain Wartel

More information

Lets SAAS-ify that Desktop Application

Lets SAAS-ify that Desktop Application Lets SAAS-ify that Desktop Application Chirag Jog Clogeny 1 About me o Chirag Jog o Computer Science Passout, PICT o Currently CTO at Clogeny Technologies. o Working on some cutting-edge Products in Cloud

More information

The Performance and Cost Variability of Amazon EC2

The Performance and Cost Variability of Amazon EC2 The Performance and Cost Variability of Amazon EC2 Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. Introduction 2. Cost Variations 3. Performance Variations Motivation Amazon EC2 and SPRINT

More information

Développement logiciel pour le Cloud (TLC)

Développement logiciel pour le Cloud (TLC) Développement logiciel pour le Cloud (TLC) 7. Infrastructure-as-a-Service Guillaume Pierre Université de Rennes 1 Fall 2012 http://www.globule.org/~gpierre/ Développement logiciel pour le Cloud (TLC) 1

More information

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The

More information

Cornell University Center for Advanced Computing

Cornell University Center for Advanced Computing Cornell University Center for Advanced Computing David A. Lifka - lifka@cac.cornell.edu Director - Cornell University Center for Advanced Computing (CAC) Director Research Computing - Weill Cornell Medical

More information

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index

DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index Infrastructure as a Service DIR Contract Number DIR-SDD-2263 Appendix C Pricing Index All customer data is located entirely in the contiguous United States. When required the data will be located in a

More information

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop SURFsara HPC Cloud Workshop doc.hpccloud.surfsara.nl UvA workshop 2016-01-25 UvA HPC Course Jan 2016 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current

More information

Zadara Storage Cloud A whitepaper. @ZadaraStorage

Zadara Storage Cloud A whitepaper. @ZadaraStorage Zadara Storage Cloud A whitepaper @ZadaraStorage Zadara delivers two solutions to its customers: On- premises storage arrays Storage as a service from 31 locations globally (and counting) Some Zadara customers

More information

Amazon EC2 Product Details Page 1 of 5

Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of

More information

Amazon EC2 XenApp Scalability Analysis

Amazon EC2 XenApp Scalability Analysis WHITE PAPER Citrix XenApp Amazon EC2 XenApp Scalability Analysis www.citrix.com Table of Contents Introduction...3 Results Summary...3 Detailed Results...4 Methods of Determining Results...4 Amazon EC2

More information

Virtualization and Cloud Computing

Virtualization and Cloud Computing Virtualization and Cloud Computing Security is a Process, not a Product Guillermo Macias CIP Security Auditor, Sr. Virtualization Purpose of Presentation: To inform entities about the importance of assessing

More information