Last time. Today. IaaS Providers. Amazon Web Services, overview

Transcription

1 Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Course evaluation forgotten Please assign one volunteer student to comment on the summarizing report Cloud computing introduction General concepts Cloud definitions Different types of clouds Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Software as a Service (SaaS) Today How to develop applications (services) for clouds? Focus on Infrastructure as a Service and Platform as a Service, including Amazon Web Services EC2 (IaaS) Cloud Foundry (PaaS) Difference between using IaaS and PaaS? What is different from developing self-hosted applications? Some hands-on experience with Amazon IaaS Providers Offers compute (VMs), storage, & networking Sometimes also various related services Payment models Per hour, discounts for longer times For what? CPU, RAM, Disk storage, network transfers, etc Cost estimation/comparison hard Pre-defined or tailored VM configurations? Small/Medium/Large vs. custom All in all, difficult to compare prices! Example providers Amazon AWS, first and by far largest Rackspace, Elastichosts, etc. CityCloud, IPeer (Swedish providers) Amazon Web Services, overview Compute services Elastic Compute Cloud (EC2) pay-per-use VM What we will use mostly Map-reduce, auto scaling, elastic load balancing Storage services Simple Storage Service (S3) For any data Elastic Block Store (EBS) For EC2 VMs Other Networking: DNS and VPN-style tools Databases: relational and nosql 1

2 Amazon, compute concepts Instances Running VMs with certain hardware ~15 different configurations small, medium, large, etc. Custom types with more memory, more CPU, etc. Cost per hour (on-demand) reserved (1 or 3 years) Spot prices (dynamically set price) Regions and availability zones Region: world location, e.g., US east, US west, EU, Asia, etc. Availability zone Distinct locations for fault tolerance Multiple per region Big crash in 2011 revealed zone overlaps Keep track of where you run your VMs, etc! Amazon, more compute concepts Amazon Machine Images (AMIs) Custom VM images with particular operating system, platform tools, etc. Some are more expensive due to software licenses More than 500 pre-made AMIs available Can define your own AMIs 1. Select a suitable base image (right OS, etc) 2. Install the software you need 3. Save image of running VM as new AMI Rather tricky part 4. Create multiple instances of your custom VM Note, not the way to keep data persistent Amazon, storage concepts VM local disk is not persistent Each VM instance is booted from the AMI, any update to local disk is lost when VM terminates/stops Elastic Block Store (EBS) Persistent storage for EC2 images Raw, unformatted device, can create file systems, etc. on top Can be mounted like device/file system by EC2 instances But only one instance at a time An instance can have multiple block stores Can be used to store snapshots Bound to particular availability zone Cost per GB/month + per 1M I/O ops. Amazon, more storage Simple Storage Service (S3) Two-level Bucket object container with unique name Key unique name in bucket (like file name) Object are indexed by bucket+key, Operations Create/Delete bucket Put/Get/Delete data from bucket Buckets are located in a specific region Cost per GB/month, per 1K ops, per GB/transferred 2

3 Amazon, getting started Login Credentials 1. Username/password Limited functionality available (only Web UI) 2. Access ID + secret access key Available for generation/download in Web UI Query API (REST) + elasticfox (firefox plugin), Programming libraries (in Java etc.) 3. Certificates Use with command line tools Login to VMs (using ssh) Needs to be generated by you Our course set-up a bit complicated Ensure not to interfere with each other More in hands-on tutorial Amazon, interfacing 1. Amazon Management Console The Web UI Useful for getting to know the services + debugging 2. Command line tools Windows or Linux, Linux version installed@cs 3. Programmatically Network interfaces: SOAP and REST Low-level, can be tedious to use Language bindings SDKs for Java, Ruby, etc. Eclipse plugins also available PaaS providers Tools for service development & deployment Typically includes databases, application servers, etc. One (or a few) programming languages Often tightly coupled to IaaS Exists for most platforms, such as: Java Google App Engine, Jelastic, Cloud Bees, etc. Cloud Foundry PHP CloudControl, etc Python Heroku, Google App Engine, etc..net Microsoft Azure Cloud Foundry VMWare s PaaS initiative Much attention recently One of few PaaS solutions with clear separation from IaaS Supports various application frameworks: Spring Java Inversion of Control (IoC) container with support for databases, XML processing, and almost everything else Ruby Neat programming language (interpreted) Various Web toolkits for Java or Ruby Ruby on Rails, Sinatra, Grails, Node.js 3

4 Cloud Foundry, procedure 1. Implement your application in Java or Ruby 2. Connect it to Cloud Foundry services 3. Deploy it to Cloud Foundry VM Tooling (for the above steps): VMC Command line interface Eclipse Cloud Foundry extensions STS Spring framework extensions Cloud Foundry, services MongoDB nosql database Scales to nodes MySQL Standard relational database Scales to ~10 nodes (if clustered) RabbitMQ Implementation of AMQP Standard message queue for robust messaging (publish-subscribe) Redis Key-value store (like nosql database) Cloud Foundry, deployment and infrastructure Micro Cloud Foundry Your own VM, to be run locally Packed as VMWare image, requires VMWare Player (or similar) to run Seamless transition to real cloud Run VM In IaaS provider For example, Amazon EC2 Need to import Micro Cloud Foundry VM IaaS vs. PaaS Developing for IaaS Manage your application Manage the infrastructure Tedious, but greater flexibility Developing for PaaS Manage your application Simpler Limited tooling/application type restrictions 4

5 Next time. After break: Getting started with Amazon, in MA416 User credentials demystified Run some VMs Next lecture Virtualization What kind of virtualization techniques are there? What are the benefits and drawbacks of virtualization? What is the role of virtualization for IaaS? When? 5