Introduction to Cloud Computing

Transcription

1 Introduction to Cloud Computing Adam Skogman, Jayway Photo by Mark Bonassera

2 Start-up?

3 Overwhelmed?

4 Successful?

5 Waiting for IT?

6 Ease Didn t We Solve This? Flexibility

7 Ease Didn t We Solve This? Web Hotel Cloud VPS Virtualization Hardware Flexibility

8 What is Cloud? Cutting through the FUD

9 Utility Computing Per GB Per Hour Per Hour Per Request Per GB Per GB Per Month Per GB Per Month

10 On-Demand Capacity Proc Node Proc Node Proc Node Proc Node Proc Node Data Data Data Data Data

11 On-Demand Capacity Proc Node Proc Node Proc Node Proc Node Proc Node Data Data Data Data Data API GUI

12 Grid Computing Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Proc Node Data Data Data Data Data Data Data Data

13 Content Delivery Network Client Client Prod DB Client

14 Content Delivery Network CDN Client Client CDN Prod DB CDN Client

15 Distributed Cloud Client Client Client

16 Distributed Cloud Client Client Prod DB Prod DB DB Prod Client

17 There are Lots of Clouds IaaS PaaS SaaS

18 Amazon Infrastructure as a Service

19

20 Bandwidth $0.10 / GB to Amazon $0.17 / GB from Amazon Free inside Amazon

21 Virtual Machines Elastic Compute Cloud Small m1.small 32 bit 1x1 CPU 1.7 GB 1 x 160 GB Large m1.large 64 bit 2x2 CPU 7.5 GB 2 x 420 GB $0.34 <$0.18 Extra Large m1.xlarge 64 bit 4x2 CPU 15 GB 4 x 420 GB $0.68 <$0.35 Medium c1.medium 32 bit 2x2.5 CPU 1.7 GB 1 x 160 GB $0.17 <$0.09 Large m1.large 64 bit 8x2.5 CPU 7 GB 2 x 420 GB $0.68 <$0.35 Double Extra Large m2.2xlarge 64 bit 4x3.25 CPU 34.2 GB 2 x 420 GB $1.20 Quadruple Extra Large m2.4xlarge 64 bit 8x2.5 CPU 68.4 GB 4 x 420 GB $2.40 $0.085 <$0.05

22 Ephemeral Storage Virtual Machine / /mnt

23 Ephemeral Storage Virtual Machine / /mnt Disappears When You Shut Down

24 Block Storage Amazon Elastic Block Storage (EBS) RAIDed! Database files Virtual Machine / /mnt Private data Price Model $0.10 per GB provisioned / Month $0.10 Per 1 Million Request /ebs/db EBS

25 Snapshots and Cloning Virtual Machine Virtual Machine / /mnt / /mnt /ebs/db /ebs/db EBS S3 EBS

26 File Storage S3

27 File Storage Amazon Simple Storage Service (S3) S3

28 File Storage Amazon Simple Storage Service (S3) Unlimited Redundant Storage S3

29 File Storage Amazon Simple Storage Service (S3) Unlimited Redundant Storage REST API / HTTP S3

30 File Storage Amazon Simple Storage Service (S3) Unlimited Redundant Storage REST API / HTTP Price Model (not complete) $0.15 per GB and Month (first 50 TB) $0.17 per GB transferred out (first 10 TB) S3 $0.01 Per 1000 Write Requests

31 Scaling Out with Redundancy Amazon Elastic Load Balancing Zone A Zone B Rest Services Rest Services Master 2nd Master Rest Services Rest Services X X X X X

32 Virtual Private Cloud $0.05 / hour Internet $0.10 / GB to Amazon $0.17 / GB from Amazon Amazon VPC GW App App App App App App IPsec VPN Tunnel Active Drectory Enterprise

33 Cloud Front CDN Client Client CDN Prod DB CDN Client Serve static content close to user Major cities in US, EU, Asia Amsterdam, Dublin, Frankfurt, London Serves from S3 Bucket Single domain name for all caches: foo123.cloudfront.net 1 GB/s, 1000 requests/s

34 My First Clouds Classic Architecture

35 Spring LDAP Dev Open LDAP Apache DS Active Directory

36 Spring LDAP Dev Open LDAP Dev Apache DS Build Active Directory

37 Spring LDAP Dev Open LDAP Dev Apache DS Build Active Directory

38 Web Start-Up Company Load Prod Prod Prod DB

39 Web Start-Up Company Load Load Prod Prod Prod Stage Stage Stage DB DB

40 Web Start-Up Company Test Client Test Client Test Client Load Load Load Prod Prod Prod Stage Stage Stage Prod Prod Prod DB DB DB

41 Load-Test Business Case Physical/virtual Test Client Test Client Test Client 8 servers >8000 SEK / month Load Cloud 2 hours / night Prod Prod Prod 20 nights / month $2.50 per night DB 700 SEK / month

42 Load-Test Business Case Physical/virtual Test Client Test Client Test Client 8 servers >8000 SEK / month Load Cloud 2 hours / night >90% Prod Prod Prod 20 nights / month $2.50 per night less DB 700 SEK / month

43 Current Project VPS Mon ELB ELB ELB Event Stream SQS Content Ingestion Public REST Services Social Media Integration SQS DB Disk DB Disk DB Disk Content Files DB Mgmt EBS S3 OPS

44 Cloud Management With Great Power Comes Overwhelming Complexity

45 What Do We Want? Test Client Test Client Test Client Load Prod Prod Prod S3 DB

46 Starting Out App DB 32 bit Ubuntu 64 bit Ubuntu Amazon Amazon

47 Templates App Template DB Template 32 bit Ubuntu 64 bit Ubuntu Amazon Amazon

48 Automation Java Deployment "Script" Admin App Role DB Role 32 bit Ubuntu 64 bit Ubuntu Amazon Amazon

49 Experiences

50 Our Experiences with Amazon EC2

51 Our Experiences with Amazon EC2 Works Great

52 Our Experiences with Amazon EC2 Works Great Super Fast

53 Our Experiences with Amazon EC2 Works Great Super Fast They donʼt Power Off Machines

54 Our Experiences with Amazon EC2 Works Great Super Fast They donʼt Power Off Machines

55 Our Experiences with Amazon EC2 Works Great Super Fast They donʼt Power Off Machines Itʼs a Loooooong Way To North Carolina

56 Our Experiences with Amazon EC2 Works Great Super Fast They donʼt Power Off Machines Itʼs a Loooooong Way To North Carolina Your App Need To Scale

57 Services Ecosystem Right Scale Auto-scale based on SLA Multi-server deployment plans Scalr.net Auto-restart on failure Deployment templates

58 Services Ecosystem Right Scale Auto-scale based on SLA Multi-server deployment plans Scalr.net Auto-restart on failure Deployment templates

59 Cloud Hosting

60 HOW COULD YOU use one of these in your current project?

61 Application Clouds Platform As A Service

62 Application Cloud Everything is Services Persistence, Caching, Mail, Users Automatic Scaling...? Less Control Serious Buy-In

63 My New Cloud

64 My New Cloud Client static flash streaming File Service App Streaming Service DB

65 Something s Got To Give App App App App App App App App App App DB

66 Something s Got To Give App App App App App App App App App App DB DB DB DB DB DB DB DB DB DB

67 Something s Got To Give Client Client App App App App App App App App App App Prod DB DB Prod DB DB DB DB DB DB DB DB DB DB DB Prod Client

68 BigTable Shoping Cart Shoping Cart Item Product id user date id cart count product id name Price 100 foo fie fum MacBook $ MacMini $599 FirstName LastName Company Phone 1 Adam Skogman Jayway

69 BigTable Shoping Cart Shoping Cart Item Product id user date id cart count product id name Price 100 foo fie fum MacBook $ MacMini $599 FirstName LastName Company Phone 1 Adam Skogman Jayway

70 BigTable Shoping Cart Shoping Cart Item Product id user date id cart count product id name Price 100 foo fie fum MacBook $ MacMini $599 user cart count product 100 foo

71 BigTable Shoping Cart Shoping Cart Item Product id user date id cart count product id name Price 100 foo fie fum MacBook $ MacMini $599 value count:macbook value:macbook count:macmini value:macmini foo $ $999 1 $599 fie $ $999 fum $599 1 $599

72 BigTable Shoping Cart Shoping Cart Item Product id user date id cart count product id name Price 100 foo fie fum MacBook $ MacMini $599 value count:macbook value:macbook count:macmini value:macmini foo $ $999 1 $599 $ $999 1 $599 $ $999 1 $599 t= :00

73 New Game Rules ACID Before Atomic Consistent Isolated BASE Today Basically Available Soft State Eventually Consistent Durable

74 Daily Budget

75

76 Virtualization on Tap

77 Scaling Business Model Virtualization on Tap

78 Architecture Style Scaling Business Model Virtualization on Tap

79 Not a Magic Silver Bullet Architecture Style Scaling Business Model Virtualization on Tap

80 Test Env of Tomorrow Not a Magic Silver Bullet Architecture Style Scaling Business Model Virtualization on Tap

81 Next: From Zero to Cloud in under 4 hours

82 The End