A Study about Web Application Inter-Cloud Auto-Scaling. Yuko KAMIYA,Toshihiko SHIMOKAWA Kyushu Sangyo University

Transcription

1 A Study about Web Application Inter-Cloud Auto-Scaling Yuko KAMIYA,Toshihiko SHIMOKAWA Kyushu Sangyo University

2 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin: Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 2

3 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin: Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 3

4 Introduction Cloud Computing system, IaaS, is a basic infrastructure of current ICT systems. Large number of systems are constructed on Cloud Computing system. Two types of cloud computing system: Public Cloud, Private Cloud. 4

5 Cloud Computing System Public Cloud Cloud providers build and provide their cloud. ex. EC2 of Amazon Web Services, Softlayer by IBM, Google Cloud Platform, and so on. Private Cloud Users can build their own cloud. ex. OpenStack, CloudStack, and so on. Many of these software are open source software. 5

6 Auto-Scaling One of the important feature of Cloud Computing System. It automatically launches or terminates virtual machines inside a Cloud Computing System. It is easy to scale up computing power. 6

7 Problems about constructing system on Cloud Computing(1/2) Users have to select a base Cloud Computing System for their system. There are a lot of Cloud Computing System. Users select a base Cloud Computing System based on a type of the service they provide, machine spec, usage fee and so on. It is not easy to select a cloud computing system from many cloud computing systems. 7

8 Problems about constructing system on Cloud Computing(2/2) Network bandwidth for their system. Auto-scaling can increase virtual machine inside a Cloud Computing System. Even in this case, external bandwidth is not increased All of these virtual machines are inside same Cloud Computing Systems. 8

9 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin: Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 9

10 Our Proposal: Meta Cloud Computing Basic idea is simple Cloud Computing System is a Cloud of Computers It hides each Computers inside a Cloud Meta Cloud Computing System is a Cloud of Cloud Computing Systems It hides each Clouds inside a Meta Cloud 10

11 Meta Cloud Computing It makes possible to use multiple Cloud Computing Systems as a single virtual Cloud Computing System. Users does not need to select Cloud Computing System 11

12 Inter-Cloud Auto-Scaling One of key feature of Meta-Cloud Natural extension of Auto-Scaling Usual Auto-Scaling launch new VM inside a cloud We call it Single Cloud Auto-Scaling Inter-Cloud Auto-Scaling launch new VM on multiple different clouds Scalability is not limited a original Cloud 12

13 Inter-Cloud Auto-Scaling Network performance can be improved New VM can be launched on new Cloud Each Clouds have their own external networks New external network will be used External bandwidth will be expanded RTT can be shorten 13

14 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin: Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 14

15 Soarin: Prototype System of Meta Cloud Computing Control different Clouds by same way Select a Cloud automatically by user defined Selection policy Launch new VM on selected Cloud Terminate existing VM on selected Cloud Global Load Balancing between multiple Clouds 15

16 Controls different Cloud Computing Systems By using fog : The Ruby cloud services library Provides general abstraction to Clouds Supports EC2, Softlayer, OpenStack, and so on Written by Ruby 16

17 Cloud Selection Policy Soarin has to Select a Cloud to do something, ex. Inter-Cloud Auto-Scaling Soarin uses pre-defined users Policies We call the policy Cloud Selection Policy There are very variety of polices We implemented some basic policies as follows 17

18 Basic Cloud Selection Policies Neighborhood of users Minimum resource usage Neighborhood of origin cloud Round Robin 18

19 Neighborhood of users It selects a Cloud Computing System depends on number of clients of each networks. RTT between Servers and Clients are important on interactive applications This policy collects IP address of clients Current implementation uses Netflow to collect clients information to reduce workload 19

20 Minimum Resource Usage It selects a Cloud Computing System depends on a remaining resource Many of public Cloud Computing System provide very large computing resources Most of private cloud provide restricted computing resources 20

21 Neighborhood of origin cloud It selects a Cloud Computing System depends on a network distance between origin Cloud Computing System and each Cloud computing Systems Contents synchronization is one of important issue of distributed server This policy uses simple solution to reduce synchronization cost 21

22 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin: Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 22

23 General web system architecture 23

24 Auto-Scaling for general web system architecture Auto-Scaling feature may launch new web server and/or application server to serve users requests. Local load balancer spreads these requests. In some cases, for example, the service many clients access database servers frequently or disasters happens, new database server is launched. 24

25 Live Streaming System 25

26 Auto-Scaling for live streaming system Auto-Scaling feature may launch new streaming servers. In the case of live video streaming, contents synchronization is easy. 26

27 Video on demand system 27

28 Auto-Scaling for Video on demand system Auto-Scaling feature may launch new streaming servers. In the case of live video streaming, contents synchronization is big problem. 28

29 Inter-Cloud Auto-Scaling issue about general web system architecture(1/3) It can deploy new web servers in the Origin Cloud or in the different Cloud Computing System. If the different Cloud Computing System is chosen, the RTT between web servers and clients may become short compared with in the Origin Cloud. 29

30 Inter-Cloud Auto-Scaling issue about general web system architecture(2/3) The RTT between servers and database servers should become long compared with in the Origin Cloud. To reduce the RTT, Inter-Cloud Auto-Scaling can deploy new database on the new Cloud Computing System. 30

31 Inter-Cloud Auto-Scaling issue about general web system architecture(3/3) Wide area database synchronization RTT between clients and servers and database synchronization is tradeoff. It depends on the services on the servers. Session of web servers 31

32 Inter-Cloud Auto-Scaling issue about Video Streaming It can deploy new streaming servers in the Origin Cloud or in the different Cloud Computing System. It is easy to launch new streaming server on the other Cloud Computing System. Inter-Cloud Auto-Scaling is very useful for this service. 32

33 Inter-Cloud Auto-Scaling issue about Video on Demand In the case of the Video on Demand have to consider about contents synchronization. Contents of video on demand is generally large. It needs some contents synchronization mechanism. 33

34 Load Balancer Meta Cloud Computing is a natural extension of Cloud Computing Single Cloud Auto-Scaling launches VM inside a cloud Inter-Cloud Auto-Scaling launches VM across clouds We have to navigate users to suitable VM inside a cloud and also across clouds. 34

35 Load Balancing inside a Cloud LLB: Local Load Balancer is used for request navigation inside a Cloud LLB hides VMs behind LLB LLB routes request to suitable VM behind LLB 35

36 Load Balancing across Clouds VMs in Inter-Cloud Auto-Scaling are launched at multiple different Clouds GLB: Global Load Balancer is required VMs are launched and/or terminated dynamically decided by user defined policy GLB must follow the user defined policy 36

37 Session Management Session Management on Inter-Cloud Auto-Scaling is open issue. This is common problem on GLB Session management requires packet inspection Most of GLB is based on DNS It is hard to inspect packet 37

38 Overview of this presentation 1. Introduction 2. Meta-Cloud Computing 3. Soarin:Prototype System of Meta-Cloud Computing 4. Consideration of Inter-Cloud Auto- Scaling 5. Conclusion 38

39 Conclusion Meta-Cloud Computing Inter-Cloud Auto-Scaling Natural extension of Cloud Computing and Auto-Scaling 39