Overlay Cloud - Yet another approach to Inter-cloud -

Transcription

1 Overlay - Yet another approach to Inter-cloud - Shigetoshi Yokoyama

2 Back ground 1

3 What s NII? National Institute of Informatics ( Research Institute + Academic Service Provider Content ID federation Network 2

4 Services provided by NII Education ( ) Multi-clouds architecture with modified Eucalyptus Research ( ) Bare metal NII private cloud with modified OpenStack Academic Inter- ( ) AIC Bare metal community cloud with modified OpenStack 3

5 Research cloud - that can handle physical machine and can utilize existing assets - Existing clusters Mapping existing cluster VLAN_ID and cluster ID in the cloud Expand(gunniii) Research cloud Allocate Cluster sharing Object Store Service tinii Cluster -A Cluster-A in the cloud Return Cluster -B Cluster-B in the cloud Physical machine pool As if a cluster is added to project segment As if a cluster is deployed like a VM through GUI/CLI 4

6 Academic Community Regional (Oversea) Hokkaido Hokuriku cloud Tohoku cloud Kansai cloud Inter-cloud infrastructure Public Kyushu cloud Tokai cloud Shikoku cloud Kanto cloud Regional cloud is spreading Linking through Inter-cloud infrastructure 5

7 Academic Inter- (academic community cloud hub) Univ. cloud Mapping university's cluster VLAN_ID and cluster ID in the cloud Academic Inter- (compute) Academic Inter- (storage) Academic Inter- cluster -A cluster -A Cooperate cluster -B Academic Inter- cluster -B Cooperate Academic Inter- cluster -C physical machine pool Inter-cloud Object Store Service colony cluster -C cluster -D As if a cluster is added to university cluster Cooperate Academic Inter- cluster -D physical machine pool; As if multiple universities use one data center As if an object store is same as local 6

8 Federation Approaches Standard Approach Standards make cloud federations possible. Application Cluster-α Application Cluster-β Network with Glue software Application Cluster-γ -A -C Hardware-1 Hardware-2 -A Provider -C Provider On-demand Approach Application Cluster-α Application Cluster-β Application Cluster-γ Separate hardware providers from cloud providers. providers deploy clouds On-demand. -A -A Provider -B -B Provider -C -C Provider Separation Hardware-1 Hardware-2 Hardware-1 Provider SINET Hardware-2 Provider 7

9 On-demand cloud approach works but On-demand cloud approach works fine in our academic community cloud environment with a limitation. -A -B Bare-metal Data Center- α L2 connection Bare-metal On demand Bare-metal On demand Academic Inter- (AIC) L2 Connection Bare-metal Data Center- β SINET ( L2VPN on demand ) Public clouds do not always support bare metals. 8

10 Overlay 9

11 Container Revolutions in Two Industries 1950s - Transport Industries Contents Containers Container Management System International Container Management System IT Industries Applications Virtual Macines Inter-cloud 2000s -? 10

12 Separation of Concerns in Transport Industries Separation of Concerns 11

13 Separation of Concerns in Transport Industries Separation of Concerns New System Separation of Concerns

14 Container = Virtual Machine? Application Cluster Application Cluster Standards Application Cluster VM VM VM VM VM VM VM VM 13

15 Container = Container Applications Separation of Concerns Virtual cloud provider New System Cluster Cluster Cluster L2Tunnels L2Tunnels L2Tunnels BM BM VM VM VM VM VM VM Separation of Concerns Real Real Real Real IT Industries 14

16 Overlay Virtual Cluster Cluster Cluster Overlay L2Tunnels L2Tunnels BM BM VM VM network L2Tunnels compute BM BM VM VM Real Real Real Real Private/Community BM: Bare-metal Machine / VM: Virtual Machine Public 15

17 Overlay Prototyping SINET Virtual # JAIRO Backup Site Automatic High Availability Secure Location Awareness Cost Effective Portability Simple / Easy Virtual # Mesos Cluster Internet Virtual # other Console / Dashboard Administrator Resource Aggregator Virtual Container Manager AICN Academic Inter- Hokudai Lab Public d App Templ Image Container Hub 16

18 Extension to public clouds Extend to the public clouds by using container technologies like docker. -A -B Docker Virtual Public - 1 Docker Docker Docker Docker Bare-metal L2 Connection Data Center- α Bare-metal On demand L2 connection Bare-metal On demand Bare-metal L2 Connection Docker Virtual L2 Academic Inter-cloud Connection Infrastructure (AIC) Data Center- β Public - 2 SINET ( L2VPN on demand ) 17

19 Extensions to Edges Extend to small geographically distributed clouds by using container technologies like docker. Docker Virtual nano Docker Virtual -A Public - 1 Docker Docker Docker Docker Bare-metal L2 Connection Data Center- α -B Docker Bare-metal Bare-metal Bare-metal Virtual On demand On demand L2 L2 L2 connection Connection Connection Academic Inter-cloud Infrastructure (AIC) Data Center- β Public - 2 Docker Virtual nano SINET ( L2VPN on demand ) Distributed Architecture for real-time data processing 18

20 Data Center to Distributed Centralized Data Center Multi-tenancy by Distributed Overlay Distributed Traditional Data Center Distributed Data Center Single-tenancy 19

21 Distributed Distributed New System Nano Micro Mega Mega Micro Nano 20

22 Thank you 21