University of Messina, Italy

Transcription

1 University of Messina, Italy IEEE MoCS 2011 Kerkyra - Greece June 28, 2011 Dr. Massimo Villari mvillari@unime.it

2 Cross Cloud Federation Federated Cloud Scenario Cloud Middleware Model: the Stack The CLEVER middleware Vertical Federation and the Scientific Computing Cloud - SGE (OGE): steps. Horizontal Federation in CLEVER Conclusions and Future Works IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 1

3 1) Monolithic: (now!!!!), cloud services are based on proprietary architectures - islands of cloud services delivered by megaproviders (this is what Amazon, Google, Salesforce and Microsoft look like today). 2) Vertical Supply Chain: some cloud providers will leverage cloud services from other providers. The clouds will be proprietary islands yet, but the ecosystem building will start. T. B co htt 20 co 3) Horizontal Federation: smaller, medium, and large providers will federate horizontally themselves to gain: economies of scale, an efficient use of their assets, and an enlargement of their capabilities. IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 2

4 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 3

5 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 4

6 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 5

7 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 6

8 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 7

9 When One Cloud is Not Enough IEEE Computer March 2011 My Private Cloud My Partner Cloud A Public Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 8

10 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 9

11 The goal of OpenStack is to allow any organization to create and offer cloud computing capabilities using open source software running on standard hardware. OpenStack Compute is software for automatically creating and managing large groups of virtual private servers. The IEEE standardization board has just lunched a new initiative aimed at the definition of new standards for cloud interoperability \cite {bib:ieee}. Even many other organisms of standardization (ITU, OGF, ISO, etc.) are working in the same direction IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 10 IEEE works towards cloud interoperability standards:

12 Cloud Manager r Virtual Infrastructure Manager Virtual Machine Manager IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 11

13 A CLoud-Enabled Virtual EnviRonment: To simplify the access management of private/hybrid clouds To provide simple and easy accessible interfaces to interact with different interconnected clouds, deploy Virtual Machines and perform load balancing through migration. THALES 14 Sept 2010, Paris. CLEVER

14 The pluggable design: integrating security, contextualization, VM disk image management federation functionalities It is able to grant: high scalability, modularity flexibility in the middleware architecture, fault tolerance requirements are also satisfied. THALES 14 Sept 2010, Paris. CLEVER

15 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 14

16 JABBERD2 Best choice for Security impl. SEDNA -> CASSANDRA IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 15

17 Zero configuration: ZeroConf Wizard Installation: common steps Minimal requirements: S.O. and environment (Java) All in a JAR file. XMPP InBand Self Registration: User name address Certificates Pluggable approach: Module auto loading at bootstrap phase Runt-time module loading Inter process communication: JMS, D-BUS THALES 14 Sept 2010, Paris. CLEVER

18 Monitoring: Inter process communication: JMS D-BUS Data request policy: On Demand Time Based Event Based THALES 14 Sept 2010, Paris. CLEVER

19 Inter Process Communication IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 18

20 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 19

21 CLEVER supports vertical federation scenarios offering services to other clouds: External clouds, using the CLEVER s web service interface Able to arrange PaaS and SaaS deploying VMs in CLEVER s IaaS. Selected a task requiring a great deal of computing power, a large physical infrastructure has to be employed for its accomplishment: Scientific Computing Clouds IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 20

22 Master Host Execution Host Sun Grid Engine Administration Host Submit Hosts IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 21 Master Host to carr batch a subm can mo can us

23 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 22

24 1. The customer sends a Grid SaaS instantiation request to the Scientific Computing Cloud : To arrange the required SaaS 2. The Scientific Computing Cloud sends an IaaS instantiation request to CLEVER via the CLEVER s web services and according to a given SLAs. The CLEVER web services interface is connected to the XMPP external communication room along with the active CM and the HMs. The request arrived via web services, it is converted in a corresponding CLEVER XML message (formatted according to the external communication protocol) and then sent. The request included within the message will be caught from the active CM which will execute the desired operation. The IaaS consists of several VMs whose operating system contains a preinstalled software for setting up a computing environment based on SGE. IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 23

25 2. The disk-images (including both the guest OS and the SGE software) for the instantiation of the VMs are uploaded by the Scientific Computing Cloud to CLEVER. The Scientific Computing Cloud uploads two types of disk-image (one for the SGE Master and the other for the worker nodes) to the CLEVER Storage Manager running on the CM (using the CLEVER web service interface). The Storage Manager registers the images within the cluster catalogue and save them within the distributed storage system. 3. CLEVER arranges the IaaS including six VMs (one acting as SGE Master and five as worker nodes) interconnected by a virtual network. The Scientific Computing Cloud via web service interface sends the VMs submission requests to the CM which in turn queries the distributed database for identifying the best HMs for allocating the VMs. Once the whole IaaS is arranged, in step 4 the Scientific Computing Cloud IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 24

26 4. The Scientific Computing Cloud instantiates the graphical web interface of the Grid SaaS and links this latter with the IaaS (running the computing environment) provided by CLEVER. Grid SaaS is delivered to the customer. IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 25

27 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 26

28 CLEVER has been designed with an eye toward horizontal federation: Using XMPP for the CLEVER module communication (i.e., external communication XMPP room) possibility to support in the future also interdomain communication between different CLEVER administrative domains. Federation allows to clouds to lend and borrow resources IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 27

29 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 28

30 Cross Cloud Federation: CLEVER arch. CLEVER in Horizontal Federation: the straightness - communication XMPP based and XML messages In Horizontal Federation - Borrowing GRID resources: Small CLEVER module seen as Job Hybrid functionalities - Grid/Cloud: GRID as an Execution Environment for VMs VirtualBox compliant VM Easy Remote Control: transparent SSH/Remote Desktop (chatting behavior) Remote Desktop against Network constraints (Firewall PassThrough): XMPP and SOCKs5 IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 29 A A

31 a) Official CLEVER's web site b) It is an open source project distributed under MIT license and downloading instructions can be retrieved from the download section of the web site. c) The source code is hosted on Google Code web site. Users and developers can get the source code downloading it from the following web address IEEE MoCS Kerkyra June 28th 2011 Dr. Massimo Villari 30

32 Dr. Massimo Villari University of Messina, Italy