EMI views on Cloud Computing

Transcription

1 EMI views on Cloud Computing Florido Paganelli Lund University NorduGrid 2011, May 10th, Sundvolden, Norway Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

2 Outline Outline 1 What are Clouds 2 EMI view Customer comes first EGI Cloud profile 3 How can Grid and Cloud cooperate? 4 Conclusions Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

3 A Definition What are Clouds Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction 1 1 National Institute of Standards and Technology (NIST) - Computer Security Division - Computer Security Resource Center Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

4 A Definition What are Clouds Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction 1 1 National Institute of Standards and Technology (NIST) - Computer Security Division - Computer Security Resource Center Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

5 What are Clouds Commonly accepted (practical) definitions enabling convenient, on-demand network access to a shared pool of configurable computing resources SaaS : Software as a Service applications without bothering about system configuration. PaaS : Platform as a Service a VM accessible remotely, with a software selection, useful for developers. IaaS : Infrastructure as a Service Set of virtual machines, storage elements, remotely configurable. Source: Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

6 What are Clouds Companies and Frameworks Companies Frameworks Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

7 EMI view The Cloud and Virtualization Task Force Explore possibilities of how virtualization and cloud technologies can interact with the grid within EMI Gather information on existing projects Understand Grid Users requirements Suggest a way to go for the EMI project Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

8 EMI view Customer comes first DCI Roadmap (2009) defines some joint Cloud objectives, summarized in the DCI Blueprint Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

9 EMI view EGI Cloud profile : the EGI Cloud Integration profile EGI use cases: 1 Running a pre-defined VM image 2 Running my data and VM in the infrastructure 3 Integrating multiple resource providers 4 Accounting across Resource providers 5 Reliability/availability of Resource Providers 6 VM Resource/state change notification Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

10 EMI view EGI Cloud profile 1. Running a pre-defined VM image Users: provide own VM image and wants to run it on a resource provider access the machine remotely Tech: OCCI, SAML, XACML and network access tools Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

11 EMI view EGI Cloud profile 2. Running my data and VM in the infrastructure Users: want to have control on how the VM accesses resources outside the resource provider need virtualization features such as snapshotting eventually want to retrieve the whole machine to move it somewhere else Data staging protocols, OVF Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

12 EMI view EGI Cloud profile 3. Integrating multiple resource provider Users: want to choose among cloud resource providers want to now about VM management interfaces on each RP Tech: GLUE2 (but it doesn t represent virtualized environments yet) Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

13 the other 3 profiles EMI view EGI Cloud profile 4. Accounting across Resource providers Users access and usage needs to be recorded Tech: RP have to share some accounting system; OGF UR 1.0, UR 2.0 will include it, for the moment being UK NGS uses UR+ that contains Cloud accounting data 5. Reliability/availability of Resource Providers Users want to monitor quality and status of the RP Tech: Monitoring and reporting services for Virtualized environments need to be deployed, no complete technology esists Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

14 EMI view EGI Cloud profile the other 3 profiles 6. VM Resource/state change notification Users: want to be notified real-time about machines issues eventually want to take actions accordingly Tech: well-known notification technologies can be used: RSS, , SMS, AMQP a candidate. Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

15 How can Grid and Cloud cooperate? Model 1: Grid with private clouds Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

16 How can Grid and Cloud cooperate? Model 2: Grid and cloud access Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

17 How can Grid and Cloud cooperate? Model 3: Grid and hybrid cloud access Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

18 How can Grid and Cloud cooperate? Model 4: Virtual grid services Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

19 Conclusions Summary ARC doesn t have a cloud strategy/plan yet EMI doesn t have a cloud plan either, but it s working on scenarios to seamlessly deploy its services in the cloud, keeping in mind EGI s needs EGI has has built an architecture based on the user profiles I ve shown Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

20 Thanks! Conclusions EGI DCI Roadmap EGI Cloud Integration Profile Presentation: Grid and Cloud Operations Interoperability An overview Di Meglio (CERN, EMI), Riedel (FZJ, EMI), Memon (FZJ, EMI), Loomis (CNRS/LAL, StratusLab),Salomoni (INFN, WNoDeS) 24/03/2011 ISGC Academia Sinica, Taipei, Taiwan Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

21 The DCI Blueprint Addenda Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

22 Addenda Model 1: Grid with private clouds Simplest to implement Very little modifications on the grid services (adapt CEs to see VM managers as an LRMS) Transparent for users Minimal impact for site admins Standardization role: VM managers APIs (for the CE support) Virtualized WN and storage space (non-persistent) Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

23 Addenda Model 2: Grid and cloud access Infrastructure part simple to implement Access model requires extension of AA policies and technologies, accounting and brokering mechanisms Very little modifications on the grid services (adapt CEs to see VM managers as an LRMS) Grid access transparent for users, new cloud access Minimal impact for site admins Standardization role: VM APIs, AA, storage interfaces, SRM, CDMI Virtualized WN, custom execution environments, persistent/shared storage space via mounted cloud file systems Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

24 Addenda Model 3: Grid and hybrid cloud access Infrastructure part more complex to implement Access model requires extension of AA policies and technologies, accounting and brokering mechanisms Very little modifications on the grid services (adapt CEs to see VM managers as an LRMS) Grid access transparent for users, new cloud access More effort for site admins in setting up and managing the private/public cloud, peak time management possible Standardization role: VM APIs, AA, storage interfaces, SRM, CDMI, Virtualized WN, custom execution environments, persistent/shared storage space via mounted cloud file systems, commercial cloud storage Elasticity Complex integrated accounting and billing system Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

25 Addenda Model 4: Virtual grid services Infrastructure and service part more complex to implement No special additional AAA requirements Potentially non trivial modifications to grid services to run as dynamically instantiated appliances Grid access transparent for users Grid potentially easier to set up for site admins Standardization role: no special requirements for grid/cloud interop, but pressure on grid standardization for service discovery and registration, dynamic configuration, info systems Potentially any service can be virtualized Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25

26 Who am I Who am I MSc in Università "La Sapienza" di Roma working part-time at Lund University (Sweden) within the EMI project working part-time on virtualization and web services in Malmö (Sweden) Florido Paganelli (Lund University) EMI views on Cloud Computing NorduGrid / 25