Virtual Machine Management with OpenNebula in the RESERVOIR project

Transcription

1 CISCO Cloud Computing Research Symposium (C 3 RS) November 5 & 6, 2008 San Jose, CA Virtual Machine Management with OpenNebula in the RESERVOIR project Ruben Santiago Montero Distributed Systems Architecture Research Group Universidad Complutense de Madrid 1/23

2 Objectives 2/23 Describe the goals of the RESERVOIR project and provide an overview of its architecture and design principles Discuss the challenges of managing VMs in a distributed environment and present the VM management model adopted by OpenNebula Study the operation of a Distributed VM in clouds environments A simple use case: Elastic Management of Computing Clusters

3 3/23 RESERVOIR Who? IBM (coordinator), Sun, SAP, ED, TID, UCM, UNIME, UMEA, UCL, USI, CETIC, Thales and OGF-Europe 17-million and 3-year project partially funded by the European Commission (NESSI Strategic Project) What? The Next Generation Infrastructure for Service Delivery, where resources and services can be transparently and dynamically managed, provisioned and relocated like utilities virtually without borders How? Integration of virtualization technologies with grid computing driven by new techniques for business service management Virtualization - Aware Grid e.g., VM as management unit for metering and billing Grid - Aware Virtualization + + e.g., live migration across administrative domains BSM e.g., policy- based manag. of service -level agreement = SOI

4 RESERVOIR The Architecture, main Components and Interfaces Service Provider Service ServiceProvider Provider Monitor service and enforce SLA compliance by managing number and capacity of service components (VEE) Service VEE VEE VEE VEE VEE Host VEE Host VEE VEE Host VEE Service Users 4/23

5 RESERVOIR The Architecture, main Components and Interfaces Service Provider Service Organize the placement of VEEs to meet optimization policies and constraints VHI VMI VEE VMI VEE VEE Host Support advance functionality for performance and realocation optimization VEE Host VEE Host VEE Host infrastructure providers 5/23

6 Distributed Management of Virtual Machines Virtual Machine Model The service as a first-class management entity Service structure Service components run in VMs Inter-connection relationship Placement constraints The VM is service agnostic However, it should provide infrastructure context Clients Network Web Server Tier VM Database Tier 6/23

7 7/23 Distributed Management of Virtual Machines Distributed Virtual Machine Management System Provides a uniform view of the resource pool Resources organized in a cluster architecture Life-cycle management and monitoring of VM The VM Management System integrates Image, Network and Virtualization technologies Distributed VM Management System Networking Image Management Virtualization The three pillars of a Distributed VM

8 Distributed Management of Virtual Machines Image Management VM Images Sources: Master images in local repositories Appliance supplier Creation on the fly Clones have to be contextualized (Context VBD) Master Images Physical Host VBD Virtual Machine Image Repository Cloning Installation Server Virtual Context Device 8/23

9 Distributed Management of Virtual Machines Network Management VMs interconnected through one or more networks Isolated, layer 2 LANs Virtual networks are dynamically created Medium size networks (x.x.x.x/20) with limited public IPs TCP/IP services are not responsibility of the VM Sample Implementation Virtual LAN (Red) Host tap0 Bridge tap1 Switch Physical Network tap0 Bridge tap1 VM VM VM VM Virtual LAN (Blue) tap2 Host VM 02:01:0A:00:01: /24 02:01:0A:00:02: /24 02:01:0A:00:01: /24 02:01:0A:00:01: /24 02:01:0A:00:02: /24 9/23

10 Physical Resources 10/23 Distributed Management of Virtual Machines Virtualization Virtual Machine structure One or more NICs attached to virtual or public networks One or more system images (clones) A context virtual block device A required capacity (memory, CPU) Use the host hypervisor to create, monitor and control VMs Distributed VM Management System hypervisor hypervisor hypervisor hypervisor

11 Distributed Management of Virtual Machines Life-cycle of a Virtual Machine (or a set of) Resource Selection: Where do I place the VM? Capacity planning (consolidation) Placement requirements (e.g. affinity) Placement Heuristics (e.g. Green IT, AR...) Resource Preparation: What do I need for the VM? Network preparation Image cloning & contextualization VM Creation: How do I start a VM? Interface with different hypervisors VM Monitoring: How is the VM doing? VM Migration: Is there a better resource for the VM? Adjust placement to better fit to the infrastructure target VM Termination: Do I need to save any VM image? 11/23

12 Distributed Management of Virtual Machines OpenNebula: Distributed VM Management System Scheduler CLI libvirt Open Source - Apache 2 Flexible & Open Design OpenNebula API OpenNebula core XML-RPC Third-party components Easily adapted Easily extended sqlite Host, Net & VM Pools Persistent Database Information Image Network VM Access Drivers XEN KVM EC2 libvirt Different Hypervisors Operation in Federated Environments Integral management of Virtual Services 12/23

13 13/23 Distributed Management of Virtual Machines OpenNebula: Distributed VM Management System Scheduler CLI libvirt OpenNebula API OpenNebula core Host, Net & VM Pools XML-RPC Information Image Manage IP and MAC addresses Manage VM life-cycle Manage Image transfers Manage Physical Resources Persistent back-end Network VM sqlite Persistent Database Access Drivers XEN KVM EC2 libvirt

14 14/23 Distributed Management of Virtual Machines OpenNebula: Distributed VM Management System Scheduler CLI libvirt OpenNebula API OpenNebula core Host, Net & VM Pools XML-RPC Information Image Image management systems Physical resources Different hypervisors Xen KVM Libvirt Network EC2 VMware (planned) VM sqlite Persistent Database Access Drivers XEN KVM EC2 libvirt

15 15/23 Distributed Management of Virtual Machines OpenNebula: Distributed VM Management System Scheduler CLI libvirt OpenNebula API VM placement policies & heuristics Plug-in XML-RPC module OpenNebula Available schedulers core Simple match-making scheduler Host, Net & VM Pools Information Image Network VM sqlite Persistent Database Access Drivers XEN KVM EC2 libvirt

16 16/23 Distributed Management of Virtual Machines OpenNebula: Distributed VM Management System Scheduler CLI libvirt OpenNebula API OpenNebula core Host, Net & VM Pools XML-RPC Information Image Unix-like CLI Libvirt interface, integration with: Network Virsh Virt-manager Other managers (e.g. Ovirt) VM... sqlite Persistent Database Access Drivers XEN KVM EC2 libvirt

17 17/23 Elastic Management of Computing Clusters A New Infrastructure Layer... Separation of Resource Provisioning from Job Management Seamless integration with the existing middleware stacks. Completely transparent to the computing service and end users LRMS (Job Management) Virtual cluster nodes Distributed VM VMM VMM VMM VMM Physical Resource

18 Elastic Management of Computing Clusters Cluster users HTTP clients Virtual Network Service Layer Cluster Front-end Virtual Workernodes OpenNebula Web Server Infrastructure Layer Physical Infrastructure 18/23

19 Elastic Management of Computing Clusters A Service to Provide Hardware on Demand (IaaS) Cloud systems provide virtualized resources as a service Provide remote on-demand access to infrastructure (through VMs) Main components of a Cloud architecture: Front-end: Remote interface Back-end: Local VM, image & network management Simple Interfaces VM Management Image Management Distr. Virtualizer Infrastructure Cloud Services Commercial Cloud: Amazon EC2, GoGrid Scientific Cloud: Nimbus (University of Chicago) 19/23

20 Elastic Management of Computing Clusters Cluster users Virtual Network Service Layer Cluster Front-end OpenNebula Virtual Workernodes Cloud Provider Infrastructure Layer Local Physical Infrastructure 20/23

21 Federation of Cloud Sites 21/23 Clients or other Provider Consumer/Provider Relationships Nimbus integration (WSRF + EC2) RESERVOIR Cloud VMI Eucalyptus (planned) Cloud Interface Capacity OpenNebula XEN / KVM Drivers ONE Core Cloud Drivers Federation of Cloud Providers Image, Network and VM issues Cloud Interface Local Infrastructure Cloud Provider Amazon EC2 Capacity OpenNebula XEN / KVM Drivers ONE Core Cloud Drivers

22 Virtual Machine Management with OpenNebula in RESERVOIR 22/23 THANK YOU FOR YOUR ATTENTION!!! More info, downloads, mailing lists at OpenNebula is partially funded by the RESERVOIR Resources and Services Virtualization without Barriers project EU grant agreement Acknowledgements Javier Fontan Ignacio M. Llorente Tino Vazquez Rafael Moreno

23 Elastic Management of Computing Clusters (DEMO - BACKUP) Worker Node Amazon EC2 Worker Node Worker Node OpenVPN Tunnels Internet Connection Bridge OpenVPN Server SGE Front-End Physical Host Bridge Local private network Bridge Bridge Bridge Worker Node Worker Node Worker Node Worker Node Worker Node Physical Host Physical Host Physical Host 23/23