Comparing Ganeti to other Private Cloud Platforms. Lance Albertson

Size: px

Start display at page:

Download "Comparing Ganeti to other Private Cloud Platforms. Lance Albertson Director lance@osuosl.org @ramereth"

Jared Little
8 years ago
Views:

1 Comparing Ganeti to other Private Cloud Platforms Lance Albertson

2 About me OSU Open Source Lab Server hosting for Open Source Projects Open Source development projects Gentoo Developer Sysadmin Jazz trumpeter

3 Disclaimer

4 What I'll Cover Compare 4 IaaS Platforms IaaS Components Discuss Strengths / Weaknesses Provide best uses for each platform NOT covering PaaS or SaaS platforms

5 Background Experience Used Xen+iSCSI for several years Researched an alternative tool Picked Ganeti+KVM 3 years ago Have had excellent experience for our use case Created web front-end for Ganeti Looking at augmenting services with OpenStack or Synnefo

Have had excellent experience for our use case Created web

6 Current State of Private IaaS Many options AWS API support Maturity of the projects Solving different problems Complexity of the platform Differences in backend architecture

7 What do you want in an IaaS? Ease of use Fault tolerance Low-cost of entry/maintenance Performance Ease of expansion API provisioning Compatibility with other platforms Agility / Fast provisioning

8 Major components of IaaS Storage VM Image management Self service / Web interface Networking Fault tolerance User management API / Hybrid Cloud Readiness Installation / Maintenance

9 Platforms I'm comparing

10 OpenStack History Joint project with Rackspace & NASA Launched in June 2010 Enable anyone to create and offer cloud computing services Many corporations joined

11 OpenStack Components Nova (compute) Swift (object storage) Glance (image service) Horizon (gui interface) Quantum (networking) Cinder (block storage) Ceilometer (metering) Heat (cloud orchestration) Keystone (identity management)

Quantum (networking) Cinder (block storage) Ceilometer

12 Eucalyptus History Started as a research project at UC Santa Barbara Company founded in 2009 to commercialize the project Split into two editions: Open-core Open source June 2012 back to fully open source

commercialize the project Split into two editions:

13 Eucalyptus Components Cloud Controller (CLC) Manages the virtualization resources and APIs Provides web interface Walrus (S3 storage) Cluster Controller (CC) Controls execution of VMs and their networking Storage Controller (SC) Provides block-level storage to VMs (EBS) Node Controller (NC) Controls VMs via hypervisors

Controller (CC) Controls execution of VMs and their networking Storage

14 CloudStack History Originally developed by Cloud.com Open Sourced in May 2010 (GPLv3) Citrix purchased Cloud.com in Aug 2011 Donated to ASF in Feb 2012

15 CloudStack Components Management Server Hypervisor Nodes Storage Nodes Layers: Zone, Pod, Cluster, Host, Primary Storage, Secondary Storage

16 Ganeti History Started as internal Google project Open sourced in August 2007 Used primarily for back-office servers for Google Focus on hardware fault-tolerance Local block-level storage Cheap commodity hardware

back-office servers for Google Focus on hardware

17 Ganeti Components Master daemon Controls overall cluster coordination Node daemon Controls node functions (storage, VMs, etc) Conf daemon Provide a fast way to query configuration API daemon - Provide a remote API Htools - Auto-allocation & rebalancing tools

etc) Conf daemon Provide a fast way to query configuration API

18 Ganeti Third Party Add-ons Ganeti Web Manager Simple IaaS management Permissions, groups Just the UI Synnefo Ganeti as a cloud service Cloud, API, UI DRBD, LVM, Shared File, RBD (Ceph/RADOS)

19 Ganeti Web Manager Django based Targeted for admins primarily Great for using Ganeti as a simple IaaS Allow simple console access to users Primary Contributors: OSU Open Source Lab

20 Ganeti Web Manager

21 Ganeti Web Manager

22 Synnefo Components Compute/Network/Image Service (Cyclades) File Storage Service (Pithos) Block Storage Service (Archipelago) Identity Service (Astakos) Adding Cloud-like features to Ganeti Major Contributor: GRNET

23 Synnefo: Cluster vs. Cloud

24 Synnefo: Architecture

25 Building upon Ganeti Stable virtualization platform Build tools to extend Ganeti Augment Ganeti with other technologies RADOS, GlusterFS, etc Simple approach makes sysadmins happy

26 Component Comparison

27 Storage Comparison Type OpenStack Eucalyptus CloudStack Ganeti [1] Block devices [2] [2] [3] [4] Fault Tolerance [5] [6] [7] Disk Images Via third party tools (Synnefo) Via an elastic block storage service iscsi, OCFS2, CLVM (depends on hypervisor) Primary storage method Uses rsync in the backend Not added until version 3.0, uses DRBD Parts are built-in, Storage is on your own

28 VM Image Comparison Type OpenStack Eucalyptus CloudStack Ganeti Image Service [2] Self Service [1] [2] [3] [3] Amazon API 1. Ability for users to create and manage their own VM images 2. Via third-party tools (Synnefo) 3. Some support

29 Self Service Comparison Type OpenStack Eucalyptus CloudStack Ganeti Web Interface [1] Users & Quotas [1] Console access [1] User management [1] 1. Available via third-party tools such as Ganeti Web Manager or Sysnefo

30 Networking Comparison Type OpenStack Eucalyptus CloudStack Ganeti Auto-allocation [1] Floating IPs maybe User defined [1] Layer 2 [1] 1. Via third-party tool Synnefo

31 Other factors OpenStack Eucalyptus CloudStack Ganeti Python Java, C Java Python, Haskell, Shell Xen, KVM, UML, LXC, VMware Xen, KVM, VMware Xen, KVM, VMware, Citrix XenServer Xen, KVM, LXC Installation Requirements Medium Large Medium/Large Low Maintenance [1] Many components to maintain Depends on your size Medium Easy Codebase Hypervisors 1. Base on my observation and opinion

32 Ease of Installation Included via distribution Amount of upfront configuration needed for a base install Ease of initialization of a cluster OpenStack Eucalyptus CloudStack Ganeti Included in Ubuntu Excellent Install Guide Provide their own repos Included in Debian/Ubuntu Lots of configuration required Yum/Apt repos Excellent install guide Puppet Labs Module Few commands for initialization Good Docs Minimal configuration needed Simple initialization

33 Strengths / Weaknesses OpenStack Eucalyptus CloudStack Ganeti Young codebase Install requirements Very GUI centric Admin centric Uncertain future Configurable but not very customizable Single java core VM Deployment Community Inclusion AWS integration weak No AWS integration Single codebase Excellent commercial support Well-rounded GUI Fault-tolerance built-in Growing community Fault-tolerance Stack is fairly simple Customizable Offers a hybrid-cloud solution with AWS Customization of the storage backend Very simple to manage and maintain Weakness Initial configuration Strengths Corporate support

34 Which platform do you choose? Size of deployment Types of services to be hosted User-base Hardware/Budget limitations Complexity of the system Fault tolerance importance Compatibility with other clouds

35 Summary of Comparisons OpenStack Eucalyptus CloudStack Ganeti public & private cloud, standardized API hybrid private/public cloud compatibility Private, highly customized cloud, standardized API Private, node failure tolerant, local storage Public Cloud Compatibility Some AWS Excellent AWS Some AWS Via Synnefo Ideal Setting Large group of machines for lots of users Large group of machines for lots of semi-trusted users Medium group of machines for semi-trusted users Smaller group of machines for highly trusted users with fault tolerance Fault-tolerance Some built-in Good with recent versions Some built-in Fully tolerant / Designed Philosophy

36 Choosing Openstack Very young project Lots of corporate backing Codebase is simplified (python only) Excellent for large deployments Web interface is young, limited Only use the components you need Medium complexity Excellent APIs

37 Choosing Eucalyptus Fairly mature project Lots of features Codebase is complicated Complex installation requirements Great commercial support Excellent hybrid-cloud platform Re-focused effort back to Open Source

38 Choosing CloudStack No Distribution Support Lots of features Medium complexity to setup Fault-tolerance built into parts AWS compatibility is weak Monolithic component architecture Recent ownership shifts Used by several large hosting providers

39 Choosing Ganeti Fault tolerance built-in Ideal for smaller clusters Less complex, but less featureful No EC2 compatibility Better performance Local storage Only solves the compute problem Can be augmented with third-party applications

40 Trying out Ganeti Vagrant testing environment node testing Operating systems CentOS, Debian, Ubuntu Walk-thru Guide PDF

41 What about the others? OpenNebula - HPC community Nimbus - Scientific community ovirt - libvirt

42 No single winner or loser Solving different problems No perfect solution for everything Try each platform out first Map out what your end goal is Think about: scalability manageability fault-tolerance

44 Questions? Lance Follow fb.com/osuosl G+ "Open Source Lab"

Comparing Open Source Private Cloud (IaaS) Platforms

Comparing Open Source Private Cloud (IaaS) Platforms Lance Albertson OSU Open Source Lab Associate Director of Operations lance@osuosl.org / @ramereth About me OSU Open Source Lab Server hosting for Open