FIA Athens 2014 ~OKEANOS: A LARGE EUROPEAN PUBLIC CLOUD BASED ON SYNNEFO. VANGELIS KOUKIS, TECHNICAL LEAD, ~OKEANOS

Transcription

1 ~OKEANOS: A LARGE EUROPEAN PUBLIC CLOUD BASED ON SYNNEFO. VANGELIS KOUKIS, TECHNICAL LEAD, ~OKEANOS 1

2 Fact 1 NRENs and Europe need to decide on how to deliver cloud services Brokering between 3 rd party cloud providers? Build own solution? Bring the vendor into the datacenter? Proprietary or commodity hardware? Where does the data reside? How much does it cost per VM? 2

3 Fact 2 Providing a public cloud service is a tough engineering job Different layers Combination of many different technologies Needs distinct skill sets 3

4 Fact 3 VMs are not cattle, they are pets Users are frustrated by downtime Cloud elasticity : I can t give you persistent VMs in a fast, scalable manner The weight falls on the cloud users Need reliable, efficient live VM migration On which hardware? Without an expensive SAN? 4

5 Running a public cloud: ~okeanos Our choices Build own AWS-like service (Compute, Network, Storage) Persistent VMs Everything open source Production-quality IaaS Super-simple UI How? 5

6 Running a public cloud: ~okeanos The tough stuff Stability Persistent VMs: VMs are not cattle, they are pets Commodity hardware Scalability Manageability: Gradual rollout of upgrades and new features 6

7 Running a public cloud: ~okeanos Our approach Synnefo Google Ganeti DRBD Archipelago Ceph OpenStack APIs 7

8 Running a public cloud: ~okeanos History Design started late 2010 Production since July 2011 Numbers Users: > 6000 VMs: > 8000 currently active More than 280k VMs spawned so far, more than 75k networks Physical Infrastructure 13 Ganeti Clusters, spanning a whole DC 1PB of raw storage capacity 8

9 ~okeanos: The service 9

10 10

11 11

12 12

13 13

14 14

15 15

16 16

17 17

18 18

19 19

20 Synnefo cloud platform An all-in-one cloud solution Written from scratch, mostly in Python Manages multiple Google Ganeti clusters of VMs Uses Archipelago to unify all cloud storage resources Exposes the OpenStack APIs to the end users Production since

21 Synnefo cloud platform A complete cloud platform Identity Service Object Storage Service Compute Service Network Service Image Service Volume Service 21

22 Services Overview 22

23 Identity Service Identity Management, Resource Accounting and SSO Multiple authentication methods per user LDAP, AD, Local username/password, Federated (Shibboleth) Google, Twitter, LinkedIn Fine-grained per-user, per-resource quota Exposes the OpenStack APIs (Keystone) to users 23

24 Identity Service A single dashboard for users View/modify profile information Set/unset active authentication methods Easy, integrated reporting of per-resource quotas Project management: View/Join/Leave projects Manage API access and retrieve authentication tokens 24

25 Compute/Network/Image/Volume Service Layer over multiple Ganeti clusters Python/Django implementation Exposes the OpenStack APIs (Nova, Neutron, Glance, Cinder) A thin translation layer From user (API) requests To VM operations on multiple Ganeti clusters Ganeti clusters are distinct entities May be geographically remote Admin always has direct access for troubleshooting 25

26 Compute/Network/Image/Volume Service Networking Fully pluggable, for integration with existing infrastructure VLAN pool, or MAC-prefix-based filtering on single VLAN VXLAN for all-ip datacenter-wide networking Open vswitch support IPv4/IPv6 public networks, complete isolation among VMs Tens of thousands of private networks over single VLAN Floating ( elastic ) IPv4 addresses, shared among VMs NIC hotplugging for dynamic IP attachment/detachment No need for NAT setup 26

27 Compute/Network/Image/Volume Service Image Handling Spawning VMs from custom Images Images treated as Files on Storage service System and User Images, fine-grained sharing, custom ACLs Images for all major Operating Systems Windows Server 2008, 2008 R2, 2012, 2012 R2 Debian, Ubuntu, RHEL, CentOS, Fedora, ArchLinux, opensuse, Gentoo NetBSD, FreeBSD, OpenBSD 27

28 Storage service A single location for user Files, VM Images, and Snapshots Exposes the OpenStack Object Storage API (Swift) plus extensions, for sharing and syncing Rich sharing, with fine-grained Access Control Lists Hash-based (sha256) deduplication for individual blocks Partial file transfers, efficient syncing (Dropbox-like) Backed by Archipelago 28

29 Layered design Client OpenStack Synnefo UI vcloud OpenStack OpenStack API vcloud Synnefo CLOUD OpenStack vcenter CLUSTER Ganeti vsphere libvirt NODE ESXi KVM / XEN KVM / XEN HYPERVISOR 29

30 Architecture 30

31 Experience Operations Rolling hardware and software upgrades kernel, Ganeti, RADOS, Synnefo with no VM downtime Node evacuations with live VM migrations Cross-datacenter move, Intel AMD, no VM downtime On-the-fly migration from NFS-backed storage to RADOS IP renumbering of all VMs 31

32 Experience Scalability From few physical hosts to multiple racks dynamic addition of Ganeti clusters Diverse workloads Different network and storage backends Choice exposed to the user 32

33 How can I benefit? Ready for your datacenter Deploy your own branded Synnefo Synnefo development team to provide full support (e.g., DeIC) Use GRNET infrastructure Over common authentication layer Synnefo already powers the ~okeanos-global service for the whole GÉANT community, through edugain 33

34 Try it out!

35 Thank you! 35