How To Build An Iaas Cloud Cloud (Geneo) For Ganet.Org

Size: px

Start display at page:

Download "How To Build An Iaas Cloud Cloud (Geneo) For Ganet.Org"

Curtis Lee
3 years ago
Views:

1 6 th GreenConnectedWorld, 10.4, Caravel, Athens Building Scalable Clouds that work! (The ~okeanos GRNET solution) Νεκτάριος Κοζύρης, καθ. ΕΜΠ, ΕΔΕΤ Greek Research and Technology Network CIO Forum, 10/02/14

2 Current production ~okeanos History - Design started late Production since July 2011 Numbers (4/2014) nkoziris@grnet.gr Users: > VMs: > 8700 currently active - More than 302k VMs spawned so far (started/destroyed) - More than 82k vlans spawned so far (user owned VLANs) Typical VM flavor (more than 340 flavors available! ) - 4 cores (vcpus), 80GB Hard Disk, 4 or 8GB RAM

gr 20130226 - Users: > 8000 - VMs: > 8700 currently active - More than 302k VMs spawned so far

3 ~okeanos VMs VMs

4 Late 2010: The challenge Goals Production-quality IaaS cloud similar to Amazon AWS Scalability to thousands users/nodes/vms Persistent VMs Commodity components (No SAN, No exotic network infrastr.) Everyone can use it-super simple web UI No vendor lock-in Low admin costs, manageable by a small team Greek Research and Technology Network CIO Forum, 10/02/14

5 Late 2010: The available offerings Reviewed open source ones Eucalyptus Cloudstack Opennebula Openstack..etc.. Still evolving systems, silo ones (touching every layer) No turnkey solutions Greek Research and Technology Network CIO Forum, 10/02/14

. Still evolving systems, silo ones (touching every layer) No

6 The software that powers ~okeanos: An open source cloud software written in python Oct. 2010: implementation starts July 2011: v (powers ~okeanos alpha) : v : v : v : v0.15rc1 (powers ~okeanos beta) : v0.15rc : v0.15 Mid 5/2014: v0.16

2010: implementation starts July 2011: v0.5.2.1 (powers ~okeanos alpha) 28.3.

7 The okeanos IaaS service Features: Production-quality IaaS cloud Everything open source: Ganeti by by Persistent VMs Commodity Hardware No SAN, No exotic network hw Add plain servers/disks/switches to scale up Three clicks to start 1 or 10s of VMs Greek Research and Technology Network CIO Forum, 10/02/14 Simple to operate

hw Add plain servers/disks/switches to scale up Three clicks to start 1 or 10s

8 Ganeti Virtual machine cluster management tool (2006-). GPLv2 license (open-sourced since 2007). Used by Google for its internal computing infrastructure (IT Corp.) GRNET is the biggest external contributor for Ganeti since 2009 (Google I/O 2012) For a quick view on Ganeti, see Jeff Bates/Iustin Pop talk on Google I/O 2012, Running Google on Google (How Google s IT keeps Pace with Google s Growth). Greek Research and Technology Network CIO Forum, 10/02/14

) GRNET is the biggest external contributor for Ganeti since 2009 (Google I/O 2012) For a quick view on Ganeti,

9 Greek Research and Technology Network CIO Forum, 10/02/14

10 Gartner 2013 Magic Quadrant for Cloud IaaS PaaS/SaaS offerings? Scalable Solutions: Who can compete Amazon? Source: Gartner

11 No SAN Storage is thinly provisioned No local storage: How we scale up? Software Defined Solution VMs can start anywhere, make a snapshot anytime, restart anywhere VMs can live migrate anywhere VMs can live anywhere New volumes can be added to any VM Single store for Files, Images, VM disks Unified Cloud Storage Software defined SDN: Scale to thousands of isolated private L2 segments over single VLAN How? In Software!! Greek Research and Technology Network CIO Forum, 10/02/14

anywhere VMs can live anywhere New volumes can be added to any VM Single store for Files, Images, VM disks Unified

12 Software Defined Storage Distributed Storage System - Powering storage in clouds Decouples storage resources from storage backends - Files / Images / Volumes / Snapshots Unified way to provision, handle, and present resources - Decouples logic from actual physical storage Greek Research and Technology Network CIO Forum, 10/02/14

Snapshots Unified way to provision, handle, and present resources - Decouples

13 How fast can you prepare a cluster of 100 (windows 2012) servers? nkoziris@grnet.gr Days? Hours? Minutes? Seconds?

14 Building blocks Virtual Compute Machines Virtual Network Ethernets Virtual Storage Disks Virtual Security Firewalls

15 5x 8x 2x 1x Greek Research and Technology Network CIO Forum, 10/02/14

16 Greek Research and Technology Network CIO Forum, 10/02/14

19 Current production ~okeanos

20 Synnefo: installations GRNET ~okeanos service (Greece) GEANT okeanos-global service (EU) DeIC (Denmark), synnefo.sky.deic.dk DataCentres is US/Germany (private sector) Australia (private sector) South Asia (SANOG) Pilots in Greece, Ireland, Belgium, Poland

22 Latest events for Synnefo Ceph days, 9/10/13 - London, UK LinuxCon 2013, 21-23/10 Edinburg, UK Supercomputing 2013, 17-22/11 Denver, Colorado Fosdem 2014, 1-2/2 Brussels, Belgium

23 See more on GO for a quick #okeanos #synnefosoftware Greek Research and Technology Network CIO Forum, 10/02/14 The project is co-financed by Greece and the European Union

Ένα διεθνές λογισμικό για Clouds από Έλληνες μηχανικούς. χιλιάδες χρήστες που αναπτύχθηκε στην Ελλάδα από το ΕΔΕΤ. μια παγκόσμια υπηρεσία με

Ένα διεθνές λογισμικό για Clouds από Έλληνες μηχανικούς μια παγκόσμια υπηρεσία με χιλιάδες χρήστες που αναπτύχθηκε στην Ελλάδα από το ΕΔΕΤ Καθ. Νεκτάριος Κοζύρης, ΕΔΕΤ ΑΕ Greek Research and Technology