Snakes on a cloud. A presentation of the OpenStack project. Thierry Carrez Release Manager, OpenStack

Transcription

1 Snakes on a cloud A presentation of the OpenStack project Thierry Carrez Release Manager, OpenStack

2 Cloud?

3 Buzzword

4 End-user services Software as a Service (SaaS)

5 End-user services Online storage / streaming

6 Backend services Raw compute / storage resources (IaaS)

7 Backend services Deployment platforms (PaaS)

8

9 Open source cloud

10 OpenStack project genesis Cloud servers Cloud files Open source

11 OpenStack project genesis NovaCC Open source

12 OpenStack project genesis Cloud servers Cloud files Open source NovaCC Open source Nova (compute) Swift (storage)

13 Mission statement To produce the ubiquitous open source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable.

14 Open Open source Open design Open development Open community

15 A young project NASA open sources Nebula platform OpenStack formed First design summit in Austin Decision to open source Rackspace Cloud First release (codenamed «Austin») «Bexar» released «Cactus» released

16 100 developers

17 Design and coding standards Scalability and elasticity Asynchronous Horizontally scalable Share-nothing (or sharding) Distribute everything Accept eventual consistency Test everything Enforce PEP-8

18 OpenStack projects Core Nova (compute) Glance (image service) Swift (storage) Incubation Keystone (common authentication) Dashboard (django-based web UI) Burrow (queue service)... Related

19 Release cycle 6 months nova glance diablo-1 diablo-2 diablo-3 diablo swift

20 Swift (Cloud Storage) Object storage RESTful interface No object size limit Stable and deployed in production Scales massively

21 Objects, containers, accounts Account Container Object Object Object Account Container Object Object Object Object Object Object Container Object Object Container Object Container Object Object

22 Rings c00...dff e00...fff ff ff a00...bff ff ff ff

23 The objects ring PUT /<api version>/<account>/<container>/<object> Partition 482 located on: zoneasrv73 zonecsrv35 zonebsrv98 ecb25d1facd7c6760f7663e394dbeddb

24 Swift request Proxy server A B C Container server

25 Listing objects in a container GET /<api version>/<account>/<container>/ cfb02ba07109d95e b Partition 68 address queries to: zonebsrv12 zoneasrv92 zonecsrv44 Containers

26 Listing containers in an account GET /<api version>/<account>/ b779f644c96a61c240de9d5bfa Partition 11 address queries to: zonebsrv42 zonecsrv09 zoneasrv63 Accounts

27 Swift components Proxy server Proxy server Proxy server Account reaper Container server Container server Updater Container server Container server Auditor Container server Account server Container server Container server Object Account server server Container server Account server Container server Account server Account server Container server Object Account server server Container server Container server Horizontal scaling Commodity hardware (no RAID)

28 Glance (Image service) Disk images and associated metadata Discover, register and retrieve Multiple disk formats : raw, VHD, vmdk, vdi, ISO, qcow2, aki, ari, ami Multiple container formats : ovf, bare, aki, ari, ami

29 Glance architecture Swift glance CLI tool S3 glance.client Python library Glance API glance-api Filesystem... Registry API HTTP... glance-registry... SQL

30 Nova (Cloud Compute) «VMs one API call away» Highly-modular framework Under heavy development Used in production in NASA Nebula cloud

31 Nova components Scheduler node Compute node API node RabbitMQ Network node Network node Volume node

32 Creating a new server Scheduler node Compute node Glance API node RabbitMQ Network node Network node Volume node

33 Share nothing? Not yet Scheduler node Compute node API node RabbitMQ Network node Network node Volume node Datastore

34 Nova modularity API node WSGI middleware EC2/OpenStack API DB/LDAP auth plugin Network node Flat, FlatDHCP, Vlan IPv4 / IPv6 Scheduler node Pluggable Chance Zone-aware Compute node QEMU, KVM, UML, LXC Xen and XenServer Hyper-V VMware vsphere Datastore AMQP Sqlite MySQL Postgres Volume node Local LVM volume groups iscsi Sheepdog HP/Lefthand SANs

35 Coming up in Diablo... Separate block storage service (LunR) Separate network services : Quantum (network API for cloud compute) Melange (network resources registry) Donabe (complex network containers) Use common authentication (Keystone)

36 Coming up in Diablo... Snapshot, clone and boot from volumes Distributed scheduling OpenStack API 1.1 Configuration drive

37

38 What we are using

39 What we are using Eventlet Paste.deploy webob routes

40 What we are using Carrot / AMQPlib (Kombu?) & sqlalchemy migrate

41 What we are using boto M2Crypto gflags

42 Come and join the fun IRC (Freenode) #openstack #openstack-dev Mailing-list

43 Questions?