2 Goals Understand OpenStack purpose and use cases Understand OpenStack ecosystem o history o projects Understand OpenStack architecture o logical architecture o components o request flow Get enough theory for hands-on lab
3 What is OpenStack? "Open source software for building private and public clouds"
4 OpenStack capabilities VMs on demand o o provisioning snapshotting Volumes Multi-tenancy o o quotas for different users user can be associated with multiple tenants Object storage for VM images and arbitrary files
5 OpenStack History July Initial announcement October Austin Release April Cactus Release October Diablo Release April Essex Release October Folsom Release
6 OpenStack Projects Nova (Compute) Glance (Image Service) Swift (Object Store) Keystone (auth) Horizon (Dashboard)
7 OpenStack Projects: Relationship
8 OpenStack: Deployment Topology
9 OpenStack Projects: Detailed View
10 Horizon "The OpenStack Dashboard (Horizon) provides a baseline user interface for managing OpenStack services."
11 Horizon notes "Stateless" Error handling is delegated to back-end Doesn't support all API functions Can use memcached or database to store sessions Gets updated via nova-api polling
12 Horizon internals 2 subprojects o horizon - generic Django libraries and components to work with REST-based back-end o openstack-dashboard - web app itself, with styles, locale, etc. Dashboard for each entity (like instances or images) - nested Django app
13 Keystone "Keystone is an OpenStack project that provides Identity, Token, Catalog and Policy services for use specifically by projects in the OpenStack family."
14 Keystone Architecture
15 Keystone data model User: has account credentials, is associated with one or more tenants Tenant: unit of ownership in openstack, contains one or more users Role: a first-class piece of metadata associated with many user-tenant pairs. Token: identifying credential associated with a user or user and tenant Extras: bucket of key-value metadata associated with a user-tenant pair. Rule: describes a set of requirements for performing an action.
16 Keystone: auth flow
17 Keystone: populating auth data Add tenants Add users Add roles Grant roles to users Add endpoint templates Map endpoint templates to zones
18 nova-api "nova-api is a RESTful API web service which is used to interact with nova"
19 nova-api characteristics Exposes REST API Provides system for managing multiple APIs on different sub-domains o EC2-compatible - will be deprecated o OpenStack Compute API - all innovation happens here The only "allowed" way to interact with nova Stateless - HA-ready
20 nova-api clients
21 nova database "nova database stores current state of all objects in compute cluster."
22 nova database Can be any relational database nova-api talks to DB via SQLAlchemy (python ORM) Most of the deployments are done with MySQL or PostreSQL DB HA should be done via external tools (like MMM for MySQL)
23 Message queue "Message queue is a unified way for collaboration between nova components."
24 OpenStack messaging 2 modes: rpc.cast - don't wait for result rpc.call - wait for result (when there is something to return)
25 Messagings notes OpenStack uses multiple queues within single RabbitMQ instance OpenStack messages traffic is not intensive OpenStack doesn't send broadcast messages HA for MQ should be configured separately
26 nova-scheduler "nova-scheduler is a daemon, which determines, on which compute host the request should run."
27 nova-scheduler: users' demand provision VM to particular host provision VMs of the particular tenant to isolated hosts provision all VMs on different hosts provision VMs to "higher density" hosts
28 nova-scheduler: available schedulers Scheduler Description Chance Simple Filter Multi Picks a host that is up at random Picks a host that is up and has the fewest running instances Picks the best-suited host which satisfies selected filter A scheduler that holds multiple subschedulers
29 nova-scheduler: filtering
30 nova-scheduler: filters Filter affinity availability zone core ram json Description Same host or different host Least cost inside selected availability zone Least CPU core utilization Only return hosts with sufficient RAM Allows simple JSON based grammar. Can be used to build custom schedulers.
31 nova-scheduler: filters Filters are statically configured in nova.conf Multiple filters can be specified It is possible to create custom filter o o Inherit from BaseHostFilter class override host_passes(self, host_state, filter_properties)
32 nova-scheduler: weights and costs
33 nova-scheduler: weights and costs Cost - integer value Every compute host can have several cost functions associated with it If no cost functions associated - use default from nova.conf weight = sum(cost i + weigth_fn i )
34 nova-scheduler: summary Allow to tweak provisioning by adjusting filters, cost and weights Still doesn't cover all customer demands - exposes framework for building custom schedulers instead
35 Questions How does OpenStack understand that specific request can be executed by the user? How to get a status for a requested server? Where it will come from? What is the difference between rpc.call vs rpc.cast? How to create a filter, which will determine servers with 8GB to 16GB RAM available?
36 nova-compute "nova-compute is a worker daemon, which primarily creates and terminates VMs via hypervisor API."
38 nova-compute: drivers Functionality is not 100% similar Exact "run_instance" flow depends on driver implementation Most of the features are tested on KVM
39 Glance "The Glance project provides services for discovering, registering, and retrieving virtual machine images."
40 Glance summary Image-as-a-service Can use multiple back-ends for image storage Supports multiple image formats
41 Glance architecture
42 Glance capabilities CRUD images Search images via filters o o o o o name container format disk format size_min, size_max status Caches images o o o o o uses SQLite or FS that supports xattrs for caching queues images for prefetching prefetches images prunes images cleans invalid cache entries
43 Glance image formats Disk Format raw vhd vmdk vdi iso qcow2 aki ari ami Description This is an unstructured disk image format This is the VHD disk format, a common disk format used by virtual machine monitors from VMWare, Xen, Microsoft, VirtualBox, and others Another common disk format supported by many common virtual machine monitors A disk format supported by VirtualBox virtual machine monitor and the QEMU emulator An archive format for the data contents of an optical disc (e.g. CDROM). A disk format supported by the QEMU emulator that can expand dynamically and supports Copy on Write This indicates what is stored in Glance is an Amazon kernel image This indicates what is stored in Glance is an Amazon ramdisk image This indicates what is stored in Glance is an Amazon machine image
44 Fetching image from glance 1. GET 2. If image can be found, API returns image-uri 3. nova-compute passes image-uri to hypervisor driver 4. hypervisor driver fetches image directly from glance back-end store using image-uri
45 Custom image creation 1. Get installation ISO 2. Create VM (qemu-img create) 3. Start VM and connect to it via VNC console a. Install image without LVM b. Create default iptables rules c. Install and configure cloud-init d. With cloud-init configure image 4. Prepare image for OpenStack a. Extract root partition, kernel and ramdisk b. cleanup c. package
46 Network configuration flow 1. Allocate MAC addresses 2. Allocate IPs (for each network) 3. Associate IPs with VMs (DB) 4. Setup network on host a. Update DHCP config b. Initialize gateway c. VPN configuration (optional) 5. Update networking info in DB
47 nova-network "nova-network is a worker daemon which performs tasks to manipulate network via external commands."
48 nova-network responsibilities Allocate and configure network via network manager o o o FlatManager FlatDHCPManager VlanManager Manage Floating IPs Manage Security groups
50 FlatManager Supports only single network Doesn't do any bridge/vlan creation The bridge needs to be manually created on all hosts Compute host attempts to inject network settings into /etc/network/interfaces
52 FlatDHCPManager Improvement of FlatManager Stars up 1 DHCP server to give out addresses Never injects network settings into guest Manages bridges
54 VlanManager features Creates host-managed VLAN for each project Requires switch that supports VLAN tagging (IEEE802.1Q) Each project gets own subnet (VPN is required to access VMs via private IPs) DHCP server is running for each subnet All instances belonging to one project are bridged into the same VLAN for that project
56 Floating IPs Shared pool of public IP addresses Each user gets a quota of how many IPs to use Managed by admin
57 Floating IPs traffic
58 Assigning Floating IPs OpenStack Admin Dedicate floating IPs to cluster OpenStack User 1. Allocate public IP for tenant within given quota 2. Associate public IP with VM a. Find host b. Add IP address to public network interface of the host c. NATting all network traffic via associated floating IP
59 Security Groups
60 Security Groups Security group is a named collection of network access rules User can select multiple security groups during VM creation If no security groups specified - default is selected Security groups are applied on the host node
61 nova-volume "nova-volume manages the creation, attaching and deattaching of persistent volumes to compute instances"
62 nova-volume summary Optional iscsi solution which uses LVM Volume can be attached only to 1 instance at a time Persistent volumes keep their state independent of instances Within single OpenStack deployment different storage providers cannot be used
63 nova-volume drivers iscsi Xen Storage Manager Nexenta NetApp SAN
Introduction to Openstack, an Open Cloud Computing Platform Libre Software Meeting 10 July 2012 David Butler BBC Research & Development firstname.lastname@example.org Introduction: Libre Software Meeting 2012
Cloud on TEIN Part I: OpenStack Cloud Deployment Vasinee Siripoonya Electronic Government Agency of Thailand Kasidit Chanchio Thammasat University Outline Objectives Part I: OpenStack Overview How OpenStack
Snakes on a cloud A presentation of the OpenStack project Thierry Carrez Release Manager, OpenStack Cloud? Buzzword End-user services Software as a Service (SaaS) End-user services Online storage / streaming
TECHNICAL WHITE PAPER Ubuntu OpenStack on VMware vsphere: A reference architecture for deploying OpenStack while limiting changes to existing infrastructure A collaboration between Canonical and VMware
Cloud computing enables the delivery of computing resources as a service, rather than a single bundled product. Amongst the many options for running a cloud infrastructure, the open source solution, OpenStack,
Building Storage as a Service with OpenStack Greg Elkinbard Senior Technical Director MIRANTIS 2012 PAGE 1 About the Presenter Greg Elkinbard Senior Technical Director at Mirantis Builds on demand IaaS
SUSE Cloud 2.0 Pete Chadwick Douglas Jarvis Senior Product Manager email@example.com Product Marketing Manager firstname.lastname@example.org SUSE Cloud SUSE Cloud is an open source software solution based on OpenStack
Déployer son propre cloud avec OpenStack GULL email@example.com Who Am I? System and Network Engineer Stuck in the Linux world for almost 2 decades Sysadmin who doesn't like to type the same
What is OpenStack? Mike Buzzetti firstname.lastname@example.org IBM 14221 I am here to help email@example.com IBM's Reference Architecture for Cloud Cloud Service Consumer Common Cloud Management Platform (CCMP)
Today Private Clouds and OpenStack Introduction 1. Private Clouds 2. Introduction to OpenStack What is OpenStack? Architecture and Main components Demo: basic commands Luis Tomás Department of Computing
Cloud Computing #8 - Datacenter OS Johan Eker Outline What is a Datacenter OS? OpenStack Kubernetes Resource Management What is an OS? What is an OS? Manage hardware resources such as CPU, RAM, disk, I/O,
OpenStack Foundations (HP-H6C68) Course Overview This three day course assists administrators and users to configure, manage, and use the OpenStack cloud services platform. An architectural overview ensures
OpenStack IaaS 1 Rhys Oxenham OSEC.pl BarCamp, Warsaw, Poland November 2013 Disclaimer The information provided within this presentation is for educational purposes only and was prepared for a community
KVM, OpenStack, and the Open Cloud Adam Jollans, IBM Southern California Linux Expo February 2015 1 Agenda A Brief History of VirtualizaJon KVM Architecture OpenStack Architecture KVM and OpenStack Case
, pp.171-180 http://dx.doi.org/10.14257/ijgdc.2014.7.5.16 Research of Enterprise Private Cloud Computing Platform Based on OpenStack Jiang Yunxia, Zhao Bowen, Wang Shuqi and Sun Dongnan School of Automation,
SUSE Cloud 4 August 06, 2014 www.suse.com End User Guide End User Guide List of Authors: Tanja Roth, Frank Sundermeyer Copyright 2006 2014 Novell, Inc. and contributors. All rights reserved. Licensed under
docs.openstack.org OpenStack Installation Guide for Red Hat Enterprise Linux, CentOS, and Fedora (2013-06-11) Copyright 2012, 2013 OpenStack Foundation All rights reserved. The OpenStack system has several
Using SUSE Cloud to Orchestrate Multiple Hypervisors and Storage at ADP Agenda ADP Cloud Vision and Requirements Introduction to SUSE Cloud Overview Whats New VMWare intergration HyperV intergration ADP
Guide to the LBaaS plugin ver. 1.0.2 for Fuel Load Balancing plugin for Fuel LBaaS (Load Balancing as a Service) is currently an advanced service of Neutron that provides load balancing for Neutron multi
UNIVERSITY OF AMSTERDAM Moving SNE to the Cloud RP1 Report Sudesh Jethoe 30-12-2011 * Summary: In this research the OpenStack framework is used to build a private, public and hybrid cloud for the System
Introduction to OpenStack Carlo Vallati PostDoc Reseracher Dpt. Information Engineering University of Pisa firstname.lastname@example.org Cloud Computing - Definition Cloud Computing is a term coined to refer
Best Practices Guide www.suse.com SUSE Cloud Installation: Best Practices Using a SMT, Xen and Ceph Storage Environment Written by B1 Systems GmbH Table of Contents Introduction...3 Use Case Overview...3
vrealize Operations Management Pack for This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more
KVM, OpenStack, and the Open Cloud Adam Jollans, IBM & Mike Kadera, Intel CloudOpen Europe - October 13, 2014 13Oct14 Open VirtualizaGon Alliance 1 Agenda A Brief History of VirtualizaGon KVM Architecture
rackspace.com/cloud/private Rackspace Private Cloud Installation (2014-11-21) Copyright 2014 Rackspace All rights reserved. This documentation is intended for users who want to install Rackspace Private
10 th International Conference on Software Testing June 18 21, 2013 at Bangalore, INDIA by Sowmya Krishnan, Senior Software QA Engineer, Citrix Copyright: STeP-IN Forum and Quality Solutions for Information
OpenStack Neutron Outline Why Neutron? What is Neutron? API Abstractions Plugin Architecture Why Neutron? Networks for Enterprise Applications are Complex. Image from windowssecurity.com Why Neutron? Reason
Building a Cloud Computing Platform based on Open Source Software 10. 18. 2011. Donghoon Kim ( email@example.com ) Yoonbum Huh ( firstname.lastname@example.org) Topics I.Open Source SW and Cloud Computing II. About OpenStack
CS312 Solutions #6 March 13, 2015 Solutions 1. (1pt) Define in detail what a load balancer is and what problem it s trying to solve. Give at least two examples of where using a load balancer might be useful,
Release Notes for Fuel and Fuel Web Version 3.0.1 June 21, 2013 1 Mirantis, Inc. is releasing version 3.0.1 of the Fuel Library and Fuel Web products. This is a cumulative maintenance release to the previously
Postgres on OpenStack Dave Page 18/9/2014 2014 EnterpriseDB Corporation. All rights reserved. 1 Introduction PostgreSQL: Core team member pgadmin lead developer Web/sysadmin teams PGCAC/PGEU board member
Greek Research and Technology Network Internal Presentation 59 Delivering IaaS for the Greek Academic and Research Community Vangelis Koukis email@example.com ki Technical Coordinator, okeanos Project Greek
Best Practices Guide www.suse.com SUSE Cloud Installation: Best Practices Using an Existing SMT and KVM Environment Written by B1 Systems GmbH Table of Contents Introduction...3 Use Case Overview...3 Hardware
CloudStack 3.0.0 Release Notes For CloudStack Version 3.0.0 Revised March 22, 2012 2:19 PM Pacific 2011, 2012 Citrix Systems, Inc. All rights reserved. Specifications are subject to change without notice.
w w w. u l t i m u m t e c h n o l o g i e s. c o m Infrastructure-as-a-Service on the OpenStack platform http://www.ulticloud.com http://www.openstack.org Introduction to OpenStack 1. What OpenStack is
SUSE Cloud Deployment Guide Questionnaire This document is a starting point for a SUSE Cloud implementation. Use this document as a guide to help you prepare for deployment and as a worksheet as you discuss
Bern University of Applied Sciences Engineering and Information Technology Module I-7410 Advanced Linux FS-11 Part1: Virtualization with KVM By Franz Meyer Version 1.0 February 2011 Virtualization Architecture
OpenStack Orgad Kimchi Principal Software Engineer Oracle ISV Engineering 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following is intended to outline
Getting Started with OpenStack and VMware vsphere TECHNICAL MARKETING DOCUMENTATION V 0.1/DECEMBER 2013 Table of Contents Introduction.... 3 1.1 VMware vsphere.... 3 1.2 OpenStack.... 3 1.3 Using OpenStack
Virtual Datacenter or Virtualization in the datacenter (OpenStack)! Larry Rudolph A merge of several public presentations Rackspace & NASA started it off, and OpenStack has grown dramatically All possible
SYNNEFO: A COMPLETE CLOUD PLATFORM OVER GOOGLE GANETI WITH OPENSTACK APIs VANGELIS KOUKIS, TECH LEAD, SYNNEFO 1 Synnefo cloud platform An all-in-one cloud solution Written from scratch in Python Manages
UNIVERSITY OF TARTU FACULTY OF MATHEMATICS AND COMPUTER SCIENCE Institute of Computer Science Valdur Kadakas Establishing Scientific Computing Clouds on Limited Resources using OpenStack Bachelor Thesis
Architecture des plates-formes IaaS Etat des lieux et perspectives Frédéric Dang Tran Orange Labs Joint CompatibleOne and OSCi workshop, 7 June 2011 1 Outline > Scope and objectives > User-facing API and
Openstack Cloud computing with Openstack Saverio Proto firstname.lastname@example.org Lugano, 23/03/2016 Agenda SWITCH role in Openstack and Cloud Computing What is Virtualization? Why is Cloud computing more
Infrastructure as a Service Jose Castro Leon CERN IT/OIS Cloud Computing On-Demand Self-Service Scalability and Efficiency Resource Pooling Rapid elasticity 2 Infrastructure as a Service Objectives 90%
OpenStack Towards a fully open cloud Thierry Carrez Release Manager, OpenStack Cloud? Why we need open source IaaS A cloud building block Emergence of a standard Eliminate cloud vendor lock-in Enable federation
SUSE Cloud 5 www.suse.com February 20, 2015 OpenStack End User Guide OpenStack End User Guide Abstract OpenStack is an open-source cloud computing platform for public and private clouds. A series of interrelated
rackspace.com/cloud/private Rackspace Private Cloud (2014-03-31) Copyright 2014 Rackspace All rights reserved. This guide is intended to assist Rackspace customers in downloading and installing Rackspace
1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.
US HEADQUARTERS Mountain View, CA 615 National Ave., Suite 100 Mountain View, CA 94043 +1-650-963-9828 Phone +1-650-963-9723 Fax Mirantis OpenStack 6 with VMware vcenter and NSX Mirantis Reference Architecture
KVM, OpenStack and the Open Cloud SUSECon November 2015 Adam Jollans Program Director, Linux & Open Virtualization Strategy IBM Agenda A Brief History of Virtualization KVM Architecture OpenStack Architecture
OpenStack & Hyper-V Alessandro Pilo- CEO Cloudbase Solu.ons @cloudbaseit Cloudbase Solutions Company started in Italy as.net / Linux interop dev and consulting Branch started in Timisoara in 2012 to hire
Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The
Building a big IaaS cloud with Apache CloudStack David Nalley PMC Member Apache CloudStack Member, Apache Software Foundation email@example.com Twitter: @ke4qqq New slides at: http://s.apache.org/bigiaas
RED HAT INFRASTRUCTURE AS A SERVICE OVERVIEW AND ROADMAP Andrew Cathrow Red Hat, Inc. Wednesday, June 12, 2013 SERVICE MODELS / WORKLOADS TRADITIONAL WORKLOADS Stateful VMs: Application defined in VM Application
What s New In OpenStack Havana Webcast October 2013 Introduction Nick Chase Technical Product Marketing With 20+ years' experience as a developer and author, Nick has written several books and hundreds
Rebecca Brenton Partner Alliances Manager Rob Hirschfeld Principal Cloud Architect Session Hashtags #chefconf #openstack About the Solution: http://dell.com/openstack http://dell.com/crowbak Iron Chef:
Desktop virtualization using SaaS Architecture Pranit U. Patil, Pranav S. Ambavkar, Dr.B.B.Meshram, Prof. Varshapriya VJTI, Matunga, Mumbai, India. firstname.lastname@example.org Abstract - Desktop virtualization
version 7.0 Contents Preface 1 Intended Audience 1 Documentation History 1 Introduction to Mirantis OpenStack and Fuel 2 System Requirements 3 Fuel Master Node Hardware Recommendations 3 Target Node Server
Open Source Networking for Cloud Data Centers Gaetano Borgione Distinguished Engineer @ PLUMgrid April 2015 1 Agenda Open Source Clouds with OpenStack Building Blocks of Cloud Networking Tenant Networks
docs.openstack.org OpenStack Cloud Administrator Guide current (2015-05-01) Copyright 2013-2015 OpenStack Foundation Some rights reserved. OpenStack offers open source software for cloud administrators
An Intro to OpenStack Ian Lawson Senior Solution Architect, Red Hat email@example.com What is OpenStack? What is OpenStack? Fully open source cloud operating system Comprised of several open source sub-projects
Cloud Optimize Your IT Windows Server 2012 The information contained in this presentation relates to a pre-release product which may be substantially modified before it is commercially released. This pre-release
Cloud Models and Platforms Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF A Working Definition of Cloud Computing Cloud computing is a model
Unified Storage for Cloud Infrastructure Nicolas Trangez Jordan Pittier Björn Schuberg Contents Introduction... 1 About OpenStack... 1 About Scality... 2 Services...3 OpenStack Swift...3 Architecture...4
EL / LAK (FOSS) 2010 May 14th, 2010 Deployment of Private, Hybrid & Public Clouds with OpenNebula University Complutense of Madrid The Anatomy of an IaaS Cloud Deployment of Private, Hybrid & Public Clouds
~OKEANOS: A LARGE EUROPEAN PUBLIC CLOUD BASED ON SYNNEFO. VANGELIS KOUKIS, TECHNICAL LEAD, ~OKEANOS 1 Fact 1 NRENs and Europe need to decide on how to deliver cloud services Brokering between 3 rd party
Comparison and Evaluation of Open-source Cloud Management Software SRIVATSAN JAGANNATHAN Masters Degree Project Stockholm, Sweden XR-EE-LCN 2012:008 Comparison and Evaluation of Open-source Cloud Management
OpenStack Awareness Session Affan A. Syed Director Engineering, PLUMgrid Inc. Pakistan Telecommunication Authority, Oct 20 th, 2015 PLUMgrid s Mission Deliver comprehensive virtual networking solutions
Getting Started with HP Helion OpenStack Using the Virtual Cloud Installation Method 1 What is OpenStack Cloud Software? A series of interrelated projects that control pools of compute, storage, and networking
Preparation Guide v3.0 BETA How to prepare your environment for an OnApp Cloud v3.0 (beta) deployment. Document version 1.0 Document release date 25 th September 2012 document revisions 1 Contents 1. Overview...
The /KVM Hypervisor Understanding what's powering your virtual machine Dr. David Alan Gilbert firstname.lastname@example.org 2015-10-14 Topics Hypervisors and where /KVM sits Components of a virtual machine KVM Devices:
ProphetStor ProphetStor Federator Runbook for Mirantis FUEL 4.1 Revision 078282014 P r o p h e t S t o r Federator Installation and Configuration Guide V1 1 Figure... 2 Table... 2 Copyright & Legal Trademark