Why the Datacenter needs an Operating System. Dr. Bernd Mathiske Senior Software Architect Mesosphere
|
|
- Briana Booth
- 8 years ago
- Views:
Transcription
1 Why the Datacenter needs an Operating System 1 Dr. Bernd Mathiske Senior Software Architect Mesosphere
2 Bringing Google-Scale Computing to Everybody
3 A Slice of Google Tech Transfer History 2005: MapReduce -> Hadoop (Yahoo) 2007: Linux cgroups for lightweight isolation (Google) 2009: BigTable -> MongoDB 2009: The Datacenter as a Computer - Barroso, Hölzle (Google) 2009: Mesos - a distributed operating system kernel (UC Berkeley) 2010: Large scale production Mesos deployment (Twitter) since 2010: Many more frameworks and quite a few meta-frameworks
4 Notable Operating System Developments Single-something => multi-something: user, tasking, threading, core, More: bits, memory, storage, bandwidth OS virtualization => lightweight virtualization (cgroups, LXCs, jails, ) Packaging => containers (docker, rkt, lmctfy, ) Static libraries => dynamic libraries => static libraries 4
5 Cluster Operating Systems (Hardware Clustering) Researched since the 1980s Trying to provide (the illusion of) a single system image Aiming at HA, load balancing, location transparency (e.g. for storage) Many systems: Amoeba, ChorusOS, GLUnix, Hurricane, MOSIX, Plan9, RHCS, Spring, Sprite, Sumo, QNX, Solaris MC, UnixWare, VAXclusters, Relatively low scale (up to 100s of nodes) Complicated to manage, less dynamic than software clustering 5
6 From HPC Grid to Enterprise Cloud Condor, LSF, Maui, Moab, Quartz, SLURM, Typically for batch jobs Also cover services => SOA => more job schedulers => grid computing => grid middleware => cloud stacks 6
7 From Server Virtualization to App Aggregation App App App App Virtualization Server App Aggregation Serv Serv Serv Serv Client-Server Era: Small apps, big servers Cloud Era: Big apps, small servers
8 Cloud Computing SaaS: Salesforce demonstrated success, then many followed PaaS: Deis, Dotcloud, OpenShift, Heroku, Pivotal, Stackato, IaaS: AWS, Azure, DigitalOcean, GCE Private cloud stacks including IaaS: Eucalyptus, CloudStack, Joyent, OpenStack, SmartCloud, vsphere, 8
9 Datacenter A facility used to house computer systems and associated components (e.g. networking, storage, cooling, sensors) In this talk we focus on how to manage and use a single production cluster of networked computers in a datacenter Such clusters range in size from 10s to 10000s of nodes Why should we and how can we end up with just one production cluster? 9
10 Datacenter Services LAMP (Linux, Apache, MSQL, PHP) or similar MEAN (MongoDB, Express.js, Angular.js, Node.js) or similar Cassandra, ElasticSearch, Exelixi, Hadoop, Hypertable, Jenkins, Kafka, MPI, Spark, Storm, SSSP, Torque, Private PaaS: Deis, 10
11 Operate your Laptop like your Datacenter?
12 From Static Partitioning to Elastic Sharing Static Partitioning 100% WASTED WASTED WASTED WEB CACHE HADOOP 100% Elastic Sharing HADOOP WEB FREE FREE CACHE
13 Software Clustering Layer between node OS and application frameworks Scale Multi-tenancy High availability
14 Available Open Source Components 2-level scheduler: Apache Mesos Meta-frameworks / schedulers: Aurora, Chronos, Marathon, Kubernetes, Swarm, Service discovery: Consul, HAProxy, Mesos DNS, Highly available configuration: zk, etcd, Storage: HDFS, Ceph, Node OSs: lots of Linux variants 14 Lots of app frameworks: Sparc, Storm, Cassandra, Kafka,
15 2-Level Scheduling Scale: from 1 node to at least 10000s of nodes Optimizing resource management End-to-end principle: application-specific functions ought to reside in the end nodes of a network rather than intermediary nodes -> Requirement for general multi-tenancy -> Requirement for having only one production cluster 15
16 How Mesos Works App Executor Task Framework Scheduler Master Slave Task Executor 16 zk/etcd Master Master Master Task Task
17 Ways to Run an Application 1. Vanilla job Employ meta-framework for invocation: Chronos, Aurora, Kubernetes, 2. Application of an adapted framework Hadoop, Sparc, Storm, ElasticSearch, Cassandra, Kafka, many more 3. Non-adapted services Employ meta-framework for invocation: Marathon, Aurora, Kubernetes, Provide (select) a service discovery solution 4. Program your own scheduler (and executor) 17
18 The Mesos Framework API Currently like internal Mesos communication: protobuf messages over HTTP Soon: JSON messages over HTTP (stream) => no need to link with binary Mesos library and/or less to reimplement ca. a dozen programming languages => any language 18
19 How to implement a framework Scheduler interface: 1 half of 2-level scheduling The framework knows best when to do what with what kind of resources About a dozen callbacks, main functionality in 2 of them: - receive resource offers - receive task status updates Executor interface: task life-cycle management and monitoring Command line executor included in Mesos Docker executor included in Mesos 19 Custom executors often not needed
20 Scheduler SPI (implemented by Framework) public interface Scheduler { void registered(schedulerdriver driver, FrameworkID frameworkid, MasterInfo masterinfo); void reregistered(schedulerdriver driver, MasterInfo masterinfo); void resourceoffers(schedulerdriver driver, List<Offer> offers); void offerrescinded(schedulerdriver driver, OfferID offerid); void statusupdate(schedulerdriver driver, TaskStatus status); void frameworkmessage(schedulerdriver driver, ExecutorID executorid, SlaveID slaveid, byte[] data); void disconnected(schedulerdriver driver); void slavelost(schedulerdriver driver, SlaveID slaveid); 20 void executorlost(schedulerdriver driver, ExecutorID executorid, SlaveID slaveid, int status); } void error(schedulerdriver driver, String message);
21 Minimal Scheduler Implementation class MyFrameworkScheduler implements Scheduler { private TaskGenerator _taskgen; public void resourceoffers(schedulerdriver driver, List<Offer> offers) { if (_taskgen.donecreatingtasks()) { for (offer : offers) { driver.declineoffer(offer.getid()); } } else { for (offer : offers) { List<TaskInfo> taskinfos = _taskgen.generatetaskinfos(offer); driver.launchtasks(offer.getid(), taskinfos, _filters); } } } 21 } public void statusupdate(schedulerdriver driver, TaskStatus status) { _taskgen.observetaskstatusupdate(taskstatus); if (_taskgen.done()) { driver.stop(); } }
22 The Developer s Perspective Focus on application logic, not datacenter structure Avoid networking-related code Reuse of built-in fault-tolerance and high availability Reuse distributed (infrastructure) frameworks (e.g., storage) => API, SDK for datacenter services 22
23 The Operations Engineer s Perspective Ease of deployment/management Uniformity of deployment/management Hardware utilization rate Scaling up as business grows Scaling out sporadically Cost and time for moving to a different datacenter High availability and fault-tolerance of system services Monitoring Trouble shooting 23
24 Necessary Multi-Tenancy Features Task containerization Resource isolation Resource and task attributes Static and dynamic resource reservations Reservation levels Meta-frameworks Dynamic scheduler update and reconfiguration 24 Security
25 Desirable Multi-Tenancy Features Optimistic offers Oversubscription Task preemption, migration, resizing, reconfiguration Rate limiting Auto-scaling => hybrid cloud Infrastructure frameworks 25
26 Using Docker Containers in Mesos 26 Mesos Master Server init + mesos-master + marathon 1 When a user requests a container Docker Registry Mesos, LXC, and Docker are tied together for launch Mesos Slave Server init + docker 8 + lxc + (user task, under container init system) 4 + mesos-slave + /var/lib/mesos/executors/docker + docker run 5
27 Other Schedulers as Meta-Frameworks in a 2-level Scheduler YARN => Kubernetes => Swarm => Swarm on Mesos (new project) => run everything in one cluster 27
28 Myriad : Virtual YARN Clusters on Mesos POST /api/clusters: Registers a new YARN GET /api/clusters: Lists all registered clusters GET /api/clusters/{clusterid}: Lists the cluster with {clusterid} PUT /api/clusters/{clusterid}/flexup: Expands the size of cluster with {clusterid} 1. Launch NodeManager PUT /api/clusters/{clusterid}/flexdown: Shrinks the size of cluster with {clusterid} DELETE /api/clusters/{clusterid}: Unregisters YARN cluster with {clusterid}. Also, kills all the nodes. Mesos YARN Master 1 Myriad Scheduler RM flexup CPU 2.0 GB Node Mesos 28 Slave 1 Myriad Executor 1 YARN NM C1 C2 2.5 CPU 2.5 GB
29 29 Kubernetes in Mesos
30 Portability Framework Apps Vanilla Apps Infrastructure Frameworks Meta-Frameworks Mesos 30 Public Cloud Managed Cloud Your Own DC
31 The Application User s Perspective Focus on apps, services, parameters, results Avoid dealing with datacenter operations/management Avoid adjusting system settings High availability Throughput Responsiveness Predictiveness Run everything I need 31 Return on and safety of investment
32 The Datacenter is the new form factor 2-level scheduler => single production cluster scalability and portability => avoiding hardware/cloud lock-in built-in container support => running containers at scale automation => operator efficiency repositories => apps/services readily available API and SDK => productive/quick app/service development 32
33 Above the Clouds with Open Source! 33
The Virtualization Practice
The Virtualization Practice White Paper: Managing Applications in Docker Containers Bernd Harzog Analyst Virtualization and Cloud Performance Management October 2014 Abstract Docker has captured the attention
More informationRED HAT CONTAINER STRATEGY
RED HAT CONTAINER STRATEGY An introduction to Atomic Enterprise Platform and OpenShift 3 Gavin McDougall Senior Solution Architect AGENDA Software disrupts business What are Containers? Misconceptions
More informationCloudCenter Full Lifecycle Management. An application-defined approach to deploying and managing applications in any datacenter or cloud environment
CloudCenter Full Lifecycle Management An application-defined approach to deploying and managing applications in any datacenter or cloud environment CloudCenter Full Lifecycle Management Page 2 Table of
More informationMesos: A Platform for Fine- Grained Resource Sharing in Data Centers (II)
UC BERKELEY Mesos: A Platform for Fine- Grained Resource Sharing in Data Centers (II) Anthony D. Joseph LASER Summer School September 2013 My Talks at LASER 2013 1. AMP Lab introduction 2. The Datacenter
More informationWhy Does CA Platform Use OpenShift?
Why Does CA Platform Use OpenShift? The Problem Let s consider an application with a back-end web service. HTTP The service could be Tomcat serving HTML, Jetty serving OData, Node.js serving plain REST
More informationYARN Apache Hadoop Next Generation Compute Platform
YARN Apache Hadoop Next Generation Compute Platform Bikas Saha @bikassaha Hortonworks Inc. 2013 Page 1 Apache Hadoop & YARN Apache Hadoop De facto Big Data open source platform Running for about 5 years
More informationOne click Hadoop clusters - anywhere
One click Hadoop clusters - anywhere Janos Matyas, Senior Director of Engineering October, Page 1 2015 Overview Page 2 Introduction Goals and motivations Technology stack How it works Results/achievements/future
More informationCloud Computing #8 - Datacenter OS. Johan Eker
Cloud Computing #8 - Datacenter OS Johan Eker Outline What is a Datacenter OS? OpenStack Kubernetes Resource Management What is an OS? What is an OS? Manage hardware resources such as CPU, RAM, disk, I/O,
More informationSacha Dubois RED HAT TRENDS AND TECHNOLOGY PATH TO AN OPEN HYBRID CLOUD AND DEVELOPER AGILITY. Solution Architect Infrastructure
RED HAT TRENDS AND TECHNOLOGY PATH TO AN OPEN HYBRID CLOUD AND DEVELOPER AGILITY Sacha Dubois Solution Architect Infrastructure sadubois@redhat.com 13. März 2015 - Seite 1 / 25 I.T. CHALLENGES 13. März
More informationMODERN ENTERPRISE APPS OPERATIONS WITH DC/OS
MODERN ENTERPRISE APPS OPERATIONS WITH DC/OS Lessons from Running Containers, Microservices, and Stateful Big Data Services in Production WHITE PAPER Table of Contents Executive Summary... 3 A New Battlefront
More informationDevOps. Josh Preston Solutions Architect Stardate 69094.1
DevOps Josh Preston Solutions Architect Stardate 69094.1 I keep hearing about DevOps What is it? FOR MANY ORGANIZATIONS, WHAT IS I.T. LIKE TODAY? WATERFALL AND SILOS Application Version X DEVELOPMENT OPERATIONS
More informationAPP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS
APP DEVELOPMENT ON THE CLOUD MADE EASY WITH PAAS This article looks into the benefits of using the Platform as a Service paradigm to develop applications on the cloud. It also compares a few top PaaS providers
More informationPaaS - Platform as a Service Google App Engine
PaaS - Platform as a Service Google App Engine Pelle Jakovits 14 April, 2015, Tartu Outline Introduction to PaaS Google Cloud Google AppEngine DEMO - Creating applications Available Google Services Costs
More informationPrivate Cloud Management
Private Cloud Management Speaker Systems Engineer Unified Data Center & Cloud Team Germany Juni 2016 Agenda Cisco Enterprise Cloud Suite Two Speeds of Applications DevOps Starting Point into PaaS Cloud
More informationCloud Computing. Adam Barker
Cloud Computing Adam Barker 1 Overview Introduction to Cloud computing Enabling technologies Different types of cloud: IaaS, PaaS and SaaS Cloud terminology Interacting with a cloud: management consoles
More informationCloud computing - Architecting in the cloud
Cloud computing - Architecting in the cloud anna.ruokonen@tut.fi 1 Outline Cloud computing What is? Levels of cloud computing: IaaS, PaaS, SaaS Moving to the cloud? Architecting in the cloud Best practices
More informationThe State of Containers and the Docker Ecosystem: 2015. Anna Gerber
The State of Containers and the Docker Ecosystem: 2015 Anna Gerber The State of Containers and the Docker Ecosystem: 2015 by Anna Gerber Copyright 2015 O Reilly Media, Inc. All rights reserved. Printed
More informationSriram Krishnan, Ph.D. sriram@sdsc.edu
Sriram Krishnan, Ph.D. sriram@sdsc.edu (Re-)Introduction to cloud computing Introduction to the MapReduce and Hadoop Distributed File System Programming model Examples of MapReduce Where/how to run MapReduce
More informationRED HAT CLOUD SUITE FOR APPLICATIONS
RED HAT CLOUD SUITE FOR APPLICATIONS DATASHEET AT A GLANCE Red Hat Cloud Suite: Provides a single platform to deploy and manage applications. Offers choice and interoperability without vendor lock-in.
More informationCloud Computing: Making the right choices
Cloud Computing: Making the right choices Kalpak Shah Clogeny Technologies Pvt Ltd 1 About Me Kalpak Shah Founder & CEO, Clogeny Technologies Passionate about economics and technology evolving through
More informationA Complete Open Cloud Storage, Virt, IaaS, PaaS. Dave Neary Open Source and Standards, Red Hat
A Complete Open Cloud Storage, Virt, IaaS, PaaS Dave Neary Open Source and Standards, Red Hat 1 Agenda 1. Traditional virtualization 2. The move to IaaS 3. Storage 4. PaaS, application encapsulation and
More informationYARN, the Apache Hadoop Platform for Streaming, Realtime and Batch Processing
YARN, the Apache Hadoop Platform for Streaming, Realtime and Batch Processing Eric Charles [http://echarles.net] @echarles Datalayer [http://datalayer.io] @datalayerio FOSDEM 02 Feb 2014 NoSQL DevRoom
More informationPrivate Clouds with Open Source
Private Clouds with Open Source GridKa School 2010 KIT September 7 th 2010 Christian Baun baun@kit.edu http://www.kit.edu Cloud-Computing? Building on compute and storage virtualization, and leveraging
More informationCloud Computing an introduction
Prof. Dr. Claudia Müller-Birn Institute for Computer Science, Networked Information Systems Cloud Computing an introduction January 30, 2012 Netzprogrammierung (Algorithmen und Programmierung V) Our topics
More informationOpenShift and Cloud Foundry PaaS: High-level Overview of Features and Architectures
OpenShift and Cloud Foundry PaaS: High-level Overview of Features and Architectures by Alexander Lomov, R&D Engineer at Altoros 2 Table of Contents: 1. Executive Summary... 3 2. The History of OpenShift
More informationAn Architecture Vision
An Architecture Vision Universal Cloud Communications Stack Cloud Telecom. Software that turns communications into a service. 1 Software Architecture That Matters Universal Cloud Communications Stack (UCCS),
More informationJava PaaS Enabling CI, CD, and DevOps
Java PaaS Enabling CI, CD, and DevOps AuthX Overview Who We Are? Digital Engagement Company offering Technical and Marketing Services with proven success supporting Fortune 1000 companies. We partner with
More informationDeveloping Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control
Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control EP/K006487/1 UK PI: Prof Gareth Taylor (BU) China PI: Prof Yong-Hua Song (THU) Consortium UK Members: Brunel University
More informationCUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS. Review Business and Technology Series www.cumulux.com
` CUMULUX WHICH CLOUD PLATFORM IS RIGHT FOR YOU? COMPARING CLOUD PLATFORMS Review Business and Technology Series www.cumulux.com Table of Contents Cloud Computing Model...2 Impact on IT Management and
More informationDistributed Scheduling with Apache Mesos in the Cloud. PhillyETE - April, 2015 Diptanu Gon Choudhury @diptanu
Distributed Scheduling with Apache Mesos in the Cloud PhillyETE - April, 2015 Diptanu Gon Choudhury @diptanu Who am I? Distributed Systems/Infrastructure Engineer in the Platform Engineering Group Design
More informationCertified Cloud Computing Professional VS-1067
Certified Cloud Computing Professional VS-1067 Certified Cloud Computing Professional Certification Code VS-1067 Vskills Cloud Computing Professional assesses the candidate for a company s cloud computing
More informationCloud/SaaS enablement of existing applications
Cloud/SaaS enablement of existing applications GigaSpaces: Nati Shalom, CTO & Founder About GigaSpaces Technologies Enabling applications to run a distributed cluster as if it was a single machine 75+
More informationContainerization and the PaaS Cloud
VIRTUALIZATION ization and the PaaS Cloud Claus Pahl, Irish Centre for Cloud Computing and Commerce Platform-as-a-service clouds can use containers to manage and orchestrate applications. This article
More informationBig Data Trends and HDFS Evolution
Big Data Trends and HDFS Evolution Sanjay Radia Founder & Architect Hortonworks Inc Page 1 Hello Founder, Hortonworks Part of the Hadoop team at Yahoo! since 2007 Chief Architect of Hadoop Core at Yahoo!
More informationAssignment # 1 (Cloud Computing Security)
Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual
More informationLinux A first-class citizen in Windows Azure. Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise
Linux A first-class citizen in Windows Azure Bruno Terkaly bterkaly@microsoft.com Principal Software Engineer Mobile/Cloud/Startup/Enterprise 1 First, I am software developer (C/C++, ASM, C#, Java, Node.js,
More information6.S897 Large-Scale Systems
6.S897 Large-Scale Systems Instructor: Matei Zaharia" Fall 2015, TR 2:30-4, 34-301 bit.ly/6-s897 Outline What this course is about" " Logistics" " Datacenter environment What this Course is About Large-scale
More informationCloud Computing 159.735. Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009
Cloud Computing 159.735 Submitted By : Fahim Ilyas (08497461) Submitted To : Martin Johnson Submitted On: 31 st May, 2009 Table of Contents Introduction... 3 What is Cloud Computing?... 3 Key Characteristics...
More informationOpen Cloud System. (Integration of Eucalyptus, Hadoop and AppScale into deployment of University Private Cloud)
Open Cloud System (Integration of Eucalyptus, Hadoop and into deployment of University Private Cloud) Thinn Thu Naing University of Computer Studies, Yangon 25 th October 2011 Open Cloud System University
More informationHDP Hadoop From concept to deployment.
HDP Hadoop From concept to deployment. Ankur Gupta Senior Solutions Engineer Rackspace: Page 41 27 th Jan 2015 Where are you in your Hadoop Journey? A. Researching our options B. Currently evaluating some
More informationCisco Application-Centric Infrastructure (ACI) and Linux Containers
White Paper Cisco Application-Centric Infrastructure (ACI) and Linux Containers What You Will Learn Linux containers are quickly gaining traction as a new way of building, deploying, and managing applications
More information24/11/14. During this course. Internet is everywhere. Frequency barrier hit. Management costs increase. Advanced Distributed Systems Cloud Computing
Advanced Distributed Systems Cristian Klein Department of Computing Science Umeå University During this course Treads in IT Towards a new data center What is Cloud computing? Types of Clouds Making applications
More informationCloud Computing Summary and Preparation for Examination
Basics of Cloud Computing Lecture 8 Cloud Computing Summary and Preparation for Examination Satish Srirama Outline Quick recap of what we have learnt as part of this course How to prepare for the examination
More informationappscale: open-source platform-level cloud computing
: open-source platform-level cloud computing I2 Joint Techs February 2 nd, 2010 Chandra Krintz Computer Science Dept. Univ. of California, Santa Barbara cloud computing Remote access to distributed and
More informationApache Stratos Building a PaaS using OSGi and Equinox. Paul Fremantle CTO and Co- Founder, WSO2 CommiCer, Apache Stratos
Apache Stratos Building a PaaS using OSGi and Equinox Paul Fremantle CTO and Co- Founder, WSO2 CommiCer, Apache Stratos @pzfreo #wso2 #apache paul@wso2.com pzf@apache.org 1 About me CTO and Co- Founder
More informationWhat Is It? Business Architecture Research Challenges Bibliography. Cloud Computing. Research Challenges Overview. Carlos Eduardo Moreira dos Santos
Research Challenges Overview May 3, 2010 Table of Contents I 1 What Is It? Related Technologies Grid Computing Virtualization Utility Computing Autonomic Computing Is It New? Definition 2 Business Business
More informationHow Bigtop Leveraged Docker for Build Automation and One-Click Hadoop Provisioning
How Bigtop Leveraged Docker for Build Automation and One-Click Hadoop Provisioning Evans Ye Apache Big Data 2015 Budapest Who am I Apache Bigtop PMC member Software Engineer at Trend Micro Develop Big
More informationUse Cases for Docker in Enterprise Linux Environment CloudOpen North America, 2014 Linda Wang Sr. Software Engineering Manager Red Hat, Inc.
Use Cases for Docker in Enterprise Linux Environment CloudOpen North America, 2014 Linda Wang Sr. Software Engineering Manager Red Hat, Inc. 1 2 Containerize! 3 Use Cases for Docker in the Enterprise Linux
More informationCloud Computing Training
Cloud Computing Training TechAge Labs Pvt. Ltd. Address : C-46, GF, Sector 2, Noida Phone 1 : 0120-4540894 Phone 2 : 0120-6495333 TechAge Labs 2014 version 1.0 Cloud Computing Training Cloud Computing
More informationOpenShift Enterprise PaaS by Red Hat. Andrey Markelov RHCA Red Hat, Presales Solution Architect andrey@redhat.com
OpenShift Enterprise PaaS Red Hat Andrey Markelov RHCA Red Hat, Presales Solution Architect andrey@redhat.com 1 Cloud Service Models IaaS PaaS SaaS APPLICATION APPLICATION PLATFORM (JBOSS, PHP, RUBY, ETC)
More informationViswanath Nandigam Sriram Krishnan Chaitan Baru
Viswanath Nandigam Sriram Krishnan Chaitan Baru Traditional Database Implementations for large-scale spatial data Data Partitioning Spatial Extensions Pros and Cons Cloud Computing Introduction Relevance
More informationHadoop: Embracing future hardware
Hadoop: Embracing future hardware Suresh Srinivas @suresh_m_s Page 1 About Me Architect & Founder at Hortonworks Long time Apache Hadoop committer and PMC member Designed and developed many key Hadoop
More informationBuilding a Kubernetes Cluster with Ansible. Patrick Galbraith, ATG Cloud Computing Expo, NYC, May 2016
Building a Kubernetes Cluster with Ansible Patrick Galbraith, ATG Cloud Computing Expo, NYC, May 2016 HPE ATG HPE's (HP Enterprise) Advanced Technology Group for Open Source and Cloud embraces a vision
More informationOracle Applications and Cloud Computing - Future Direction
Oracle Applications and Cloud Computing - Future Direction February 26, 2010 03:00 PM 03:40 PM Presented By Subash Krishnaswamy skrishna@astcorporation.com Vijay Tirumalai vtirumalai@astcorporation.com
More informationA Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)
1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.
More informationDocker : devops, shared registries, HPC and emerging use cases. François Moreews & Olivier Sallou
Docker : devops, shared registries, HPC and emerging use cases François Moreews & Olivier Sallou Presentation Docker is an open-source engine to easily create lightweight, portable, self-sufficient containers
More informationCloud Essentials for Architects using OpenStack
Cloud Essentials for Architects using OpenStack Course Overview Start Date 18th December 2014 Duration 2 Days Location Dublin Course Code SS906 Programme Overview Cloud Computing is gaining increasing
More informationBig Data Analytics - Accelerated. stream-horizon.com
Big Data Analytics - Accelerated stream-horizon.com Legacy ETL platforms & conventional Data Integration approach Unable to meet latency & data throughput demands of Big Data integration challenges Based
More informationDistributed Cloud Computing Platform as a Service (PaaS) Analysis and Recommendations
Distributed Cloud Computing Platform as a Service (PaaS) Analysis and Recommendations OGF 34, 14 March 2012 www.r2ad.com Michael V. Behrens CTO, R2AD, LLC David Moolenaar VP West Cost, R2AD LLC Eugene
More informationDevOps Course Content
DevOps Course Content INTRODUCTION TO DEVOPS What is DevOps? History of DevOps Dev and Ops DevOps definitions DevOps and Software Development Life Cycle DevOps main objectives Infrastructure As A Code
More informationNetworks and Services
Networks and Services Dr. Mohamed Abdelwahab Saleh IET-Networks, GUC Fall 2015 TOC 1 Infrastructure as a Service 2 Platform as a Service 3 Software as a Service Infrastructure as a Service Definition Infrastructure
More informationScalable Architecture on Amazon AWS Cloud
Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect
More informationThere's Plenty of Room in the Cloud
There's Plenty of Room in the Cloud [Shameless reference to Feynman s talk from 1959] Lecturer: Zoran Dimitrijevic Altiscale, Inc. Spring 2015 CS290B -- Cloud Computing 50 Years of Moore
More informationA Very Brief Introduction To Cloud Computing. Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman
A Very Brief Introduction To Cloud Computing Jens Vöckler, Gideon Juve, Ewa Deelman, G. Bruce Berriman What is The Cloud Cloud computing refers to logical computational resources accessible via a computer
More informationEXECUTIVE GUIDE WHY THE MODERN DATA CENTER NEEDS AN OPERATING SYSTEM
EXECUTIVE GUIDE WHY THE MODERN DATA CENTER NEEDS AN OPERATING SYSTEM TABLE OF CONTENTS 2 6 8 12 21 30 Why your modern data center needs an operating system What is a data center operating system and how
More informationGigaSpaces Real-Time Analytics for Big Data
GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and
More informationHow To Understand Cloud Computing
Overview of Cloud Computing (ENCS 691K Chapter 1) Roch Glitho, PhD Associate Professor and Canada Research Chair My URL - http://users.encs.concordia.ca/~glitho/ Overview of Cloud Computing Towards a definition
More informationJenkins Slave Cloud with Apache Mesos. Klaus Azesberger Reinhard Kiesswetter Infonova GmbH
Jenkins Cloud with Apache Mesos Klaus Azesberger Reinhard Kiesswetter Infonova GmbH Agenda Our Jenkins Reasons to adopt our approach Pains of a static slave cloud Live Demo of setup and common ops use
More informationData Centers and Cloud Computing. Data Centers
Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises
More informationUniversity of Magdeburg
University of Magdeburg Faculty of Computer Science Bachelor Thesis Evaluation of an Architecture for a Scaling and Self-Healing Virtualization System Author: Patrick Wuggazer March 06, 2015 Advisors:
More informationBuilding Out Your Cloud-Ready Solutions. Clark D. Richey, Jr., Principal Technologist, DoD
Building Out Your Cloud-Ready Solutions Clark D. Richey, Jr., Principal Technologist, DoD Slide 1 Agenda Define the problem Explore important aspects of Cloud deployments Wrap up and questions Slide 2
More informationIBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud
IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain
More informationopenshift enterprise whitepaper Gordon Haff
openshift enterprise whitepaper The Road to Enterprise PaaS Gordon Haff EXECUTIVE SUMMARY Platform-as-a-Service (PaaS) provides an abstraction that makes developers more productive by helping them focus
More informationHadoop. MPDL-Frühstück 9. Dezember 2013 MPDL INTERN
Hadoop MPDL-Frühstück 9. Dezember 2013 MPDL INTERN Understanding Hadoop Understanding Hadoop What's Hadoop about? Apache Hadoop project (started 2008) downloadable open-source software library (current
More informationSoftware Defined Everything
Software Defined Everything, s, Containers, and Storage Pete Chadwick Senior Product Manager pchadwick@suse.com Joachim Werner Senior Product Manager joe@suse.com Data Center History - 1970s One (big)
More informationSoftware as a Service (SaaS) and Platform as a Service (PaaS) (ENCS 691K Chapter 1)
Roch Glitho, PhD Software as a Service (SaaS) and Platform as a Service (PaaS) (ENCS 691K Chapter 1) Associate Professor and Canada Research Chair My URL - http://users.encs.concordia.ca/~glitho/ Software
More informationApache Ignite TM (Incubating) - In- Memory Data Fabric Fast Data Meets Open Source
Apache Ignite TM (Incubating) - In- Memory Data Fabric Fast Data Meets Open Source DMITRIY SETRAKYAN Founder, PPMC http://www.ignite.incubator.apache.org #apacheignite Agenda Apache Ignite (tm) In- Memory
More informationUnit 10b: Introduction to Cloud Computing
ESIR SR Unit 10b: Introduction to Cloud Computing François Taïani [http://www.cheswick.com/ches/map/] 1 Session Outline n Defining cloud computing n Related technologies and precursors è Grid è Virtualisation
More informationWindows Azure and private cloud
Windows Azure and private cloud Joe Chou Senior Program Manager China Cloud Innovation Center Customer Advisory Team Microsoft Asia-Pacific Research and Development Group 1 Agenda Cloud Computing Fundamentals
More informationContainerisation and the PaaS Cloud
IEEE CLOUD COMPUTING MAGAZINE [IN PRESS - ACCEPTED FOR PUBLICATION, 6 MAY 2015] 1 Containerisation and the PaaS Cloud Claus Pahl Abstract Containerisation is widely discussed as a lightweight virtualisation
More informationCI Pipeline with Docker 2015-02-27
CI Pipeline with Docker 2015-02-27 Juho Mäkinen, Technical Operations, Unity Technologies Finland http://www.juhonkoti.net http://github.com/garo Overview 1. Scale on how we use Docker 2. Overview on the
More informationOverview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB
Overview of Databases On MacOS Karl Kuehn Automation Engineer RethinkDB Session Goals Introduce Database concepts Show example players Not Goals: Cover non-macos systems (Oracle) Teach you SQL Answer what
More informationStackato PaaS Architecture: How it works and why.
Stackato PaaS Architecture: How it works and why. White Paper Published in 2012 Stackato PaaS Architecture: How it works and why. Stackato is software for creating a private Platform-as-a-Service (PaaS).
More informationCIS 4930/6930 Spring 2014 Introduction to Data Science Data Intensive Computing. University of Florida, CISE Department Prof.
CIS 4930/6930 Spring 2014 Introduction to Data Science Data Intensive Computing University of Florida, CISE Department Prof. Daisy Zhe Wang Cloud Computing and Amazon Web Services Cloud Computing Amazon
More informationHow To Understand Cloud Computing
CSM 002 / Advanced Dist. Sys. Session 2.2 Cloud Computing François Taïani (heavily source from: Cloud computing: stateof-the-art and research challenges, Qi Zhang, Lu Cheng, Raouf Boutaba. J. of Internet
More informationCloud Computing an introduction Netzprogrammierung (Algorithmen und Programmierung V)
Cloud Computing an introduction Netzprogrammierung (Algorithmen und Programmierung V) Our topics today in more detail What is cloud computing - old wine in new bottles? From the first idea to the BIG business.
More informationCloud Computing Trends
UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered
More informationSoftware Defined Whatever @SURFsara RON TROMPERT
Software Defined Whatever @SURFsara RON TROMPERT About SURFsara Supports research in the Netherlands (and abroad) by offering advanced ICT infrastructure, services and expertise National Supercomputer
More informationJAVA IN THE CLOUD PAAS PLATFORM IN COMPARISON
JAVA IN THE CLOUD PAAS PLATFORM IN COMPARISON Eberhard Wolff Architecture and Technology Manager adesso AG, Germany 12.10. Agenda A Few Words About Cloud Java and IaaS PaaS Platform as a Service Google
More informationWhat is Cloud Computing? First, a little history. Demystifying Cloud Computing. Mainframe Era (1944-1978) Workstation Era (1968-1985) Xerox Star 1981!
Demystifying Cloud Computing What is Cloud Computing? First, a little history. Tim Horgan Head of Cloud Computing Centre of Excellence http://cloud.cit.ie 1" 2" Mainframe Era (1944-1978) Workstation Era
More informationData Centers and Cloud Computing
Data Centers and Cloud Computing CS377 Guest Lecture Tian Guo 1 Data Centers and Cloud Computing Intro. to Data centers Virtualization Basics Intro. to Cloud Computing Case Study: Amazon EC2 2 Data Centers
More informationOracle Cloud Computing Strategy
Oracle Cloud Computing Strategy Han Wammes Public Sector Market Development Manager 1 Copyright 2012, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following is intended
More informationIntroduction to Cloud Computing
Discovery 2015: Cloud Computing Workshop June 20-24, 2011 Berkeley, CA Introduction to Cloud Computing Keith R. Jackson Lawrence Berkeley National Lab What is it? NIST Definition Cloud computing is a model
More informationAmazon EC2 Product Details Page 1 of 5
Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of
More informationIskandar Najmuddin. 10 Beaumont Road, London W4 5AP +44 (0) 7949 423 204 jobs@iskandar.co.uk
Iskandar Najmuddin 10 Beaumont Road, London W4 5AP +44 (0) 7949 423 204 jobs@iskandar.co.uk SUMMARY A pragmatic technology leader who believes in building systems to solve business problems. Passionate
More informationLast time. Today. IaaS Providers. Amazon Web Services, overview
Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Yvonne@CS Course evaluation forgotten Please assign one volunteer
More informationSistemi Operativi e Reti. Cloud Computing
1 Sistemi Operativi e Reti Cloud Computing Facoltà di Scienze Matematiche Fisiche e Naturali Corso di Laurea Magistrale in Informatica Osvaldo Gervasi ogervasi@computer.org 2 Introduction Technologies
More informationIntroduction to Cloud Computing
Introduction to Cloud Computing Cloud Computing I (intro) 15 319, spring 2010 2 nd Lecture, Jan 14 th Majd F. Sakr Lecture Motivation General overview on cloud computing What is cloud computing Services
More informationOperating Systems Virtualization mechanisms
Operating Systems Virtualization mechanisms René Serral-Gracià Xavier Martorell-Bofill 1 1 Universitat Politècnica de Catalunya (UPC) May 26, 2014 Contents 1 Introduction 2 Hardware Virtualization mechanisms
More information