Avoiding Pain Running MySQL in the Cloud

Size: px
Start display at page:

Download "Avoiding Pain Running MySQL in the Cloud"

Transcription

1 ! Avoiding Pain Running MySQL in the Cloud Neil Armitage

2 whoami DBA Oracle/Mainframes/MySQL (25 Years) Deployment Continuent 1 or 2 Customer Deployments/Week On Premise or Cloud deployments Developer for Cloud Operations and Continuent 2

3 Quick Continuent Facts Largest Tungsten installation processes over 700 million transactions daily on 225 terabytes of data Tungsten Replicator was application of the year at the 2011 MySQL User Conference Wide variety of topologies including MySQL, Oracle, Vertica, and MongoDB are in production now MySQL to Hadoop deployments are now in progress with multiple customers

4 Aims Make you think 4

5 Aims Make you think Make you question 5

6 Aims Make you think Make you question Make you discuss 6

7 Aims Make you think Make you question Make you discuss Learn from our mistakes 7

8 Why Cloud Everyone wants servers now. Waiting months to provision a database environment is no longer acceptable. The business would have failed before new physical servers could be provisioned. Initial capital outlay is low - long term cost can be higher. Less internal skills are required to maintain and deploy servers. 8

9 Before Cloud Came Along (a year or so ago) 9

10 On-premise/Colo deployments Raise a project Get Approval Order hardware Rack and cable hardware Connect to network Install Operating System Connect to SAN 10

11 11

12 Cloud deployments Enter credit card number call API nova boot --image centos6-x86_64 --flavor m1.large db1 nova boot --image centos6-x86_64 --flavor m1.large db2 nova boot --image centos6-x86_64 --flavor m1.large db3! ec2-run-instances ami-xxxxx -k ${EC2_KEYPAIR} -t m1.large ec2-run-instances ami-xxxxx -k ${EC2_KEYPAIR} -t m1.large ec2-run-instances ami-xxxxx -k ${EC2_KEYPAIR} -t m1.large! 12

13 13

14 What is the Cloud? 14

15 Cloud Providers Public Clouds Amazon AWS Google Cloud RackSpace HP Cloud Many others On Premise Clouds VMware Openstack 15

16 Where is a cloud server located? Oregon (3 AZ) California (3 AZ) Northern Virginia (5 AZ) Ireland (3 AZ) Tokyo (3 AZ) Singapore (2 AZ) Sao Paulo (2 AZ) Sydney (2 AZ) 16

17 AWS Availability Zones Availability Zone Availability Zone Availability Zone Availability Zone Availability Zone Region Region 17

18 Why is working in the Cloud Different? 18

19 Where is my server? db1 db2 db3 Provision 3 nodes DB1->DB3 19

20 Where is my server? db1 db3 db2 EC2 Server A EC2 Server B 20

21 Where is my server? db3 EC2 Server B Server A has died 21

22 Where is your data? 22

23 Where is your data? X 23

24 Where is your data? X X 24

25 Where is your data? X X X 25

26 Networking in the Cloud Can be unreliable Where it is? What it is? Security? IP s can change 26

27 High Availability 27

28 High Availability - On Premise Ensure servers in different Racks Redundant Power Redundant Network Redundant Disk Backup Server in DR location Redundant network between Datacenters 28

29 High Availability - Cloud 29

30 Cloud Environments Fail 30

31 Cloud Environments Fail 31

32 Cloud Environments Fail 32

33 Cloud Deployment Options - Simple Separate Nodes across AZ s Slave Master Availability Zone 1B Availability Zone 1C S3 Backups Region US-EAST-1 33

34 Cloud Deployment Options - Better Separate Nodes across AZ s and Regions Slave Master Slave Availability Zone Availability Zone 1B 1C S3 Backups Region US-EAST-1 Availability Zone 1C Region S3 Backups US-WEST-1 34

35 Cloud Deployment Options - Even Better Separate Nodes across Providers Slave S3 Backups Slave Master Availability Zone 1C Availability Zone 1B S3 Backups Region Availability Zone 1C Region US-WEST-1 US-EAST-1 Slave Rackspace Cloud Backups 35

36 What to think about Need to consider locations Have more nodes than you would with on premise Nodes can just disappear or stop functioning Spain cluster has had an issue this afternoon - the current master DB has dropped off the network/out of AWS 36

37 What to think about Plan for and expect node failures Don t assume that you will be able to quickly provision new nodes. Take plenty of backups (S3 costs only $100/ month to store 1TB) Expect a few bad nodes poor cpu performance poor disk performance throw them away - shoot them VS 37

38 Running Databases in the Cloud 38

39 AWS Relational Database Service (RDS) MySQL, Oracle, SQL Service Read Slaves Multi-AZ deployments Simple to set up and use 39

40 AWS Relational Database Service (RDS) AWS Only Limited options for replicating data out Very limited options for replicating in Slow failover with AZ s (10 mins +) 40

41 Trove MySQL Only Single Node No Replication Used by Openstack/Rackspace/HP Cloud 41

42 Google Cloud Google only Synchronous and asynchronous replication Across DC s? 42

43 How we deploy clusters (in the cloud) 43

44 Deploying in the Cloud Automate everything Puppet allows us to work across clouds No need to maintain AMI s/images just use a standard o/s images masterless puppet to ensure we don t have a SPOF Our install tools work across multi-nodes in parallel Heavy use of vagrant with AWS plugin for demos and POC installs 44

45 Need to setup secure connections OpenVPN Need multiple servers to avoid a SPOF Software We now support secure connections Between DB s Between Apps and DB s 45

46 Best Practices RAID EBS Volumes (RAID1) Backups xtrabackup (backed up into S3) EBS Snapshot ec2- consistent- snapshot \ --mysql --freeze-filesystem /vol \ --region eu-west-1 \ --description "$(hostanme) RAID snapshot $(date +'%Y-%m- %d %H:%M:%S')" \ vol-1f9a6446 vol-649a643d Use VPC s and fixed networks 46

47 Best Practices Monitoring Nagios / Opsview Zabbix Alerts New Relic 47

48 Lesson Learnt EC2 Instances fail One of anything is never enough Don t assume you can spin up more resources instantly Think multi-cloud, public/private Resources are disposable - throw away and rebuild if needed 48

49 Lesson Learnt Monitor everything Automate as much as possible Backup everything (twice) 49

50 Questions 50

51 560 S. Winchester Blvd., Suite 500 San Jose, CA Tel +1 (866) Fax +1 (408) Our Blogs: Continuent Website: Tungsten Replicator: 51

Deploying Database clusters in the Cloud

Deploying Database clusters in the Cloud Deploying Database clusters in the Cloud Neil Armitage - Continuent whoami 2 DBA Oracle/Mainframes/MySQL (25 Years) Deployment Engineer for Continuent Developer for Cloud Operations and Deployments @ Continuent

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Using ArcGIS for Server in the Amazon Cloud Randall Williams, Esri Subrat Bora, Esri Esri UC 2014 Technical Workshop Agenda What is ArcGIS for Server on Amazon Web Services Sounds good! How much does it

More information

High-Availability in the Cloud Architectural Best Practices

High-Availability in the Cloud Architectural Best Practices 1 High-Availability in the Cloud Architectural Best Practices Josh Fraser, VP Business Development, RightScale Brian Adler, Sr. Professional Services Architect 2 # RightScale World s #1 cloud management

More information

19.10.11. Amazon Elastic Beanstalk

19.10.11. Amazon Elastic Beanstalk 19.10.11 Amazon Elastic Beanstalk A Short History of AWS Amazon started as an ECommerce startup Original architecture was restructured to be more scalable and easier to maintain Competitive pressure for

More information

Future-Proofing MySQL for the Worldwide Data Revolution

Future-Proofing MySQL for the Worldwide Data Revolution Future-Proofing MySQL for the Worldwide Data Revolution Robert Hodges, CEO. What is Future-Proo!ng? Future-proo!ng = creating systems that last while parts change and improve MySQL is not losing out to

More information

Agenda. - Introduction to Amazon s Cloud - How ArcGIS users adopt Amazon s Cloud - Why ArcGIS users adopt Amazon s Cloud - Examples

Agenda. - Introduction to Amazon s Cloud - How ArcGIS users adopt Amazon s Cloud - Why ArcGIS users adopt Amazon s Cloud - Examples Amazon Web Services Agenda - Introduction to Amazon s Cloud - How ArcGIS users adopt Amazon s Cloud - Why ArcGIS users adopt Amazon s Cloud - Examples How did Amazon Get into Cloud Computing? On-Premise

More information

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com Cloud Computing with Amazon Web Services and the DevOps Methodology Who am I? Max Manders @maxmanders Systems Developer at Cloudreach @cloudreach Director / Co-Founder of Whisky Web @whiskyweb Who are

More information

Amazon Web Services. 18.11.2015 Yu Xiao

Amazon Web Services. 18.11.2015 Yu Xiao Amazon Web Services 18.11.2015 Yu Xiao Agenda Introduction to Amazon Web Services(AWS) 7 Steps to Select the Right Architecture for Your Web Applications Private, Public or Hybrid Cloud? AWS Case Study

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

MySQL Comes of Age. Robert Hodges Sr. Staff Engineer Percona Live London November 4, 2014. 2014 VMware Inc. All rights reserved.

MySQL Comes of Age. Robert Hodges Sr. Staff Engineer Percona Live London November 4, 2014. 2014 VMware Inc. All rights reserved. MySQL Comes of Age Robert Hodges Sr. Staff Engineer Percona Live London November 4, 2014 2014 VMware Inc. All rights reserved. Continuent is now part of VMware! VMware acquired Continuent on 28 October

More information

Real Time Big Data Processing

Real Time Big Data Processing Real Time Big Data Processing Cloud Expo 2014 Ian Meyers Amazon Web Services Global Infrastructure Deployment & Administration App Services Analytics Compute Storage Database Networking AWS Global Infrastructure

More information

Solving Large-Scale Database Administration with Tungsten

Solving Large-Scale Database Administration with Tungsten Solving Large-Scale Database Administration with Tungsten Neil Armitage, Sr. Software Engineer Robert Hodges, CEO. Introducing Continuent The leading provider of clustering and replication for open source

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Federal GIS Conference February 9 10, 2015 Washington, DC Using ArcGIS for Server in the Amazon Cloud Bonnie Stayer, Esri Amy Ramsdell, Blue Raster Session Outline AWS Overview ArcGIS in AWS Cloud Builder

More information

Expand Your Infrastructure with the Elastic Cloud. Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager

Expand Your Infrastructure with the Elastic Cloud. Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager Expand Your Infrastructure with the Elastic Cloud Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager Today we re going to talk about The Cloud Scenarios Questions You Probably

More information

Deploying for Success on the Cloud: EBS on Amazon VPC. Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012

Deploying for Success on the Cloud: EBS on Amazon VPC. Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012 Deploying for Success on the Cloud: EBS on Amazon VPC Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012 Agenda Amazon AWS Global Infrastructure AWS VirtualPrivateCloud(VPC) Architecture

More information

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Scaling in the Cloud with AWS By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Welcome! Why is this guy talking to us? Please ask questions! 2 What is Scaling anyway? Enabling

More information

Description of Application

Description of Application Description of Application Operating Organization: Coeur d Alene Tribe, Plummer, Idaho Community of Interest: U.S. Indian tribes and their governments; rural governments OS and software requirements: Microsoft

More information

High Performance MySQL Choices in Amazon Web Services: Beyond RDS. Andrew Shieh, SmugMug Operations shandrew @ smugmug.

High Performance MySQL Choices in Amazon Web Services: Beyond RDS. Andrew Shieh, SmugMug Operations shandrew @ smugmug. High Performance MySQL Choices in Amazon Web Services: Beyond RDS Andrew Shieh, SmugMug Operations shandrew @ smugmug.com April 15, 2015 Agenda 2 All about AWS Current RDS alternatives Cloud failures ->

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security For the Period April 1, 2013 March 31, 2014 Ernst & Young LLP Suite 1600 560 Mission Street San Francisco,

More information

Deploying Splunk on Amazon Web Services

Deploying Splunk on Amazon Web Services Copyright 2014 Splunk Inc. Deploying Splunk on Amazon Web Services Simeon Yep Senior Manager, Business Development Technical Services Roy Arsan Senior SoHware Engineer Disclaimer During the course of this

More information

Drupal in the Cloud. Scaling with Drupal and Amazon Web Services. Northern Virginia Drupal Meetup

Drupal in the Cloud. Scaling with Drupal and Amazon Web Services. Northern Virginia Drupal Meetup Drupal in the Cloud Scaling with Drupal and Amazon Web Services Northern Virginia Drupal Meetup 3 Dec 2008 Cast of Characters Eric at The Case Foundation: The Client With typical client challenges Cost:

More information

What is Cloud Computing? Why call it Cloud Computing?

What is Cloud Computing? Why call it Cloud Computing? What is Cloud Computing? Why call it Cloud Computing? 1 Cloud Computing Key Properties Advantages Shift from CAPEX to OPEX Lowers barrier for starting a new business/project Can be cheaper even in the

More information

Running Oracle Applications on AWS

Running Oracle Applications on AWS Running Oracle Applications on AWS Bharath Terala Sr. Principal Consultant Apps Associates LLC June 09, 2014 Copyright 2014. Apps Associates LLC. 1 Agenda About the Presenter About Apps Associates LLC

More information

Build Your Own Performance Test Lab in the Cloud. Leslie Segal Testware Associate, Inc. leslie.segal@testwareinc.com

Build Your Own Performance Test Lab in the Cloud. Leslie Segal Testware Associate, Inc. leslie.segal@testwareinc.com Build Your Own Performance Test Lab in the Cloud Leslie Segal Testware Associate, Inc. leslie.segal@testwareinc.com Problem(s) I was trying to Solve Need more VUs Don t have Tool Times up reschedule test

More information

AWS Performance Tuning

AWS Performance Tuning AWS Performance Tuning Markus Albe @Percona Fernando Ipar @Percona Ryan Lowe @Square PLNY 2012 Amazon Web Services Cloud Formation CloudFront CloudSearch CloudWatch DirectConnect DynamoDB ec2 ElastiCache

More information

Fault-Tolerant Computer System Design ECE 695/CS 590. Putting it All Together

Fault-Tolerant Computer System Design ECE 695/CS 590. Putting it All Together Fault-Tolerant Computer System Design ECE 695/CS 590 Putting it All Together Saurabh Bagchi ECE/CS Purdue University ECE 695/CS 590 1 Outline Looking at some practical systems that integrate multiple techniques

More information

ColdFusion 10 in the Amazon AWS Cloud. Sven Ramuschkat tecracer GmbH

ColdFusion 10 in the Amazon AWS Cloud. Sven Ramuschkat tecracer GmbH ColdFusion 10 in the Amazon AWS Cloud Sven Ramuschkat tecracer GmbH Sven Ramuschkat Focus on Web-Projects - Adobe ColdFusion - Adobe Flash Media Server - Adobe LiveCycle - Adobe Flex, Connect - Java, HTML5,

More information

Design for Failure High Availability Architectures using AWS

Design for Failure High Availability Architectures using AWS Design for Failure High Availability Architectures using AWS Harish Ganesan Co founder & CTO 8KMiles www.twitter.com/harish11g http://www.linkedin.com/in/harishganesan Sample Use Case Multi tiered LAMP/LAMJ

More information

Déployer son propre cloud avec OpenStack. GULL 18.11.2014 François Deppierraz francois.deppierraz@nimag.net

Déployer son propre cloud avec OpenStack. GULL 18.11.2014 François Deppierraz francois.deppierraz@nimag.net Déployer son propre cloud avec OpenStack GULL francois.deppierraz@nimag.net Who Am I? System and Network Engineer Stuck in the Linux world for almost 2 decades Sysadmin who doesn't like to type the same

More information

Cloud Computing For Bioinformatics

Cloud Computing For Bioinformatics Cloud Computing For Bioinformatics Cloud Computing: what is it? Cloud Computing is a distributed infrastructure where resources, software, and data are provided in an on-demand fashion. Cloud Computing

More information

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012) 1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.

More information

TECHNOLOGY WHITE PAPER Jun 2012

TECHNOLOGY WHITE PAPER Jun 2012 TECHNOLOGY WHITE PAPER Jun 2012 Technology Stack C# Windows Server 2008 PHP Amazon Web Services (AWS) Route 53 Elastic Load Balancing (ELB) Elastic Compute Cloud (EC2) Amazon RDS Amazon S3 Elasticache

More information

SkySQL Data Suite. A New Open Source Approach to MySQL Distributed Systems. Serge Frezefond V1212.01

SkySQL Data Suite. A New Open Source Approach to MySQL Distributed Systems. Serge Frezefond V1212.01 SkySQL Data Suite A New Open Source Approach to MySQL Distributed Systems Serge Frezefond V1212.01 Agenda SkySQL Cloud Data Suite Architecture SkySQL Cloud Data Suite on Amazon EC2 Components for automated

More information

HOPS: Hadoop Open Platform-as-a-Service

HOPS: Hadoop Open Platform-as-a-Service HOPS: Hadoop Open Platform-as-a-Service Alberto Lorente, Hamid Afzali, Salman Niazi, Mahmoud Ismail, Kamal Hakimazadeh, Hooman Piero, Jim Dowling jdowling@sics.se Scale Research Laboratory What is Hadoop?

More information

Cloud Databases and Oracle

Cloud Databases and Oracle The following text is partly taken from the Oracle book Middleware and Cloud Computing It is available from Amazon: http://www.amazon.com/dp/0980798000 Cloud Databases and Oracle When designing your cloud

More information

VMware Continuent. Benefits and Configurations TECHNICAL WHITE PAPER

VMware Continuent. Benefits and Configurations TECHNICAL WHITE PAPER Benefits and Configurations TECHNICAL WHITE PAPER Table of Contents What is VMware Continuent?....3 Key benefits....4 High availability (HA), disaster recovery (DR), and continuous operations.... 4 Ease

More information

Alfresco Enterprise on AWS: Reference Architecture

Alfresco Enterprise on AWS: Reference Architecture Alfresco Enterprise on AWS: Reference Architecture October 2013 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 13 Abstract Amazon Web Services (AWS)

More information

Scalable Application. Mikalai Alimenkou http://xpinjection.com 11.05.2012

Scalable Application. Mikalai Alimenkou http://xpinjection.com 11.05.2012 Scalable Application Development on AWS Mikalai Alimenkou http://xpinjection.com 11.05.2012 Background Java Technical Lead/Scrum Master at Zoral Labs 7+ years in software development 5+ years of working

More information

Performance Benchmark for Cloud Databases

Performance Benchmark for Cloud Databases Performance Benchmark for Cloud Databases J.R. Arredondo vjune2013 (updated pricing on 7/15/2013) Contents Summary of the performance benchmark tests Description of the tests Charts and Data! Results of

More information

Cloud Computing. A new kind of developers? Presentation by. Nick Barcet nick.barcet@canonical.com

Cloud Computing. A new kind of developers? Presentation by. Nick Barcet nick.barcet@canonical.com Cloud Computing A new kind of developers? Presentation by Nick Barcet nick.barcet@canonical.com www.canonical.com July 2011 Cloud computing stack Salesforce.com, GoogleDocs, Office, etc... GoogleApps,

More information

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES TABLE OF CONTENTS Introduction... 3 Overview: Delphix Virtual Data Platform... 4 Delphix for AWS... 5 Decrease the

More information

Making Your ColdFusion Apps Highly Available. Brian Klaas Johns Hopkins Bloomberg School of Public Health bklaas@jhsph.

Making Your ColdFusion Apps Highly Available. Brian Klaas Johns Hopkins Bloomberg School of Public Health bklaas@jhsph. Making Your ColdFusion Apps Highly Available Brian Klaas Johns Hopkins Bloomberg School of Public Health bklaas@jhsph.edu @brian_klaas How much downtime can you afford? 99% = 14 minutes/day 99.9% = 1.4

More information

Software- as- a- Service (SaaS) on AWS Business and Architecture Overview

Software- as- a- Service (SaaS) on AWS Business and Architecture Overview Software- as- a- Service (SaaS) on AWS Business and Architecture Overview SaaS and AWS Introduction Software- as- a Service (SaaS) is an application delivery model that enables users to utilize a software

More information

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011 Preparing for the Big Oops! Disaster Recovery Sites for Robert Hodges, CEO, Continuent Conference 2011 Topics / Introductions / A Motivating Story / Master / Slave Disaster Recovery Replication Tungsten

More information

How AWS Pricing Works

How AWS Pricing Works How AWS Pricing Works (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction... 3 Fundamental

More information

TECHNOLOGY WHITE PAPER Jan 2016

TECHNOLOGY WHITE PAPER Jan 2016 TECHNOLOGY WHITE PAPER Jan 2016 Technology Stack C# PHP Amazon Web Services (AWS) Route 53 Elastic Load Balancing (ELB) Elastic Compute Cloud (EC2) Amazon RDS Amazon S3 Elasticache CloudWatch Paypal Overview

More information

Linas Virbalas Continuent, Inc.

Linas Virbalas Continuent, Inc. Linas Virbalas Continuent, Inc. / Introductions / What is Tungsten? / Architecture of a Rule Based Management Framework for Database Clusters / Demo of Business Rules in Operation / Business Rules in Source

More information

With Eversync s cloud data tiering, the customer can tier data protection as follows:

With Eversync s cloud data tiering, the customer can tier data protection as follows: APPLICATION NOTE: CLOUD DATA TIERING Eversync has developed a hybrid model for cloud-based data protection in which all of the elements of data protection are tiered between an on-premise appliance (software

More information

Big Data Use Case. How Rackspace is using Private Cloud for Big Data. Bryan Thompson. May 8th, 2013

Big Data Use Case. How Rackspace is using Private Cloud for Big Data. Bryan Thompson. May 8th, 2013 Big Data Use Case How Rackspace is using Private Cloud for Big Data Bryan Thompson May 8th, 2013 Our Big Data Problem Consolidate all monitoring data for reporting and analytical purposes. Every device

More information

MANAGE YOUR AMAZON AWS ASSETS USING BOTO

MANAGE YOUR AMAZON AWS ASSETS USING BOTO Who am I? Chirag Jog CTO, Clogeny Technologies - Cloud Computing Experts Python developer Open Source Contributor Linux Test Project, Linux Kernel, boto etc Innovation Execution Solution Delivered MANAGE

More information

AWS Database Migration Service. User Guide Version API Version 2016-01-01

AWS Database Migration Service. User Guide Version API Version 2016-01-01 AWS Database Migration Service User Guide AWS Database Migration Service: User Guide Copyright 2016 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress

More information

Backing up to the Cloud

Backing up to the Cloud Backing up to the Cloud Sean Lim, Director, Cloud Service Providers, APAC sean.lim@netapp.com @rhipecloud #RCCS15 Agenda Backup & Archive to the Cloud Veeam & Steelstore Cloud Service Provider Partners

More information

On- Prem MongoDB- as- a- Service Powered by the CumuLogic DBaaS Platform

On- Prem MongoDB- as- a- Service Powered by the CumuLogic DBaaS Platform On- Prem MongoDB- as- a- Service Powered by the CumuLogic DBaaS Platform Page 1 of 16 Table of Contents Table of Contents... 2 Introduction... 3 NoSQL Databases... 3 CumuLogic NoSQL Database Service...

More information

Lessons Learned from the Movies

Lessons Learned from the Movies Lessons Learned from the Movies October 2013 Adrian Cockcroft @adrianco @NetflixOSS http://www.linkedin.com/in/adriancockcroft Where time to market wins big Making a land-grab Disrupting competitors (OODA)

More information

Introduction to Cloud : Cloud and Cloud Storage. Lecture 2. Dr. Dalit Naor IBM Haifa Research Storage Systems. Dalit Naor, IBM Haifa Research

Introduction to Cloud : Cloud and Cloud Storage. Lecture 2. Dr. Dalit Naor IBM Haifa Research Storage Systems. Dalit Naor, IBM Haifa Research Introduction to Cloud : Cloud and Cloud Storage Lecture 2 Dr. Dalit Naor IBM Haifa Research Storage Systems 1 Advanced Topics in Storage Systems for Big Data - Spring 2014, Tel-Aviv University http://www.eng.tau.ac.il/semcom

More information

Getting Started with Database As a Service on OpenStack

Getting Started with Database As a Service on OpenStack White Paper Getting Started with Database As a Service on OpenStack Today s Database Management Challenges The last decade of computing technologies have been dominated by the proliferation of virtualization

More information

Using Amazon EMR and Hunk to explore, analyze and visualize machine data

Using Amazon EMR and Hunk to explore, analyze and visualize machine data Using Amazon EMR and Hunk to explore, analyze and visualize machine data Machine data can take many forms and comes from a variety of sources; system logs, application logs, service and system metrics,

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security and Availability For the Period April 1, 2015 September 30, 2015 Ernst & Young LLP Suite 1600 560 Mission

More information

High Availability Solutions for MySQL. Lenz Grimmer <lenz@grimmer.com> 2008-08-29 DrupalCon 2008, Szeged, Hungary

High Availability Solutions for MySQL. Lenz Grimmer <lenz@grimmer.com> 2008-08-29 DrupalCon 2008, Szeged, Hungary High Availability Solutions for MySQL Lenz Grimmer 2008-08-29 DrupalCon 2008, Szeged, Hungary Agenda High Availability in General MySQL Replication MySQL Cluster DRBD Links/Tools Why

More information

So What s the Big Deal?

So What s the Big Deal? So What s the Big Deal? Presentation Agenda Introduction What is Big Data? So What is the Big Deal? Big Data Technologies Identifying Big Data Opportunities Conducting a Big Data Proof of Concept Big Data

More information

Designing Apps for Amazon Web Services

Designing Apps for Amazon Web Services Designing Apps for Amazon Web Services Mathias Meyer, GOTO Aarhus 2011 Montag, 10. Oktober 11 Montag, 10. Oktober 11 Me infrastructure code databases @roidrage www.paperplanes.de Montag, 10. Oktober 11

More information

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview Opsview in the Cloud Monitoring with Amazon Web Services Opsview Technical Overview Page 2 Opsview In The Cloud: Monitoring with Amazon Web Services Contents Opsview in The Cloud... 3 Considerations...

More information

ArcGIS for Server: In the Cloud

ArcGIS for Server: In the Cloud DevSummit DC February 11, 2015 Washington, DC ArcGIS for Server: In the Cloud Bonnie Stayer, Esri Session Outline Cloud Overview - Benefits - Types of clouds ArcGIS in AWS - Cloud Builder - Maintenance

More information

OpenStack. Orgad Kimchi. Principal Software Engineer. Oracle ISV Engineering. 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved.

OpenStack. Orgad Kimchi. Principal Software Engineer. Oracle ISV Engineering. 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved. OpenStack Orgad Kimchi Principal Software Engineer Oracle ISV Engineering 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following is intended to outline

More information

Running your Java EE 6 Applications in the Cloud

Running your Java EE 6 Applications in the Cloud Running your Java EE 6 Applications in the Cloud Arun Gupta Oracle blogs.sun.com/arungupta @arungupta The following/preceding is intended to outline our general product direction. It is intended for information

More information

A Most Simple Cloud. Is Amazon RDS for Oracle Right for You? Jeremiah Wilton, Principal Consultant. June, 2014

A Most Simple Cloud. Is Amazon RDS for Oracle Right for You? Jeremiah Wilton, Principal Consultant. June, 2014 A Most Simple Cloud Is Amazon RDS for Oracle Right for You? Jeremiah Wilton, Principal Consultant June, 2014 Jeremiah Wilton wilton@pythian.com @oradebug Working with Oracle since 1994 (v.5) Amazon s first

More information

3rd Party Audited Cloud Infrastructure SOC 1, Type II SOC 2, Type II ISO 27001. Annual 3rd party application Pen Tests.

3rd Party Audited Cloud Infrastructure SOC 1, Type II SOC 2, Type II ISO 27001. Annual 3rd party application Pen Tests. THE BRIGHTIDEA CLOUD INFRASTRUCTURE INTRODUCTION Brightidea s world-class cloud infrastructure is designed and certified to handle the most stringent security, reliability, scalability, and performance

More information

High Availability of VistA EHR in Cloud. ViSolve Inc. White Paper February 2015. www.visolve.com

High Availability of VistA EHR in Cloud. ViSolve Inc. White Paper February 2015. www.visolve.com High Availability of VistA EHR in Cloud ViSolve Inc. White Paper February 2015 1 Abstract Inspite of the accelerating migration to cloud computing in the Healthcare Industry, high availability and uptime

More information

Cloud Computing #8 - Datacenter OS. Johan Eker

Cloud Computing #8 - Datacenter OS. Johan Eker Cloud Computing #8 - Datacenter OS Johan Eker Outline What is a Datacenter OS? OpenStack Kubernetes Resource Management What is an OS? What is an OS? Manage hardware resources such as CPU, RAM, disk, I/O,

More information

Amazon AWS in.net. Presented by: Scott Reed scottr@develop.com

Amazon AWS in.net. Presented by: Scott Reed scottr@develop.com Amazon AWS in.net Presented by: Scott Reed scottr@develop.com Objectives Cloud Computing What Amazon provides Why Amazon Web Services? Q&A Instances Interacting with Instances Management Console Command

More information

Investor Newsletter. Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE?

Investor Newsletter. Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE? Investor Newsletter Storage Made Easy Cloud Appliance High Availability Options WHAT IS THE CLOUD APPLIANCE? The SME Cloud Appliance is a software platform that enables companies to enhance their existing

More information

Storage Options in the AWS Cloud

Storage Options in the AWS Cloud Storage Options in the AWS Cloud Joseph G. Baron, Principal Solutions Architect Storage in the Amazon Cloud Tools to access services Cross Service features Platform building blocks Infrastructure building

More information

Last time. Today. IaaS Providers. Amazon Web Services, overview

Last time. Today. IaaS Providers. Amazon Web Services, overview Last time General overview, motivation, expected outcomes, other formalities, etc. Please register for course Online (if possible), or talk to Yvonne@CS Course evaluation forgotten Please assign one volunteer

More information

Building Fault-Tolerant Applications on AWS October 2011

Building Fault-Tolerant Applications on AWS October 2011 Building Fault-Tolerant Applications on AWS October 2011 Jeff Barr, Attila Narin, and Jinesh Varia 1 Contents Introduction... 3 Failures Shouldn t be THAT Interesting... 3 Amazon Machine Images... 4 Elastic

More information

Using The Hortonworks Virtual Sandbox

Using The Hortonworks Virtual Sandbox Using The Hortonworks Virtual Sandbox Powered By Apache Hadoop This work by Hortonworks, Inc. is licensed under a Creative Commons Attribution- ShareAlike3.0 Unported License. Legal Notice Copyright 2012

More information

Cloud & DevOps Program Big Group. March 13, 2015 Friday 2:00-3:00 p.m. Science Center Hall A

Cloud & DevOps Program Big Group. March 13, 2015 Friday 2:00-3:00 p.m. Science Center Hall A Cloud & DevOps Program Big Group March 13, 2015 Friday 2:00-3:00 p.m. Science Center Hall A Agenda Program Update (10 min) General Accomplishments Wave 1 Overview Schedule Minimum Viable Product Cloud

More information

Pierre Riteau University of Chicago

Pierre Riteau University of Chicago Infrastructure Clouds for Science and Educa3on: Infrastructure Cloud Offerings Pierre Riteau University of Chicago 12/11/2012 NIMBUS 1 IaaS Clouds Multitude of IaaS providers available Most are following

More information

Application Security Best Practices. Matt Tavis Principal Solutions Architect

Application Security Best Practices. Matt Tavis Principal Solutions Architect Application Security Best Practices Matt Tavis Principal Solutions Architect Application Security Best Practices is a Complex topic! Design scalable and fault tolerant applications See Architecting for

More information

Zadara Storage Cloud A whitepaper. @ZadaraStorage

Zadara Storage Cloud A whitepaper. @ZadaraStorage Zadara Storage Cloud A whitepaper @ZadaraStorage Zadara delivers two solutions to its customers: On- premises storage arrays Storage as a service from 31 locations globally (and counting) Some Zadara customers

More information

GigaSpaces Real-Time Analytics for Big Data

GigaSpaces Real-Time Analytics for Big Data GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and

More information

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity P3 InfoTech Solutions Pvt. Ltd http://www.p3infotech.in July 2013 Created by P3 InfoTech Solutions Pvt. Ltd., http://p3infotech.in 1 Web Application Deployment in the Cloud Using Amazon Web Services From

More information

Traditional v/s CONVRGD

Traditional v/s CONVRGD Traditional v/s CONVRGD Traditional Virtualization Stack Converged Virtualization Infrastructure with HCE/HSE Data protection software applications PDU Backup Servers + Virtualization Storage Switch HA

More information

Disaster Recovery to the Cloud

Disaster Recovery to the Cloud Disaster Recovery to the Cloud 3 December 2014 Copyright 2014 Arcserve (USA), LLC and its affiliates and subsidiaries. All rights reserved. Prepared & Presented by Andrew Martin CEO Asia Online Publishing

More information

Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud

Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud Use case Figure 1: Company C Architecture (Before Migration) Company C is an automobile insurance claim processing company with

More information

Running Oracle on the Amazon Cloud

Running Oracle on the Amazon Cloud Running Oracle on the Amazon Cloud Bryan Stroble RMOUG Training Days February 7, 2014 Oracle Experts, Easy to Work With Oracle experts Oracle Database Technology Consulting Oracle E-Business Suite Applications

More information

CLOUD COMPUTING WITH AWS An INTRODUCTION. John Hildebrandt Solutions Architect ANZ

CLOUD COMPUTING WITH AWS An INTRODUCTION. John Hildebrandt Solutions Architect ANZ CLOUD COMPUTING WITH AWS An INTRODUCTION John Hildebrandt Solutions Architect ANZ AGENDA Todays Agenda Background and Value proposition of AWS Global infrastructure and the Sydney Region AWS services Drupal

More information

Developing Plugins for Cloud Scale

Developing Plugins for Cloud Scale Developing Plugins for Cloud Scale Who I am? 2 Who I am? I am? Oscar Sanjuan Engineering Director Email: oscar@elasticbox.com Twitter: twitter.com/elasticbox Blog: elasticbox.com/blog What does Elasticbox?

More information

StoneFly SCVM TM for ESXi

StoneFly SCVM TM for ESXi StoneFly TM for ESXi Add StoneFly Storage Concentrator Virtual Machine () to your VMware ESXi Server and the possibilities are endless! Reduce your CapEx and OpEx by optimized utilization of servers and

More information

Database Usage in the Public and Private Cloud: Choices and Preferences

Database Usage in the Public and Private Cloud: Choices and Preferences Database Usage in the Public and Private Cloud: Choices and Preferences What Early Adopters Are Saying ebook Introduction Organizations depend on their databases to process transactions and access the

More information

Implementing and Managing Windows Server 2008 Clustering

Implementing and Managing Windows Server 2008 Clustering Implementing and Managing Windows Server 2008 Clustering Course Number: 6423A Course Length: 3 Days Course Overview This instructor-led course explores Windows Server 2008 clustering and provides students

More information

Supercharge your MySQL application performance with Cloud Databases

Supercharge your MySQL application performance with Cloud Databases Supercharge your MySQL application performance with Cloud Databases J.R. Arredondo Director Product Marketing Kelly Goolsby Sales Engineering Manager Daniel Morris Senior Product Manager Dave Fowler Founder

More information

Postgres on OpenStack

Postgres on OpenStack Postgres on OpenStack Dave Page 18/9/2014 2014 EnterpriseDB Corporation. All rights reserved. 1 Introduction PostgreSQL: Core team member pgadmin lead developer Web/sysadmin teams PGCAC/PGEU board member

More information

www.boost ur skills.com

www.boost ur skills.com www.boost ur skills.com AWS CLOUD COMPUTING WORKSHOP Write us at training@boosturskills.com BOOSTURSKILLS No 1736 1st Amrutha College Road Kasavanhalli,Off Sarjapur Road,Bangalore-35 1) Introduction &

More information

Every Silver Lining Has a Vault in the Cloud

Every Silver Lining Has a Vault in the Cloud Irvin Hayes Jr. Autodesk, Inc. PL6015-P Don t worry about acquiring hardware and additional personnel in order to manage your Vault software installation. Learn how to spin up a hosted server instance

More information

What is Cloud Computing? Tackling the Challenges of Big Data. Tackling The Challenges of Big Data. Matei Zaharia. Matei Zaharia. Big Data Collection

What is Cloud Computing? Tackling the Challenges of Big Data. Tackling The Challenges of Big Data. Matei Zaharia. Matei Zaharia. Big Data Collection Introduction What is Cloud Computing? Cloud computing means computing resources available on demand Resources can include storage, compute cycles, or software built on top (e.g. database as a service)

More information

Appendix A Core Concepts in SQL Server High Availability and Replication

Appendix A Core Concepts in SQL Server High Availability and Replication Appendix A Core Concepts in SQL Server High Availability and Replication Appendix Overview Core Concepts in High Availability Core Concepts in Replication 1 Lesson 1: Core Concepts in High Availability

More information

Cloud Computing: Making the right choices

Cloud Computing: Making the right choices Cloud Computing: Making the right choices Kalpak Shah Clogeny Technologies Pvt Ltd 1 About Me Kalpak Shah Founder & CEO, Clogeny Technologies Passionate about economics and technology evolving through

More information

Cloud Computing Now and the Future Development of the IaaS

Cloud Computing Now and the Future Development of the IaaS 2010 Cloud Computing Now and the Future Development of the IaaS Quanta Computer Division: CCASD Title: Project Manager Name: Chad Lin Agenda: What is Cloud Computing? Public, Private and Hybrid Cloud.

More information

Best Practices for Using MySQL in the Cloud

Best Practices for Using MySQL in the Cloud Best Practices for Using MySQL in the Cloud Luis Soares, Sr. Software Engineer, MySQL Replication, Oracle Lars Thalmann, Director Replication, Backup, Utilities and Connectors THE FOLLOWING IS INTENDED

More information