Deploying Splunk on Amazon Web Services

Size: px
Start display at page:

Download "Deploying Splunk on Amazon Web Services"

Transcription

1 Copyright 2014 Splunk Inc. Deploying Splunk on Amazon Web Services Simeon Yep Senior Manager, Business Development Technical Services Roy Arsan Senior SoHware Engineer

2 Disclaimer During the course of this presentalon, we may make forward- looking statements regarding future events or the expected performance of the company. We caulon you that such statements reflect our current expectalons and eslmates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward- looking statements, please review our filings with the SEC. The forward- looking statements made in the this presentalon are being made as of the Lme and date of its live presentalon. If reviewed aher its live presentalon, this presentalon may not contain current or accurate informalon. We do not assume any obligalon to update any forward- looking statements we may make. In addilon, any informalon about our roadmap outlines our general product direclon and is subject to change at any Lme without nolce. It is for informalonal purposes only, and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligalon either to develop the features or funclonality described or to include any such feature or funclonality in a future release. 2

3 Amazon Web Services vs. Everyone Else 3

4 ObjecLve: Integrate your Splunk Enterprise deployment with Amazon Web Services (AWS) 4

5 Bios Simeon Yep! 6+ Splunk! Roles in: Support ConsulLng Technical Sales! Currently focused on Partner Ecosystem (including AWS) Roy Arsan! 2+ Splunk! Roles in: Product Engineering Cloud Architecture 5

6 Agenda! Infrastructure: AWS ElasLc Compute Cloud (EC2)! Deployment Examples! How to Deploy: AWS CloudFormaLon! Apps + Other 6

7 AWS EC2 Infrastructure

8 What is this Amazon stuff?! Amazon ElasLc Compute Cloud (EC2) is a web service that provides resizable compute capacity in the cloud! Pay only for capacity that you actually use! Splunk is easily deployed in Amazon 8

9 Splunk and Hardware! Splunk consumes high I/O due to indexing and searching! Load!= GB/day! Search drives a large porlon of the load Rare vs. Sparse vs. ReporLng Real- Lme vs. Historic! Reference servers can index up to 500 GB/day with no search load! Virtualized systems incur some overhead, but work well if tuned correctly 9

10 Typical User Scenario 1. Sign- up for an AWS account (use AWS IAM IdenLty and Access Management) 2. Launch an instance (via user chosen tool such as GUI, CLI, or external) 3. Use key credenlals to access the instance 4. Install SoHware/Splunk 10

11 Instances ü Availability Zones exist within Regions (8 Regions + Gov) ü Amazon Machine Image (AMI) Amazon Linux based Best Performance Cost EffecLve (extra $$ for Windows)

12 Instances! Instance type Pricing: Spot vs. On- demand vs. Reserved Family: Storage vs. Compute vs. GPU vs. Memory vs. General Purpose GeneraLon: Current vs. Previous! Instance size Workload size: compute units, memory, storage Micro, Small, Medium, Large, Extra Large (XL) ê MulLple XL sizes: xlarge, 2xlarge, 4xlarge, 8xlarge 4XL general purpose provides similar performance to a reference server ê GB/day indexing and searching 12

13 Instance Storage! Instances have ephemeral storage (Current Gen has SSDs) General Purpose instances have GBs to TBs Storage OpLmized instances have up to 48 TB! Data is lost when the instance dies! EBS ElasLc Block Storage Persistent block level storage volumes for use with EC2 instances Cost associated 1 TB costs $50/month, 5 TB costs $250/month Data is not lost when instance dies can be remounted with new instance! S3 Simple Storage Service Online cloud storage service (files, data, snapshots, etc ) Need this for backup purposes Can also be used as a data feed for Splunk 13

14 Storage Summary! For single instances or non- replicated distributed deployments: Use EBS volumes in RAID 1+0 for indexes, RAID 0 for OS/soHware SoHware RAID will consume cpu Use snapshots to backup the instance (S3) IOPS oplmized can provide some benefits XFS preferred (customer feedback)! Warming Doesn t have to do with Datacenter temperature Improves first write performance hit NoLceable improvements in performance when performed on ephemeral storage EBS volumes created from snapshots also benefit from warming 14

15 Instance SelecLon! How can I make my deployment resilient? OpLon 1: RAID 1+0 at the storage layer + EBS (was the preferred setup) OpLon 2: Index ReplicaLon OpLon 3: Data Cloning (Index and Forward, HA license required)! Instance seleclon should factor in resiliency, use- case, and cost! Index ReplicaLon FTW (?) Factoring in most common retenlon needs, you may need large EBS volumes and/or double the instances to be resilient (maybe HA license as well) ReplicaLon requires more instances, but does not require EBS IR is driven per instance cost 15

16 ! 1 TB/day deployment example EBS backed storage for availability No replicalon Instance SelecLon 16

17 Instance SelecLon! 1 TB/day deployment cost comparison! Overall Cost is equivalent when EBS retenlon is 211 days (vs. 960)! Index ReplicaLon offers immediate search capability with SF/RF 17

18 Instance SelecLon Distributed Deployments Using Index ReplicaLon (IR)! Local ephemeral storage (SSDs) may perform beuer than EBS! Search/ReplicaLon Factor determines availability of data for searching! IR adds load and requires more servers and storage Using EBS volumes, no IR! Typically fewer instances to manage vs. IR! Search Availability is driven by the capability to remount a volume to a new instance (automalcally or manually)! Cost can be largely driven by retenlon and daily volume 18

19 Best PracLces! Custom AMI crealon Create your own AMI using Linux based or Splunk provided Leverage current configuralon tooling with AMI (don t have to use deployment server, but can be very helpful)! AuthenLcaLon and AuthorizaLon Policies will dictate what you can or cannot use LDAP/AD will require an SSL tunnel Other oplons: scripted input or proxying (SSO) SAML (Okta)! Security SSL everywhere + private network Install your own cerlficates 19

20 ! Search Head Pools Best PracLces! Deploy to the same Availability Zone ReplicaLon and searches across Regions and AZ can be a challenge! Monitor from outside of the Region/AZ Offers addilonal resiliency! Use a Virtual Private Cloud (VPC) 20

21 Best PracLces (Rewrite)! ConfiguraLon and SoHware Management Use the tools you are most familiar with Chef and Puppet content publicly available! Deployment server usage EffecLve for controlling Splunk configuralon (only)! Use Cloud FormaLon Allows for easy and quick deployment Great starlng point for large deployments (See Appendix A) 21

22 General Guidelines Follow Best PracLces for ArchitecLng and Sizing: Load=Searching+Indexing Indexers ( GB/day)! m3.2xlarge 8vcpu, 30 GB RAM! i2.4xlarge 16vcpu, 122 GB RAM! hs1.8xlarge 16vcpu, 117 GB RAM *These are all starlng points! Splunk can index and search more OR less depending on overall load Search Heads (8+ users)! c3.2xlarge 8vcpu, 15 GB RAM! c3.4xlarge 32vcpu, 60 GB RAM Cluster Master or Deployment Server! m3.xlarge 4vcpu, 15 GB RAM! c3.2xlarge 8vcpu, 15 GB RAM License Master! m3.large 2vcpu, 7.5 GB RAM! m3.xlarge 4vcpu, 15 GB RAM 22

23 Architecture & Deployment Examples

24 Architecture Examples! Centralized! Decentralized! Hybrid! Centralized with Index ReplicaLon 24

25 Search Pooling Centralized Topology Indexers Forwarders Intermediate Forwarder Forwarders Syslog Devices 25

26 Decentralized Topology Search Pooling 26

27 Hybrid Topology 27

28 Index Replication with Search Pooling Cluster Master Search Pool Forwarders Peer Nodes 28

29 ! Deployment A! Deployment B Deployment Examples 29

30 Deployment A! Use Case: Searching, ReporLng and AnalyLcs! Capable of GB/day indexing! m3.2xlarge instance High value for cpu (8 vcpu, 30 GB RAM) Previously were using c1.xlarge (8 vcpu, 7 GB RAM)! RAID 1+0 across 4 EBS volumes! 16 concurrent users 30

31 Deployment B! Use Case: ApplicaLon Management, Security Forensics! Capable of 500 GB/day indexing! Distributed deployment with Index ReplicaLon (2 SF, 3 RF)! 3 hs1.8xl instances with 49 TB ephemeral storage (indexers)! c1.xlarge instance (search head)! Leveraging AWS API for instance management 31

32 Deployment B Search Head(s) Cluster Master License Master Indexer Indexer Indexer 32 32

33 Example Architectures Use case and requirements influence final setup, but there is no right or wrong way Using EBS Backed Storage! 20 GB/day m3.2xlarge (single instance)! 100 GB/day m3.2xlarge (single instance)! 300 GB/day m3.2xlarge (3) c3.4xlarge! 500 GB/day m3.2xlarge as indexer (5) c3.4xlarge as search head (1) Using Index ReplicaJon! 100 GB/day m3.2xlarge as indexer (2) c3.2xlarge as search head (1) c3.xlarge as CM/LM! 500 GB/day hs1.8xlarge as indexer (3) c3.8xlarge as search head (1) m3.xlarge as CM/LM 33

34 How To Provision Deployments

35 Cloud Provisioning Tools A Primer Server Provisioning Deployment Provisioning AWS OpsWorks AWS CloudFormation Scalr Terraform! Flexible recipe- based configuralon Configure machine based on role! Fast template- based provisioning Provision & connect resources 35

36 Splunk AWS CloudFormaLon What used to take days to get all configured properly, now I can do in few minutes with Splunk [AWS] CloudFormaLon Abdallah Mohammed, Data Architect, Intuit 36

37 Splunk AWS CloudFormaLon! Open- source self- service tool (no cost associated)! Fast, automated, consistent Splunk deployments on AWS! Available on GitHub: Templates + Tutorial hups://github.com/splunk/splunk- aws- cloudformalon! Splunk Blog: Deploy your own Splunk cluster on AWS in minutes! hup://blogs.splunk.com/2014/05/20/deploy- your- own- splunk- cluster- on- aws- in- minutes/

38 Splunk AWS CloudFormaLon What can Splunk AWS CloudFormaLon do for you?! Accelerates deployment Lme down to minutes! Incorporates Splunk best pracjces for operalons and administralon! Abstracts away details of configuring distributed Splunk! Extensible and customizable templates to fit custom needs 38

39 Sample Architecture Search Head(s) Cluster Master License Master Indexer Indexer Indexer 39 39

40 Deploy Splunk Cluster in < 30 minutes 40

41 Simple User- Friendly Push- Buuon Form 41

42 Demo Time 42

43 QuesLons? 43

44 Contact Simeon Yep Business Development Roy Arsan Engineering 44

45 References! Splunk App for AWS: hup://apps.splunk.com/app/1274/! Hunk App for AWS ELB: hup://apps.splunk.com/app/1731/! Technical Brief: hup://www.splunk.com/web_assets/pdfs/secure/ Splunk_and_Amazon_Web_Services_Tech_Brief.pdf 45

46 References! Blogs: hup://blogs.splunk.com/2012/03/07/splunk- and- aws- sizing- revisited/ hup://blogs.splunk.com/2013/06/06/splunkit- v results- ec2- storage- comparisons/ hup://blogs.splunk.com/2013/07/31/whats- going- on- with- aws- and- splunk/ hup://blogs.splunk.com/2014/05/20/deploy- your- own- splunk- cluster- on- aws- in- minutes/! AMIs Splunk: hups://aws.amazon.com/marketplace/pp/b00gizituo?sr=0-4 Hunk: hups://aws.amazon.com/marketplace/pp/b00gizk2qi?sr=0-2 46

47 THANK YOU

Deploying Splunk on Amazon Web Services

Deploying Splunk on Amazon Web Services Copyright 2015 Splunk Inc. Deploying Splunk on Amazon Web Services Simeon Yep, Strategic Alliances Nate Kwong, Senior SE Bill BartleD, Senior SE Disclaimer During the course of this presentakon, we may

More information

How AWS Pricing Works

How AWS Pricing Works How AWS Pricing Works (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction... 3 Fundamental

More information

How AWS Pricing Works May 2015

How AWS Pricing Works May 2015 How AWS Pricing Works May 2015 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction...

More information

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology. www.cloudreach.com Cloud Computing with Amazon Web Services and the DevOps Methodology Who am I? Max Manders @maxmanders Systems Developer at Cloudreach @cloudreach Director / Co-Founder of Whisky Web @whiskyweb Who are

More information

Cloud Computing and Amazon Web Services

Cloud Computing and Amazon Web Services Cloud Computing and Amazon Web Services Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. An Overview of Cloud Computing 2. Amazon Web Services 3. Amazon EC2 Tutorial 4. Conclusions 2 CLOUD

More information

Amazon Elastic Compute Cloud Getting Started Guide. My experience

Amazon Elastic Compute Cloud Getting Started Guide. My experience Amazon Elastic Compute Cloud Getting Started Guide My experience Prepare Cell Phone Credit Card Register & Activate Pricing(Singapore) Region Amazon EC2 running Linux(SUSE Linux Windows Windows with SQL

More information

Best PracBces: Deploying Splunk on Physical, Virtual, and Cloud Infrastructure

Best PracBces: Deploying Splunk on Physical, Virtual, and Cloud Infrastructure Copyright 2013 Splunk Inc. Best PracBces: Deploying Splunk on Physical, Virtual, and Cloud Infrastructure Sean Blake & Simeon Yep #splunkconf Legal NoBces During the course of this presentabon, we may

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Using ArcGIS for Server in the Amazon Cloud Randall Williams, Esri Subrat Bora, Esri Esri UC 2014 Technical Workshop Agenda What is ArcGIS for Server on Amazon Web Services Sounds good! How much does it

More information

Amazon EC2 Product Details Page 1 of 5

Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of

More information

Smartronix Inc. Cloud Assured Services Commercial Price List

Smartronix Inc. Cloud Assured Services Commercial Price List Smartronix Inc. Assured Services Commercial Price List Smartronix, Inc. 12120 Sunset Hills Road Suite #600, Reston, VA 20190 703-435-3322 cloudassured@smartronix.com www.smartronix.com Table of Contents

More information

Architec:ng and Sizing your Splunk Deployment

Architec:ng and Sizing your Splunk Deployment Copyright 2014 Splunk Inc. Architec:ng and Sizing your Splunk Deployment Simeon Yep Sr. Manager BD Tech Serv, Splunk Karandeep Bains Sr. Sales Engineer, Splunk Disclaimer During the course of this presenta:on,

More information

Copyright 2015 Splunk Inc. Go Big or Go Home. Sean Delaney Specialist SE Mustafa Ahamed Director, Product Management

Copyright 2015 Splunk Inc. Go Big or Go Home. Sean Delaney Specialist SE Mustafa Ahamed Director, Product Management Copyright 2015 Splunk Inc. Go Big or Go Home Sean Delaney Specialist SE Mustafa Ahamed Director, Product Management Agenda! 3 Tier Approach! Design the Forwarding Tier! Design the Indexing Tier! Design

More information

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer

PRIVATE CLOUD. November 6, 2013 Kay Metsker & Dan Mercer PRIVATE CLOUD November 6, 2013 Kay Metsker & Dan Mercer Agenda Deployment Milestones Service Strategy Service Benefits Feature Comparison Future Features Feature Set Matrix Consumption Models Financial

More information

Zadara Storage Cloud A whitepaper. @ZadaraStorage

Zadara Storage Cloud A whitepaper. @ZadaraStorage Zadara Storage Cloud A whitepaper @ZadaraStorage Zadara delivers two solutions to its customers: On- premises storage arrays Storage as a service from 31 locations globally (and counting) Some Zadara customers

More information

19.10.11. Amazon Elastic Beanstalk

19.10.11. Amazon Elastic Beanstalk 19.10.11 Amazon Elastic Beanstalk A Short History of AWS Amazon started as an ECommerce startup Original architecture was restructured to be more scalable and easier to maintain Competitive pressure for

More information

Alfresco Enterprise on AWS: Reference Architecture

Alfresco Enterprise on AWS: Reference Architecture Alfresco Enterprise on AWS: Reference Architecture October 2013 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 13 Abstract Amazon Web Services (AWS)

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Innovation Execution Solution Delivered Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO Clogeny Technologies kalpak@clogeny.com * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php

More information

Introduction to Cloud Computing

Introduction to Cloud Computing Introduction to Cloud Computing Adam Skogman, Jayway Photo by Mark Bonassera Start-up? Overwhelmed? Successful? Waiting for IT? Ease Didn t We Solve This? Flexibility Ease Didn t We Solve This? Web Hotel

More information

Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content

Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content Introduction to Cloud Computing A Short history Client Server Computing Concepts Challenges with Distributed Computing Introduction

More information

Cloud Computing and E-Commerce

Cloud Computing and E-Commerce Cloud Computing and E-Commerce Cloud Computing turns Computing Power into a Virtual Good for E-Commerrce is Implementation Partner of 4FriendsOnly.com Internet Technologies AG VirtualGoods, Koblenz, September

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

Deep Dive: Maximizing EC2 & EBS Performance

Deep Dive: Maximizing EC2 & EBS Performance Deep Dive: Maximizing EC2 & EBS Performance Tom Maddox, Solutions Architect 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved What we ll cover Amazon EBS overview Volumes Snapshots

More information

Description of Application

Description of Application Description of Application Operating Organization: Coeur d Alene Tribe, Plummer, Idaho Community of Interest: U.S. Indian tribes and their governments; rural governments OS and software requirements: Microsoft

More information

ArcGIS for Server in the Amazon Cloud. Michele Lundeen Esri

ArcGIS for Server in the Amazon Cloud. Michele Lundeen Esri ArcGIS for Server in the Amazon Cloud Michele Lundeen Esri What we will cover ArcGIS for Server in the Amazon Cloud Why How Extras Why do you need ArcGIS Server? Some examples Publish - Dynamic Map Services

More information

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain

More information

Oracle Applications and Cloud Computing - Future Direction

Oracle Applications and Cloud Computing - Future Direction Oracle Applications and Cloud Computing - Future Direction February 26, 2010 03:00 PM 03:40 PM Presented By Subash Krishnaswamy skrishna@astcorporation.com Vijay Tirumalai vtirumalai@astcorporation.com

More information

Software AG and the AWS cloud. Past, Present and Best Practices. Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing

Software AG and the AWS cloud. Past, Present and Best Practices. Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing Software AG and the AWS cloud Past, Present and Best Practices Jonathan Madamba Director, Solution Cloud John Fitzgerald Director, Product Marketing Agenda How Software AG Uses The cloud Software AG s

More information

ORACLE ENTERPRISE MANAGER OPS CENTER 12C

ORACLE ENTERPRISE MANAGER OPS CENTER 12C OPS CENTER ORACLE ENTERPRISE MANAGER OPS CENTER 12C KEY FEATURES Automatic discovery of Oracle datacenter assets Automated provisioning of operating environments and firmware Intelligent patching and configuration

More information

SQL Server Virtualization 101. David Klee, Group Principal and Practice Lead. SQL PASS Virtualization VC, 2014.01.08

SQL Server Virtualization 101. David Klee, Group Principal and Practice Lead. SQL PASS Virtualization VC, 2014.01.08 SQL Server Virtualization 101 David Klee, Group Principal and Practice Lead SQL PASS Virtualization VC, 2014.01.08 www.linchpinpeople.com 1 David Klee Group Principal and Practice Lead @kleegeek davidklee.net

More information

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity P3 InfoTech Solutions Pvt. Ltd http://www.p3infotech.in July 2013 Created by P3 InfoTech Solutions Pvt. Ltd., http://p3infotech.in 1 Web Application Deployment in the Cloud Using Amazon Web Services From

More information

Managing MySQL Scale Through Consolidation

Managing MySQL Scale Through Consolidation Hello Managing MySQL Scale Through Consolidation Percona Live 04/15/15 Chris Merz, @merzdba DB Systems Architect, SolidFire Enterprise Scale MySQL Challenges Many MySQL instances (10s-100s-1000s) Often

More information

Part 1: Price Comparison Among The 10 Top Iaas Providers

Part 1: Price Comparison Among The 10 Top Iaas Providers Part 1: Price Comparison Among The 10 Top Iaas Providers Table of Contents Executive Summary 3 Estimating Cloud Spending 3 About the Pricing Report 3 Key Findings 3 The IaaS Providers 3 Provider Characteristics

More information

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with

More information

Microsoft Windows Server Failover Clustering (WSFC) and SQL Server AlwaysOn Availability Groups on the AWS Cloud: Quick Start Reference Deployment

Microsoft Windows Server Failover Clustering (WSFC) and SQL Server AlwaysOn Availability Groups on the AWS Cloud: Quick Start Reference Deployment Microsoft Windows Server Failover Clustering (WSFC) and SQL Server AlwaysOn Availability Groups on the AWS Cloud: Quick Start Reference Deployment Mike Pfeiffer July 2014 Last updated: September 2015 (revisions)

More information

Understanding ArcGIS in Virtualization and Cloud Environments

Understanding ArcGIS in Virtualization and Cloud Environments Esri Middle East and Africa User Conference December 10 12 Abu Dhabi, UAE Understanding ArcGIS in Virtualization and Cloud Environments Marwa Mabrouk Powerful GIS capabilities Delivered as Web services

More information

Microsoft SharePoint Server 2013 on the AWS Cloud: Quick Start Reference Deployment

Microsoft SharePoint Server 2013 on the AWS Cloud: Quick Start Reference Deployment Microsoft SharePoint Server 2013 on the AWS Cloud: Quick Start Reference Deployment Mike Pfeiffer August 2014 Last updated: April 2015 (revisions) Table of Contents Abstract... 3 What We ll Cover... 4

More information

MySQL and Virtualization Guide

MySQL and Virtualization Guide MySQL and Virtualization Guide Abstract This is the MySQL and Virtualization extract from the MySQL Reference Manual. For legal information, see the Legal Notices. For help with using MySQL, please visit

More information

Avoiding Pain Running MySQL in the Cloud

Avoiding Pain Running MySQL in the Cloud ! Avoiding Pain Running MySQL in the Cloud Neil Armitage whoami DBA Oracle/Mainframes/MySQL (25 Years) Deployment Engineer @ Continuent 1 or 2 Customer Deployments/Week On Premise or Cloud deployments

More information

Building an AWS-Compatible Hybrid Cloud with OpenStack

Building an AWS-Compatible Hybrid Cloud with OpenStack Building an AWS-Compatible Hybrid Cloud with OpenStack AWS is Transforming IT Amazon Web Services (AWS) commands a significant lead in the public cloud services market, with revenue estimated to grow from

More information

AWS Performance Tuning

AWS Performance Tuning AWS Performance Tuning Markus Albe @Percona Fernando Ipar @Percona Ryan Lowe @Square PLNY 2012 Amazon Web Services Cloud Formation CloudFront CloudSearch CloudWatch DirectConnect DynamoDB ec2 ElastiCache

More information

THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES

THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES Introduction Amazon Web Services (AWS), which was officially launched in 2006, offers you varying cloud services that are not only cost effective, but also

More information

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect AWS HISTORY About How didamazon Amazon Web Services! Deep experience in building and operating global

More information

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview

Opsview in the Cloud. Monitoring with Amazon Web Services. Opsview Technical Overview Opsview in the Cloud Monitoring with Amazon Web Services Opsview Technical Overview Page 2 Opsview In The Cloud: Monitoring with Amazon Web Services Contents Opsview in The Cloud... 3 Considerations...

More information

Cisco UCS Infrastructure with Docker Datacenter for Container Management

Cisco UCS Infrastructure with Docker Datacenter for Container Management White Paper Cisco UCS Infrastructure with Docker Datacenter for Container Management 2016 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 1 of 16 Contents Solution

More information

High Performance MySQL Choices in Amazon Web Services: Beyond RDS. Andrew Shieh, SmugMug Operations shandrew @ smugmug.

High Performance MySQL Choices in Amazon Web Services: Beyond RDS. Andrew Shieh, SmugMug Operations shandrew @ smugmug. High Performance MySQL Choices in Amazon Web Services: Beyond RDS Andrew Shieh, SmugMug Operations shandrew @ smugmug.com April 15, 2015 Agenda 2 All about AWS Current RDS alternatives Cloud failures ->

More information

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION A DIABLO WHITE PAPER AUGUST 2014 Ricky Trigalo Director of Business Development Virtualization, Diablo Technologies

More information

OTM in the Cloud. Ryan Haney

OTM in the Cloud. Ryan Haney OTM in the Cloud Ryan Haney The Cloud The Cloud is a set of services and technologies that delivers real-time and ondemand computing resources Software as a Service (SaaS) delivers preconfigured applications,

More information

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1.

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1. CONTENTS 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix EXECUTIVE SUMMARY Tenzing Managed IT services has recently partnered with Amazon Web Services

More information

Traditional v/s CONVRGD

Traditional v/s CONVRGD Traditional v/s CONVRGD Traditional Virtualization Stack Converged Virtualization Infrastructure with HCE/HSE Data protection software applications PDU Backup Servers + Virtualization Storage Switch HA

More information

ArcGIS for Server: In the Cloud

ArcGIS for Server: In the Cloud DevSummit DC February 11, 2015 Washington, DC ArcGIS for Server: In the Cloud Bonnie Stayer, Esri Session Outline Cloud Overview - Benefits - Types of clouds ArcGIS in AWS - Cloud Builder - Maintenance

More information

Microsoft Private Cloud Fast Track

Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track Microsoft Private Cloud Fast Track is a reference architecture designed to help build private clouds by combining Microsoft software with Nutanix technology to decrease

More information

Amazon Web Services Student Tutorial

Amazon Web Services Student Tutorial Amazon Web Services Free Usage Tier Elastic Compute Cloud Amazon Web Services Student Tutorial David Palma Joseph Snow CSC 532: Advanced Software Engineering Louisiana Tech University October 4, 2012 Amazon

More information

An Introduction to Cloud Computing Concepts

An Introduction to Cloud Computing Concepts Software Engineering Competence Center TUTORIAL An Introduction to Cloud Computing Concepts Practical Steps for Using Amazon EC2 IaaS Technology Ahmed Mohamed Gamaleldin Senior R&D Engineer-SECC ahmed.gamal.eldin@itida.gov.eg

More information

Gain Insight into Your Cloud Usage with the Splunk App for AWS

Gain Insight into Your Cloud Usage with the Splunk App for AWS Copyright 2013 Splunk Inc. Gain Insight into Your Cloud Usage with the Splunk App for AWS Nilesh Khe

More information

Hadoop & Spark Using Amazon EMR

Hadoop & Spark Using Amazon EMR Hadoop & Spark Using Amazon EMR Michael Hanisch, AWS Solutions Architecture 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda Why did we build Amazon EMR? What is Amazon EMR?

More information

Running Oracle on the Amazon Cloud

Running Oracle on the Amazon Cloud Running Oracle on the Amazon Cloud Bryan Stroble RMOUG Training Days February 7, 2014 Oracle Experts, Easy to Work With Oracle experts Oracle Database Technology Consulting Oracle E-Business Suite Applications

More information

Using ArcGIS for Server in the Amazon Cloud

Using ArcGIS for Server in the Amazon Cloud Federal GIS Conference February 9 10, 2015 Washington, DC Using ArcGIS for Server in the Amazon Cloud Bonnie Stayer, Esri Amy Ramsdell, Blue Raster Session Outline AWS Overview ArcGIS in AWS Cloud Builder

More information

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2 DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing Slide 1 Slide 3 A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet.

More information

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com

Scaling in the Cloud with AWS. By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Scaling in the Cloud with AWS By: Eli White (CTO & Co-Founder @ mojolive) eliw.com - @eliw - mojolive.com Welcome! Why is this guy talking to us? Please ask questions! 2 What is Scaling anyway? Enabling

More information

AWS Cloud for HPC and Big Data

AWS Cloud for HPC and Big Data AWS Cloud for HPC and Big Data David Pellerin, Business Development Principal IDC HPC User Forum September 16, 2014 AWS Regions US West (Oregon) US West (Northern California) GovCloud (ITAR Compliance)

More information

Providing Self-Service, Life-cycle Management for Databases with VMware vfabric Data Director

Providing Self-Service, Life-cycle Management for Databases with VMware vfabric Data Director Providing Self-Service, Life-cycle Management for Databases with VMware vfabric Data Director Graeme Gordon Senior Systems Engineer, VMware 2013 VMware Inc. All rights reserved Traditional IT Application

More information

WE RUN SEVERAL ON AWS BECAUSE WE CRITICAL APPLICATIONS CAN SCALE AND USE THE INFRASTRUCTURE EFFICIENTLY.

WE RUN SEVERAL ON AWS BECAUSE WE CRITICAL APPLICATIONS CAN SCALE AND USE THE INFRASTRUCTURE EFFICIENTLY. WE RUN SEVERAL CRITICAL APPLICATIONS ON AWS BECAUSE WE CAN SCALE AND USE THE INFRASTRUCTURE EFFICIENTLY. - Murari Gopalan Director, Technology Expedia Expedia, a leading online travel company for leisure

More information

Cloud Computing @ UT. Pay-as-you-go computing explained

Cloud Computing @ UT. Pay-as-you-go computing explained Cloud Computing @ UT Pay-as-you-go computing explained Course Overview Cloud Computing @ TU, May 18+25, 2009 2 Acknowledgement and references Cloud Computing @ TU, May 18+25, 2009 3 Outline Players in

More information

Développement logiciel pour le Cloud (TLC)

Développement logiciel pour le Cloud (TLC) Développement logiciel pour le Cloud (TLC) 7. Infrastructure-as-a-Service Guillaume Pierre Université de Rennes 1 Fall 2012 http://www.globule.org/~gpierre/ Développement logiciel pour le Cloud (TLC) 1

More information

Hosting Requirements Smarter Balanced Assessment Consortium Contract 11 Test Delivery System. American Institutes for Research

Hosting Requirements Smarter Balanced Assessment Consortium Contract 11 Test Delivery System. American Institutes for Research Contract 11 Test Delivery System American Institutes for Research Revision History Revision Description Author/Modifier Date Initial Release David Lopez de Quintana October 14, 2013 Updated to latest Amazon

More information

Using WebSphere Application Server on Amazon EC2. Speaker(s): Ed McCabe, Arthur Meloy

Using WebSphere Application Server on Amazon EC2. Speaker(s): Ed McCabe, Arthur Meloy Using WebSphere Application Server on Amazon EC2 Speaker(s): Ed McCabe, Arthur Meloy Cloud Computing for Developers Hosted by IBM and Amazon Web Services October 1, 2009 1 Agenda WebSphere Application

More information

Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud

Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud Migration Scenario: Migrating Backend Processing Pipeline to the AWS Cloud Use case Figure 1: Company C Architecture (Before Migration) Company C is an automobile insurance claim processing company with

More information

A Shared File System on SAS Grid Manger in a Cloud Environment

A Shared File System on SAS Grid Manger in a Cloud Environment A Shared File System on SAS Grid Manger in a Cloud Environment ABSTRACT Ying-ping (Marie) Zhang, Intel Corporation, Chandler, Arizona Margaret Carver, SAS Institute, Cary, North Carolina Gabriele Paciucci,

More information

Matt Tavis Solutions Architect Architectural Design Patterns in Cloud Computing

Matt Tavis Solutions Architect Architectural Design Patterns in Cloud Computing Matt Tavis Solutions Architect mtavis@amazon.com Architectural Design Patterns in Cloud Computing Cloud Best Practices Whitepaper Prescriptive guidance to Cloud Architects Just Search for Cloud Best Practices

More information

AWS Account Setup and Services Overview

AWS Account Setup and Services Overview AWS Account Setup and Services Overview 1. Purpose of the Lab Understand definitions of various Amazon Web Services (AWS) and their use in cloud computing based web applications that are accessible over

More information

Cloud Sure - Virtual Machines

Cloud Sure - Virtual Machines Cloud Sure - Virtual Machines Maximize your IT network The use of Virtualization is an area where Cloud Computing really does come into its own and arguably one of the most exciting directions in the IT

More information

The Journey of Testing with Stubs and Proxies in AWS

The Journey of Testing with Stubs and Proxies in AWS The Journey of Testing with Stubs and Proxies in AWS Lucy Chang lucy_chang@intuit.com Abstract Intuit, a leader in small business and accountants software, is a strong AWS(Amazon Web Services) partner

More information

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES TABLE OF CONTENTS Introduction... 3 Overview: Delphix Virtual Data Platform... 4 Delphix for AWS... 5 Decrease the

More information

Top 5 Reasons to choose Microsoft Windows Server 2008 R2 SP1 Hyper-V over VMware vsphere 5

Top 5 Reasons to choose Microsoft Windows Server 2008 R2 SP1 Hyper-V over VMware vsphere 5 Top 5 Reasons to choose Microsoft Windows Server 2008 R2 SP1 Hyper-V over VMware Published: April 2012 2012 Microsoft Corporation. All rights reserved. This document is provided "as-is." Information and

More information

Amazon RDS for Oracle

Amazon RDS for Oracle Amazon RDS for Oracle Quick Provisioning. Easy Management. Reduced Cost Dhanraj Pondicherry, Sr. Manager Solutions Architecture Amazon Web Services Oct 7 th, 2016 2016, Amazon Web Services, Inc. or its

More information

Running R from Amazon's Elastic Compute Cloud

Running R from Amazon's Elastic Compute Cloud Running R on the Running R from Amazon's Elastic Compute Cloud Department of Statistics University of NebraskaLincoln April 30, 2014 Running R on the 1 Introduction 2 3 Running R on the Pre-made AMI Building

More information

PUBLIC CLOUD USAGE TRENDS

PUBLIC CLOUD USAGE TRENDS PUBLIC CLOUD USAGE TRENDS 450 COMPANIES 165,000 INSTANCES 5.5 PB OF STORAGE FIRST QUARTER 2013 DAVID FEINLEIB UNDERWRITTEN BY thebigdatagroup.com Copyright 2013 The Big Data Group, LLC bigdatalandscape.com

More information

National Center for Education Statistics. Amazon Hosted ESRI ArcGIS Servers Project Final Report

National Center for Education Statistics. Amazon Hosted ESRI ArcGIS Servers Project Final Report Amazon Hosted ESRI ArcGIS Servers Project Final Report Description of Application National Center for Education Statistics Operating Organization The US Department of Education s (ED) The National Center

More information

Hosting Requirements Smarter Balanced Assessment Consortium Contract 11 Test Delivery System. American Institutes for Research

Hosting Requirements Smarter Balanced Assessment Consortium Contract 11 Test Delivery System. American Institutes for Research Contract 11 Test Delivery System American Institutes for Research Revision History Revision Description Author/Modifier Date Initial Release David Lopez de Quintana October 14, 2013 Contents 4 Overview...

More information

Designing Apps for Amazon Web Services

Designing Apps for Amazon Web Services Designing Apps for Amazon Web Services Mathias Meyer, GOTO Aarhus 2011 Montag, 10. Oktober 11 Montag, 10. Oktober 11 Me infrastructure code databases @roidrage www.paperplanes.de Montag, 10. Oktober 11

More information

The High-Performance Cloud Infrastructure Company! 2011 Joyent, Inc. Contains Joyent Restricted Secrets. Not for Public Disclosure. Patents Pending.!

The High-Performance Cloud Infrastructure Company! 2011 Joyent, Inc. Contains Joyent Restricted Secrets. Not for Public Disclosure. Patents Pending.! The High-Performance Cloud Infrastructure Company 2011 Joyent, Inc. Contains Joyent Restricted Secrets. Not for Public Disclosure. Patents Pending. Joyent: The High-Performance Cloud Infrastructure Company

More information

Storage and Disaster Recovery

Storage and Disaster Recovery Storage and Disaster Recovery Matt Tavis Principal Solutions Architect The Business Continuity Continuum High Data Backup Disaster Recovery High, Storage Backup and Disaster Recovery form a continuum of

More information

Enabled by EMC CLARiiON, EMC Replication Manager, and EMC Avamar

Enabled by EMC CLARiiON, EMC Replication Manager, and EMC Avamar EMC Backup and Recovery for VMware Enabled by EMC CLARiiON, EMC Replication Manager, and EMC Avamar EMC Global Solutions Centers EMC Corporation Corporate Headquarters Hopkinton MA 01748-9103 1.508.435.1000

More information

ArcGIS for Server in the Cloud

ArcGIS for Server in the Cloud Esri Developer Summit March 8 11, 2016 Palm Springs, CA ArcGIS for Server in the Cloud Cherry Lin, Nikhil Shampur, and Derek Law March 10, 2016 Quick Survey 1. How many attendees are using the Cloud today?

More information

AWS Storage: Minimizing Costs While Retaining Functionality

AWS Storage: Minimizing Costs While Retaining Functionality AWS Storage: Minimizing Costs While Retaining Functionality This whitepaper, the second in our Cost Series, discusses persistent storage with Amazon Web Services. It will focus upon Elastic Block Store

More information

Kahu Compute: Crush Your Cloud Costs. Kahu Compute. Crush Your Cloud Costs. Lightcrest Kahu Compute 2016 Lightcrest LLC May 2016

Kahu Compute: Crush Your Cloud Costs. Kahu Compute. Crush Your Cloud Costs. Lightcrest Kahu Compute 2016 Lightcrest LLC May 2016 Kahu Compute: Crush Your Cloud Costs Kahu Compute Crush Your Cloud Costs 2 Kahu Highlights This whitepaper will enumerate several key points to empower IT decision makers: 1. Kahu cuts cloud costs upwards

More information

Cloud computing - Architecting in the cloud

Cloud computing - Architecting in the cloud Cloud computing - Architecting in the cloud anna.ruokonen@tut.fi 1 Outline Cloud computing What is? Levels of cloud computing: IaaS, PaaS, SaaS Moving to the cloud? Architecting in the cloud Best practices

More information

SUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse.

SUSE Cloud 2.0. Pete Chadwick. Douglas Jarvis. Senior Product Manager pchadwick@suse.com. Product Marketing Manager djarvis@suse. SUSE Cloud 2.0 Pete Chadwick Douglas Jarvis Senior Product Manager pchadwick@suse.com Product Marketing Manager djarvis@suse.com SUSE Cloud SUSE Cloud is an open source software solution based on OpenStack

More information

Understanding ArcGIS Deployments in Public and Private Cloud. Marwa Mabrouk

Understanding ArcGIS Deployments in Public and Private Cloud. Marwa Mabrouk Understanding ArcGIS Deployments in Public and Private Cloud Marwa Mabrouk Agenda Back to Basics What are people doing? New Features Using ArcGIS in the Cloud - Private Cloud - Public Cloud Technical Demos

More information

PostgreSQL Performance Characteristics on Joyent and Amazon EC2

PostgreSQL Performance Characteristics on Joyent and Amazon EC2 OVERVIEW In today's big data world, high performance databases are not only required but are a major part of any critical business function. With the advent of mobile devices, users are consuming data

More information

Development and Test on Amazon Web Services Solution Briefing. Development and Test on Amazon Web Services. Solution Briefing. June 2013.

Development and Test on Amazon Web Services Solution Briefing. Development and Test on Amazon Web Services. Solution Briefing. June 2013. Development and Test on Amazon Web Services Solution Briefing June 2013 Page 1 of 7 Overview An easy way to get started using Amazon Web Services is by deploying development and test workloads. This solution

More information

VMware vrealize Code Stream Reference Architecture

VMware vrealize Code Stream Reference Architecture VMware vrealize Code Stream Reference Architecture vrealize Code Stream 2.1 This document supports the version of each product listed and supports all subsequent versions until the document is replaced

More information

OVERVIEW. The complete IaaS platform for service providers

OVERVIEW. The complete IaaS platform for service providers OVERVIEW The complete IaaS platform for service providers The complete IaaS platform for service providers With OnApp you can sell more services, automate more of your infrastructure and extend your reach

More information

Oracle Hyperion Financial Management Virtualization Whitepaper

Oracle Hyperion Financial Management Virtualization Whitepaper Oracle Hyperion Financial Management Virtualization Whitepaper Oracle Hyperion Financial Management Virtualization Whitepaper TABLE OF CONTENTS Overview... 3 Benefits... 4 HFM Virtualization testing...

More information

Resource Sizing: Spotfire for AWS

Resource Sizing: Spotfire for AWS Resource Sizing: for AWS With TIBCO for AWS, you can have the best in analytics software available at your fingertips in just a few clicks. On a single Amazon Machine Image (AMI), you get a multi-user

More information

Oracle Database 11g on Amazon EC2 Implementation Guide

Oracle Database 11g on Amazon EC2 Implementation Guide Oracle Database 11g on Amazon EC2 Implementation Guide Abdul Sathar Sait November 2013 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this guide.) Page 1 of 40 Table of Contents

More information

Taking the Plunge: Desktop Infrastructure. Rich Clifton

Taking the Plunge: Desktop Infrastructure. Rich Clifton Taking the Plunge: Effectively Deploying Virtualized Desktop Infrastructure Rich Clifton SVP & GM Technology Enablement & Solutions Two Worlds Virtual Desktops Desktop Virtualization Software Data Center

More information

Technical Paper. Moving SAS Applications from a Physical to a Virtual VMware Environment

Technical Paper. Moving SAS Applications from a Physical to a Virtual VMware Environment Technical Paper Moving SAS Applications from a Physical to a Virtual VMware Environment Release Information Content Version: April 2015. Trademarks and Patents SAS Institute Inc., SAS Campus Drive, Cary,

More information

Cloud n Service Presentation. NTT Communications Corporation Cloud Services

Cloud n Service Presentation. NTT Communications Corporation Cloud Services Cloud n Service Presentation NTT Communications Corporation Cloud Services 1 Overview of Global Public Cloud Services Cloud n offeres datacenters in U.S. and Japan Global standard service architecture

More information

Estimating the Cost of a GIS in the Amazon Cloud. An Esri White Paper August 2012

Estimating the Cost of a GIS in the Amazon Cloud. An Esri White Paper August 2012 Estimating the Cost of a GIS in the Amazon Cloud An Esri White Paper August 2012 Copyright 2012 Esri All rights reserved. Printed in the United States of America. The information contained in this document

More information