Berlin Storage, Backup and Disaster Recovery in the Cloud AWS Customer Case Study: HERE Maps for Life

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Berlin 2015. Storage, Backup and Disaster Recovery in the Cloud AWS Customer Case Study: HERE Maps for Life"

Transcription

1 Berlin 2015 Storage, Backup and Disaster Recovery in the Cloud AWS Customer Case Study: HERE Maps for Life

2 Storage, Backup and Disaster Recovery in the Cloud Robert Schmid, Storage Business Development, AWS Ali Abbas, Principal Architect, HERE Case Study: AWS Customer HERE Maps for Life: Satellite Imagery - S3 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

3 What we will cover in this session Amazon storage options Amazon Elastic File System Use cases (Backup, Archive, DR) Customer Use Case: HERE Maps for Life, Satellite Imagery-S3

4 S3 usage 102% year-over-year increase in data transfer to and from S3 (Q vs Q4 2013, not including Amazon use)

5 Amazon S3 Simple Storage Service

6 Amazon S3 Simple Storage Service % durability $0.03 per GB-month $360 per TB/year

7 Amazon Glacier Low-cost archiving service

8 Amazon Glacier Low-cost archiving service $0.01 per GB-month $120 per TB/year % durability 3 5 hours data retrieval

9 Amazon EBS Elastic Block Storage

10 EBS General Purpose (SSD) Up to 16 TB 10,000 IOPS Provisioned IOPS (SSD) Up to 16 TB 20,000 IOPS $0.10 per GB-month $0.125 per GB-month 0.065/provisioned IOPS

11 Amazon Storage Gateway

12 Storage Gateway Your on-ramp to AWS cloud storage: Back up into S3 Archive into Amazon Glacier iscsi or VTL interface

13 Summary: AWS Storage Options Object Storage (S3, Glacier) Elastic Block Storage (EBS) Storage Gateway (iscsi, VTL) Elastic File System for EC2 (EFS)

14 Introducing Amazon Elastic File System for EC2 Instances pilot availability later this summer US-WEST (Oregon)

15 What is EFS? Fully managed file system for EC2 instances Provides standard file system semantics (NFSv4) Elastically grows to petabyte scale and shrinks elastically Delivers performance for a wide variety of workloads Highly available and durable simple elastic scalable

16 Amazon Storage Use Cases: Backup, Archive, Disaster Recovery

17 Backup, Archive, Disaster Recovery Customer Data Center Block File Archive Backup Disaster Recovery Colocation Data Center Customer /CSP Assets Storage Gateways AWS SGW DirectConnect Private Storage for AWS Internet AWS Direct Connect S3 Glacier AWS Cloud S3 Glacier

18 AWS Customer Case Study Ali Abbas HERE: Maps for Life Principal Architect High Resolution Satellite Imagery Predictive Analytics/Machine Learning 18

19 19 HERE Maps HERE Drive HERE Transit HERE City Lens Explore

20 Maps for Life Web and Mobile App available on: Android/iOS/Windows Phone 20

21 Save the maps of your country or state on your phone Use your phone offline Explore anywhere without an internet connection Offline Map 21

22 Unified Route Planning Route Alternatives Turn-by-turn Navigation Pocket Nav Sat 22

23 Route Alternatives Step-by-step transit Turn-by-turn walk guidance Urban Navigation 23

24 Collections Easy location sharing Personal Maps 24

25 Train Schedule Traffic incidents 3D Maps Interactive Maps 25

26 Reality Capture Processing Satellite/Aerial Delivery Enterprise Businesses End to End User Integration 26

27 99.99% availability, % durability High throughput/good Performance for most use-cases Good price ratio Design simplifies creating integration pipelines 27

28 28 The case f Satellite Imagery

29 29 Continuous increase global coverage with a higher frequency of refresh

30 Billion of tiles Huge storage requirements due to high resolution content across zoom levels Big amount of small tile size to keep track and deliver Challenges Exponential growth rate (today some billions, tomorrow some trillions) Increased data volume refresh rate 30 Maintain low latency requirements and service level agreement

31 Behind the curtain Specialized spatial file system to deliver tile imagery with sub-ms lookup time over the network. Simple Architecture with CDN Caches and Core sites (with full dataset) Remote sites had CDN type caches with geospatial shard-ing placement algorithms. Some select cache regions suffered sometimes from inter-continental network latency due to non-optimized routing The scale of data implies massive storage infrastructure to maintain on top 31

32 Mercator based shard-ing layer Specialized Spatial Blob Store Intelligent Filter layer Specialized Adaptive Spatial Blob Store Shared Store Singleton Store 32 Core Caches

33 Given the success of S3 usage across HERE and the recent enhancement to the offering, we started to look at S3 to solve 2 main problems with 1 solution Simplify the storage handling layer with getting rid of the storage compute from our architecture and simplify Operations. Reduce the network latency from core data to our delivery instances by adding core data presence in each availability regions. 33

34 Satellite on S3 Easy life-cycle management for recurring update Big Data store requirements on-demand (ease capacity planning) Easy pipeline integration with SQS/SNS for background jobs Good performance out of the box, however did not fulfill our requirements - Too much variation in response time ~ AVG ms. 34

35 S3 Load constrain Amazon S3 maintains an index of object key names in each AWS region. Object keys are stored lexicographically across multiple partitions in the index. That is, Amazon S3 stores key names in alphabetical order. The key name dictates which partition the key is stored in. Using a sequential prefix, such as timestamp or an alphabetical sequence, increases the likelihood that Amazon S3 will target a specific partition for a large number of your keys, overwhelming the I/O capacity of the partition. 35

36 S3 Load constrain + Satellite Amazon S3 maintains an index of object key names in each AWS region. Object keys are stored lexicographically across multiple partitions in the index. That is, Amazon S3 stores key names in alphabetical order. The key name dictates which partition the key is stored in. Using a sequential prefix, such as timestamp or an alphabetical sequence, increases the likelihood that Amazon S3 will target a specific partition for a large number of your keys, overwhelming the I/O capacity of the partition. 36

37 S3 Load constrain + Satellite Stored lexicographically across S3 partitions z x y Satellite example tile ID: 15/18106/ /18089/11275 quadkey representation /72409/

38 S3 Load constrain + Satellite Stored lexicographically across S3 partitions z x y Satellite example tile ID: 15/18106/ /18089/11275 quadkey representation /72409/ Each zoom level has 4^level_detail tiles, a quadkey length is equal to the level of detail of the corresponding tile. 38

39 S3 Load constrain + Satellite Stored lexicographically across S3 partitions Alternative to quadkeys use random hash, increase base number Remaining problem At the scale of satellite, the ratio of requests in regards to the lexicographic overlap produced with a random hash was still significant and would not scale well. Performance was still unacceptable in light of our requirements. Billion of PUT requests would considerably increase recurring-updates cost. 39

40 S3 Load constrain + Satellite Stored lexicographically across S3 partitions Better solution Reduce the amount of files by creating binary blob on S3, index the tiles inside the blobs and use HTTP range-request for access. New Challenge Managing updates got more complicated, more logic requires to distribute tiles inside the blobs and more important the predicted index size was in magnitude of terabytes and growing cost and complexity overhead. 40

41 41 Back on the whiteboard

42 New Pseudo-Quad Index New compact O(1) data-structure to work around the performance constrains of S3 It minimizes the index size constrain to keep track of tiles and random hashes % size reduction in comparison to generic optimized hash tables It reduces and sets boundaries for proximity regions to cause better dispersion on the n-gram load split algorithm used by S3 Simplified Imagery updates; geometrical consistency across all S3 buckets Performance: S3: > ms S3 + PQI: <26ms 42

43 With S3 and PQI we have simplified our architecture PQI Backend Tiny ref file Simple infrastructure delivering from a few billion up to a few trillion images 43

44 Impact on Architecture Impact on day-day Operation of our services Brings us geographically closer to our customer while not compromising on design patterns to work around network latencies. Allows us to only focus on our core business and technologies while offloading compute/storage to AWS. 44

45 Thank you! please meet our Sponsors/Partners and see us in the EXPO area 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

46 Further information:

Intro to AWS: Storage Services

Intro to AWS: Storage Services Intro to AWS: Storage Services Matt McClean, AWS Solutions Architect 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved AWS storage options Scalable object storage Inexpensive archive

More information

Amazon Cloud Storage Options

Amazon Cloud Storage Options Amazon Cloud Storage Options Table of Contents 1. Overview of AWS Storage Options 02 2. Why you should use the AWS Storage 02 3. How to get Data into the AWS.03 4. Types of AWS Storage Options.03 5. Object

More information

Understanding AWS Storage Options

Understanding AWS Storage Options Understanding AWS Storage Options Ian Massingham, Technical Evangelist @IanMmmm ianmas@amazon.com 30 April 2014 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified,

More information

Amazon Web Services. 18.11.2015 Yu Xiao

Amazon Web Services. 18.11.2015 Yu Xiao Amazon Web Services 18.11.2015 Yu Xiao Agenda Introduction to Amazon Web Services(AWS) 7 Steps to Select the Right Architecture for Your Web Applications Private, Public or Hybrid Cloud? AWS Case Study

More information

How AWS Pricing Works

How AWS Pricing Works How AWS Pricing Works (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction... 3 Fundamental

More information

Real Time Big Data Processing

Real Time Big Data Processing Real Time Big Data Processing Cloud Expo 2014 Ian Meyers Amazon Web Services Global Infrastructure Deployment & Administration App Services Analytics Compute Storage Database Networking AWS Global Infrastructure

More information

Rethink Cloud Strategies for Cost Effective Enterprise Storage Management. PRESENTATION TITLE GOES HERE Laz Vekiarides ClearSky Data

Rethink Cloud Strategies for Cost Effective Enterprise Storage Management. PRESENTATION TITLE GOES HERE Laz Vekiarides ClearSky Data Rethink Cloud Strategies for Cost Effective Enterprise Storage Management PRESENTATION TITLE GOES HERE Laz Vekiarides ClearSky Data Enterprise Storage Today Flash Complex, costly silos $/TB Mid-Range Scale

More information

How AWS Pricing Works May 2015

How AWS Pricing Works May 2015 How AWS Pricing Works May 2015 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction...

More information

DLT Solutions and Amazon Web Services

DLT Solutions and Amazon Web Services DLT Solutions and Amazon Web Services For a seamless, cost-effective migration to the cloud PREMIER CONSULTING PARTNER DLT Solutions 2411 Dulles Corner Park, Suite 800 Herndon, VA 20171 Duane Thorpe Phone:

More information

DataStax Enterprise, powered by Apache Cassandra (TM)

DataStax Enterprise, powered by Apache Cassandra (TM) PerfAccel (TM) Performance Benchmark on Amazon: DataStax Enterprise, powered by Apache Cassandra (TM) Disclaimer: All of the documentation provided in this document, is copyright Datagres Technologies

More information

Amazon EC2 Product Details Page 1 of 5

Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of

More information

Technical Brief: Global File Locking

Technical Brief: Global File Locking Nasuni enables collaboration among users of files no matter where users are located Introduction The Nasuni Service combines the availability and scale of cloud storage with the local performance found

More information

Storage as a Service: Leverage the benefits of scalability and elasticity with Storage as a Service

Storage as a Service: Leverage the benefits of scalability and elasticity with Storage as a Service Storage as a Service: Leverage the benefits of scalability and elasticity with Storage as a Service Storage is one of the great opportunities for cloud computing, thanks to the scalability and elasticity

More information

Storage Solutions in the AWS Cloud. Miles Ward Enterprise Solutions Architect

Storage Solutions in the AWS Cloud. Miles Ward Enterprise Solutions Architect Storage Solutions in the AWS Cloud Miles Ward Enterprise Solutions Architect Traditional Storage On-Premise Storage Options SAN network-attached block devices: LUNs DAS local block devices (disks) NAS

More information

Deploying for Success on the Cloud: EBS on Amazon VPC. Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012

Deploying for Success on the Cloud: EBS on Amazon VPC. Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012 Deploying for Success on the Cloud: EBS on Amazon VPC Phani Kottapalli Pavan Vallabhaneni AST Corporation August 17, 2012 Agenda Amazon AWS Global Infrastructure AWS VirtualPrivateCloud(VPC) Architecture

More information

A programming model in Cloud: MapReduce

A programming model in Cloud: MapReduce A programming model in Cloud: MapReduce Programming model and implementation developed by Google for processing large data sets Users specify a map function to generate a set of intermediate key/value

More information

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect

Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect Introduction to Amazon Web Services! Leo Zhadanovsky! @leozh leo@amazon.com! Senior Solutions Architect AWS HISTORY About How didamazon Amazon Web Services! Deep experience in building and operating global

More information

Simple Storage Service (S3)

Simple Storage Service (S3) Simple Storage Service (S3) Amazon S3 is storage for the Internet. It is designed to make web-scale computing easier for developers. Amazon S3 provides a simple web services interface that can be used

More information

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect on AWS Services Overview Bernie Nallamotu Principle Solutions Architect \ So what is it? When your data sets become so large that you have to start innovating around how to collect, store, organize, analyze

More information

Amazon S3 Essentials

Amazon S3 Essentials Fr Amazon Simple Storage Service (Amazon S3), provides developers and IT teams with secure, durable, and highly scalable object storage. Amazon S3 is easy to use, with a simple web services interface to

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security For the Period April 1, 2013 March 31, 2014 Ernst & Young LLP Suite 1600 560 Mission Street San Francisco,

More information

Graph Database Proof of Concept Report

Graph Database Proof of Concept Report Objectivity, Inc. Graph Database Proof of Concept Report Managing The Internet of Things Table of Contents Executive Summary 3 Background 3 Proof of Concept 4 Dataset 4 Process 4 Query Catalog 4 Environment

More information

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity

Web Application Deployment in the Cloud Using Amazon Web Services From Infancy to Maturity P3 InfoTech Solutions Pvt. Ltd http://www.p3infotech.in July 2013 Created by P3 InfoTech Solutions Pvt. Ltd., http://p3infotech.in 1 Web Application Deployment in the Cloud Using Amazon Web Services From

More information

Building Storage-as-a-Service Businesses

Building Storage-as-a-Service Businesses White Paper Service Providers Greatest New Growth Opportunity: Building Storage-as-a-Service Businesses According to 451 Research, Storage as a Service represents a large and rapidly growing market with

More information

With DDN Big Data Storage

With DDN Big Data Storage DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The Big

More information

Riverbed Whitewater/Amazon Glacier ROI for Backup and Archiving

Riverbed Whitewater/Amazon Glacier ROI for Backup and Archiving Riverbed Whitewater/Amazon Glacier ROI for Backup and Archiving November, 2013 Saqib Jang Abstract This white paper demonstrates how to increase profitability by reducing the operating costs of backup

More information

AWS Performance Tuning

AWS Performance Tuning AWS Performance Tuning Markus Albe @Percona Fernando Ipar @Percona Ryan Lowe @Square PLNY 2012 Amazon Web Services Cloud Formation CloudFront CloudSearch CloudWatch DirectConnect DynamoDB ec2 ElastiCache

More information

HyperQ Storage Tiering White Paper

HyperQ Storage Tiering White Paper HyperQ Storage Tiering White Paper An Easy Way to Deal with Data Growth Parsec Labs, LLC. 7101 Northland Circle North, Suite 105 Brooklyn Park, MN 55428 USA 1-763-219-8811 www.parseclabs.com info@parseclabs.com

More information

TECHNICAL WHITE PAPER: ELASTIC CLOUD STORAGE SOFTWARE ARCHITECTURE

TECHNICAL WHITE PAPER: ELASTIC CLOUD STORAGE SOFTWARE ARCHITECTURE TECHNICAL WHITE PAPER: ELASTIC CLOUD STORAGE SOFTWARE ARCHITECTURE Deploy a modern hyperscale storage platform on commodity infrastructure ABSTRACT This document provides a detailed overview of the EMC

More information

Backing up to the Cloud

Backing up to the Cloud Backing up to the Cloud Practical Considerations Chander Kant CEO Zmanda, Inc. 1 Zmanda Worldwide Leader in Open Source Backup 500,000+ Protected Systems Open Source. Open APIs. Open Formats. Smashes traditional

More information

Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen

Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen Accelerating Real Time Big Data Applications PRESENTATION TITLE GOES HERE Bob Hansen Apeiron Data Systems Apeiron is developing a VERY high performance Flash storage system that alters the economics of

More information

UniFS A True Global File System

UniFS A True Global File System UniFS A True Global File System Introduction The traditional means to protect file data by making copies, combined with the need to provide access to shared data from multiple locations, has created an

More information

Introduction to AWS Economics

Introduction to AWS Economics Introduction to AWS Economics Reducing Costs and Complexity May 2015 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational purposes

More information

Leveraging Public Clouds to Ensure Data Availability

Leveraging Public Clouds to Ensure Data Availability Systems Engineering at MITRE CLOUD COMPUTING SERIES Leveraging Public Clouds to Ensure Data Availability Toby Cabot Lawrence Pizette The MITRE Corporation manages federally funded research and development

More information

Amazon Web Services and Maginatics Solution Brief

Amazon Web Services and Maginatics Solution Brief Amazon Web Services and Maginatics Solution Brief Today, enterprise IT organizations are faced with unprecedented challenges when it comes to storing unstructured data both cost-effectively and securely

More information

Introduction to AWS in Higher Ed

Introduction to AWS in Higher Ed Introduction to AWS in Higher Ed Lori Clithero loricli@amazon.com 206.227.5054 University of Washington Cloud Day 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 2 Cloud democratizes

More information

Big data Devices Apps

Big data Devices Apps Trends driving IT pressures Cloud Big data Devices Apps Devices: Info Workers Will Erase Boundary Between enterprise And Consumer Technologies. Forrester Research. August 30, 2012 Apps: Gartner: Predicts

More information

Preparing Your IT for the Holidays. A quick start guide to take your e-commerce to the Cloud

Preparing Your IT for the Holidays. A quick start guide to take your e-commerce to the Cloud Preparing Your IT for the Holidays A quick start guide to take your e-commerce to the Cloud September 2011 Preparing your IT for the Holidays: Contents Introduction E-Commerce Landscape...2 Introduction

More information

HYBRID ARCHITECTURE IN THE CLOUD

HYBRID ARCHITECTURE IN THE CLOUD Revision 7.12-4 HIE ELECTRONICS: HYBRID ARCHITECTURE IN THE CLOUD Discussion of the Cloud and Tiered Architecture Hie Electronics, Inc. Copyright 2012 Introduction This paper compares some of the most

More information

Deploying for Success on the Cloud: EBS on Amazon VPC Session ID#11312

Deploying for Success on the Cloud: EBS on Amazon VPC Session ID#11312 Deploying for Success on the Cloud: EBS on Amazon VPC Session ID#11312 Phani Kottapalli AST Corporation Our Services Oracle Partnership Oracle Specialized E-Business Suite Business Intelligence EPM-Hyperion

More information

Deploying ArcGIS for Server Using Esri Managed Services

Deploying ArcGIS for Server Using Esri Managed Services Federal GIS Conference 2014 February 10 11, 2014 Washington DC Deploying ArcGIS for Server Using Esri Managed Services Andrew Sakowicz Erin Ross Cloud Overview Deploying ArcGIS for Server What is Cloud:

More information

Accelerating Cloud Based Services

Accelerating Cloud Based Services Accelerating Cloud Based Services A White Paper February 2011 1.1 Replify 2011 Table of Contents Executive Summary... 3 Introduction... 4 The Network a Barrier to Cloud Adoption... 4 Current Solutions...

More information

Amazon Web Services. 2015 Annual ALGIM Conference. Tim Dacombe-Bird Regional Sales Manager Amazon Web Services New Zealand

Amazon Web Services. 2015 Annual ALGIM Conference. Tim Dacombe-Bird Regional Sales Manager Amazon Web Services New Zealand Amazon Web Services 2015 Annual ALGIM Conference Tim Dacombe-Bird Regional Sales Manager Amazon Web Services New Zealand 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda Who

More information

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES AWS GLOBAL INFRASTRUCTURE 10 Regions 25 Availability Zones 51 Edge locations WHAT

More information

Study concluded that success rate for penetration from outside threats higher in corporate data centers

Study concluded that success rate for penetration from outside threats higher in corporate data centers Auditing in the cloud Ownership of data Historically, with the company Company responsible to secure data Firewall, infrastructure hardening, database security Auditing Performed on site by inspecting

More information

Web Application Hosting using Amazon Web Services. E: Roshanr_2004@hotmail.com W: http://virtualizationandstorage.wordpress.

Web Application Hosting using Amazon Web Services. E: Roshanr_2004@hotmail.com W: http://virtualizationandstorage.wordpress. Web Application Hosting using Amazon Web Services Document Author: Contact: Roshan Ratnayake M: 0434 725 855 E: Roshanr_2004@hotmail.com W: http://virtualizationandstorage.wordpress.c om/category/aws/

More information

Research on AWS. Genomics Research Statistical Analysis Mathematical Modeling Computational Fluid Dynamics Grid/Cluster/High Performance Computing

Research on AWS. Genomics Research Statistical Analysis Mathematical Modeling Computational Fluid Dynamics Grid/Cluster/High Performance Computing Research on AWS Genomics Research Statistical Analysis Mathematical Modeling Computational Fluid Dynamics Grid/Cluster/High Performance Computing Research use cases on AWS (examples) Carat is an application

More information

Chapter 19 Cloud Computing for Multimedia Services

Chapter 19 Cloud Computing for Multimedia Services Chapter 19 Cloud Computing for Multimedia Services 19.1 Cloud Computing Overview 19.2 Multimedia Cloud Computing 19.3 Cloud-Assisted Media Sharing 19.4 Computation Offloading for Multimedia Services 19.5

More information

Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000 Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000 Clear the way for new business opportunities. Unlock the power of data. Overcoming storage limitations Unpredictable data growth

More information

Software Defined Storage @ Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation

Software Defined Storage @ Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation Software Defined @ Microsoft PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation Lessons Learned operating large cloud properties Industry trends Cloud scale services

More information

White Paper. Amazon in an Instant: How Silver Peak Cloud Acceleration Improves Amazon Web Services (AWS)

White Paper. Amazon in an Instant: How Silver Peak Cloud Acceleration Improves Amazon Web Services (AWS) Amazon in an Instant: How Silver Peak Cloud Acceleration Improves Amazon Web Services (AWS) Amazon in an Instant: How Silver Peak Cloud Acceleration Improves Amazon Web Services (AWS) Amazon Web Services

More information

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing WHAT IS CLOUD COMPUTING? 2 DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing Slide 1 Slide 3 A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet.

More information

Introduction to Cloud : Cloud and Cloud Storage. Lecture 2. Dr. Dalit Naor IBM Haifa Research Storage Systems. Dalit Naor, IBM Haifa Research

Introduction to Cloud : Cloud and Cloud Storage. Lecture 2. Dr. Dalit Naor IBM Haifa Research Storage Systems. Dalit Naor, IBM Haifa Research Introduction to Cloud : Cloud and Cloud Storage Lecture 2 Dr. Dalit Naor IBM Haifa Research Storage Systems 1 Advanced Topics in Storage Systems for Big Data - Spring 2014, Tel-Aviv University http://www.eng.tau.ac.il/semcom

More information

Hitachi Cloud Service for Content Archiving. Delivered by Hitachi Data Systems

Hitachi Cloud Service for Content Archiving. Delivered by Hitachi Data Systems SOLUTION PROFILE Hitachi Cloud Service for Content Archiving, Delivered by Hitachi Data Systems Improve Efficiencies in Archiving of File and Content in the Enterprise Bridging enterprise IT infrastructure

More information

VMware Hybrid Cloud. Accelerate Your Time to Value

VMware Hybrid Cloud. Accelerate Your Time to Value VMware Hybrid Cloud Accelerate Your Time to Value Fulfilling the Promise of Hybrid Cloud Computing Through 2020, the most common use of cloud services will be a hybrid model combining on-premises and external

More information

Introduction to Windows Azure Cloud Computing Futures Group, Microsoft Research Roger Barga, Jared Jackson,Nelson Araujo, Dennis Gannon, Wei Lu, and

Introduction to Windows Azure Cloud Computing Futures Group, Microsoft Research Roger Barga, Jared Jackson,Nelson Araujo, Dennis Gannon, Wei Lu, and Introduction to Windows Azure Cloud Computing Futures Group, Microsoft Research Roger Barga, Jared Jackson,Nelson Araujo, Dennis Gannon, Wei Lu, and Jaliya Ekanayake Range in size from edge facilities

More information

Introducing 365 Cloud Storage

Introducing 365 Cloud Storage Introducing 365 Cloud Storage Local Enterprise Cloud Storage SERVICE AVAILABILITY: SEPTEMBER 23, 2014 What we do 365 Data Centers provides secure and reliable colocation services that offer an easier way

More information

Cluster Computing. ! Fault tolerance. ! Stateless. ! Throughput. ! Stateful. ! Response time. Architectures. Stateless vs. Stateful.

Cluster Computing. ! Fault tolerance. ! Stateless. ! Throughput. ! Stateful. ! Response time. Architectures. Stateless vs. Stateful. Architectures Cluster Computing Job Parallelism Request Parallelism 2 2010 VMware Inc. All rights reserved Replication Stateless vs. Stateful! Fault tolerance High availability despite failures If one

More information

Service Organization Controls 3 Report

Service Organization Controls 3 Report Service Organization Controls 3 Report Report on the Amazon Web Services System Relevant to Security and Availability For the Period April 1, 2015 September 30, 2015 Ernst & Young LLP Suite 1600 560 Mission

More information

Deploying a Geospatial Cloud

Deploying a Geospatial Cloud Deploying a Geospatial Cloud Traditional Public Sector Computing Environment Traditional Computing Infrastructure Silos of dedicated hardware and software Single application per silo Expensive to size

More information

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms

More information

ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013

ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013 ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013 POWER OF HITACHI Founded in 1910 US$118B FY11 900 subsidiaries 324,000 employees More than 760 PhDs INFORMATION and TELECOMMU- NICATIONS

More information

Cloud Models and Platforms

Cloud Models and Platforms Cloud Models and Platforms Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF A Working Definition of Cloud Computing Cloud computing is a model

More information

DELL s Oracle Database Advisor

DELL s Oracle Database Advisor DELL s Oracle Database Advisor Underlying Methodology A Dell Technical White Paper Database Solutions Engineering By Roger Lopez Phani MV Dell Product Group January 2010 THIS WHITE PAPER IS FOR INFORMATIONAL

More information

CLOUD COMPUTING FOR THE ENTERPRISE AND GLOBAL COMPANIES Steve Midgley Head of AWS EMEA

CLOUD COMPUTING FOR THE ENTERPRISE AND GLOBAL COMPANIES Steve Midgley Head of AWS EMEA CLOUD COMPUTING FOR THE ENTERPRISE AND GLOBAL COMPANIES Steve Midgley Head of AWS EMEA AWS Introduction Why are enterprises choosing AWS? What are enterprises using AWS for? How are enterprise getting

More information

Case Study. Cloud Adoption, Fault Tolerant AWS Support & Magento ecommerce Implementation. Case Study

Case Study. Cloud Adoption, Fault Tolerant AWS Support & Magento ecommerce Implementation. Case Study Cloud Adoption, Fault Tolerant AWS Support & Magento ecommerce Implementation World s Largest Publisher of Medical and Scientific Literature 1 2013 Compunnel Software Group Cloud Adoption, Fault Tolerant

More information

Building an AWS-Compatible Hybrid Cloud with OpenStack

Building an AWS-Compatible Hybrid Cloud with OpenStack Building an AWS-Compatible Hybrid Cloud with OpenStack AWS is Transforming IT Amazon Web Services (AWS) commands a significant lead in the public cloud services market, with revenue estimated to grow from

More information

Flash Use Cases Traditional Infrastructure vs Hyperscale

Flash Use Cases Traditional Infrastructure vs Hyperscale Flash Use Cases Traditional Infrastructure vs Hyperscale Steve Knipple, CTO / VP Engineering Atmosera : Global Hybrid Managed Services Provider Agenda Speaker Perspective The Infrastructure Market Traditional

More information

Big data management with IBM General Parallel File System

Big data management with IBM General Parallel File System Big data management with IBM General Parallel File System Optimize storage management and boost your return on investment Highlights Handles the explosive growth of structured and unstructured data Offers

More information

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand.

IBM Global Technology Services September 2007. NAS systems scale out to meet growing storage demand. IBM Global Technology Services September 2007 NAS systems scale out to meet Page 2 Contents 2 Introduction 2 Understanding the traditional NAS role 3 Gaining NAS benefits 4 NAS shortcomings in enterprise

More information

Breaking the Storage Array Lifecycle with Cloud Storage

Breaking the Storage Array Lifecycle with Cloud Storage Breaking the Storage Array Lifecycle with Cloud Storage 2011 TwinStrata, Inc. The Storage Array Lifecycle Anyone who purchases storage arrays is familiar with the many advantages of modular storage systems

More information

Expand Your Infrastructure with the Elastic Cloud. Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager

Expand Your Infrastructure with the Elastic Cloud. Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager Expand Your Infrastructure with the Elastic Cloud Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager Today we re going to talk about The Cloud Scenarios Questions You Probably

More information

White Paper October 2014. Scaling MySQL Deployments Using HGST FlashMAX PCIe SSDs. An HGST and Percona Collaborative Whitepaper

White Paper October 2014. Scaling MySQL Deployments Using HGST FlashMAX PCIe SSDs. An HGST and Percona Collaborative Whitepaper White Paper October 2014 Scaling MySQL Deployments Using HGST FlashMAX PCIe SSDs An HGST and Percona Collaborative Whitepaper Table of Contents Introduction The Challenge Read Workload Scaling...1 Write

More information

From Internet Data Centers to Data Centers in the Cloud

From Internet Data Centers to Data Centers in the Cloud From Internet Data Centers to Data Centers in the Cloud This case study is a short extract from a keynote address given to the Doctoral Symposium at Middleware 2009 by Lucy Cherkasova of HP Research Labs

More information

Microsoft s Cloud Networks

Microsoft s Cloud Networks Microsoft s Cloud Networks Page 1 Microsoft s Cloud Networks Microsoft s customers depend on fast and reliable connectivity to our cloud services. To ensure superior connectivity, Microsoft combines globally

More information

Amazon Compute - EC2 and Related Services

Amazon Compute - EC2 and Related Services Amazon Compute - EC2 and Related Services G-Cloud Service 1 1.An overview of the G-Cloud Service Arcus Global are approved to sell to the UK Public Sector as official Amazon Web Services resellers. Amazon

More information

Deploying ArcGIS for Server Using Managed Services

Deploying ArcGIS for Server Using Managed Services Deploying ArcGIS for Server Using Managed Services Andrew Sakowicz Erin Ross Sridhar Karra Agenda Introduction Program Overview - Overview - Methodology - Tools Customer Deployments - Architecture and

More information

GEOSPATIAL DIGITAL ASSET MANAGEMENT A SOLUTION INTEGRATING IMAGERY AND GIS WHERE WILL ALL THE PIXELS GO?(AND HOW WILL WE EVER FIND THEM?

GEOSPATIAL DIGITAL ASSET MANAGEMENT A SOLUTION INTEGRATING IMAGERY AND GIS WHERE WILL ALL THE PIXELS GO?(AND HOW WILL WE EVER FIND THEM? GEOSPATIAL DIGITAL ASSET MANAGEMENT A SOLUTION INTEGRATING IMAGERY AND GIS WHERE WILL ALL THE PIXELS GO?(AND HOW WILL WE EVER FIND THEM?) Dr. Joan Lurie, GCC, Inc. 30 West 61 st Street, Apt 9A New York,

More information

Object Storage: A Growing Opportunity for Service Providers. White Paper. Prepared for: 2012 Neovise, LLC. All Rights Reserved.

Object Storage: A Growing Opportunity for Service Providers. White Paper. Prepared for: 2012 Neovise, LLC. All Rights Reserved. Object Storage: A Growing Opportunity for Service Providers Prepared for: White Paper 2012 Neovise, LLC. All Rights Reserved. Introduction For service providers, the rise of cloud computing is both a threat

More information

Cloud Optimize Your IT

Cloud Optimize Your IT Cloud Optimize Your IT Windows Server 2012 The information contained in this presentation relates to a pre-release product which may be substantially modified before it is commercially released. This pre-release

More information

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com;

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Microsoft Big Data Solutions Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Why/What is Big Data and Why Microsoft? Options of storage and big data processing in Microsoft Azure. Real Impact of Big

More information

SOLUTION BRIEF Citrix Cloud Solutions Citrix Cloud Solution for On-boarding

SOLUTION BRIEF Citrix Cloud Solutions Citrix Cloud Solution for On-boarding SOLUTION BRIEF Citrix Cloud Solutions Citrix Cloud Solution for On-boarding www.citrix.com Contents Introduction... 3 The On- boarding Problem Defined... 3 Considerations for Application On- boarding...

More information

Performance Benchmark for Cloud Block Storage

Performance Benchmark for Cloud Block Storage Performance Benchmark for Cloud Block Storage J.R. Arredondo vjune2013 Contents Fundamentals of performance in block storage Description of the Performance Benchmark test Cost of performance comparison

More information

Cloud Courses Description

Cloud Courses Description Courses Description 101: Fundamental Computing and Architecture Computing Concepts and Models. Data center architecture. Fundamental Architecture. Virtualization Basics. platforms: IaaS, PaaS, SaaS. deployment

More information

Hitachi Cloud Services for Private File Tiering. Low Risk Cloud at Your Own Pace. The Hitachi Vision on Cloud

Hitachi Cloud Services for Private File Tiering. Low Risk Cloud at Your Own Pace. The Hitachi Vision on Cloud S o l u t i o n P r o f i l e Hitachi Cloud Services for Private File Tiering Low Risk Cloud at Your Own Pace Hitachi Data Systems is a premier provider of cloud storage infrastructure, services and solutions

More information

Database Scalability {Patterns} / Robert Treat

Database Scalability {Patterns} / Robert Treat Database Scalability {Patterns} / Robert Treat robert treat omniti postgres oracle - mysql mssql - sqlite - nosql What are Database Scalability Patterns? Part Design Patterns Part Application Life-Cycle

More information

Storage and Disaster Recovery

Storage and Disaster Recovery Storage and Disaster Recovery Matt Tavis Principal Solutions Architect The Business Continuity Continuum High Data Backup Disaster Recovery High, Storage Backup and Disaster Recovery form a continuum of

More information

LONDON. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

LONDON. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved LONDON 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Best Practices for Building Partner Managed Services on AWS Kelly Hartman, Global Segment Leader, MSPs Kyle Lichtenberg, Solutions

More information

T a c k l i ng Big Data w i th High-Performance

T a c k l i ng Big Data w i th High-Performance Worldwide Headquarters: 211 North Union Street, Suite 105, Alexandria, VA 22314, USA P.571.296.8060 F.508.988.7881 www.idc-gi.com T a c k l i ng Big Data w i th High-Performance Computing W H I T E P A

More information

Scalable Architecture on Amazon AWS Cloud

Scalable Architecture on Amazon AWS Cloud Scalable Architecture on Amazon AWS Cloud Kalpak Shah Founder & CEO, Clogeny Technologies kalpak@clogeny.com 1 * http://www.rightscale.com/products/cloud-computing-uses/scalable-website.php 2 Architect

More information

AWS Storage: Minimizing Costs While Retaining Functionality

AWS Storage: Minimizing Costs While Retaining Functionality AWS Storage: Minimizing Costs While Retaining Functionality This whitepaper, the second in our Cost Series, discusses persistent storage with Amazon Web Services. It will focus upon Elastic Block Store

More information

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database Built up on Cisco s big data common platform architecture (CPA), a

More information

Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching

Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching Accelerating Web-Based SQL Server Applications with SafePeak Plug and Play Dynamic Database Caching A SafePeak Whitepaper February 2014 www.safepeak.com Copyright. SafePeak Technologies 2014 Contents Objective...

More information

Utilizing Cloud Storage for Mainframes

Utilizing Cloud Storage for Mainframes Utilizing Cloud Storage for Mainframes Art Tolsma Luminex Software, Inc. March 3, 2015 Vendor Session #17166 What? Why? and How? of Cloud Storage Cloud Storage and Cloud Computing are changing how IT operates

More information

Amazon EFS (Preview) User Guide

Amazon EFS (Preview) User Guide Amazon EFS (Preview) User Guide Amazon EFS (Preview): User Guide Copyright 2015 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used

More information

HyperQ Hybrid Flash Storage Made Easy White Paper

HyperQ Hybrid Flash Storage Made Easy White Paper HyperQ Hybrid Flash Storage Made Easy White Paper Parsec Labs, LLC. 7101 Northland Circle North, Suite 105 Brooklyn Park, MN 55428 USA 1-763-219-8811 www.parseclabs.com info@parseclabs.com sales@parseclabs.com

More information

Aleksandar Nenov. Devops Talk Belgrade 2015

Aleksandar Nenov. Devops Talk Belgrade 2015 Learning about Cloud Computing with Aleksandar Nenov Who am I? My name is Aleksandar Nenov I live and work in Novi Sad, Serbia Senior IT Consultant Devops practitioner Founder & CEO at CLOUDWEBOPS (WhiteCitySoft

More information

StorReduce Technical White Paper Cloud-based Data Deduplication

StorReduce Technical White Paper Cloud-based Data Deduplication StorReduce Technical White Paper Cloud-based Data Deduplication See also at storreduce.com/docs StorReduce Quick Start Guide StorReduce FAQ StorReduce Solution Brief, and StorReduce Blog at storreduce.com/blog

More information

Cloud Courses Description

Cloud Courses Description Cloud Courses Description Cloud 101: Fundamental Cloud Computing and Architecture Cloud Computing Concepts and Models. Fundamental Cloud Architecture. Virtualization Basics. Cloud platforms: IaaS, PaaS,

More information

Enterprise Cloud Backup and Recovery with Symantec NetBackup

Enterprise Cloud Backup and Recovery with Symantec NetBackup Enterprise Cloud Backup and Recovery with Symantec NetBackup Data Sheet: Backup and Disaster Recovery Overview of Symantec NetBackup As the established market leader, Symantec NetBackup delivers reliable

More information