How to Leverage Cloud to Quickly Build Scalable Applications



Similar documents
Building your Big Data Architecture on Amazon Web Services

CLOUD COMPUTING FOR THE ENTERPRISE AND GLOBAL COMPANIES Steve Midgley Head of AWS EMEA

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Real Time Big Data Processing

Introduction to Amazon Web Services! Leo Senior Solutions Architect

Amazon.com, Inc. and its affiliates. All rights reserved.

IAN MASSINGHAM. Technical Evangelist Amazon Web Services

Amazon Web Services. Lawrence Berkeley LabTech Conference 9/10/15. Jamie Baker Federal Scientific Account Manager AWS WWPS

Innovative Geschäftsmodelle Ermöglicht durch die AWS Cloud

Amazon Web Services (AWS) A Secure and Scalable Platform for Global Enterprises. Tim Bixler Sr. Manager, Solutions Architecture

Amazon Web Services Annual ALGIM Conference. Tim Dacombe-Bird Regional Sales Manager Amazon Web Services New Zealand

Hadoop & Spark Using Amazon EMR

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

Extending your Enterprise IT with Amazon Virtual Private Cloud. Oyvind Roti Principal Solutions Architect, AWS

Amazon Web Services. Steve Spano, Brig Gen (Ret), USAF GM, Defense and National Security AWS, Worldwide Public Sector

Thing Big: How to Scale Your Own Internet of Things.

Amazon Web Services. For Government, Education, and Nonprofit Organizations. Jakob Huhn. Partner Manager Benelux, Public Sector

MICROSTRATEGY ON AWS

What is Cloud Computing? Tackling the Challenges of Big Data. Tackling The Challenges of Big Data. Matei Zaharia. Matei Zaharia. Big Data Collection

The Future of Data Management

Introduction to AWS in Higher Ed

AIST Data Symposium. Ed Lenta. Managing Director, ANZ Amazon Web Services

QLIKVIEW INTEGRATION TION WITH AMAZON REDSHIFT John Park Partner Engineering

Big Data & Cloud Computing. Faysal Shaarani

DLT Solutions and Amazon Web Services

Service Organization Controls 3 Report

Native Connectivity to Big Data Sources in MSTR 10

Cloud Database Demystified to Deliver SaaS Customer Value

Background on Elastic Compute Cloud (EC2) AMI s to choose from including servers hosted on different Linux distros

Running Oracle Applications on AWS

End to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ

Agenda. - Introduction to Amazon s Cloud - How ArcGIS users adopt Amazon s Cloud - Why ArcGIS users adopt Amazon s Cloud - Examples

CAPTURING & PROCESSING REAL-TIME DATA ON AWS

Analyzing Big Data with AWS

Next-Generation Cloud Analytics with Amazon Redshift

PCI COMPLIANCE ON AWS: HOW TREND MICRO CAN HELP

Luncheon Webinar Series May 13, 2013

Amazon Web Services Fredrik Rapp, Partner Manager. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Expand Your Infrastructure with the Elastic Cloud. Mark Ryland Chief Solutions Architect Jenn Steele Product Marketing Manager

Big Data and Market Surveillance. April 28, 2014

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Analytics in the Cloud. Peter Sirota, GM Elastic MapReduce

Getting Started with SAP BI on AWS

Using ArcGIS for Server in the Amazon Cloud

Cloudera Enterprise Reference Architecture for Google Cloud Platform Deployments

Enterprise Cloud Services

How To Use Hp Vertica Ondemand

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Parallel Data Warehouse

Datenverwaltung im Wandel - Building an Enterprise Data Hub with

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

So What s the Big Deal?

BIG DATA TRENDS AND TECHNOLOGIES

How To Use Aws.Com

Guide to AWS. Brought to you by

The IBM Cognos Platform

SECURITY IS JOB ZERO. Security The Forefront For Any Online Business Bill Murray Director AWS Security Programs

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect

Scalability in the Cloud HPC Convergence with Big Data in Design, Engineering, Manufacturing

ASUG 2014 Moving SAP to the Cloud

Frequently Asked Questions

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies

Service Organization Controls 3 Report

Modernizing Your Data Warehouse for Hadoop

Encrypting Data at Rest

With Eversync s cloud data tiering, the customer can tier data protection as follows:

Securing Amazon It s a Jungle Out There

Financial Services Grid Computing on Amazon Web Services January 2013 Ian Meyers

A Comparison of Clouds: Amazon Web Services, Windows Azure, Google Cloud Platform, VMWare and Others (Fall 2012)

Lambda Architecture for Batch and Real- Time Processing on AWS with Spark Streaming and Spark SQL. May 2015

Virtualizing Apache Hadoop. June, 2012

C a r l G o e t h a l s T e r r e m a r k E u r o p e. C a r l. g o e t h a l t e r r e m a r k. c o m

Big Data Web Analytics Platform on AWS for Yottaa

Aligning Your Strategic Initiatives with a Realistic Big Data Analytics Roadmap

Amazon EC2 Product Details Page 1 of 5

Chukwa, Hadoop subproject, 37, 131 Cloud enabled big data, 4 Codd s 12 rules, 1 Column-oriented databases, 18, 52 Compression pattern, 83 84

Microsoft Hybrid Cloud: Best of Both Worlds. March 26, 2015

IBM Cognos TM1 on Cloud Solution scalability with rapid time to value

WHAT S NEW IN SAS 9.4

Cloud Models and Platforms

Big Data at Cloud Scale

HDP Hadoop From concept to deployment.

Tap into Hadoop and Other No SQL Sources

Oracle s Cloud Computing Strategy

2015 Ironside Group, Inc. 2

AWS Benefits, Regions & Across. Paul Yung Head of Territory Development HK, Macau & TW pyung@amazon.com

Anypoint Platform Cloud Security and Compliance. Whitepaper

Private Clouds Can Be Complicated: The Challenges of Building and Operating a Microsoft Private Cloud

Unisys Cost Schedule. Unisys Cost Schedule. Page 1

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013

MicroStrategy Cloud Enterprise User Guide Version 2

Common Situations. Departments choosing best in class solutions for their specific needs. Lack of coordinated BI strategy across the enterprise

Transcription:

How to Leverage Cloud to Quickly Build Scalable Applications Chris Keyser Principal Solution Architect David Polley Senior Director Cloud Product Management

Cloud Growth Recent IDC cloud research shows that spending on public IT cloud services will reach $47.4 billion in 2013 and is expected to be more than $107 billion in 2017. Over the 2013 2017 forecast period, public IT cloud services will have a compound annual growth rate (CAGR) of 23.5%, five times that of the industry overall. By 2017, IDC expects public IT cloud services will drive 17% of the IT product spending and nearly half of all growth across five technology categories: applications, system infrastructure software, platform as a service (PaaS), servers, and basic services. http://www.idc.com/prodserv/fourpillars/cloud/index.jsp

Myths and Reality of Cloud Cloud Myths Security & Privacy Regulations Performance Loss of Flexibility Immature Platforms Cloud Reality Fast Deployments On-Demand Scalability Lower Operational Cost & TCO Reduced Operational Skills Rapid Access to New Capabilities Focus on Content Easier Integration Massive Flexibility Performance on Demand

Amazon Web Services

Gartner Magic Quadrant for Cloud Infrastructure as a Service Gartner Magic Quadrant for Cloud Infrastructure as a Service, Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Haynes, May 28, 2014. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the entire report. The Gartner report is available at http://aws.amazon.com/resources/analyst-reports/. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

What is AWS? Deployment & Administration Application Services Compute Storage Database Networking AWS Global Infrastructure

Security is Job Zero Physical Security Network Security Platform Security People & Procedures

Build everything on a constantly improving security baseline GxP ISO 13485 AS9100 ISO/TS 16949 AWS Foundation Services Compute Storage Database Networking AWS Global Infrastructure Availability Zones Regions Edge Locations AWS is responsible for the security OF the Cloud

AWS global infrastructure 11 Regions 28 Availability Zones 52 Edge locations

Unconstrained Big Data Growth EB ZB IT/Application server logs IT Infrastructure logs, Metering, Audit logs, Change logs Websites/Mobile apps/ads Clickstream, User Engagement Sensor data/iot Weather, Smart Grids, Wearables Social media, user content PB 450MM+ Tweets/day GB TB

Big Data Technologies and techniques for working productively with data, at any scale.

Creating Value from Data Assets BIG DATA Recommendations, Collective Intelligence Learning from Social Media Conversations Hypothesis Testing & Predictions Visualization Measuring Functionality and Services SOCIAL Machine Learning Sentiment Analysis Statistical Analysis Dashboards Business Intelligence Ad Hoc Queries A/B Testing

Big Data Potentially massive datasets Iterative, experimental style of data manipulation and analysis Frequently not a steady-state workload; peaks and valleys Time to results is key Hard to configure/manage AWS Cloud Massive, virtually unlimited capacity Iterative, experimental style of infrastructure deployment/usage Highly efficient with variable workloads Parallel clusters from single source Managed services

AWS Big Data Portfolio Collect Ingest Store Analyze Share AWS Direct Connect Amazon Kinesis Amazon S3 Amazon Elastic MapReduce Amazon EC2 Amazon S3 AWS Import/Export Amazon DynamoDB Amazon Redshift Amazon Redshift AWS Data Pipeline Partners Amazon Glacier Kinesis

AWS Marketplace AWS Online Software Store aws.amazon.com/marketplace

Amazon RDS: managed SQL in the cloud Simple and fast to deploy Handles repetitive management tasks Compatible with your applications Amazon RDS And introducing Amazon Aurora Fast, predictable performance Simple and fast to scale Secure Cost-effective

Amazon Redshift Fast, simple, petabyte-scale data warehousing for less than $1,000/TB/Year

Common Use Cases for Amazon Redshift Traditional Enterprise DW Companies with Big Data SaaS Companies Reduce costs by extending DW rather than adding HW Migrate completely from existing DW systems Respond faster to business Improve performance by an order of magnitude Make more data available for analysis Access business data via standard reporting tools Add analytic functionality to applications Scale DW capacity as demand grows Reduce HW & SW costs by an order of magnitude

Amazon Redshift Architecture Leader Node SQL endpoint Stores metadata Coordinates query execution Compute Nodes Local, columnar storage Execute queries in parallel Parallel Load, backup, restore HW optimized for data processing DW1: HDD; scale from 2TB to 2PB DW2: SSD; scale from 160GB to 326TB Ingestion Backup Restore 10 GigE (HPC) JDBC/ODBC

Amazon Redshift has security built-in SSL to secure data in transit Customer VPC ECDHE perfect forward security Encryption to secure data at rest JDBC/ODBC AES-256; hardware accelerated All blocks on disks & in Amazon S3 encrypted On-premises HSM & CloudHSM support Audit logging & AWS CloudTrail integration Internal VPC 10 GigE (HPC) Amazon VPC support SOC 1/2/3, PCI-DSS Level 1, FedRAMP Ingestion Backup Restore Load encrypted from S3

Amazon Elastic MapReduce (EMR) Hadoop 1.x & 2.x / HDFS clusters Easy to use; fully managed Support for EC2 Spot Instances S3, DynamoDB, Redshift & Kinesis Integration

A Typical Amazon EMR Cluster Master instance group HDFS HDFS Core instance group Task instance group Amazon S3

How Does Amazon EMR Work? 1. Put the data into Amazon S3 Amazon S3 Amazon EMR 2. Choose Hadoop distribution, # of nodes, types of nodes, and Hadoop apps like Hive, Pig and HBase 4. Get the output from Amazon S3 3. Launch the cluster using the EMR console, CLI, SDK, or APIs

How Does Amazon EMR Work? You can easily resize the cluster EMR Amazon EMR And launch parallel clusters using the same data

How Does Amazon EMR Work? EMR Amazon EMR Use Spot nodes to save time and money

How Do Amazon EMR and MicroStrategy Work? odbc EMR Amazon EMR

MicroStrategy Cloud

Changing How BI is Delivered Traditional Implementations can be lengthy and costly 1 Understand Business 5 RFIs, RFPs and POCs 9 Build Purchase Orders 13 Test Environment 2 Define Requirements 6 Select Providers 10 Hire Technical Staff 14 Build Application 3 Assign Resources 7 Negotiate Agreements 11 Receive Equipment 15 Test and Deploy 4 Research 8 Approvals 12 Install and Configure 16 Finish Cost. Time. Risk.

Changing How BI is Delivered 1 Understand Business 2 Define Requirements 5 Build Application 3 Sign Cloud Agreement 6 Test and Deploy 7 Finish * Based on MicroStrategy Cloud Implementations in 2012 & 2013 Accelerate time to market. Improve business agility. Reduce Risk.

Two Cloud Options MicroStrategy-managed and Customer-managed

AWS Marketplace Enterprise analytics meets unlimited computing power Optimized for companies that have strong in house MicroStrategy Expertise Want complete control over the management of the BI solution Need Rapid provisioning and high flexibility in the availability of the solution. Want to rapidly connect to Data stored in the AWS Ecosystem MicroStrategy Marketplace: http://www.microstrategy.com/us/platforms/analytics/cloud?utm_s ource=mstr-world- 2014&utm_medium=presentation&utm_campaign=cloudaws#get-started AWS Marketplace: https://aws.amazon.com/marketplace/search/results/ref=gtw_nav gno_search_box?page=1&searchterms=microstrategy 32

MicroStrategy on AWS Marketplace

MicroStrategy Managed Cloud Secure Cloud Identity & Security Services Analytics Services Data Warehouse Services Data Integration Services Mobile Services Integration Services Secure Infrastructure

Optimal Distribution of Expertise Business Users Mobile and Web Apps Run Reports/Dashboards Manage Subscriptions Self-service Visual Exploration MicroStrategy BI Servers MicroStrategy Experts Monitor System Tune Operational Environment Optimize Performance Adjust Capacity Manage Upgrades IT Professionals Design Reports / Dashboards Create BI Metadata Database Design Manage Database Administer Users Developers

Out-of-the-Box Value Plug-and-play analytics platform Flexible Environments Clustering, high availability options Data backups Operational expertise DBA, VM, ETL, MSTR, OS, Performance management 24*7 Monitoring Customer Success Manager Metadata database hosting LDAP, SFTP services Data backup MicroStrategy software platform Mobile Transaction services Clustering Multisource Office Distribution Services OLAP services Access to database services Options from cost effective to large scale enterprise-class Access to ETL services Options range from cost effective cloud implementation to high performance single tenant solutions Networking High speed connections Routers/switches Secure dedicated VLAN Security Secure network architecture Intrusion detection VPN configuration and management SOC II Type 2 data center Power Facilities and Rackspace

Flexible Data Connection Options Choose Where the Data Lives No Need to Move the Data Direct Connect Let Us Do the Heavy Lifting Cloud Data Services Secure VPN On premises data Data Warehouse Data Integration MicroStrategy Architecture Optimizes Performance Best Hardware and Software On-Demand In-memory BI Push-down analytics 64-bit operations Multi-pass SQL Multi-source architecture Dual 10GB Internet connections Best-of-breed analytical database and data integration Pre-integrated and optimized

Secure Cloud Business Analytics Platform Architecture Customer Isolation Encryption Authentication Certifications & Controls Vulnerability & Penetration Testing 24x7 Monitoring & alerts Controls map to : SOC 2 Type II, PCI, HIPAA Facilities SOC2 Type II Surveillance, Biometrics Service Organization Controls (SOC) over the security, availability, and processing integrity of a system and the confidentiality and privacy of the information processed by the system. Health Insurance Portability and Accountability Act (HIPAA) designed to provide privacy standards to protect patients' medical records and other health information. Safe Harbor is intended for organizations within the EU or US that store customer data and is designed to prevent accidental information disclosure or loss. Payment Card Industry Data Security Standard (PCI DSS) is a proprietary information security standard for organizations that handle cardholder information.

Cloud Support Lifecycle Level of interactivity Who are they? The ultimate customer advocate What is their role? Proactively engage with customers to ensure MicroStrategy Cloud delivers optimal value Ensure all requests efficiently flow through MicroStrategy Schedule regular status meetings to review open issues and align with customer objectives Regularly review Cloud usage and performance metrics with customer Ensure optimally tuned systems and conduct capacity planning reviews Particularly critical at 3 stages: onboarding, upgrades, and production roll-outs 39

Optional Value Added Services Professional Services and Premium Support Requirements Application Architecture Application Development Quality Assurance Application tuning and more Available Options: Dedicated Case Manager Dedicated Support Engineer 24x7x365 Support Critical Issue Notification and more Application Platform Consulting Professional Services Managed Services Cloud Complete Cloud Plus Cloud Standard Support Platform Management & Support Dedicated Implementation Support Business Intelligence Data Services (DW, DI) Secure Infrastructure

Get Started Now 30 day free trial on the http://www.microstrategy.com/us/analytics/get-started Join the MicroStrategy 10 Beta Program on the Cloud At MicroStrategy, we continually work to improve our existing products, develop new ones and bring you leading edge technology. Before our software is available to the general public, Beta Participants evaluate new products in their own environments. betaprograms@microstrategy.com 41

Questions