How to Leverage Cloud to Quickly Build Scalable Applications

Transcription

1 How to Leverage Cloud to Quickly Build Scalable Applications Chris Keyser Principal Solution Architect David Polley Senior Director Cloud Product Management

2 Cloud Growth Recent IDC cloud research shows that spending on public IT cloud services will reach $47.4 billion in 2013 and is expected to be more than $107 billion in Over the forecast period, public IT cloud services will have a compound annual growth rate (CAGR) of 23.5%, five times that of the industry overall. By 2017, IDC expects public IT cloud services will drive 17% of the IT product spending and nearly half of all growth across five technology categories: applications, system infrastructure software, platform as a service (PaaS), servers, and basic services.

3 Myths and Reality of Cloud Cloud Myths Security & Privacy Regulations Performance Loss of Flexibility Immature Platforms Cloud Reality Fast Deployments On-Demand Scalability Lower Operational Cost & TCO Reduced Operational Skills Rapid Access to New Capabilities Focus on Content Easier Integration Massive Flexibility Performance on Demand

4 Amazon Web Services

5 Gartner Magic Quadrant for Cloud Infrastructure as a Service Gartner Magic Quadrant for Cloud Infrastructure as a Service, Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Haynes, May 28, This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the entire report. The Gartner report is available at Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

6 What is AWS? Deployment & Administration Application Services Compute Storage Database Networking AWS Global Infrastructure

7 Security is Job Zero Physical Security Network Security Platform Security People & Procedures

8 Build everything on a constantly improving security baseline GxP ISO AS9100 ISO/TS AWS Foundation Services Compute Storage Database Networking AWS Global Infrastructure Availability Zones Regions Edge Locations AWS is responsible for the security OF the Cloud

9 AWS global infrastructure 11 Regions 28 Availability Zones 52 Edge locations

10 Unconstrained Big Data Growth EB ZB IT/Application server logs IT Infrastructure logs, Metering, Audit logs, Change logs Websites/Mobile apps/ads Clickstream, User Engagement Sensor data/iot Weather, Smart Grids, Wearables Social media, user content PB 450MM+ Tweets/day GB TB

11 Big Data Technologies and techniques for working productively with data, at any scale.

12 Creating Value from Data Assets BIG DATA Recommendations, Collective Intelligence Learning from Social Media Conversations Hypothesis Testing & Predictions Visualization Measuring Functionality and Services SOCIAL Machine Learning Sentiment Analysis Statistical Analysis Dashboards Business Intelligence Ad Hoc Queries A/B Testing

13 Big Data Potentially massive datasets Iterative, experimental style of data manipulation and analysis Frequently not a steady-state workload; peaks and valleys Time to results is key Hard to configure/manage AWS Cloud Massive, virtually unlimited capacity Iterative, experimental style of infrastructure deployment/usage Highly efficient with variable workloads Parallel clusters from single source Managed services

14 AWS Big Data Portfolio Collect Ingest Store Analyze Share AWS Direct Connect Amazon Kinesis Amazon S3 Amazon Elastic MapReduce Amazon EC2 Amazon S3 AWS Import/Export Amazon DynamoDB Amazon Redshift Amazon Redshift AWS Data Pipeline Partners Amazon Glacier Kinesis

15 AWS Marketplace AWS Online Software Store aws.amazon.com/marketplace

16 Amazon RDS: managed SQL in the cloud Simple and fast to deploy Handles repetitive management tasks Compatible with your applications Amazon RDS And introducing Amazon Aurora Fast, predictable performance Simple and fast to scale Secure Cost-effective

17 Amazon Redshift Fast, simple, petabyte-scale data warehousing for less than $1,000/TB/Year

18 Common Use Cases for Amazon Redshift Traditional Enterprise DW Companies with Big Data SaaS Companies Reduce costs by extending DW rather than adding HW Migrate completely from existing DW systems Respond faster to business Improve performance by an order of magnitude Make more data available for analysis Access business data via standard reporting tools Add analytic functionality to applications Scale DW capacity as demand grows Reduce HW & SW costs by an order of magnitude

19 Amazon Redshift Architecture Leader Node SQL endpoint Stores metadata Coordinates query execution Compute Nodes Local, columnar storage Execute queries in parallel Parallel Load, backup, restore HW optimized for data processing DW1: HDD; scale from 2TB to 2PB DW2: SSD; scale from 160GB to 326TB Ingestion Backup Restore 10 GigE (HPC) JDBC/ODBC

20 Amazon Redshift has security built-in SSL to secure data in transit Customer VPC ECDHE perfect forward security Encryption to secure data at rest JDBC/ODBC AES-256; hardware accelerated All blocks on disks & in Amazon S3 encrypted On-premises HSM & CloudHSM support Audit logging & AWS CloudTrail integration Internal VPC 10 GigE (HPC) Amazon VPC support SOC 1/2/3, PCI-DSS Level 1, FedRAMP Ingestion Backup Restore Load encrypted from S3

21 Amazon Elastic MapReduce (EMR) Hadoop 1.x & 2.x / HDFS clusters Easy to use; fully managed Support for EC2 Spot Instances S3, DynamoDB, Redshift & Kinesis Integration

22 A Typical Amazon EMR Cluster Master instance group HDFS HDFS Core instance group Task instance group Amazon S3

23 How Does Amazon EMR Work? 1. Put the data into Amazon S3 Amazon S3 Amazon EMR 2. Choose Hadoop distribution, # of nodes, types of nodes, and Hadoop apps like Hive, Pig and HBase 4. Get the output from Amazon S3 3. Launch the cluster using the EMR console, CLI, SDK, or APIs

24 How Does Amazon EMR Work? You can easily resize the cluster EMR Amazon EMR And launch parallel clusters using the same data

25 How Does Amazon EMR Work? EMR Amazon EMR Use Spot nodes to save time and money

26 How Do Amazon EMR and MicroStrategy Work? odbc EMR Amazon EMR

27 MicroStrategy Cloud

28 Changing How BI is Delivered Traditional Implementations can be lengthy and costly 1 Understand Business 5 RFIs, RFPs and POCs 9 Build Purchase Orders 13 Test Environment 2 Define Requirements 6 Select Providers 10 Hire Technical Staff 14 Build Application 3 Assign Resources 7 Negotiate Agreements 11 Receive Equipment 15 Test and Deploy 4 Research 8 Approvals 12 Install and Configure 16 Finish Cost. Time. Risk.

29 Changing How BI is Delivered 1 Understand Business 2 Define Requirements 5 Build Application 3 Sign Cloud Agreement 6 Test and Deploy 7 Finish * Based on MicroStrategy Cloud Implementations in 2012 & 2013 Accelerate time to market. Improve business agility. Reduce Risk.

30 Two Cloud Options MicroStrategy-managed and Customer-managed

31 AWS Marketplace Enterprise analytics meets unlimited computing power Optimized for companies that have strong in house MicroStrategy Expertise Want complete control over the management of the BI solution Need Rapid provisioning and high flexibility in the availability of the solution. Want to rapidly connect to Data stored in the AWS Ecosystem MicroStrategy Marketplace: ource=mstr-world- 2014&utm_medium=presentation&utm_campaign=cloudaws#get-started AWS Marketplace: gno_search_box?page=1&searchterms=microstrategy 32

32 MicroStrategy on AWS Marketplace

33 MicroStrategy Managed Cloud Secure Cloud Identity & Security Services Analytics Services Data Warehouse Services Data Integration Services Mobile Services Integration Services Secure Infrastructure

34 Optimal Distribution of Expertise Business Users Mobile and Web Apps Run Reports/Dashboards Manage Subscriptions Self-service Visual Exploration MicroStrategy BI Servers MicroStrategy Experts Monitor System Tune Operational Environment Optimize Performance Adjust Capacity Manage Upgrades IT Professionals Design Reports / Dashboards Create BI Metadata Database Design Manage Database Administer Users Developers

35 Out-of-the-Box Value Plug-and-play analytics platform Flexible Environments Clustering, high availability options Data backups Operational expertise DBA, VM, ETL, MSTR, OS, Performance management 24*7 Monitoring Customer Success Manager Metadata database hosting LDAP, SFTP services Data backup MicroStrategy software platform Mobile Transaction services Clustering Multisource Office Distribution Services OLAP services Access to database services Options from cost effective to large scale enterprise-class Access to ETL services Options range from cost effective cloud implementation to high performance single tenant solutions Networking High speed connections Routers/switches Secure dedicated VLAN Security Secure network architecture Intrusion detection VPN configuration and management SOC II Type 2 data center Power Facilities and Rackspace

36 Flexible Data Connection Options Choose Where the Data Lives No Need to Move the Data Direct Connect Let Us Do the Heavy Lifting Cloud Data Services Secure VPN On premises data Data Warehouse Data Integration MicroStrategy Architecture Optimizes Performance Best Hardware and Software On-Demand In-memory BI Push-down analytics 64-bit operations Multi-pass SQL Multi-source architecture Dual 10GB Internet connections Best-of-breed analytical database and data integration Pre-integrated and optimized

37 Secure Cloud Business Analytics Platform Architecture Customer Isolation Encryption Authentication Certifications & Controls Vulnerability & Penetration Testing 24x7 Monitoring & alerts Controls map to : SOC 2 Type II, PCI, HIPAA Facilities SOC2 Type II Surveillance, Biometrics Service Organization Controls (SOC) over the security, availability, and processing integrity of a system and the confidentiality and privacy of the information processed by the system. Health Insurance Portability and Accountability Act (HIPAA) designed to provide privacy standards to protect patients' medical records and other health information. Safe Harbor is intended for organizations within the EU or US that store customer data and is designed to prevent accidental information disclosure or loss. Payment Card Industry Data Security Standard (PCI DSS) is a proprietary information security standard for organizations that handle cardholder information.

38 Cloud Support Lifecycle Level of interactivity Who are they? The ultimate customer advocate What is their role? Proactively engage with customers to ensure MicroStrategy Cloud delivers optimal value Ensure all requests efficiently flow through MicroStrategy Schedule regular status meetings to review open issues and align with customer objectives Regularly review Cloud usage and performance metrics with customer Ensure optimally tuned systems and conduct capacity planning reviews Particularly critical at 3 stages: onboarding, upgrades, and production roll-outs 39

39 Optional Value Added Services Professional Services and Premium Support Requirements Application Architecture Application Development Quality Assurance Application tuning and more Available Options: Dedicated Case Manager Dedicated Support Engineer 24x7x365 Support Critical Issue Notification and more Application Platform Consulting Professional Services Managed Services Cloud Complete Cloud Plus Cloud Standard Support Platform Management & Support Dedicated Implementation Support Business Intelligence Data Services (DW, DI) Secure Infrastructure

40 Get Started Now 30 day free trial on the Join the MicroStrategy 10 Beta Program on the Cloud At MicroStrategy, we continually work to improve our existing products, develop new ones and bring you leading edge technology. Before our software is available to the general public, Beta Participants evaluate new products in their own environments. 41

41 Questions