Transcription

1

2

3

4 The Microsoft data platform capabilities Transform + analyze Data Visualize + decide Capture + manage

5 The Microsoft data platform capabilities Transform + analyze Data Visualize + decide Capture + manage

6 Hybrid Cloud Shared Lower Cost On Premises SQL SQL SQL SQL SQL SQL SQL SQL SQL Dedicated Higher Cost SQL Higher Administration Off Premises Lower Administration

7 SQL DW

8

9 Key Benefits Test Reduce project overhead TFS in Windows Azure Speed time to market Secure, redundant source code Development Work Stations SQL Server in a Windows Azure Virtual Machine Deploy SQL Server Dev Tools On-Premises SQL Server On-Premises Telenor saved 70% on test, development and demo that could be turned off when finished to minimize their capital outlays, Marius Pedersen, Telenor Group 70% savings Ready in hours, not weeks No resource limits 8

10

11 Leads to greater revenue

12 What is SQL Database? A relational database-as-a-service, fully managed by Microsoft. For cloud-designed apps when near-zero administration and enterprise-grade capabilities are key. Perfect for organizations looking to dramatically increase the DB:IT ratio. SQL Server in a VM Azure SQL Database Best for Resources TCO benefits Scalability

13 Service tiers Elastic scale & performance: Six performance levels across three tiers for scale up and down based on throughput needs. Better resource isolation Improved billing experience. Business continuity & data protection: A spectrum of business continuity and data protection features from light-weight to mission-critical across the tiers. Customers can dial up the control over data recovery and failover. Familiar & Self-managed: Unprecedented efficiencies as your applications scale with a near-zero maintenance service and a variety of familiar management tools & programmatic APIs.

14 SQL Database ready for business-class apps SLA Increased from 99.9% to 99.99% uptime SLA Performance New service design point enables scale up of resources, delivering predictable throughput & performance Protection Point-in-time-restore, geo-restore, and standard and active georeplication protect against human & environmental-initiated events Compliance Azure certifications: ISO, HIPAA BAA, EU Model Clause Auditing on SQL Database Flexibility Hourly billing & broad set of price points

15 With SQL Database Elastic Scale technology, scale out to 10s of terabytes SQL Database scale up limits Customer dimensions to consider Scale out options DTU (throughput) currently from 5 up to 1750 DTU ~1400 tx/sec* DB size from 2GB to 1TB per node Pure max data size Active portion of total data Amount of transactional workload the app will generate Largest amount of data that needs to live in the same transactional space (i.e. database) Basic, Standard, Premium B, S0-S3, P1-P11,.. * Based on Azure SQL Database Benchmark estimation and specific OLTP workload configuration

16 Basic Standard Premium P11 B S0 S1 S2 P1 P2 Performance is easily scaled up or down to meet changing workload and business needs

17 Azure SQL Database Elastic Scale Library Components 1. Shard Map Management 2. Data Dependent Routing 3. Multi-Shard Queries 4. Split-Merge Service

18 Azure SQL Database V12 Features New Azure portal is available to create SQL Database databases and servers at version V12, with additional SQL 2016 capabilities. In the portal you specify your SQL Database and then proceed to specify a SQL Database server to host it. Choose a version of SQL Database server when you use the New Azure portal to create a new database. The default is V12. Security enjoys the new feature of users in contained databases. Other features are row-level security, dynamic data masking, Auditing, Thread detection, and transparent data encryption although some of these are not yet at GA. Easier management of large databases to support heavier workloads with parallel queries (Premium only), table partitioning, online indexing, worry-free large index rebuilds with 2GB size limit removed, and more options on the ALTER DATABASE command. Support for key programmability functions to drive more robust application design with CLR integration, Transact-SQL window functions, XML indexes, and change tracking for data. Breakthrough performance with support for in-memory columnstore index queries (Premium tier only) for data mart and smaller analytic workloads. Monitoring and troubleshooting are improved with visibility into over 100 new table views in an expanded set of Database Management Views (DMVs). In Preview: Index Tuning Advisor, Query Performance Insight. New S3 performance level in the Standard tier: offers more pricing flexibility between Standard and Premium. S3 will deliver more DTUs (database throughput units) and all the features available in the Standard tier. Plus elastic Scale for high-end OLTP transaction workloads.

19

20 Introducing Azure SQL Data Warehouse Scale-out relational or non-relational Powered by the cloud Market leading price and performance Scale-out relational data warehouse

21 Introducing Azure SQL Data Warehouse Scale-out to petabytes of data Massively Parallel Processing Instant-on compute scales up/down in seconds Query relational / Hadoop Up and running in minutes No hardware to acquire, maintain, or tune Pre-tuned for optimal performance and scale No large CapEx acquisition Pay what you need: spin up/down compute on-demand Low costs to migrate on-prem DW without rewriting T-SQL Scale-out Relational Data warehouse

22 A relational data warehouse-as-a-service, fully managed by Microsoft. Industries first elastic cloud data warehouse with enterprise-grade capabilities. Support your smallest to your largest data storage needs while handling queries up to 100x faster.

23 Demo Azure SQL Data Warehouse

24

25 Not only SQL vs SQL overview Non-relational (NoSQL) Relational (SQL) Microsoft Analytics Platform System Analytical SQL Server Database Engine Azure SQL Database Azure managed data service Operational

26 DocumentDB overview A NoSQL document database-as-a-service, fully managed by Microsoft Azure. For cloud-designed apps when query over schema-free data; reliable and predictable performance; and rapid development are key. First of its kind database service to offer native support for JavaScript, SQL query and transactions over JSON documents. Perfect for cloud architects and developers who need an enterprise-ready NoSQL document database. Query JSON data with no secondary indices Native JavaScript transactional processing Familiar SQL-based query language Fast, predictable performance Tunable consistency Elastic scale Build with familiar tools REST, JSON, JavaScript Easy to start and fully-managed Enterprise-grade Azure platform

27 A document store DocumentDB Collections Document 1 Document 2 { } "name": "John", "country": "Canada", "age": 43, "lastuse": "March 4, 2014" { } "name": "Eva", "country": "Germany", "age": 25 Application Document 3 Document 4 JSON { } "name": "Lou", "country": "Australia", "age": 51, "firstuse": "May 8, 2013" { "doccount": 3, "last": "May 1, 2014" }

28 Value proposition over MongoDB Capability Managed service - SQL query language ACID transaction control through stored procedures JavaScript triggers Greater consistency control Access rights down to document level Open API with RESTful HTTP and standards based Advantage Spin up on demand with no setup and availability guarantee of 99.95%. Smooth linear price curve without VM step functions. Integration with other managed Azure services like HDInsight and Search. Leverage SQL experience and.net LINQ Simpler programing model versus using state variables Simple programing model for running JavaScript code as part of insert/update/delete actions Four levels provide more options for consistency, availability, and performance requirements Greater control for access of all documents and attachments within collections Open standards protocol for accessing and managing DocumentDB databases. Uses JSON standard no mapping of BSON to JSON needed

29 DocumentDB at Microsoft over 425 million unique users user data store store 20TB of JSON document data available globally to serve all markets store for 40+ app / device combinations under 15ms writes and single digit ms reads

30 Pricing for General Availability Standard pricing tier with hourly billing S1, S2 and S3 units differentiated by performance (good, better, best) Performance levels assigned during collection (data partition) creation Performance levels can be adjusted based on application needs Each collection includes 10GB of SSD storage Limit of 100 collections (1 TB) for each account can be lifted as needed

31 Rich query over JSON data Build modern, scalable apps with robust transactional querying and data processing on JSON documents. Unlike other document database options, DocumentDB provides a full-featured NoSQL document database service with transactional processing over multiple documents using a SQL-like query grammar and native JavaScript support. No forced, pre-defined indices allow for differentiated querying

32

33

34 Data Lake + Data Warehouse Better Together What happened? What is happening? Why did it happen? What are key relationships? Data sources What will happen? What if? How risky is it? What should happen? What is the best option? How can I optimize?

35 Hadoop Distributed File System (HDFS) For The Cloud Built from the ground-up as native HDFS Integrated w/ HDInsight, Hortonworks, Cloudera Accessible to all HDFS compliant projects (Spark, Storm, Flume, Sqoop, Kafka, R, etc.)

36 Unlimited Storage, Petabyte Files TB PB TB PB GB Unlimited account sizes Individual file sizes from GBs to PBs Immediate read/write access

37 Optimized for Massive Throughput Built for running large analytic systems that require massive throughput Automatically optimize for any throughput Optimized for parallel computation over PBs of data

38 Manage and secure your data assets Monitor performance, receive alerts, and audit usage Azure Active Directory integration for identity and access management over all of your data

39 Deployed in minutes Deployed with no hardware Deployed with no hardware to install or tune No hardware acquisition or maintenance costs Up and running in a few clicks (and within minutes) Scale-out to any amount of data on-demand

40

41 Microsoft s cloud Hadoop-as-a-Service offering De-coupled Compute and Storage 100% open source Apache Hadoop HDP Fully supported by Microsoft Built on the latest releases across Hadoop (2.6) Up and running in minutes with no hardware to deploy Harness existing.net and Java skills Utilize familiar BI tools for analysis including Microsoft Excel

42 An unified, open source, parallel, data processing framework for Big Data Analytics

43

44

45 Driver Program SparkContext Cluster Manager Worker Node Worker Node Worker Node HDFS

46 persistent RDDs. Obviously does not apply to transformations RDD RDD RDD RDD RDD actions Value

47

48 Demo HDInsight Spark Overview

49

50

51

52 End-to-End Architecture Overview Azure Stream Analytics Temporal Semantics Guaranteed delivery Guaranteed up time Event Inputs - Event Hub - Azure Blob Transform - Temporal joins - Filter - Aggregates - Projections - Windows - Etc. Enrich Correlate Outputs - SQL Database - Blob Storage - Event Hub - Power BI - Table Storage - Service Bus Queue - Service Bus Topic Reference Data - Azure Blob - Upcoming Call ML models Azure Storage Data Source Collect Process Deliver Consume

53 Easily implement temporal functions Tumbling Windows Repeating, non-overlapping, fixed interval windows Hopping Windows Generic window, overlapping, fixed size Sliding Windows Slides by an epsilon and produces output at the occurrence of an event

54

55 Scaling Functions WITH PARTITION BY Analytic Functions ISFIRST LAG Date and Time Functions DATENAME DATEPART DAY MONTH YEAR DATETIMEFROMPARTS DATEDIFF DATADD Windowing Extensions Tumbling Window Hopping Window Sliding Window Conversion Functions CAST Aggregate Functions SUM COUNT AVG MIN MAX STDEV STDEVP VAR VARP CollectTOP String Functions LEN CONCAT CHARINDEX SUBSTRING PATINDEX LOWER UPPER

56 Multi-Tenant Service No Yes No Deployment Model IaaS PaaS PaaS* Extensibility Medium Low High Deployment Complexity Medium Low Low* Cost Medium Low Med Open Source Support No No Yes Programmability.NET / LINQ SQL* SparkSQL, Scala, Python, Java Power BI Integration Rest API Yes, Native Yes, Native

57

58