Microsoft Data Platform Evolution

Transcription

1 Microsoft Data Platform Evolution New innovations Paweł Potasiński Product Manager Data Insights

2 Disclaimer There is no public release of SQL Server vnext available at the moment. Some of the presented features can disappear or be a subject of substantial changes.

3 Applications Reports Dashboards Natural language query Mobile Data Orchestration Information management Complex event processing Modeling Machine learning The Microsoft Data Platform Relational Non-relational NoSQL Streaming Internal & external

4 SQL Server 2016

5 The in-memory journey SQL Server SQL Server SQL Server SQL Server 2008 R PowerPivot in-memory for Excel PowerPivot in-memory for Excel PowerPivot in-memory for Excel PowerPivot in-memory for Excel Analysis Services in-memory Analysis Services in-memory Analysis Services in-memory In-memory ColumnStore Enhanced in-memory ColumnStore Enhanced in-memory ColumnStore In-memory OLTP In-memory OLTP In-memory in the cloud In-memory in the cloud IAAS & PAAS In-memory OLTP for greater number of apps Operational Analytics on in-memory OLTP

6 In-memory OLTP Enhancements

7 Enhanced Columnstore Indexes Clustered Additional NCI allowed PK/FK allowed AlwaysON AG supported with readable secondary Snapshot and RC Snapshot isolation levels supported Nonclustered Updateable Can be filtered New query execution strategies Online REORGANIZE removes deleted rows New DMVs, XE and PerfMon counters Parallel Insert Single thread batch mode execution Batch anti-semi-join Multiple count DISTINCT Window aggregates Sort

8 AlwaysOn Enhancements

9 Query Data Store 1.Enable Query Store. 2.Use a set of DMV s. 3.Find the bottleneck. 4.Find the fastest plan. 5.Mark fastest plan to be used for the query. ALTER DATABASE MyTestDB SET QUERY_STORE (interval_length_minutes = 1); ALTER DATABASE MyTestDB SET QUERY_STORE = ON; EXEC sp_query_store_force_plan 1, 1;

10 Always Encrypted Help protect data at rest and in motion, on-premises & cloud Apps Trusted SQL Server SELECT Name FROM Patients WHERE SELECT Name FROM Patients Query Client side Enhanced ADO.NET Column Master Key Result Set Name Jim Gray Result Set Name Jim Gray dbo.patients Name Jane Doe ciphertext SSN 1x7fg655se2e Country USA Jim Gray 0x7ff654ae6d USA John Smith 0y8fj754ea2c USA Column Encryption Key

11 Dynamic Data Masking From

12 Mission critical performance Performance Security Availability Scalability Operational analytics In-memory OLTP for more applications Query data store Always Encrypted Row Level Security Dynamic Data Masking Enhanced AlwaysOn 3 synchronous replicas for auto failover across domains Round robin load balancing of replicas DTC for transactional integrity across database instances with AlwaysOn Enhanced database caching No 16 core and 128GB of RAM restrictions in Standard Edition Native JSON Temporal database support Enhanced online operations Support for Windows Server TB memory support

13 VALUE Advanced Analytics Beyond business intelligence How can we make it happen? What will happen? Prescriptive Analytics Why did it happen? Predictive Analytics What happened? Diagnostic Analytics Descriptive Analytics Traditional BI Advanced Analytics Source: Gartner DIFFICULTY

14 PolyBase Query relational and non-relational data with T-SQL Quote: T-SQL query ************************ ********************** ********************* SQL Server Hadoop ********************** *********************** $ Name DOB State Jim Gray 11/13/58 WA Ann Smith 04/29/76 ME

15 Built-in advanced analytics In-database analytics at massive scale Example Solutions Sales forecasting Warehouse efficiency Predictive maintenance Credit risk protection Extensibility R Integration R Analytic Library T-SQL Interface 1 Relational Data Built-in to SQL Server? Data Scientist Interact directly with data Data Developer/DBA Manage data and analytics together New R scripts Microsoft Azure Marketplace

16 Enhanced Analysis & Reporting Services Scalable on-premises BI solutions & new modern reports Internet Explorer Edge Chrome Firefox Safari

17 Rich visualizations on mobile devices Business insights through rich visualizations on any device. Native apps for Windows, ios and Android

18 Deeper insights across data Access any data Scale and manage Powerful insights PolyBase Power Query for analytics and reporting Enhanced SSIS Designer support for previous SSIS versions Support for Power Query Enterprise-grade Analysis Services New single SSDT in Visual Studio 2015 Enhanced MDS Excel add-in 15x faster More granular security roles Archival options for transaction logs Reuse entities across models Built-in advanced analytics Business insights through rich visualizations on mobile devices Enhanced Reporting Services

19 Stretch SQL Server into Azure Securely stretch cold tables to Azure with remote query processing Always Encrypted Order history Microsoft Azure Name Date Item 0x21ba906fdb52 1ba906fd 2ba906f 0x19ca706fbd9a 5re316rl 1da813t 1x59cm676rfd8b 1re306fd 3ha706f 2y36cg776rgd5b 3bg606fl 1ba906i 1t64ce87r6pd7d 5ba616rj 2ra933f 0y16cj676r6fd3e 1ra806fd 3ra806t 3x47cr876r6fd9g 2hh906fj 1sa906f STRETCH; 1x11cj576rf6d3d Order history 6be916gi Stretch to cloud 3sa523t 2t74ce6676rfd9c Name Date 1hi9306fj Item 2ga906f Customer data 0y47cm776rfd1b 0x21ba906fdb52 3bi506gd 1ba906fd 1wa806f 2ba906f 4x32cj6676rfd9y 0x19ca706fbd9a 3ha916fi 5re316rl Product 1da813t 2ba913i data 0x77cf6676rfd3x 1x59cm676rfd8b 5re926gi 1re306fd 3ha706f 1ba902f Order History 2t22cm676rfd3a 2y36cg776rgd5b 1ra536fe 3bg606fl 1ba906i 1ea667i ALTER DATABASE MyERPDatabase SET STRETCH ON; ALTER TABLE dbo.[order History] ENABLE Query App

20 Hyperscale cloud Hybrid solutions Simplicity Consistency Stretch tables into Azure Power BI with on-premises data Hybrid scenarios with SSIS Enhanced backup to Azure Easy migration of on-premises SQL Server Simplified Add Azure Replica Wizard Common development, management and identity tools Consistent experience from on-premises to Azure

21 Today Complex data orchestration Non-Relational & unstructured Relational IAAS & PAAS Data

22 Tomorrow Complex data orchestration Non-Relational & unstructured Relational IAAS & PAAS Complex data orchestration Data Non-Relational & unstructured

23 Look for the SQL Server 2016 CTP2 this summer Pre-register for the SQL Server 2016 CTP & Azure SQL DW previews

24 SQL Server 2016 CTP2 Features In-Memory Enhancements Operational Analytics Always Encrypted AlwaysOn Enhancements Row Level Security Dynamic Data Native JSON Temporal Database Query Data Store

25 Enjoy SQLDay 2015 Thank you! Paweł Potasiński Product Manager Data Insights