The IT and Analyst's Perspectives: Advanced BI with PowerPivot DAX, SharePoint Dashboards, and SQL Data Mining

Transcription

1 The IT and Analyst's Perspectives: Advanced BI with PowerPivot DAX, SharePoint Dashboards, and SQL Data Mining Rafal Lukawiecki Strategic Consultant, Project Botticelli Ltd 1 1

2 Objectives Introduce more advanced BI analytics from Microsoft Discuss using SharePoint 2010 as a BI Dashboard environment This seminar is based on a number of sources including a few dozen of Microsoft-owned presentations, used with permission. Thank you to Chris Dial, Tara Seppa, Aydin Gencler, Ivan Kosyakov, Bryan Bredehoeft, Marin Bezic, and Donald Farmer with his entire team for all the support. 2 The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation. Portions 2010 Project Botticelli Ltd & entire material 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation. Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE. 2

3 3 PowerPivot on SharePoint 2010 Manageability

4 PowerPivot for SharePoint 2010 Managed Self-Service Business Intelligence Collaborative, shared gallery of PowerPivots IT Pro management Lifecycle & Workflow Server Resource Management 4 4

5 Share Insights Common view of organizational performance 5 5

6 6 1. PowerPivot for SharePoint: Uploading Documents to Server 2. Galleries

7 Managing the BI Environment User driven application administration and monitoring Manage and facilitate access to secure organizational data 7 7

8 8 1. PowerPivot Management Dashboard 2. Anticipating a self-created BI that can become an organisational concern

9 PowerPivot Client Architecture 9 9

10 PowerPivot Part of SharePoint 10 10

11 13 PowerPivot DAX

12 Data Analysis Expressions (DAX) Simple Excel-style formulas Define new fields in the PivotTable field list Enable Excel users to perform powerful data analysis using the skills they already have Has elements of MDX but does not replace MDX 14 14

13 Data Analysis Expressions (DAX) No notion of addressing individual cells or ranges DAX functions refer to columns in the data Sample DAX expression Means: = [First Name] & & [Last Name] String concatenation just like Excel =SUM(Sales[Amount]) SUM function takes a column name instead of a range of cells =RELATED (Product[Cost]) new RELATED function follows relationship between tables 15 15

14 More than 80 Excel Functions in DAX 17 Date and Time Information Math and Trig Statistical Text DATE ISBLANK ABS AVERAGE CONCATENATE DATEVALUE ISERROR CEILING, ISO.CEILING AVERAGEA EXACT DAY ISLOGICAL EXP COUNT FIND EDATE ISNONTEXT FACT COUNTA FIXED EOMONTH ISNUMBER FLOOR COUNTBLANK LEFT HOUR ISTEXT INT MAX LEN MINUTE LN MAXA LOWER MONTH Logical LOG MIN MID NOW AND LOG10 MINA REPLACE SECOND IF MOD REPT TIME IFERROR MROUND RIGHT TIMEVALUE NOT PI SEARCH TODAY OR POWER SUBSTITUTE WEEKDAY FALSE QUOTIENT TRIM WEEKNUM TRUE RAND UPPER YEAR RANDBETWEEN VALUE YEARFRAC ROUND ROUNDDOWN ROUNDUP SIGN SQRT SUM SUMSQ TRUNC 17

15 Example: Functions over a Time Period TotalMTD (Expression, Date_Column [, SetFilter]) TotalQTD (Expression, Date_Column [, SetFilter]) TotalYTD (Expression, Date_Column [, SetFilter] [,YE_Date]) OpeningBalanceMonth (Expression, Date_Column [,SetFilter]) OpeningBalanceQuarter (Expression, Date_Column [,SetFilter]) OpeningBalanceYear (Expression, Date_Column [,SetFilter] [,YE_Date]) ClosingBalanceMonth (Expression, Date_Column [,SetFilter]) ClosingBalanceQuarter (Expression, Date_Column [,SetFilter]) ClosingBalanceYear (Expression, Date_Column [,SetFilter] [,YE_Date]) 18 18

16 19 1. DAX for Creating Calculated Measures 2. DAX for Creating New Columns

17 20 SharePoint 2010 BI Dashboards: PerformancePoint Services

18 PPS in SharePoint 2010 PerformancePoint Services in SharePoint 2010 improve over PerformancePoint Server 2007: SharePoint does all security, management, backup, respository of dashboard Decomposition Tree KPI Details Scorecard drilldown, dynamic hierarchies, calculated KPIs Dynamic, up-to-date filters for time intelligence SharePoint Dashboard Designer is smoother Better accessibility Analytic charts with value filtering and server-based conditional formatting 21 21

19 Monitoring with PPS Business users can build performance dashboards easily 22 22

20 Analytics with PPS Integration of KPIs and analytics Multidimensional slice and dice, drill-across, drill-to-detail, root-cause analysis, prediction and centralized business logic definitions No coding 23 23

21 Reporting and Consolidation in PPS Combine operational and financial data into one report No need to reconsolidate manually Dynamic and standard reports Consistent live reports published from Excel to Reporting Services and SharePoint 24 24

22 27 1. Building a Dashboard, Scorecard, and a KPI Using SharePoint Server PerformancePoint Services

23 28 Visualising BI with Microsoft Visio and SharePoint 2010

24 Two Trends that Lead to The Messy Diagram 29

25 Data Visualization Fault Analysis Tree Color By Value Text Callouts Status Indicators Data Bars 30

26 Data Visualization Manufacturing Specialized Shapes 31

27 Strategy Maps Visualize PPS Scorecard data in context 32 32

28 33 Data Mining with SQL Server

29 What does Data Mining Do? Explores Your Data Finds Patterns Performs Predictions 34 34

30 Data Mining Techniques Algorithm Decision Trees Association Rules Clustering Naïve Bayes Sequence Clustering Time Series Neural Nets Linear Regression Logistic Regression Description Finds the odds of an outcome based on values in a training set Identifies relationships between cases Classifies cases into distinctive groups based on any attribute sets Clearly shows the differences in a particular variable for various data elements Groups or clusters data based on a sequence of previous events Analyzes and forecasts time-based data combining the powerof ARTXP (developed by Microsoft Research) for short-term predictionswith ARIMA (in SQL 2008) for long-term accuracy. Seeks to uncover non-intuitive relationships in data Determines the relationship between columns in order to predict an outcome Determines the relationship between columns in order to evaluate the probability that a column will contain a specific state 38 38

31 40 1. Association Rules for Market Basket Analysis 2. Automatic recommendation engine using DMX queries

32 Summary SharePoint makes PowerPivot manageable Advanced self-service analysis requires a rich expression language: DAX Team, and organisational BI dashboards and scorecards are easy to build using SharePoint 2010 Data Mining enables advanced pattern (correlation) discovery in your data 41 41

33 Agenda 14:00 14:15 Summary: BI in Your Enterprise 14:15 15:15 Lunch 15:15 16:30 Microsoft Visual Studio

34 2010 Microsoft Corporation & Project Botticelli Ltd. All rights reserved. The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation. Portions 2010 Project Botticelli Ltd & entire material 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation. Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE