Analysis of Mul-- dimensional data with MDX (covering MS Analysis Services, Oracle Hyperion, Cognos TM1, & SAP BW)

Transcription

1 Analysis of Mul-- dimensional data with MDX (covering MS Analysis Services, Oracle Hyperion, Cognos TM1, & SAP BW) Mohamed Diakite Pineda

2 Agenda Overview: Connec-ng to OLAP Sources OLAP Repor5ng Principles OLAP to MicroStrategy Objects OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor5ng Roadmap Ques5ons and Answers 2

3 Demo Connec5ng to OLAP sources

4 Connec5ng to OLAP Sources Overview of Components & Protocols to Connect to OLAP Sources IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (MSSAS) ODBO (TM1) Essbase C API Java Connector (JCO) SAP JCO (SAP BAPI) Microsoft Analysis Services OLE DB Provider TM1 OLEDB Provider Oracle Essbase C API Third-party libraries

5 Connec5ng to OLAP Sources Connec5ng to SAP BW Intelligence Server Windows: Add SAP JCO libraries to Intelligence Server s home directory. (E.g. C:\Program Files(x86)\Common\MicroStrategy) Linux: Set SAP JCO library location in env/sap.sh Java Connector (JCO) SAP JCO (SAP BAPI) sapjco.*

6 Connec5ng to OLAP Sources Connec5ng to SAP BW Intelligence Server Java Connector (JCO) SAP JCO (SAP BAPI)

7 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider IIS Install MDX Cube Provider

8 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (MSSAS) ODBO (TM1) Essbase C API Configure MDX Cube Provider one time in Datasources.xml (only one provider per MDX Cube Provider instance) Authentication methods (simple/integrated) Type of provider (Essbase, MSSAS, TM1)

9 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with MSSAS IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (MSSAS) Microsoft Analysis Services OLE DB Provider

10 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with MSSAS IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (MSSAS) URL to MDX Cube Provider MSSAS Server Database/Catalog Microsoft Analysis Services OLE DB Provider

11 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with Oracle Essbase IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider Essbase C API Oracle Essbase C API Register Essbase API: Program Files (x86)/common/ MicroStrategyEssbaseConnector_SetEnv_64_64.bat

12 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with Oracle Essbase IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider Essbase C API URL to MDX Cube Provider Essbase Server Essbase Application Oracle Essbase C API

13 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with TM1 IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (TM1) TM1 OLEDB Provider

14 Connec5ng to OLAP Sources MicroStrategy MDX Cube Provider with TM1 IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (TM1) URL to MDX Cube Provider TM1 Server TM1 Configuration/Catalog TM1 OLEDB Provider

15 Connec5ng to OLAP Sources Overview of Components & Protocols to Connect to OLAP Sources IIS Intelligence Server XMLA (HTTP) MicroStrategy MDX Provider ODBO (MSSAS) ODBO (TM1) Essbase C API Java Connector (JCO) SAP JCO (SAP BAPI) Microsoft Analysis Services OLE DB Provider TM1 OLEDB Provider Oracle Essbase C API Third-party libraries

16 Connec5ng to OLAP Sources Authen5ca5on Authentication Mechanism MSSAS Essbase SAP TM1 Basic Authentication Kerberos Authentication Connection Mapping SAP SCN Trust Authentication N/A N/A N/A 16

17 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor-ng Principles OLAP Repor5ng in MicroStrategy OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor5ng Roadmap Ques5ons and Answers 17

18 OLAP Repor5ng Principles OLAP Online Analytical Processing Analysis of business data in a multi-dimensional array of data Cube

19 OLAP Repor5ng Principles Cubes and Dimensions What is an OLAP cube? Time Product Electronics , Books Music Movies Beer Table = 2-Dimensional Cube Cubes are made of Dimensions Measures Product dimension has 5 members (Electronics, Books, etc.) Time dimension has also 5 members (2001, 2002, etc.) Measure is Revenue

20 OLAP Repor5ng Principles Measures Can I have multiple measures in a cube? YES, cubes can have multiple measures Product Time Measures Revenue Qty Sld Revenue Qty Sld Electro Books Beer Time Product Electro Books Beer Revenue Time Product Electro 3 30 Books 4 8 Beer Qty Sold

21 OLAP Repor5ng Principles Measures Measures is another dimension (generally, without hierarchies, though) Overlap those two individual tables, each with a different measure, and you get a cube Products Beer Music Movies Books Qty Sold Electronic s Measures Time Revenue CUBE with 3 dimensions: Products, Time, Measures

22 OLAP Repor5ng Principles Measures Each unique value occurs at at the intersection of three members of different dimensions: Cell (or tuple, in MDX) Products Beer Music Movies (Electronics, 2006, Revenue) = $23.3 Books Electronics Time Measures 3 Dimensions

23 OLAP Repor5ng Principles Hierarchies Elements in Dimensions are organized in Hierarchies: I want quarterly data, not just monthly data Products Time Electronics Books Music Movies Beer 2001 Q1 Jan Feb Data can exist at multiple levels in the time dimension in the cube: Year, Quarter, Month Mar Q1 Total Total Year, Quarter and Month form a hierarchy of time members. Data can be aggregated at the different time hierarchy levels; cubes can do complex rollups (not just sums)

24 OLAP Repor5ng Principles Hierarchies The Product Dimension, a hierarchy might look like this This hierarchy has levels [All Products] is also a member! Product Dimension All All Products Category Electronics Books Beer Subcategory Computers TVs & Audio Fiction Non-fiction Travel Lager Ale Item Macbook Pro 13 Samsung LCD 2x5 BI Utopia IT Drives Business MDX for All Lonely Planet: China XX Lager Duvel Chimay Each level has members

25 OLAP Repor5ng Principles Hierarchies The Products Dimension may be organized differently: by category and by brands Multiple Hierarchies may exist in a Dimension All brands All Products Electronics Beer General Electric Samsung Computers Lager Ale HomeAppliance Plus Pureview XX Lager Duvel Galaxy Chimay

26 OLAP Repor5ng Principles Wrap- up Products Beer Dimensions Members Hierarchies and Levels Music Movies Books Electronics Jan Feb Mar Apr May Jun Time Measures is another dimension Measures Q Q

27 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor5ng Principles OLAP Repor-ng in MicroStrategy OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor5ng Ques5ons and Answers 27

28 OLAP Repor5ng in MicroStrategy ODBO OLE DB for OLAP (Object Linking and Embedding, Database for Online Analytical Processing abbreviated ODBO) is Microsoft published specification and an industry standard for multi-dimensional data processing OLAP Provider ODBO MicroStrategy MSSAS Essbase TM1 SAP Catalog Schema Cube Dimension Hierarchy Level Schema (per DB Instance) Ignored MDX Cube Dimension Hierarchy Attribute Member Attribute Element Member Properties Attribute Forms ODBO Drivers SAP JCO Essbase C API MicroStrategy objects 28

29 OLAP Repor5ng in MicroStrategy ODBO - MSSAS Sharing: MDX cubes in a given Schema share the Dimensions, Hierarchies, Levels (attributes), as in the source. MSSAS ODBO MicroStrategy Database Catalog Schema (per DB Instance) N/A Schema Ignored Cube/Perspective Cube MDX Cube Dimension Dimension Dimension Hierarchy Hierarchy Hierarchy Level Level Attribute Member Member Attribute Element Member Properties Member Properties Attribute Forms MSSAS ODBO Driver MicroStrategy objects 29

30 OLAP Repor5ng in MicroStrategy ODBO - Essbase Measures as Dimension: Measures dimension can be treated as an attribute dimension (instead of as Metrics) Sharing: Each MDX cube has its own private Dimensions, Hierarchies, Attributes. Hierarchies: Essbase only exposes a single hierarchy per Dimension. Essbase ODBO MicroStrategy Application Catalog Schema (per DB Instance) N/A Schema Ignored Database Cube MDX Cube Dimension Dimension Dimension Hierarchy Hierarchy Hierarchy Level Level Attribute Member Member Attribute Element Member Properties (9.3+) Member Properties Attribute Forms Essbase Essbase C API MicroStrategy objects 30

31 OLAP Repor5ng in MicroStrategy ODBO SAP BW Certification: MicroStrategy is SAP-Certified: BW-OBI 2.0 External interface for OLAP client application Sharing: Dimensions/Hierarchies are shared across cubes in a Catalog (as in the Source) SAP BW ODBO MicroStrategy InfoCube Catalog Schema (per DB Instance) N/A Schema Ignored InfoCube/Query Cube MDX Cube Characteristic Dimension Dimension Hierarchy Hierarchy Hierarchy Virtual Level Level Attribute Characteristic Value Member Attribute Element Display Attributes Member Properties Attribute Forms SAP BW SAP JCO (OLAP BAPI) MicroStrategy objects 31

32 OLAP Repor5ng in MicroStrategy ODBO TM1 Sharing: Dimensions/Hierarchies are shared across cubes in a Catalog (as in the Source) TM1 ODBO MicroStrategy Server Catalog Schema (per DB Instance) N/A Schema Ignored Cube Cube MDX Cube Dimension Dimension Dimension Hierarchy Hierarchy Hierarchy Level Level Attribute Element Member Attribute Element Attribute Member Properties Attribute Forms TM1 ODBO Driver MicroStrategy objects 32

33 OLAP Repor5ng in MicroStrategy Making OLAP Cube Available in MicroStrategy Corresponding MicroStrategy attributes, hierarchies and metrics. Cube Structure 33

34 OLAP Repor5ng in MicroStrategy Configura5on SeRngs - Hierarchy Proper5es: Ragged Hierarchies Treats hierarchies as ragged for display purposes only Subtotals are still internally aggregated by Analytical Engine (planned enhancement) 34

35 OLAP Repor5ng in MicroStrategy Configura5on SeRngs - Hierarchy Proper5es: Ragged Hierarchies Rows when Hierarchy is Balanced Rows when Unbalanced Hierarchy setting set Hierarchies marked as unbalanced/ragged = Keeping all rows even if some do not have corresponding elements in all levels 35

36 OLAP Repor5ng in MicroStrategy Configura5on SeRngs - Hierarchy & Level Proper5es: Source Order Retrieves & saves member sort order If enabled, recommendation is to update hierarchy structure regularly with changing data. Setting also available for Hierarchy Levels For example: charts of accounts make sense in certain order only. 36

37 OLAP Repor5ng in MicroStrategy Configura5on SeRngs - Measures: Addi5onal Metrics Compound Metrics based on imported measures. Custom MDX Expressions as calculated members of Measures dimension (useful for transformations, conditional metrics, etc.) 37

38 OLAP Repor5ng in MicroStrategy Configura5on SeRngs - MDX VLDB SeRngs Control MDX syntax or features For example: Cell Level Formatting Non empty keyword Date format 38

39 Demo Modeled OLAP Configura5on SeRngs

40 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor5ng OLAP Repor5ng in MicroStrategy OLAP vs. Rela-onal Repor-ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor5ng Roadmap Ques5ons and Answers 40

41 Rela5onal Repor5ng Schema based on Tables Objects Mapped to table columns Attributes Facts Transformations

42 OLAP Repor5ng Schema based on Cubes OLAP Cubes contain business/reporting logic Attributes, Hierarchies, Metrics represent semantics of OLAP cube

43 Rela5onal Repor5ng Applica5on Objects Application objects contain business/reporting logic (e.g. how data is aggregated) Application objects determine what and how to get data from databases

44 OLAP Repor5ng Applica5on Objects Application objects only list what to retrieve from the cube (not how)

45 Rela5onal Repor5ng Query Language SQL is generated based on reporting logic in application objects SQL says what and how data is retrieved from relational sources

46 OLAP Repor5ng Query Language MDX says only what is retrieved from OLAP sources Report Report: MDX View

47 OLAP vs. Rela5onal Repor5ng How do OLAP and Rela5onal repor5ng compare? Schema Objects ROLAP Attributes Facts Transformations Hierarchies Others (Partition Map,etc.) -- MOLAP Attributes Hierarchies -- Metrics Application Objects Metrics Filters Prompts Consolidations Custom Groups Derived Elements Reports Documents Etc. Metrics Filters Consolidations Custom Groups Prompts Derived Elements Reports Documents Etc.

48 OLAP vs. Rela5onal Repor5ng Rela5onal and OLAP Repor5ng Together App Objects Schema Objects City Store Discount Data Sources ROLAP MOLAP MOLAP Self- Service Project Schema MDX Schema MDX Schema * Very simplified view

49 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor5ng OLAP Repor5ng in MicroStrategy OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela-onal Repor-ng Data Import vs. Modeled OLAP Repor5ng Roadmap Ques5ons and Answers 49

50 Blending OLAP and Rela5onal Repor5ng Map OLAP cube to Project AUributes Multi-source scenario App Objects Schema Objects City Store Discount Data Sources ROLAP MOLAP MOLAP Self- Service Project Schema MDX Schema MDX Schema

51 Blending OLAP and Rela5onal Repor5ng Map OLAP cube to Project AUributes Go to MDX Cube Catalog Right-mouse click on object, choose Map Refresh Schema 51

52 Blending OLAP and Rela5onal Repor5ng Map OLAP cube to Project AUributes Mapping to Project ANributes Mul5- source AUributes: reports with project auributes and metrics from database or OLAP cubes Standalone Filters Security Filter Custom Groups Consolida5ons Common selectors, groupings in Report Services documents 52

53 Blending OLAP and Rela5onal Repor5ng Mapping Objects between OLAP Cubes Cube A Choose a Year Query A Var1 Var 2 Var1 Query B

54 Blending OLAP and Rela5onal Repor5ng Map OLAP cube to Project AUributes Mapping to Other Cubes Avoiding redundant prompts: SAP BW Variables Switching cubes in a report 54

55 Demo Mapping OLAP cube to Project Schema and Mul5source

56 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor5ng OLAP Repor5ng in MicroStrategy OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor-ng Roadmap Ques5ons and Answers 56

57 Data Import vs. Modeled OLAP Repor5ng Configura5on Feature Modeling Data Import Needs MDX Cube Provider (non-sap) Needs SAP JCO libraries in Intelligence Server (SAP) Supports Kerberos Authentication (MSSAS, TM1, SAP only) Database Instance need to be configured in Developer 57

58 Data Import vs. Modeled OLAP Repor5ng Func5onality Feature Modeling Data Import Ragged Hierarchy Support Configurable Automatic Source Order Functionality Configurable Unexposed Compound Metrics Pass-through MDX Calculated Members Configurable Unexposed VLDB Settings (Non empty, Cell-level Formatting, etc.) VLDB settings are set at Database Instance and Report levels Configurable Configurable for DB Instance Multi-source reporting / Data Blending Attribute Mapping Visual Insight Attr. Linking 58

59 Demo OLAP Repor5ng from VI with Data Blending

60 Data Import vs. Modeled OLAP Repor5ng Recommenda5ons Use Data Import workflows preferably: End user experience is better Improvements will appear first in Data Import Use modeled way if there are needs for advanced features (pass-through metrics, source order, etc.) there is a need to load data to Intelligent Cubes 60

61 Agenda Overview: Connec5ng to OLAP Sources OLAP Repor5ng OLAP Repor5ng in MicroStrategy OLAP vs. Rela5onal Repor5ng Blending OLAP and Rela5onal Repor5ng Data Import vs. Modeled OLAP Repor5ng Roadmap Ques5ons and Answers 61

62 Roadmap Overview Short-Term Mid-term Long-term Hierarchical Attribute on template (better support of ragged/unbalanced hierarchies) Subtotals from source (support non-additive measures in MDX) Filter Panel (for hierarchical attribute) Incremental Fetch (Server-to-Client) Derived Elements (on Hierarchical Attribute) / Custom Sorting Calculated members (pass-through DEs)

63 Questions and Answers MicroStrategy World