Alejandro Vaisman Esteban Zimanyi. Data. Warehouse. Systems. Design and Implementation. ^ Springer

Transcription

1 Alejandro Vaisman Esteban Zimanyi Data Warehouse Systems Design and Implementation ^ Springer

2 Contents Part I Fundamental Concepts 1 Introduction A Historical Overview of Data Warehousing Spatial and Spatiotemporal Data Warehouses New Domains and Challenges Review Questions 11 2 Database Concepts Database Design The Northwind Case Study Conceptual Database Design Logical Database Design The Relational Model Normalization Relational Query Languages Physical Database Design Summary Bibliographic Notes Review Questions Exercises 48 3 Data Warehouse Concepts Multidimensional Model Hierarchies Measures OLAP Operations Data Warehouses Data Warehouse Architecture Back-End Tier Data Warehouse Tier OLAP Tier 78 xix

3 xx Contents Front-End Tier Variations of the Architecture Data Warehouse Design Business Intelligence Tools Overview of Microsoft SQL Server Tools Overview of Pentaho Business Analytics Summary Bibliographic Notes Review Questions Exercises 86 4 Conceptual Data Warehouse Design Conceptual Modeling of Data Warehouses Hierarchies Balanced Hierarchies Unbalanced Hierarchies Generalized Hierarchies Alternative Hierarchies Parallel Hierarchies Nonstrict Hierarchies Advanced Modeling Aspects Facts with Multiple Granularities Many-to-Many Dimensions Querying the Northwind Cube Using the OLAP Operations Summary Bibliographic Notes Review Questions Exercises Logical Data Warehouse Design Logical Modeling of Data Warehouses Relational Data Warehouse Design Relational Implementation of the Conceptual Model Time Dimension Logical Representation of Hierarchies Balanced Hierarchies Unbalanced Hierarchies Generalized Hierarchies Alternative Hierarchies Parallel Hierarchies Nonstrict Hierarchies Advanced Modeling Aspects Facts with Multiple Granularities Many-to-Many Dimensions Slowly Changing Dimensions 139

4 5.8 SQL/OLAP Operations Data Cube ROLLUP, CUBE, and GROUPING SETS Window Functions Definition of the Northwind Cube in Analysis Services Data Sources Data Source Views Dimensions Hierarchies Cubes Definition of the Northwind Cube in Mondrian Schemas and Physical Schemas Cubes, Dimensions, Attributes, and Hierarchies Measures Summary Bibliographic Notes Review Questions Exercises 174 Querying Data Warehouses Introduction to MDX Tuples and Sets Basic Queries Slicing Navigation Cross Join Subqueries Calculated Members and Named Sets Relative Navigation Time Series Functions Filtering Sorting Top and Bottom Analysis Aggregation Functions Querying the Northwind Cube in MDX Querying the Northwind Data Warehouse in SQL Comparison of MDX and SQL Summary Bibliographic Notes Review Questions Exercises 230

5 XXII Contents Part II Implementation and Deployment 7 Physical Data Warehouse Design Physical Modeling of Data Warehouses Materialized Views Algorithms Using Rill Information Algorithms Using Partial Information Data Cube Maintenance Computation of a Data Cube PipeSort Algorithm Cube Size Estimation Partial Computation of a Data Cube Indexes for Data Warehouses Bitmap Indexes Bitmap Compression Join Indexes Evaluation of Star Queries Data Warehouse Partitioning Queries in Partitioned Databases Managing Partitioned Databases Partitioning Strategies Physical Design in SQL Server and Analysis Services Indexed Views Partition-Aligned Indexed Views Column-Store Indexes Partitions in Analysis Services Query Performance in Analysis Services Query Performance in Mondrian Aggregate Tables Caching Summary Bibliographic Notes Review Questions Exercises Extraction, Transformation, and Loading Business Process Modeling Notation Conceptual ETL Design Using BPMN Conceptual Design of the Northwind ETL Process Integration Services and Kettle Overview of Integration Services Overview of Kettle The Northwind ETL Process in Integration Services The Northwind ETL Process in Kettle Summary 324

6 Contents xxiii 8.8 Bibliographic Notes Review Questions Exercises 32G 9 Data Analytics: Exploiting the Data Warehouse Data Mining Data Mining Tasks Supervised Classification Clustering Association Rules Pattern Growth Algorithm Sequential Patterns Data Mining in Analysis Services Key Performance Indicators Classification of Key Performance Indicators Guidelines for Defining Key Performance Indicators KPIs for the Northwind Case Study KPIs in Analysis Services Dashboards Types of Dashboards Guidelines for Dashboard Design Dashboards in Reporting Services Summary Bibliographic Notes Review Questions Exercises A Method for Data Warehouse Design Approaches to Data Warehouse Design General Overview of the Method Requirements Specification Analysis-Driven Requirements Specification Analysis-Driven Requirements for the Northwind Case Study Source-Driven Requirements Specification Source-Driven Requirements for the Northwind Case Study Analysis/Source-Driven Requirements Specification Conceptual Design Analysis-Driven Conceptual Design Analysis-Driven Conceptual Design for the Northwind Case Study Source-Driven Conceptual Design 407

7 xxiv Contents Source-Driven Conceptual Design for the Northwind Case Study Analysis/Source-Driven Conceptual Design Logical Design Logical Schemas ETL Processes Physical Design Characterization of the Various Approaches Analysis-Driven Approach Source-Driven Approach Analysis/Source-Driven Approach Summary Bibliographic Notes Review Questions Exercises 420 Part III Advanced Topics 11 Spatial Data Warehouses General Concepts of Spatial Databases Spatial Data Types Continuous Fields Conceptual Modeling of Spatial Data Warehouses Spatial Hierarchies Spatiality and Measures Implementation Considerations for Spatial Data Spatial Reference Systems Vector Model Raster Model Relational Representation of Spatial Data Warehouses Spatial Levels and Attributes Spatial Facts, Measures, and Hierarchies Topological Constraints GeoMondrian Querying the GeoNorthwind Cube in MDX Querying the GeoNorthwind Data Warehouse in SQL Spatial Data Warehouse Design Requirements Specification and Conceptual Design Logical and Physical Design Summary Bibliographic Notes Review Questions Exercises 469

8 Contents xxv 12 Trajectory Data Warehouses Mobility Data Analysis Temporal Types Temporal Spatial Types Temporal Field Types Implementation of Temporal Types in PostGIS The Northwind Trajectory Data Warehouse Querying the Northwind Trajectory Data Warehouse in SQL Summary Bibliographic Notes Review Questions Exercises New Data Warehouse Technologies MapReduce and Hadoop High-Level Languages for Hadoop Hive Pig Latin Column-Store Database Systems In-Memory Database Systems Representative Systems Vertica MonetDB MonctDB/XlOO SAPHANA Oracle TimesTen SQL Server xvelocity Real-Time Data Warehouses Extraction, Loading, and Transformation Summary Bibliographic Notes Review Questions Exercises Data Warehouses and the Semantic Web Semantic Web Introduction to RDF and RDFS RDF Serializations RDF Representation of Relational Data SPARQL RDF Representation of Multidimensional Data RDF Data Cube Vocabulary QB40LAP Vocabulary Representation of the Northwind Cube in QB40LAP Querying the Northwind Cube in SPARQL 564

9 XXVI Contents 14.6 Summary Bibliographic Notes Review Questions Exercises Conclusion Temporal Data Warehouses D/4D Spatial Data Warehouses Text Analytics and Text Data Warehouses Multimedia Data Warehouses Graph Analytics and Graph Data Warehouses 586 A Graphical Notation 589 A.l Entity-Relationship Model 589 A.2 Relational Model 591 A.3 MultiDim Model for Data Warehouses 591 A.4 MultiDim Model for Spatial Data Warehouses 595 A.5 BPMN Notation for ETL 597 References 601 Index 615