Managing a Fragmented XML Data Cube with Oracle and Timesten



Similar documents
Alejandro Vaisman Esteban Zimanyi. Data. Warehouse. Systems. Design and Implementation. ^ Springer

Using the column oriented NoSQL model for implementing big data warehouses

Data Warehousing Systems: Foundations and Architectures

LEARNING SOLUTIONS website milner.com/learning phone

A Design and implementation of a data warehouse for research administration universities

DIMENSION HIERARCHIES UPDATES IN DATA WAREHOUSES A User-driven Approach

MS 20467: Designing Business Intelligence Solutions with Microsoft SQL Server 2012

Building Views and Charts in Requests Introduction to Answers views and charts Creating and editing charts Performing common view tasks

DWEB: A Data Warehouse Engineering Benchmark

Data Warehouses & OLAP

OLAP and OLTP. AMIT KUMAR BINDAL Associate Professor M M U MULLANA

DATA CUBES E Jayant Haritsa Computer Science and Automation Indian Institute of Science. JAN 2014 Slide 1 DATA CUBES

Business Intelligence, Data warehousing Concept and artifacts

OLAP and Data Warehousing! Introduction!

Course 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Analysis Services

Tiber Solutions. Understanding the Current & Future Landscape of BI and Data Storage. Jim Hadley

Concepts of Database Management Seventh Edition. Chapter 9 Database Management Approaches

Data W a Ware r house house and and OLAP II Week 6 1

BUILDING OLAP TOOLS OVER LARGE DATABASES

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence

CUBE INDEXING IMPLEMENTATION USING INTEGRATION OF SIDERA AND BERKELEY DB

Copyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 29-1

<Insert Picture Here> Extending Hyperion BI with the Oracle BI Server

Designing Business Intelligence Solutions with Microsoft SQL Server 2012 Course 20467A; 5 Days

Modelling Architecture for Multimedia Data Warehouse

Data Warehousing and Decision Support. Introduction. Three Complementary Trends. Chapter 23, Part A

SAP HANA In-Memory Database Sizing Guideline

Whitepaper. Innovations in Business Intelligence Database Technology.

In-Memory Analytics: A comparison between Oracle TimesTen and Oracle Essbase

<Insert Picture Here> Enhancing the Performance and Analytic Content of the Data Warehouse Using Oracle OLAP Option

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database Option

ORACLE OLAP. Oracle OLAP is embedded in the Oracle Database kernel and runs in the same database process

Implementing Data Models and Reports with Microsoft SQL Server

Data Warehousing Concepts

OLAP Theory-English version

MS 50511A The Microsoft Business Intelligence 2010 Stack

"The performance driven Enterprise" Emerging trends in Enterprise BI Platforms

SQL Server Analysis Services Complete Practical & Real-time Training

IMPLEMENTATION OF DATA WAREHOUSE SAP BW IN THE PRODUCTION COMPANY. Maria Kowal, Galina Setlak

Associate Professor, Department of CSE, Shri Vishnu Engineering College for Women, Andhra Pradesh, India 2

When to consider OLAP?

Databases in Organizations

An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise

Alexander Nikov. 5. Database Systems and Managing Data Resources. Learning Objectives. RR Donnelley Tries to Master Its Data

Part 22. Data Warehousing

A Model-based Software Architecture for XML Data and Metadata Integration in Data Warehouse Systems

SAP HANA PLATFORM Top Ten Questions for Choosing In-Memory Databases. Start Here

The IBM Cognos Platform for Enterprise Business Intelligence

OLAP. Business Intelligence OLAP definition & application Multidimensional data representation

Dimensional Modeling for Data Warehouse

Data Warehouse Design

Oracle Architecture, Concepts & Facilities

14. Data Warehousing & Data Mining

M Designing and Implementing OLAP Solutions Using Microsoft SQL Server Day Course

Turning your Warehouse Data into Business Intelligence: Reporting Trends and Visibility Michael Armanious; Vice President Sales and Marketing Datex,

SQL Server 2012 End-to-End Business Intelligence Workshop

Data W a Ware r house house and and OLAP Week 5 1

Oracle Database 11g Comparison Chart

Course DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

SQL Server and MicroStrategy: Functional Overview Including Recommendations for Performance Optimization. MicroStrategy World 2016

Implementing Data Models and Reports with Microsoft SQL Server 20466C; 5 Days

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

MDM for the Enterprise: Complementing and extending your Active Data Warehousing strategy. Satish Krishnaswamy VP MDM Solutions - Teradata

Birds of a Feather Session: Best Practices for TimesTen on Exalytics

SAS BI Course Content; Introduction to DWH / BI Concepts

SQL Server 2012 Business Intelligence Boot Camp

Data warehousing with PostgreSQL

<Insert Picture Here> Oracle Database Directions Fred Louis Principal Sales Consultant Ohio Valley Region

Introducing Oracle Exalytics In-Memory Machine

Curriculum of the research and teaching activities. Matteo Golfarelli

Big Data, Fast Data, Complex Data. Jans Aasman Franz Inc

Well packaged sets of preinstalled, integrated, and optimized software on select hardware in the form of engineered systems and appliances

The Microsoft Business Intelligence 2010 Stack Course 50511A; 5 Days, Instructor-led

DATA WAREHOUSE CONCEPTS DATA WAREHOUSE DEFINITIONS

Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

Sai Phanindra. Summary. Experience. SQL Server, SQL DBA and MSBI SQL School saiphanindrait@gmail.com

Decision Support. Chapter 23. Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke 1

New Approach of Computing Data Cubes in Data Warehousing

Introduction to Oracle Business Intelligence Standard Edition One. Mike Donohue Senior Manager, Product Management Oracle Business Intelligence

End to End Microsoft BI with SQL 2008 R2 and SharePoint 2010

Microsoft Implementing Data Models and Reports with Microsoft SQL Server

Chapter 5. Warehousing, Data Acquisition, Data. Visualization

Subject Description Form

Conceptual Workflow for Complex Data Integration using AXML

Report Model (SMDL) Alternatives in SQL Server A Guided Tour of Microsoft Business Intelligence

Safe Harbor Statement

Oracle Warehouse Builder 10g

Transcription:

ACM Fifteenth International Workshop On Data Warehousing and OLAP (DOLAP 2012) Maui, Hawaii, USA November 2nd, 2012 Managing a Fragmented XML Data Cube with Oracle and Timesten Doulkifli BOUKRAA, ESI, Algiers, Algeria Omar BOUSSAID, Fadila BENTAYEB, ERIC Lab, Univ. Lyon 2 France {omar.boussaid, fadila.bentayeb}@univ-lyon2.fr Djamel Eddine ZEGOUR, ESI, Algiers, Algeria 1

Outline Context and Motivation Timesten in-memory Database XML Data Cube XML Cube Management Configurations Implementation and Testing Related Work Conclusion 2

Context and motivation Performance optimization of data warehouses (DW) Focus on a special type of DWs: XML warehouses Warehousing and analyzing complex data Multidimensional model: conceptual, logical, physical level Performance issues Vertical fragmentation approach proposed Crossing two techniques Vertical Fragmentation Caching 3

Objectives and Contribution Objective: Analyze the impact of vertical fragmentation on caching and vice versa A better cache management (data organization-aware) Leverage the vertical fragmentation Contributions A set of configurations to manage a fragmented XML cube A comparision between the configurations 4

TimesTen In-Memory database Oracle s In-memory database solution Different uses of TimesTen As a database cache for a disk resident database Read-only transactions Read-Write transactions As a full-featured relational database Persistence Recovery 5

XML cubemodel General Cube Schema 6

XML Cube Model Instantiation: Auction cube 7

XML Cube Model Unfragmented XML cube Basic configuration Fact and each dimension member = one XML document Formally: UXCube ={D i, i=1, } set of XML documents Di ={P i j, i=1,, j=1, }set of XML properties accessed by XPath 8

XML Cube Model Before fragmentation After fragmentation 9

XML Cube Model 10

XML Cube Model Fragmented XML cube: example 11

XML Cube Management Configurations 12

XML Cube Management Configurations Instantiation: Auction cube configurations 13

Implementation and Testing Disk Resident Database: Oracle 11g Rel. 2 Database cache and in-memory database: Oracle TimesTen 11.2.1 Data Set: XML Cube of auctions: 6 XML document types Fragmented Cube: 28 XML fragment types Query load: 100 analytical queries targeting different aggregation levels of UXCube Queries rewritten against FXCube 14

Implementation and Testing First measure: average query response times Unfragmented Vs Fragmented XML Cube 15

Implementation and Testing First measure: average query response times Unfragmented Vs Fragmented XML Cube 16

Implementation and Testing First measure: average query response times Unfragmented Vs Fragmented XML Cube 17

Response time Implementation and Testing First measure: average query response times Disk-resident Vs Cached Vs in-memory XML Cube 18

Response time Implementation and Testing First measure: average query response times Disk-resident Vs Cached Vs in-memory XML Cube 19

Implementation and Testing Second measure: percentage of efficient queries Unfragmented Vs Fragmented XML Cube Disk resident configurations 20

Implementation and Testing Second measure: percentage of efficient queries Unfragmented Vs Fragmented XML Cube Disk resident configurations 21

Implementation and Testing Second measure: percentage of efficient queries Unfragmented Vs Fragmented XML Cube Disk resident configurations 22

Implementation and Testing Second measure: percentage of efficient queries Disk-resident Vs Cached Vs in-memory XML Cube DU=MU=CU F 23

Implementation and Testing Second measure: percentage of efficient queries Disk-resident Vs Cached Vs in-memory XML Cube DU=MU=CU F 24

Related Work (1/2) Category of work Database & Web Data Warehouses XML Examples Altinel et al (2003): Static and dynamic caching Manegold et al (2000): Optimizing main memory access Dar et al. (1996): Semantic caching Huang and Hsu (2008): Web document caching Andrade et al. (2007): Optimizing multiple data analysis queries Deshpande et al. (1998) Cache small regions of a multidimensional space Lehner et al. (2000): Dynamic caching for multidimensional data Scheuermann et al. (1996): Caching small sets of query results Muto & Kitsuregawa (1998) : Main memory for compressed cube management Ross & Zaman (2000): Cache data cube subset materialization Yang et al. (2003): Cache frequent XML patterns Mandhani & Suciu (2005): Semantic cache of materialized Xpath queries Obermeier and Bottcher (2008): XML splitting over mobile devices 25

Related Work (2/2) Discussion Our work meets the same motivation of Obermeier and Bottcher (2008) but applied to XML cubes Combination of Vertical fragmentation, main memory data management and caching not tackled before 26

Conclusion and Perspectives Conclusion Crossed two optimization techniques of data warehouses: caching and vertical fragmentation Benefits of fragmentation when the cube is managed in main memory In-memory enhances both fragmented and unfragmented cube Main memory increases the % of efficient queries 27

Conclusion and Perspectives Pespectives Implement our proposals on an ad hoc network Combine horizontal and vertical fragmentation with cache and in-memory management 28