MAPPING BETWEEN DPM AND MDM



Similar documents
Improving transparency in financial and business reporting Harmonisation topics Part 5: Mapping between DPM and MDM

This document is a preview generated by EVS

XBRL Interoperability through a Multidimensional Data Model

XBRL, UML and Databases: State of art

Schneps, Leila; Colmez, Coralie. Math on Trial : How Numbers Get Used and Abused in the Courtroom. New York, NY, USA: Basic Books, p i.

Course 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Analysis Services

XBRL Analytics that Just Makes Sense

Delivering Business Intelligence With Microsoft SQL Server 2005 or 2008 HDT922 Five Days

CHAPTER 4: BUSINESS ANALYTICS

Data W a Ware r house house and and OLAP II Week 6 1

Data Warehouse: Introduction

Development and Management

MDM and Data Warehousing Complement Each Other

MS Designing and Optimizing Database Solutions with Microsoft SQL Server 2008

MS 20467: Designing Business Intelligence Solutions with Microsoft SQL Server 2012

MS 50511A The Microsoft Business Intelligence 2010 Stack

BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by:

OLAP Theory-English version

SQL Server for developers. murach's TRAINING & REFERENCE. Bryan Syverson. Mike Murach & Associates, Inc. Joel Murach

Data Warehousing Systems: Foundations and Architectures

OLAP & DATA MINING CS561-SPRING 2012 WPI, MOHAMED ELTABAKH

DIGITAL MARKETING PROPOSAL. Stage 1: SEO Audit/Correction.

Michael van Genderen, Semansys

DATA WAREHOUSING - OLAP

LEARNING SOLUTIONS website milner.com/learning phone

CHAPTER 5: BUSINESS ANALYTICS

2074 : Designing and Implementing OLAP Solutions Using Microsoft SQL Server 2000

Business Intelligence Tutorial

Overview. DW Source Integration, Tools, and Architecture. End User Applications (EUA) EUA Concepts. DW Front End Tools. Source Integration

Implementing Data Models and Reports with Microsoft SQL Server 20466C; 5 Days

Databases in Organizations

Microsoft Implementing Data Models and Reports with Microsoft SQL Server

Anwendersoftware Anwendungssoftwares a. Data-Warehouse-, Data-Mining- and OLAP-Technologies. Online Analytic Processing

IBM Cognos 8 Business Intelligence Analysis Discover the factors driving business performance

Concepts of Database Management Seventh Edition. Chapter 9 Database Management Approaches

Building Cubes and Analyzing Data using Oracle OLAP 11g

Reporting Fundamentals for Programmers

SAP BO 4.1 Online Training

Monitoring Genebanks using Datamarts based in an Open Source Tool

Insurance and Banking Supervision XBRL Implementation in France

"Charting the Course... MOC B Server Virtualization with Windows Hyper-V and System Center. Course Summary

Microsoft Services Exceed your business with Microsoft SharePoint Server 2010

Turning your Warehouse Data into Business Intelligence: Reporting Trends and Visibility Michael Armanious; Vice President Sales and Marketing Datex,

Data Warehouse design

Data Warehouse Center Administration Guide

The Crossroads of Accounting & IT

Oracle BI Suite Enterprise Edition For Discoverer Users. Mark Rittman, Rittman Mead Consulting

DATA WAREHOUSING AND OLAP TECHNOLOGY

Data Warehouse Design

In-memory databases and innovations in Business Intelligence

CS2032 Data warehousing and Data Mining Unit II Page 1

Developing Microsoft SQL Server Databases 20464C; 5 Days

CHAPTER 4 Data Warehouse Architecture

The Microsoft Business Intelligence 2010 Stack Course 50511A; 5 Days, Instructor-led

EIOPA XBRL Filing Rules for Preparatory Phase Reporting

"Charting the Course to Your Success!" MOC B Configuring and Administering Microsoft SharePoint Course Summary

Implementing Data Models and Reports with Microsoft SQL Server 2012 MOC 10778

UNLOCKING XBRL CONTENT

COREP/FINREP A Technical Insight. 26 June 2013, London

CRG Academy Course Descriptions. Corporate Renaissance Group 6 Antares Drive, Phase 1, Suite 200 Ottawa, ON K2E 8A9

A Design and implementation of a data warehouse for research administration universities

Table of Contents. CHAPTER 1 Web-Based Systems 1. CHAPTER 2 Web Engineering 12. CHAPTER 3 A Web Engineering Process 24

Learning Objectives. Definition of OLAP Data cubes OLAP operations MDX OLAP servers

Implementing Data Models and Reports with Microsoft SQL Server

CS Programming OLAP

1. OLAP is an acronym for a. Online Analytical Processing b. Online Analysis Process c. Online Arithmetic Processing d. Object Linking and Processing

Designing Business Intelligence Solutions with Microsoft SQL Server 2012 Course 20467A; 5 Days

20464C: Developing Microsoft SQL Server Databases

SAP BUSINESS OBJECTS BO BI 4.1 amron

The Benefits of Data Modeling in Business Intelligence

Bussiness Intelligence and Data Warehouse. Tomas Bartos CIS 764, Kansas State University

Implementing Data Models and Reports with Microsoft SQL Server

PREFACE INTRODUCTION MULTI-DIMENSIONAL MODEL. Chris Claterbos, Vlamis Software Solutions, Inc.

Dimensional Data Modeling for the Data Warehouse

End to End Microsoft BI with SQL 2008 R2 and SharePoint 2010

SQL Server 2005 Features Comparison

How To Write Powerpivot For Excel

"Charting the Course... MOC AC SQL Server 2014 Performance Tuning and Optimization. Course Summary

Principles of Database. Management: Summary

Microsoft SQL Business Intelligence Boot Camp

Course 20464: Developing Microsoft SQL Server Databases

How To Write A Report In Xbarl

Analytics: Pharma Analytics (Siebel 7.8) Student Guide

BUSINESS ANALYTICS AND DATA VISUALIZATION. ITM-761 Business Intelligence ดร. สล ล บ ญพราหมณ

LITERATURE SURVEY ON DATA WAREHOUSE AND ITS TECHNIQUES

Business Intelligence, Analytics & Reporting: Glossary of Terms

SQL Server 2012 Business Intelligence Boot Camp

Enterprise Performance Tuning: Best Practices with SQL Server 2008 Analysis Services. By Ajay Goyal Consultant Scalability Experts, Inc.

Week 3 lecture slides

Business Intelligence Solutions. Cognos BI 8. by Adis Terzić

OLAP and Data Mining. Data Warehousing and End-User Access Tools. Introducing OLAP. Introducing OLAP

<Insert Picture Here> Introducing Data Modeling and Design with Oracle SQL Developer Data Modeler

BUILDING OLAP TOOLS OVER LARGE DATABASES

Transcription:

MAPPING BETWEEN DPM AND MDM CEN WS XBRL XBRL week in Luxembourg, December 10 th, 2013. Ignacio Santos Bank of Spain Madrid, December 10 th, 2013. 1

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 2

INTRODUCTION This work is a contribution of Ignacio Santos (Bank of Spain), Roland Hommes (Rhocon) and Katrin Heinze (Deutsche Bundesbank). The Multidimensional Data Model (MDM) presented in this document is intended to be a starting point for a subsequent modelling process to be adjusted and extended to specific analytical or transactional needs. This document aims to provide an introduction to the topic of creating a conceptual model for storing multidimensional data which is received as XBRL instances that follow the rules defined by European taxonomies published by the European Banking Authority (EBA) or by the European Insurance and Occupational Pensions Authority (EIOPA). The structure of the data model is based on meta classes, introduced in part 1 and 4 of the CWA1 document. 3

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 4

INTRODUCTION TO THE MDM The multidimensional database is primarily used to create OLAP (On-line Analytical Process) applications and their databases using a fact table and set of dimensions. A multidimensional structure stores multidimensional data, that is to say, cubes. A cell or fact is an intersection consisting of elements that form the dimension(s) which in turn form a cube. The Multidimensional Data Model (MDM) is used instead of the Relational Model, because the European architecture of economicfinancial reports is relying on dimensions heavily, which makes implementation in MDM the logical choice. 5

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 6

PRECONDITIONS ON MAPPING I Types of Database Management Sytems (DBMSs) 7

PRECONDITIONS ON MAPPING II It is necessary to verify that database transactions are processed reliably. For this, a database must fulfil ACID (Atomicity, Consistency, Isolation, and Durability) properties. Not all databases fulfil the ACID requirements, this depends on the vendor. Fundamental choices: Mapping the XBRL instance document to the relational model; Storing the XBRL instance document as a blob, or PDF document in the database; Storing the XBRL instance as a XML document or as a XBRL document. 8

PRECONDITIONS ON MAPPING III An XBRL instance document can be stored in a relational database as an XML document or in a relational format: In XML, these queries use XQuery and XPath; Relational Database use standard SQL; If the XBRL instance document is stored directly in the database (as a blob), the problems are the same but the RDBMS is an inferior level. Cases are: Storing as a photo (Blog or Clog); Storing as a XML document. Storing the XBRL instance as a XML document or as a XBRL document. 9

PRECONDITIONS ON MAPPING IV Proposals Native store Convert before store Quantity of aspects to store (direct from instance) (+)(-) (+)(-) Quantity of aspects to store (indirect from Discoverable Taxonomy Set (DTS)) (-) (+) Speed of storage process (+) (-) Maintenance (mapping table, mapping software) (+) (-) Analyst queries, degree of difficulty (-) (+) Analyst queries, speed (-) (+) Easy handling of new DTS versions (+) (-) Extensibility towards proprietary XBRL reports Extensibility towards proprietary non-xbrl reports (+) (-) (-) (+) 10

PRECONDITIONS ON MAPPING V Fact definitions: presentation vs DPM. Storing native XBRL facts. Dimension/defaultMember. All EBA defined dimensions will have a default member. Naturally, these default dimension/member combinations must be identified in storage since they are not allowed in the instance. Options. XBRL allows for more presentation texts to be added besides primary, dimension, member, table or axis. Versioning. EBA has chosen to include two special attributes on every concept: creationdate and modificationdate. Changes on fact values. If the NSA has the authority to change reported fact values, they must be aware that recreating the original instance may be cumbersome, unless appropriate versioning mechanisms have been put in place to conserve the original fact values. 11

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 12

TERMS AND DEFINITIONS I The terms used directly or indirectly in the mapping of DPM in the MDM are (I): Concept. Data Point Model. Dimension. Domain. Family. Framework. Item. (Domain) member. Namespace. Owner. Public elements. 13

TERMS AND DEFINITIONS II The terms used directly or indirectly in the mapping of DPM in the MDM are (II): TableGroup. DataPoint. DataCube. Module. Hypercube. Taxonomy. Context. 14

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 15

MAPPING FROM DPM TO MDM I Star model of the DPM using ROLAP tool. 16

MAPPING FROM DPM TO MDM II Framework (I): 17

MAPPING FROM DPM TO MDM III Framework (II): 18

MAPPING FROM DPM TO MDM IV Taxonomy: 19

MAPPING FROM DPM TO MDM V Dimensions (I): 20

MAPPING FROM DPM TO MDM VI Dimensions (II): 21

MAPPING FROM DPM TO MDM VII Context (I): 22

MAPPING FROM DPM TO MDM VIII Context (II): 23

MAPPING FROM DPM TO MDM IX Primary Items (I): 24

MAPPING FROM DPM TO MDM X Primary Items (II): 25

MAPPING FROM DPM TO MDM XI Fact table or Data points (I): 26

MAPPING FROM DPM TO MDM XII Fact table or Data points (II): 27

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 28

METAMODEL DEFINED BY THE EBA (FINREP AND COREP) MAPPED TO MDM Creation of the structure and load of the DPM from the EBA in a RDBMS. Loading DPM_ROLAP from DPM_EBA: Mapping. Code. 29

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 30

IMPLEMENTATION OF THE DPM IN THE MDM USING THE DESIGN ROLAP Structure ROLAP. Creation of the infrastructure through MS SQL Server: Code. 31

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 32

DPM OF FINREP 2012 AND THE FIRST PROTOTYPE OF SOLVENCY II IN THE MDM USING THE DESIGN ROLAP. Structure and Tables. 33

SUMMARY Introduction. Introduction to the Multidimensional Data Model. Preconditions on mapping. Terms and definitions. Mapping from Data Point Model to Multidimensional Data Model. Metamodel defined by the EBA (FINREP and COREP) mapped to MDM. Implementation of the DPM in the MDM using the design ROLAP. DPM of FINREP 2012 and the first prototype of Solvency II in the MDM using the design ROLAP. Conclusion. 34

CONCLUSION This document is a starting point for a subsequent modelling process. This document does reference to CWA1 documents. Based on an easily comprehensible example, more complex issues are addressed that would need to be taken into account by defining an MDM for production use. 35

Ignacio Santos. Unit of Databases. Department of Information System. E-mail: ignacio.santos@bde.es Phone: + 34 91 3387192. FAX: + 34 913386875. Banco de España (Bank of Spain). c/ Alcalá 522. 28027 Madrid. España (Spain).