DSS based on Data Warehouse



Similar documents
Fluency With Information Technology CSE100/IMT100

Copyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 29-1

OLAP and Data Mining. Data Warehousing and End-User Access Tools. Introducing OLAP. Introducing OLAP

Data Mart/Warehouse: Progress and Vision

Federico Rajola. Customer Relationship. Management in the. Financial Industry. Organizational Processes and. Technology Innovation.

8. Business Intelligence Reference Architectures and Patterns

CHAPTER SIX DATA. Business Intelligence The McGraw-Hill Companies, All Rights Reserved

A Model-based Software Architecture for XML Data and Metadata Integration in Data Warehouse Systems

Course DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

B.Sc (Computer Science) Database Management Systems UNIT-V

Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

Data Warehouse: Introduction

Chapter 5. Warehousing, Data Acquisition, Data. Visualization

1. OLAP is an acronym for a. Online Analytical Processing b. Online Analysis Process c. Online Arithmetic Processing d. Object Linking and Processing

SAP BOBJ. Participants will gain the detailed knowledge necessary to design a dashboard that can be used to facilitate the decision making process.

LEARNING SOLUTIONS website milner.com/learning phone

Data warehouse and Business Intelligence Collateral

Talend Metadata Manager. Reduce Risk and Friction in your Information Supply Chain

CONCEPTUALIZING BUSINESS INTELLIGENCE ARCHITECTURE MOHAMMAD SHARIAT, Florida A&M University ROSCOE HIGHTOWER, JR., Florida A&M University

BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by:

Database Marketing, Business Intelligence and Knowledge Discovery

Data Mining for Successful Healthcare Organizations

When to consider OLAP?

Foundations of Business Intelligence: Databases and Information Management

Data Warehousing and Data Mining in Business Applications

Structure of the presentation

Discussion on Airport Business Intelligence System Architecture

Enterprise Solutions. Data Warehouse & Business Intelligence Chapter-8

Data Warehouse Design

MS 20467: Designing Business Intelligence Solutions with Microsoft SQL Server 2012

Lection 3-4 WAREHOUSING

Integrating SAP and non-sap data for comprehensive Business Intelligence

OLAP. Business Intelligence OLAP definition & application Multidimensional data representation

Java Metadata Interface and Data Warehousing

Turkish Journal of Engineering, Science and Technology

2074 : Designing and Implementing OLAP Solutions Using Microsoft SQL Server 2000

Research on Airport Data Warehouse Architecture

OLAP Theory-English version

Alexander Nikov. 5. Database Systems and Managing Data Resources. Learning Objectives. RR Donnelley Tries to Master Its Data

Course MIS. Foundations of Business Intelligence

Whitepaper. Data Warehouse/BI Testing Offering YOUR SUCCESS IS OUR FOCUS. Published on: January 2009 Author: BIBA PRACTICE

Designing Business Intelligence Solutions with Microsoft SQL Server 2012 Course 20467A; 5 Days

CHAPTER 4 Data Warehouse Architecture

How to Enhance Traditional BI Architecture to Leverage Big Data

BI4Dynamics provides rich business intelligence capabilities to companies of all sizes and industries. From the first day on you can analyse your

Oracle OLAP What's All This About?

IMPROVING DATA INTEGRATION FOR DATA WAREHOUSE: A DATA MINING APPROACH

A Technical Review on On-Line Analytical Processing (OLAP)

Increasing the Business Performances using Business Intelligence

THE QUALITY OF DATA AND METADATA IN A DATAWAREHOUSE

Chapter 6 FOUNDATIONS OF BUSINESS INTELLIGENCE: DATABASES AND INFORMATION MANAGEMENT Learning Objectives

QAD Business Intelligence Release Notes

Alejandro Vaisman Esteban Zimanyi. Data. Warehouse. Systems. Design and Implementation. ^ Springer

Establish and maintain Center of Excellence (CoE) around Data Architecture

Business Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? PTR Associates Limited

John R. Vacca INSIDE

LITERATURE SURVEY ON DATA WAREHOUSE AND ITS TECHNIQUES

Vendor briefing Business Intelligence and Analytics Platforms Gartner 15 capabilities

ORACLE OLAP. Oracle OLAP is embedded in the Oracle Database kernel and runs in the same database process

Foundations of Business Intelligence: Databases and Information Management

TIM 50 - Business Information Systems

Practical meta data solutions for the large data warehouse

14. Data Warehousing & Data Mining

DATA WAREHOUSING - OLAP

M Designing and Implementing OLAP Solutions Using Microsoft SQL Server Day Course

OLAP and OLTP. AMIT KUMAR BINDAL Associate Professor M M U MULLANA

Data W a Ware r house house and and OLAP II Week 6 1

Part 22. Data Warehousing

Data-Warehouse-, Data-Mining- und OLAP-Technologien

Foundations of Business Intelligence: Databases and Information Management

Technology in Action. Alan Evans Kendall Martin Mary Anne Poatsy. Eleventh Edition. Copyright 2015 Pearson Education, Inc.

Foundations of Business Intelligence: Databases and Information Management

BUILDING BLOCKS OF DATAWAREHOUSE. G.Lakshmi Priya & Razia Sultana.A Assistant Professor/IT

Master of Science in Health Information Technology Degree Curriculum

Advanced Data Management Technologies

3/17/2009. Knowledge Management BIKM eclassifier Integrated BIKM Tools

Foundations of Business Intelligence: Databases and Information Management

MicroStrategy Course Catalog

Course 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Analysis Services

UNIT-3 OLAP in Data Warehouse

DATA WAREHOUSE CONCEPTS DATA WAREHOUSE DEFINITIONS

Unit -3. Learning Objective. Demand for Online analytical processing Major features and functions OLAP models and implementation considerations

A Review of Contemporary Data Quality Issues in Data Warehouse ETL Environment

Tracking System for GPS Devices and Mining of Spatial Data

An Introduction to Data Warehousing. An organization manages information in two dominant forms: operational systems of

Business Intelligence

Enterprise Data Warehouse (EDW) UC Berkeley Peter Cava Manager Data Warehouse Services October 5, 2006

Paper DM10 SAS & Clinical Data Repository Karthikeyan Chidambaram

BENEFITS OF AUTOMATING DATA WAREHOUSING

Business Intelligence Solutions. Cognos BI 8. by Adis Terzić

IAF Business Intelligence Solutions Make the Most of Your Business Intelligence. White Paper November 2002

Basics of Dimensional Modeling

Transcription:

DSS based on Data Warehouse C_13 / 6.01.2015 Decision support system is a complex system engineering. At the same time, research DW composition, DW structure and DSS Architecture based on DW, puts forward the theoretical basis and key technologies of building DSS, including data preparation, Metadata Model Building, OLAP, data mining, and give a set of DSS design solution scheme in accordance with typical DW technology. An Intelligent Decision Support System: Data Warehouse, Online Analytical Processing, Data Mining and Decision Supporting based on models: DSSBDW. A DSSBDW system enables knowledge workers to make strategic and tactical business decisions based on factual data stored in a business intelligence data warehouse. DSS must allow users to intuitively, quickly, and flexibly manipulate data using familiar terms, in order to provide analytical insight. DSSBDW are implementations of an informational database used to store sharable data sourced from an operational database-of-record. They are typically a subject database that allows users to tap into a company's vast store of operational data to track business trends, facilitate forecasting and data mining, respond to data patterns, aid planning efforts, and measure performance against strategic goals all with the goal of aiding and supporting decision making. Yang Bao LuJing Zhang - Decision Support System Based on Data Warehouse - World Academy of Science, Engineering and Technology 71 2010 MicroStrategy / Support - Decision Support Data Warehouse www.microstrategy.com/decision-support-data-warehouse/ 1/15

Decision Support and Data Warehouse (DW) Decision Support System (DSS) generally is consisted of three bases model, and Intelligent Decision Support System (IDSS) is consisted of four bases structure, based on three bases increasing the knowledge base system and its reasoning system, the IDSS is considered of an increase of expert system in the general DSS. Knowledge base is intelligent component in IDSS, used to simulate some smart activity in the human decision making process, that can make DSS supporting to decision makers been greatly enhanced. DW system contains three levels of architecture. The three levels respectively: data sources, data storage and management, On-Line Analytical Processing (OLAP) and data mining tools. The data organization style of DW contains three kinds: virtual database relations based on the storage and multidimensional databases. Data Warehouse, the data is divided into four categories: Early details, the details, light degree integrated, highly integrated level. Data Warehouse, there is an important data-metadata (metadata). The data storage environment, there are two main metadata: The first is the operational environment to the data warehouse and conversion of $data, including all source data of members, properties and the data warehouse in the transformation and the two million data for the OLAP and Data Warehouse building map. 2/15

DSS Architecture based on DW DSSBDW compared with traditional DSS, it provided three kinds of decision tools: MDSS (Model DSS), DM, OLAP. The figure 2 can be seen, DSSBDW including DW, Model Analyzing, metadata, OLAP, user interface, etc. Architecture of Data Warehouse Architecture of DSS based on Data Warehouse 3/15

THE KEY TECHNOLOGY OF DW IN DSS Data preparation, also known as data pretreating, is the basic premise on building DW. It majorly includes extraction, transformation, loading, commonly known as ETL (Extract, Transform, Load). Data preparation is the data entry for the whole DW, this link will complete the task of data acquisition, cleaning, certification, amalgamation and integration, loading, filing, data reproducing, reducing paradigm degree and summary. Metadata takes on extremely important role in the design, operation of DW, it describes the various objects of DW in all its aspects, which is the core of DW. For it, there is two major metadata standards to be used in the DW areas,: OIM (Open Information Model) Standards of MDC (Meta Data Coalition) and CWM (Common Warehouse Model, CWM) standards of OMG. The composition of CWM Metamodel (Package Structure of CWM Metamodel). 4/15

THE KEY TECHNOLOGY OF DW IN DSS The OLAP operating mainly aims to online data access and analysis of specific problems, the object is to meet the need of specific query and reporting of decision support or multidimensional environment, focusing on the decision support of decision makers and senior managers, and so it is a powerful tool to analyze and make decision. It contains Slice, Dice, Rotate and Drill. Typical Data mining methods in accordance with the different apply mode contain: Related analysis, Time order mode, Cluster, Classification, Deviation testing and Forecasting models. It is an orderly and complete process. fundamental processes of data mining with ETL, OLAP of DW have many coincide ways, shown in figure below: Main Steps of Data Mining 5/15

Designing and Implementing of DW Three levels of model of DW contain: Conception Model, Logical Model and Physical Model. In these, Logic model is the important link in the implementation of DW, There are five kinds of relative Modeling Technology commonly like next figure shown: Data Model of Data Warehouse To highlight the development process with its uncertain demand, DW design method is described as CLDS methods, and SDLC on the contrary, the keystone is through adopting the External Data Access to complete DW modeling, data acquisition integrating, DW building, DSS application programming, system testing, requirement understanding, and then going trace back to the DW modeling. The implementing steps of DW contain: collect and analyzing business needs, establish the data models and the physical design of DW, select DW technique and platform, define data sources, develops DSS application, strengthen management, take the active participation with end users, decompounds the complex needs, prepare data, provide OLAP and data mining tools, etc. 6/15

THE DSS DESIGN WITH DW TECHNOLOGY DSS design adopts the architecture shown as next figure. Data source is from the original operational system database and stored into the Data Warehouse Center storage through ETL tools. OLAP and DM tools provide multidimensional analyzing and mining means in DSS, and show to the final decision makers by performance tools. Architecture of DSS: 7/15

The typical realizing scheme of System Architecture DSS can be used "Three layers plus two layers" structure model, namely that ETL/system management module use Client/Server mode, OLAP module use Browser/Server mode. Its main design scheme in next figure: Realizing Scheme of Decision Support System Based on Data warehouse 8/15

ETL Design The ETL integrated components include: Data Access Component, Data Conversion Component, Data Loading Component, Process Management Component, Systems Management Component. In DSS, the source field should be related to the property field of target data object, and be defined the length, data type of property field in the source field record, and so on. Targets objects and properties are the table and field in DW or Data In data objects and properties in transaction component. Rule information describe the corresponding data conversion regulation and transaction. Completed regulation description and the corresponding definition information shown as table II. Data Pipeline is a data migration tool, it is used to migrate from a database to another database, these database can be the same DBMS, as well as different DBMS. When creating data pipeline object must specify some pipeline parameters. 9/15

OLAP Design The OLAP design of DSS will transform indicators entities in the system theme domain into fact tables in the relational database, and transform dimension entities into in the relational database. By establishing the relationships between fact tables and dimension tables in the form of primary key and foreign key, multidimensional star-type framework can be formed with all the fact tables as the center. DSS needs to use multidimensional analysis ways to provide multidimensional analysis services for user level. 1. Multidimensional analysis session management: The multidimensional analysis Management is to import users multidimensional analysis demands, specifically in the querying dialog, which includes themes, constraining conditions, aggregate levels be observed in all various of dimensions, and what dimension checked. According to the multidimensional results collection, it can have various multidimensional operations (Slice, Dice, Rotate, Drill, etc.), so get some angle of data in a comprehensive degree. 10/15

OLAP Design 2.Analyzing and querying by use of SQL: Through the star-type model dimensionality and multidimensional theme management are constructed, so the connection between dimension tables and center fact tables exists, and can use SQL statements to realize the querying and analyzing to the data, it includes three ways: constructing Material View, constructing the connecting between tables, and constructing temporary tables. 3.Optimizing query performance: Considering the features of star-type model, the analyzing records number of general dimension table is limited, but fact table is large, which maybe several order of magnitudes more than that, so it can use multi-connection, aggregation operating algorithm to raise query performance, such as the way of Material View expansion. 11/15

Data Mining Design 1. Data Classification Standard[4]:Class should be internal high cohesion and low cohesion between classes. On classifying, it need be high comparability between isomorphic class objects, namely as high cohesion, and there is a great difference between different kind of class objects, namely as low cohesion. It need adopt different data conceptual level on different classification tasks in different datasets, set different class valve, select different classification properties, there will be completely different classifying results. 2. Data Conception Arrangement: It contains two ways:implication type representation way and tree structure representation way. 3. Main Induction Relation: In order to get clear classification mode, the first is to induce the original data into the higher conceptual level. This can be done on the way of using induction facing to property in the data related to assignment. It contains: increasing, classification threshold, main induction relation, coverage number of main induction relation. 12/15

Data Mining Design 6. Arithmetic of Main Induction Relation and Classifying Mode: Creating arithmetic of main induction relation and classifying mode is the key to control data mining technologies in its using whether the effect is good or bad. The first is to achieve induction facing to the properties. That is, a property without a higher level concept will be deleted, otherwise to induce the properties on the way of upgrading conceptual level, namely as replacing the property value with a higher level concepts. The next is to create classification mode, and show by conjunction normal form. Conjunction normal form, namely as if the data values present to some properties are covering all the data on its respective concept level, these properties should be deleted from conjunction normal form, otherwise, these properties and the pack of related values should be included in the category of conjunction normal form. On the other hand, if the data values present to some properties are not covering all the data on its respective concept level, which shows that there are only some specific values in this class. By containing these specific values in conjunction normal form, this classification is precisely characterized and the classification border is very clear. So the property and its related values pack should be included in the conjunction normal form. 13/15

Data Mining Design 4. Classifying Mode: Based on classification properties in main induction relations to set off tuple, and then export one conjunction normal form for each class. If the values of some certain property (except classification property) in main induction relation cover all the concepts on its respective concept level, this property should not be included in the certain conjunction normal form; Otherwise, the property should be included in the conjunction normal form, and all the values of some certain property are included in the property set. 5. Induction Facing to Property: In the classification rules facing to property, knowledge engineers or field knowledge experts generally put out the data conceptual level. Some data conceptual level can be automatically extracted. Generally, the type of data in the database can be divided into character, date, boolean and numerical. 14/15

End of 13 REFERENCES [1] Fan Jin-Sheng, Zhang Xiao-Ning. Imports and exports decision support system based on data warehouse [J]. COMPUTER ENGINEERING AND DESIGN,2008,(12). [2] Zhang Zhi-Jun. Enterprise Management Decision Support System Based on Data Warehouse [J] Computer Application and Software,2005,(6):41-43. [3] SHAMS,KAMRUDDIN,FARISHTA,et al.data Warehousing: Toward Knowledge Management [J]. Topics in Health Information Management,2001,21(3):24-32. [4] FORGIONNE,GANGOPADHYAY, ADYA.Cancer Surveillance Using Data Warehousing, Data Mining,and Decision Support Systems [J]. Topics in Health Information Management,2000,21(1):21-34... C_13 / 6.01.2015 15/15