Turkish Journal of Engineering, Science and Technology

Similar documents
Data Warehousing and OLAP Technology for Knowledge Discovery

IST722 Data Warehousing

Part 22. Data Warehousing

Published by: PIONEER RESEARCH & DEVELOPMENT GROUP ( 28

DATA WAREHOUSING AND OLAP TECHNOLOGY

Fluency With Information Technology CSE100/IMT100

A Comparative Study on Operational Database, Data Warehouse and Hadoop File System T.Jalaja 1, M.Shailaja 2

A Survey on Data Warehouse Architecture

1. OLAP is an acronym for a. Online Analytical Processing b. Online Analysis Process c. Online Arithmetic Processing d. Object Linking and Processing

A Design and implementation of a data warehouse for research administration universities

Lection 3-4 WAREHOUSING

A Critical Review of Data Warehouse

Namrata 1, Dr. Saket Bihari Singh 2 Research scholar (PhD), Professor Computer Science, Magadh University, Gaya, Bihar

Introduction to Data Warehousing. Ms Swapnil Shrivastava

Data Warehousing and Data Mining in Business Applications

LITERATURE SURVEY ON DATA WAREHOUSE AND ITS TECHNIQUES

International Journal of Scientific & Engineering Research, Volume 5, Issue 4, April ISSN

Bussiness Intelligence and Data Warehouse. Tomas Bartos CIS 764, Kansas State University

14. Data Warehousing & Data Mining

DATA WAREHOUSING APPLICATIONS: AN ANALYTICAL TOOL FOR DECISION SUPPORT SYSTEM

OLAP and OLTP. AMIT KUMAR BINDAL Associate Professor M M U MULLANA

Dimensional Modeling for Data Warehouse

Course DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

BUILDING BLOCKS OF DATAWAREHOUSE. G.Lakshmi Priya & Razia Sultana.A Assistant Professor/IT

Enterprise Data Warehouse (EDW) UC Berkeley Peter Cava Manager Data Warehouse Services October 5, 2006

Copyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 29-1

Data Warehousing. Read chapter 13 of Riguzzi et al Sistemi Informativi. Slides derived from those by Hector Garcia-Molina

Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

Data Warehousing and Data Mining

Data Warehouse: Introduction

DATA WAREHOUSING - OLAP

Week 13: Data Warehousing. Warehousing

OLAP and Data Warehousing! Introduction!

Data Mart/Warehouse: Progress and Vision

DATA CUBES E Jayant Haritsa Computer Science and Automation Indian Institute of Science. JAN 2014 Slide 1 DATA CUBES

An Overview of Data Warehousing, Data mining, OLAP and OLTP Technologies

New Approach of Computing Data Cubes in Data Warehousing

Data Warehousing: A Technology Review and Update Vernon Hoffner, Ph.D., CCP EntreSoft Resouces, Inc.

II. OLAP(ONLINE ANALYTICAL PROCESSING)

An Introduction to Data Warehousing. An organization manages information in two dominant forms: operational systems of

BUILDING OLAP TOOLS OVER LARGE DATABASES

Chapter 5. Warehousing, Data Acquisition, Data. Visualization

When to consider OLAP?

Tracking System for GPS Devices and Mining of Spatial Data

CHAPTER 4 Data Warehouse Architecture

Data Warehouse Snowflake Design and Performance Considerations in Business Analytics

Business Intelligence: Effective Decision Making

OLAP & DATA MINING CS561-SPRING 2012 WPI, MOHAMED ELTABAKH

Data W a Ware r house house and and OLAP II Week 6 1

University of Gaziantep, Department of Business Administration

Metadata Technique with E-government for Malaysian Universities

SAS BI Course Content; Introduction to DWH / BI Concepts

Data Warehousing Systems: Foundations and Architectures

Deriving Business Intelligence from Unstructured Data

Data Warehousing. Overview, Terminology, and Research Issues. Joachim Hammer. Joachim Hammer

Jagir Singh, Greeshma, P Singh University of Northern Virginia. Abstract

THE TECHNOLOGY OF USING A DATA WAREHOUSE TO SUPPORT DECISION-MAKING IN HEALTH CARE

Why Business Intelligence

META DATA QUALITY CONTROL ARCHITECTURE IN DATA WAREHOUSING

Data Warehousing, OLAP, and Data Mining

Data Warehousing and OLAP

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence

Data W a Ware r house house and and OLAP Week 5 1

OLAP Theory-English version

Technology-Driven Demand and e- Customer Relationship Management e-crm

Dr. Osama E.Sheta Department of Mathematics (Computer Science) Faculty of Science, Zagazig University Zagazig, Elsharkia, Egypt

Business Intelligence

Applied Business Intelligence. Iakovos Motakis, Ph.D. Director, DW & Decision Support Systems Intrasoft SA

Modelling Architecture for Multimedia Data Warehouse

DATA WAREHOUSE CONCEPTS DATA WAREHOUSE DEFINITIONS

B.Sc (Computer Science) Database Management Systems UNIT-V

M Designing and Implementing OLAP Solutions Using Microsoft SQL Server Day Course

CS2032 Data warehousing and Data Mining Unit II Page 1

Data Warehousing. Outline. From OLTP to the Data Warehouse. Overview of data warehousing Dimensional Modeling Online Analytical Processing

Monitoring Genebanks using Datamarts based in an Open Source Tool

CHAPTER 3. Data Warehouses and OLAP

Week 3 lecture slides

2074 : Designing and Implementing OLAP Solutions Using Microsoft SQL Server 2000

Data Warehousing, Data Mining, OLAP and OLTP Technologies Are Essential Elements to Support Decision-Making Process in Industries

A Technical Review on On-Line Analytical Processing (OLAP)

Web Log Data Sparsity Analysis and Performance Evaluation for OLAP

Data Warehousing. Jens Teubner, TU Dortmund Winter 2015/16. Jens Teubner Data Warehousing Winter 2015/16 1

Associate Professor, Department of CSE, Shri Vishnu Engineering College for Women, Andhra Pradesh, India 2

Module 1: Introduction to Data Warehousing and OLAP

Outline. Data Warehousing. What is a Warehouse? What is a Warehouse?

Keywords: Data Warehouse, Data Warehouse testing, Lifecycle based testing, performance testing.

Business Intelligence Solutions. Cognos BI 8. by Adis Terzić

Meta-data and Data Mart solutions for better understanding for data and information in E-government Monitoring

8. Business Intelligence Reference Architectures and Patterns

Transcription:

Turkish Journal of Engineering, Science and Technology 03 (2014) 106-110 Turkish Journal of Engineering, Science and Technology journal homepage: www.tujest.com Integrating Data Warehouse with OLAP Server Jitendra Singh a*, Shivani Sharma b a Assistant Professor, Department of CSE, SRM University, Delhi NCR Campus, India b M.Tech (CSE), Department of CSE, SRM University, Delhi NCR Campus, India Article Info Abstract Article history: Received April 03, 2014 Accepted May 02, 2014 Available online March 02, 2014 Keywords: Data Warehousing, OLAP, OLTP, Multidimensional Data, Clustering Data warehouse is the collection of information gathered by the other resources. Basically Data warehouse is used to collect the data from the Data warehouse. This paper is used to combine the Data warehouse and On-Line analytical processing (OLAP) server and also compare the technology of On-Line transaction processing (OLTP) and On-Line analytical processing (OLAP). Data warehouse is also subjective and based on time and decision technology. The main component is Data warehouse and OLAP server with the comparison of OLTP. OLTP is used for recent data for transaction based. OLTP is not used for large amount of data, whereas OLAP technique is used for historical data. OLAP technique is used for globally and analytical based. Basically OLAP technique is used for multidimensional data. 2014 TUJEST. All rights reserved. 1. Introduction A Data Warehouse is the subject oriented, integrated, time variant, and collection of the large amount of data which may be used for multiple databases. In Database there are huge amount of data to handle the information. There are several definitions of data warehouse [1], but the following is most widely used Data Warehouse is subject oriented, time-variant, non-volatile, integrated collection of data used for decision making. Data Warehouse [2] is based on the decision support technology so that it is used to support the knowledge workers (executives, managers, salesman, business man etc). Data Warehouse is based on the real time business and business intelligence. Data Warehouse is the learning process describe the high level architectures. Data Warehouse is the integration of the learning objectives like extraction, transformation and load (ETL). Data Warehouse is the repository of the information where relational data and operational data is used to provide enterprise-wide, cleansed data in a standardized format. Operational processing (transaction processing) is used to store and manipulate data to support daily operations. Data Warehouse can consolidate and integrate information from internal and external resources. Data Warehouse is constructed by integrating multiple, heterogeneous data sources. * Corresponding Author: Jitendra Singh, e-mail: jit@post.com

107 Table 1. Base and summery data store [6] PID 1001 Product Suit Specification Standard Region Noida Year 2009 Sales 39999 Information is retrieved from the data. The organizations create, store and provide information data in its business context [6]. In this survey business is organized the multidimensional data to store the cuboid data. Because of the relational data time period and cost is very high in market and other related departments, so to avoid this problem. We survey the business and the market data, all the information is based on the multidimensional data. Client client Query analysis Data Warehouse Integration server server server Figure 1. Simple Data Warehouse Process Flow Architecture 2. DATA WAREHOUSING Data Warehouse is a collection of decision support technology aimed at enabling the knowledge worker (executives, manger, and analyst) to make better and good decision [4]. Now the question is What is Warehouse Warehouse is the collection of many tools and components like gathering resources, cleansing data, to collect and analysis the query and then monitoring it with the databases. Now another question is Why a Warehouse???? there are two approaches first one is the query driven and second one is warehouse itself. Figure 1 shows the simple Data Warehouse process flow architecture.

108 2.1. CHARACTERISTICS OF DATA WAREHOUSING Subject oriented Integrated Time-variant Non volatile Real- time Client based and server based integration Relational data model Multi-dimensional data model Web based data Meta data 2.2. ARCHITECTURE DATA warehouse ROLAP OLAP server data request OLAP cube MOLAP Collection server queries against answer data warehouse data warehouse schema user Figure 2. Integrated Architecture 2.3. DATA WAREHOUSES Enterprise Data Warehouse (EDW) It is used to collect all the information of the organization. Basically collects all information about the various subjects like customers, products, sales, personnel that span whole organization. It is one of the best information services. EDW manipulates data from the multiple resources. EDW provide best and secure information to the customers and other departmental users. Operational data store (ODS) - Operational data store only used for specific information. Operational data warehouse is designed to support only transaction based data like (insert, update, delete). It is only used for current data. Operational data is used to store garbage data or raw data stream. Knowledge support system (DSS) - It is also called decision support system which is used to provide the knowledge into the multiple resources. It helps to support the executives, workers, managers, and other related enterprises. 2.4. ON-LINE TRANSACTION PROCESSING (OLTP)

In On-Line Transaction Processing user can transact the data from the database using (insert, update, and delete). OLTP [2] only use current and operational data which is used in day-to day business work. Traditional system require that user switch from their Data Warehouse front end to another data entry program [3]. It is one of the applications that supports and manage only transactions. 109 ON-LINE ANALYTICAL PROCESSING (OLAP) OLAP stands for On-Line Analytical Processing in which only consolidation data is used. OLAP is used for large amount of data at a Time. It is used to analysis the historical data or used for complex query. OPERATIONS IN OLAP There are various operations in OLAP which is mainly used and essential in Data Warehouse and OLAP server: OLAP Operations include roll- up, drill down, slicing and dicing. Whereas roll up is used to increasing the high level aggregation, drill down decreasing the level of aggregation, slicing and dicing is used for selection and projection [4]. MULTIDIMENSIONAL DATA MODEL (MDDM) As the name implied Multidimensional Data Model is a dimensional model. In the multidimensional data model large amount of data can be store at a time. It provides a mechanism to store data and to help the users. OLAP SERVER Relational OLAP- Traditionally Relational OLAP is used which is involved in many operations. Relation OLAP is the dimensions based model. ROLAP method is only used for only relational database. Relational database is a set of database which consists of fact and dimensions. ROLAP IMPLEMENT THROUGH TABLE A B C M 0 1 1 50 A B M 0 1 50 1 1 100 2 3 60 4 5 70 6 5 90 A C M 0 1 50 1 1 100 2 1 60 4 1 70 6 2 90 B C M 1 1 150 3 1 60 5 1 70 5 2 90 1 1 1 100 2 3 1 60 CUBE 4 5 1 70 6 5 2 90 A M 0 50 1 100 2 60 4 70 6 90 B M 1 150 3 60 5 160 C M 1 280 2 90 M 370 Figure 3: ROLAP implementation in OLAP server [5]

110 3. CONCLUSION In this paper, we have discussed about the Data warehouse as the collection of information collected from the other resources. We have compared the technology of On-Line transaction processing (OLTP) and On-Line analytical processing (OLAP). OLTP is used for recent data for transaction based. OLTP is not used for large amount of data, whereas OLAP technique is used for historical data that can be used for globally and analytical based multidimensional data. In this paper we have proposed how to integrate data with OLAP server. OLAP server is based on the multidimensional data model. Server is the web application server that we use in this paper to analyze and performed better results for customers, users, and other bank officers. Because in Relational data model only current data is used which is only suitable for colleges and department only, but in multidimensional data model we analyze the data in the historical model. Integrated Data Warehouse provides the data collection and transformed the data. REFERENCES [1] Reddy G. S., Srinivas R., Rao P. C., & Rikkula S. R., (2010). Data Warehousing, Data Mining, OLAP and OLTP Technologies are essential elements to support decision-making process in Industries. International Journal on Computer Science and Engineering, Vol. 02(9). pp 2865-2873 [2] Srivastava J., & Chen P. Y., (1999). Warehouse Creation- A Potential Roadblock to Data Warehousing. IEEE Transactions on Knowledge and Data Engineering, Vol. 11(1). pp 118-126 [3] Jarke, M., Quix,C., Blees, G., Lehmann, D., Michalk, G., & Stierl, S., (1999). Improving OLTP Data Quality Using Data Warehouse Mechanisms. Proceedings of the 1999 ACM SIGMOD International Conference on Management of Data. SIGMOD '99. pp 536-537 [4] Surajit Chaudhuri, S., & Dayal, U. (1997). An Overview of Data Warehousing and OLAP Technology. ACM Sigmod 97, 517-525 [5] Morfonios, K., Konakas, S., Ioannidis, Y., and Kotsis, N. (2007). ROLAP implementations of the data cube. ACM Comput. Surv. 39, 4, Article 12 (October 2007), http://doi.acm.org. [6] Sharma N., & Gupta S. K. (2012). Design and Implementation of access the contents in the Data Warehouse. International Journal of Information Technology and Knowledge Management, Vol. 6(1), pp. 61-64.