Research on Airport Data Warehouse Architecture

Similar documents
Discussion on Airport Business Intelligence System Architecture

Data Warehousing Systems: Foundations and Architectures

Original Research Articles

Bussiness Intelligence and Data Warehouse. Tomas Bartos CIS 764, Kansas State University

Data Warehouse Overview. Srini Rengarajan

IST722 Data Warehousing

Master Data Management and Data Warehousing. Zahra Mansoori

An Introduction to Data Warehousing. An organization manages information in two dominant forms: operational systems of

Establish and maintain Center of Excellence (CoE) around Data Architecture

MDM and Data Warehousing Complement Each Other

The Business Value of Predictive Analytics

A Knowledge Management Framework Using Business Intelligence Solutions

A Service-oriented Architecture for Business Intelligence

Moving Large Data at a Blinding Speed for Critical Business Intelligence. A competitive advantage

Migrating a Discoverer System to Oracle Business Intelligence Enterprise Edition

Business Intelligence: Effective Decision Making

CHAPTER SIX DATA. Business Intelligence The McGraw-Hill Companies, All Rights Reserved

OLAP and OLTP. AMIT KUMAR BINDAL Associate Professor M M U MULLANA

Lection 3-4 WAREHOUSING

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence

Integrating SAP and non-sap data for comprehensive Business Intelligence

TRENDS IN THE DEVELOPMENT OF BUSINESS INTELLIGENCE SYSTEMS

Extensibility of Oracle BI Applications

Microsoft Data Warehouse in Depth

ENTERPRISE EDITION ORACLE DATA SHEET KEY FEATURES AND BENEFITS ORACLE DATA INTEGRATOR

Data Warehousing. Jens Teubner, TU Dortmund Winter 2015/16. Jens Teubner Data Warehousing Winter 2015/16 1

Survey of use of Data Warehousing and Business Intelligence at Australasian Universities 2008

RRF Reply Reporting Framework

Introduction to Datawarehousing

Course DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

Business Intelligence. A Presentation of the Current Lead Solutions and a Comparative Analysis of the Main Providers

Data Warehousing and Data Mining

COURSE 20463C: IMPLEMENTING A DATA WAREHOUSE WITH MICROSOFT SQL SERVER

The Role of the BI Competency Center in Maximizing Organizational Performance

Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization

IBM Cognos 8 Business Intelligence Reporting Meet all your reporting requirements

Data Search. Searching and Finding information in Unstructured and Structured Data Sources

Business Intelligence and Healthcare

資 料 倉 儲 (Data Warehousing)

Data Integrator: Object Naming Conventions

Applied Business Intelligence. Iakovos Motakis, Ph.D. Director, DW & Decision Support Systems Intrasoft SA

Oracle Architecture, Concepts & Facilities

Business Intelligence In SAP Environments

OLAP Theory-English version

Implementing a Data Warehouse with Microsoft SQL Server 2014

Data Warehouse Technology and Application in Data Centre Design for E-government

Data Warehouse: Introduction

Whitepaper. Data Warehouse/BI Testing Offering YOUR SUCCESS IS OUR FOCUS. Published on: January 2009 Author: BIBA PRACTICE

Oracle9i Data Warehouse Review. Robert F. Edwards Dulcian, Inc.

Course Outline: Course: Implementing a Data Warehouse with Microsoft SQL Server 2012 Learning Method: Instructor-led Classroom Learning

A Critical Review of Data Warehouse

Data Warehousing Fundamentals for IT Professionals. 2nd Edition

Oracle BI Application: Demonstrating the Functionality & Ease of use. Geoffrey Francis Naailah Gora

Enterprise Solutions. Data Warehouse & Business Intelligence Chapter-8

BUILDING BLOCKS OF DATAWAREHOUSE. G.Lakshmi Priya & Razia Sultana.A Assistant Professor/IT

Implement a Data Warehouse with Microsoft SQL Server 20463C; 5 days

Enterprise Data Warehouse (EDW) UC Berkeley Peter Cava Manager Data Warehouse Services October 5, 2006

Chapter 5. Warehousing, Data Acquisition, Data. Visualization

<Insert Picture Here> Oracle Retail Data Model Overview

Practical meta data solutions for the large data warehouse

Key organizational factors in data warehouse architecture selection

How To Use Noetix

LEARNING SOLUTIONS website milner.com/learning phone

Published by: PIONEER RESEARCH & DEVELOPMENT GROUP ( 28

Implementing a Data Warehouse with Microsoft SQL Server

BUILDING A WEB-ENABLED DATA WAREHOUSE FOR DECISION SUPPORT IN CONSTRUCTION EQUIPMENT MANAGEMENT

Data warehouse and Business Intelligence Collateral

Business Intelligence in Oracle Fusion Applications

An Approach for Facilating Knowledge Data Warehouse

Trends in Data Warehouse Data Modeling: Data Vault and Anchor Modeling

Chapter 6 Basics of Data Integration. Fundamentals of Business Analytics RN Prasad and Seema Acharya

Offload Enterprise Data Warehouse (EDW) to Big Data Lake. Ample White Paper

SQL Server 2005 Features Comparison

Reverse Engineering in Data Integration Software

Turning your Warehouse Data into Business Intelligence: Reporting Trends and Visibility Michael Armanious; Vice President Sales and Marketing Datex,

A Survey on Data Warehouse Architecture

Oracle BI Applications (BI Apps) is a prebuilt business intelligence solution.

META DATA QUALITY CONTROL ARCHITECTURE IN DATA WAREHOUSING

The Application of Data Warehouses in the Support of Decision Making Processes. Polish Enterprises Case Studies

Structure of the presentation

Implementing a Data Warehouse with Microsoft SQL Server

CONCEPTUALIZING BUSINESS INTELLIGENCE ARCHITECTURE MOHAMMAD SHARIAT, Florida A&M University ROSCOE HIGHTOWER, JR., Florida A&M University

Jagir Singh, Greeshma, P Singh University of Northern Virginia. Abstract

Experience studies data management How to generate valuable analytics with improved data processes

Service Oriented Data Management

EFFECTS OF BUSINESS INTELLIGENCE APPLICATION IN TOLLING SYSTEM

The Benefits of Data Modeling in Data Warehousing

Foundations of Business Intelligence: Databases and Information Management

Data Mining for Successful Healthcare Organizations

POLAR IT SERVICES. Business Intelligence Project Methodology

Comprehensive Centralized-Data Warehouse for Managing Malaria Cases

Integrating Netezza into your existing IT landscape

Data warehouse Architectures and processes

Implementing a SQL Data Warehouse 2016

BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by:

DSS based on Data Warehouse

Breadboard BI. Unlocking ERP Data Using Open Source Tools By Christopher Lavigne

Understanding Data Warehousing. [by Alex Kriegel]

ENTERPRISE BI AND DATA DISCOVERY, FINALLY

Transcription:

Research on Airport Warehouse Architecture WANG Jian-bo FAN Chong-jun Business School University of Shanghai for Science and Technology Shanghai 200093, P. R. China. Abstract Domestic airports are accelerating the construction of business intelligence systems, and data warehouse is core of the airport decision-making system. On the background of Shanghai Airport,This paper analyses the key demands of airport BI and data warehouse, discusses the application architecture of airport data warehouse based on the comparison of several other types of architecture and explores the function architecture of airport data warehouse architecture. This paper aims to provide the reference and help for the research and planning of relevant airport projects. Keywords: Warehouse architecture; airport; data mining 1. Introduction The concept of data warehousing dates back to the late 1980s. Several different definitions have been used to describe data warehouse. McFadden and Watson[1] define a data warehouse to be a collection of integrated, subject-oriented databases, designed to support decision enhancing activities, where each unit of data is relevant to some moment in time. DW ( Warehouse) is used to collect data designed to support management decision making. So far, the foreign scholars have done a very in-depth study on data warehouse. McFadden and Watson[1] present one of the earliest architectures for data warehouse design. At home, Zhang Shuming[2] discusses the basic principles and main design methods of data architecture through a data warehouse system implementation case of a telecommunication enterprise, yet research on Airport areas are still less. The data warehouse as an important aspect of the construction of the airport business intelligence systems is an important means to effectively support airport decision-making, data warehouse architecture design as a fundamental basis in the data warehouse technology is a description of the system architecture and modeling directly determine the applicability and validity of the data warehouse system, an extremely important role in the process of building data warehouse system. This article rely on the data warehouse system construction projects in Shanghai airport, have a brief discussion on data warehouse architecture such as Bus architecture, Hub-and-Spoke architecture, Federated data architecture, and proposed a data warehouse architecture for airport development program. 2. Warehouse The purpose of the data warehouse is to build integrated data analysis-oriented environment for enterprises to provide decision support. In fact, the data warehouse itself is not "production" of any data, at the same time itself does not need to "consume" any data, data from an external source, and open to external applications. The basic structure of the data warehouse contains data inflow and outflow of the process, which can be divided into four layers - the source data, data staging area, data presentation area, data access tools. Operational systems: (Structured and unstructured data) from OLTP systems, database such as SQL, Oracle, Sybase and other modern data source, WSDL, LDAP, JDBC etc.; staging area: a DW environment includes an extraction, transformation, and loading (ETL) process; presentation area includes the data warehouse and an online analytical processing (OLAP) engine; access tools: including some Query Services like Warehouse Browsing, Access and Security, Mining,, Activity Monitor Mining etc.. DW logical architecture shows as Fig.1. 107

BUS Centre for Promoting Ideas, USA www.ijbhtnet.com Systems Structured & Unstructured Staging Area Staging Services - Extract - ation - The Warehouse BUS Metadata Catalog Dimensional Warehouse Dimensions & Facts Dimensional s Query Services - Warehouse Browsing - Access and Security - Mining - - Activity Monitor OLAP Modeling Operational System 3. Warehouse Architecture 3.1 Bus Architecture Fig. 1 Logical architecture Bus Architecture[3] starts with a business requirements analysis for a specific process such as orders, deliveries, customer calls, or billing. One mart is created for a single business process, Additional marts are developed using the conformed dimensions of the first mart. The data warehouse is a joint constitute the data mart, data passed via the data bus. The data mart established according to the appropriate standard for data warehouse that same dimension. If there is no adhesion of the consistency dimension, data marts can only be an isolated application. Precisely because of the previous bus architecture and consistency dimension, this architecture can guarantee to ensure consistency of business data but also in the process of the gradual establishment of a data mart. In this method, you can understand the data mart set for the logical child of the entire data warehouse system. The data warehouse bus architecture diagram show as Fig. 2. Mining 3.2 Hub-and-Spoke Fig. 2 Bus Architecture The Hub-and-Spoke data warehouse architecture is to collect data from various source systems and data available to the various data marts and mining warehouse. This architecture develops after an enterprise-level analysis of data requirements, mainly focuses on building a scalable and maintainable infrastructure and consists of a centralized hub that accepts requests from multiple applications that are connected through spokes. See (Fig. 3). Integrated data distributed to each data mart from the central data warehouse. This architectural approach is of course, disadvantages, although data marts build according the integrated central data warehouse, yet they can not communicate between each other. At the same time, due to the establishment of the data mart, ETL program is different, so the data among the various data marts may be inconsistent, which makes follow-up construction of this architectural approach becomes complicated. DW Mining 108 Fig. 3 Hub-and-Spoke Architecture

3.3 Federated Warehouse Architecture The federal data warehouse leaves existing decision-support structures and data marts in place, and shares information among a number of different systems. The data is either logically or physically integrated. The federal data warehouse diagram show as Fig. 4. Federated data warehouse architecture regardless of geographical federal or functional need to build data warehouse respectively, and this can easily lead to integration is not complete unless the federated data warehouse architecture is also used similar functionality as the Bus Architecture, and retain conformed table in the data preparation and continually update it. Of course, for a quick solution to the original independent data mart data exchange federal architecture has some advantages. DW Mining 4. Airport Warehouse architecture 4.1 Airport information systems and demand analysis Fig. 4 Federated Warehouse Architecture After years of information technology process, the types of airport information systems, covering a wide range, overall, include the business systems and management information systems. The production system is divided into the flight information system, security monitoring systems, equipment and facilities management related systems. Management system, including purchasing inventory management system, property rental management system, asset management system, contract management, tender management system, human resources management system, investment project management system, customer relationship management systems, financial management systems, logistic Management System, etc.. Due to different period of development of information, there are some of the same information system and part of the independent system between the two. As businesses grow, large amounts of data exchange happen between the two, as well as The Group and Air Traffic Control, and some other external information systems. Between the current data exchange is a peer-to-peer mode (Fig. 5). Shanghai Airport Group business intelligence services to senior management and decision making, supplemented by functional business support. Shanghai Airport, including two airports, Pudong and Hongqiao. The Group does not directly make a specific production business, but mainly responsible for the possession of business entities under control. To this end, data warehouse architecture should be beneficial to senior management, financial management, strategic management and statistical analysis, performance management problems. Group base Pudong Airport s Air Traffic Management Bureau Hongqiao Airport s Fig. 5 Airport data exchange mode 109

Centre for Promoting Ideas, USA www.ijbhtnet.com 3.2 Comparison of the data warehouse architecture The bus data warehouse architecture is to establish a data warehouse from the bottom, which established in accordance with the business process data marts, and achieved enterprise-level consistency through the data bus and consistency dimension. Its architecture is simple, at the same time, using the dimensional modeling approach has some advantages compared to ER modeling. The bus structure has less effects on the source system data, and some other advantages such as low cost, fast deployment etc.. The Hub-and-Spoke architecture establishes a data warehouse from the top down. According to the established enterprise-level data warehouse, gradually establish department-level applications. Relative to the bus data warehouse, the architecture process is more complex and higher data integration, to some extent, this architecture can affect to the business system data. In the project implementation stage, the hub architecture needs high startup costs, but the subsequent development of lower cost. The proposing of the Federated Warehouse Architecture mean to solve the problem of information silos based on the use of existing facilities. When we need to build a data warehouse, some companies may already have some of the data mart. However, this data warehouse is often a remedy, so its data integration, data warehouse construction is not thorough enough. Many factors potentially affect the architecture selection decision, such as upper management s information needs, strategic view of the data warehouse prior to implementation, compatibility with existing systems, perceived ability of the in-house IT staff, end user requirements, emerging technologies. On the basis of analysis of the above factors, combined with the characteristics of the various data warehouse architecture, we believe that the bus data warehouse architecture is suitable for the requirements and future development of Shanghai Airport. 3.3 Airport Bus Architecture In this structure, The DW system extract data from business systems and establish financial analysis mart, statistical analysis mart, marketing analysis mart, KPI management mart, data mining mart etc. (Fig.6). The airport will be based on the phased establishment of specific business area data marts, and each phase of the establishment of a data mart can be mutually compatible and can be combined to achieve a data warehouse. DATA BUS Access Tools Mining... Financial Statistical Marketing KPI Mgmt. Mining ETL Extract, ation,... ETL SQL Operational XLS Management Systems: CRM System, Financial Mgmt. System, Logistic Mgmt. System Production Systems: Statistical System, Departure System, FIDS, Passenger Baggage System 110 Fig. 6 Airport Bus Architecture The data bus mode is also conducive to the airport in accordance with the development of the business needs, instead of a one-time construction, which provides the conditions for the data warehouse scalability, and also space for business development.

These data warehouse construction methods meet the requirements of the strategic development of the Shanghai Airport, also in line with the step-by-step implementation of the strategic considerations of the development of information technology, and a valuable solution. 5. Conclusion In this paper, we conduct a comparative study of three common data warehouse architecture according to the needs of decision-making theme of the Shanghai Airport Group. We believe that the data bus relative to the other two type of architecture has a distinct advantage. The data bus architecture model allows businesses to ensure consistency of data dimensions, and the gradual completion of the construction of a data warehouse in accordance with the business development needs. The solution proposed in this paper can provide a reference for the airport data warehouse construction, but also has a certain degree of universality can learn from other industries data warehouse construction. References F McFadden, H.J Watson (1996), The world of data warehousing: issues and opportunities Journal of Warehousing, 1(1):61 71. Zhang Shuming (2009), Discussion of Architecture Design for Warehousing: Information and Communications Technologies, 6:11-15. Thilini Ariyachandra, Hugh J. Watson (2006). Which Warehouse Architecture Is Most Successful: Business Intelligence Journal, 11(1)4 6. 111