Keywords: Data Warehouse, Data Warehouse testing, Lifecycle based testing, performance testing.
|
|
- Alisha Washington
- 8 years ago
- Views:
Transcription
1 DOI / ISSN IJESC Research Article December 2015 Issue Performance Testing Of Data Warehouse Lifecycle Surekha.M 1, Dr. Sanjay Srivastava 2, Dr. Vineeta Khemchandani 3 IV Sem, MTech 1, Professor & HOD 2, Associate professor 3 Department of CSE 1, 2 MGM College of Engineering, Noida 1, 2 JSSATE, Noida Uttar Pradesh Technical University, India 3 surekhashivakumar@gmail.com 1, sanjaysrivastava@coet.in 2, vkhemchandani@jssaten.ac.in 3 Abstract: Testing is an essential part of design lifecycle of any software product. Testing of Data warehouse is very important in projects because users need to trust the quality of information they access. The reasons for this are increase in Enterprise Mergers & Acquisitions, Compliance Regulations, Increased focus on data by Management and data driven decision makings. Data warehouse is a collection of large amount of data which is used by management for making strategic decisions. In this paper, we introduce a performance testing of Data warehouse Lifecycle and implement the same for a dataset using Naïve Bayes and K-Nearest Neighbour algorithm and made comparison between these two discuss how it can help solve some of the challenges in data warehouse This paper also proposes implementation details and future roadmap for model based data warehouse Keywords: Data Warehouse, Data Warehouse testing, Lifecycle based testing, performance I. Introduction to Data Warehouse In Computing Data warehouse is a system used for Reporting and data analysis. DWs are central repositories of integrated data from one or more desperate sources. They store historical and current data are used for creating analytical reports for knowledge workers throughout the enterprise. It is also called enterprise data Ware house (EDW). A Data warehouse is a Subject-oriented, time variant, integrated and nonvolatile collection of data in support of management s decision making process. A data warehouse is a copy of transaction data specifically structured for analysis and query. Data warehouse testing is carried out to check the quality of data stored. Testing should focus on Transformation of data, quality and performance of data and completeness of data. This paper is organized as follows section 2 briefly explains the survey of different DWT techniques. Section 3 explains proposed work. Section 4 explains advantages of lifecycle. Section 5 represents results and performance evaluation. Section 6 contains conclusion Data Warehouse Testing DWT itself has multiple phases and is staggered throughout the lifecycle of DW implementation. DWT is focuses on quality, consistency, completeness and validation of data. Testing implementation undergoes the cycle of unit testing Integration testing, System testing and usability testing and also focus on test cases generation requirement gathering and for the system. Data Warehouse Testing VS Software Testing DWT has a broader scope than software testing as it focus upon the usefulness and correctness of data. DWT always deals with huge volume of Data. DWT is post placement activity where as software testing is prior placement activity of software DWT test cases are unlimited. Software testing test cases are limited. DWT is System triggered whereas software testing is user triggered. DWT focus on validating the data whereas software testing focuses on the code. Challenges in Data Warehouse Testing As it is accepted that DW is different from other System, Hence there are some challenges in DW II. Different types of formatted data. Data of Heterogeneous sources. Huge volume of Data. Lack of testing tools knowledge Lack of requirements clarity Missing values in large volume of data One of the core challenges of testing DWS or providing technique for testing DW is its flexible architecture DW system could have different architectures. RELATED WORK In [1] Naveen ElGamal proposed to show the workflow of the framework when it is put in to operation. The key player of the DW testing process is the Test manager, who feeds the system with the DW architecture under test and current state of DW.DW architecture Analyzer component then studies the received data and compare it with the dependency graph with the assistance of test dependency manager component and passes the data to test recommender to generate an
2 abstract test plan, then executed validation and verification phase. Validation manager involves the business experts and system experts where as verification manager involves system tester and DB administrator for assistance in process of Test Case preparation. In[2] Kuldeep Deshpande proposed model based testing is a technique for automatic generation and execution of test cases based on formal models of system under test(sut).model based testing can be applied at various levels of testing i.e. unit testing, integration test and system In [3] Syntel white paper proposed object oriented framework for DW conceptual design. Framework is divided in to two levels namely-requirement level and Design level. At the requirement level, the requirements are gathered from different users and a thorough analysis is made. In design level UML designs helps in Extracting major objects and classes from data gathered and construction of UML class diagrams. In [4] Rajini Jindal and Shweta Taneja proved testing technique in large DW projects. Paper suggests that Industry best practices in DWH testing are data completeness and quality check, BI report data tasting, Performance validation of ETL and reports. Critical success factors for testing are Referential integrity of facts and Dimensions, Risk based Testing, data abfuscation, effective defect management and Focus on automation. In [5] Naveen ElGamal, Ali Ei Bastawissy and Galal Edeen proposed DW matrices which is categorized as what, where and when These categories will result in a three dimensional matrix. As shown in table1, the rows represent the where dimension, the columns represent the what dimension, and later on the when dimension is represented in color. Each cell of this table will consist of the group of test routines that addresses combination of dimension members.this matrix is used to compare the existing DW testing approaches. In [7] Execution-MiH explained categories of DW testing which includes different stages of the process. The testing is done on individual and end to end basis. Testing will include extraction testing transformation testing loading testing, end user testing end user browsing and OLAP testing, Adhoc Query testing, Stress and volume testing and parallel In [8] Golfarelli M. and Rizzi S introduced data warehouse testing activities framed within a DW development methodology. They stated that, The components needs to be tested: conceptual schema, Logical Schema, ETL procedures, Database and frontend. Table2: DW components vs testing types[8] III.PROPOSED WORK The testing activities in data warehousing projects begin with the requirement gathering phase and carried out in an iterative manner. In data warehousing testing, every component of the project needs to be tested. Figure 1 shows the proposed lifecycle for data warehouse testing containing following phases. Table 1: DW Testing Matrices In [6] Manoj Philip Mathen proposed two focus points for DW At a high level, Any strategy should focus on the two main aspects mentioned as underlying data and DW components. Underlying data includes Data coverage and data complying with the Transformation logic in accordance with the Business Rules. Whereas in DW Components he mentioned: performance, scalability, component orchestration tests and regression Figure1: Proposed Lifecycle of Data Warehouse Testing
3 We are briefly described the above phases as follows: 1. DATA GATHERING PHASE : All the data is collected from different sources like SQL server, access sheets. In this paper we used Data from Banking Domain as shown in figure1 Reviewed data. 2. REVIEW The data collected is reviewed for any correction present in the data. All data which is to be tested should be included in the data gathering. data if parameters are age, sex, income etc in Naive Bayes classifier considers each of these features contribute independently to the probability of data being in an existing data, regardless of the presence or absence of the other features. K-Nearest Neighbor: K nearest neighbors is a simple algorithm that stores all available cases and Classifies new cases based on a similarity measure (e.g., distance functions). Algorithm A case is classified by a majority vote of its neighbors, with the case being assigned to the class most common amongst its K nearest neighbors measured by a distance function. If K = 1, then the case is simply assigned to the class of its nearest neighbor. It should also be noted that all three distance measures are only valid for Continuous variables. In the instance of Categorical variables the Hamming Distance must be used. Figure 1: Reviewed Data 3. PLANNING In this phase, test data is prepared for In this phase how testing is to be carried out is planned. Decision for selecting of which algorithm is made here. In this paper selected testing algorithms are Naive bays and K-nearest neighbor. 4. REQUIREMENT TESTING In this emphasis is given defining business rules and requirement stated should be complete, clear, consistent and understandable. Interface review must be done to check the usability of the system. Tools must be decided in this phase on which testing must be performed. 5. TEST CASE GENERATION Different test cases are generated by using different combinations and according tools are set to operate. 6. TESTING Different testing techniques are mentioned: Testing phase involves selection of algorithm to be implemented to test DW performance. Selected algorithm in our case are Naive Bayes and KNN (K-Nearest Neighbor) Naïve Bayes: Briefly explaining Naïve Bayes classifier, In simple terms, a Naive Bayes classifier assumes that the value of a particular feature is unrelated to the presence or absence of any other feature, given the class variable. For example, In banking It also brings up the issue of standardization of the numerical variables between 0 and 1 when there is a mixture of numerical and Categorical variables in the dataset. Unit Testing: In this white box testing is performed. The developer loads the data from data source, data modules is tested individually. Integration testing: the process of combining and testing the components together one by one to check their integrity issues and to make sure they perform well working together. System Testing: this testing executes at developer site to make sure the system performs well. All the components run well together. Usability testing: this is a black box This checks for fulfillment of the requirements and ensure the validation of data. 7. PERFORMANCE TEST The proposed lifecycle executed well in implementation as we are getting validated data as a result of querying the data through.net interface. In WEKA data is validated. Then unit testing is done on single units. Then proceed to integration testing by integrating WEKA, SQL SERVER and UI together to check whether following components worked well. Data is tested against the accuracy of the data sets and performance is judged on the basis of different data mining attributes like precision, accuracy and time taken
4 IV. FEATURES OF PROPOSED TESTING LIFECYCLE FOR DATA WAREHOUSE 1. Test planning is done prior to the test cases development. 2. Stress on Requirement testing is given as it is important for the need of development of the system and tools is studied for testing the data. 3. Strategy is prepared as all the test data should be covered in test cases so that defects can be recognized at the early stages. 4. Testing the data on the basis of accuracy is the major part as in data mining there are many algorithms to choose, the best algorithm according to the need is chosen. 5. Testing is made iterative to make it easy for testers to change the system according to the requirements or add on any strategy without any hindrance. V. IMPLEMENTATION RESULTS Testing of data is done using the proposed lifecycle. Firstly, all data is collected and extracted by using ETL (Extracted Tested Loaded) process. All the data is transformed according to the business rules, which is then loaded into the WEKA tool and algorithm is loaded and results are captured. Data is validated using this process. Cost/benefit and threshold curve algorithm used for data analysis shows good result of graph. Secondly, GUI (Graphical user Interface) is made in which data sets is loaded and queried and result is displayed so as to ensure whether the validated data is producing correct results. Thirdly Comparison is made using proposed algorithms Figure 4: Threshold curve for KNN Figure 5: Threshold curve for KNN Figure 6: Threshold curve for KNN Figure 2: threshold graph for naive bayes VI. CONCLUSION From our work, we have concluded that. Any bug found in later stages can affect the analysis of data. Hence it become very important to validate before presenting it to GUI, It can help the data analyst to do analysis at accurate rate and in simplified manner. This paper presents the iterative DWT life cycle. The paper shows 94.2% accuracy achieved with KNN algorithm in comparison with Naïve Bayes, which shows 89.5% accuracy which concludes that KNN gives better performance than Naïve Bayes. VII. FUTURE WORK ROADMAP In future, we plan to conduct the studies on various data gathering techniques and would work on data gathering and will focus more on building a data warehouse with more improved testing strategies. Figure 3: cost Benefit graph for Naïve Bayes ACKNOWLEGMENT I thanks to all the experts who have contributed towards this work. I would also like to dedicate my acknowledgment of gratitude towards the following significant advisors and contributors:
5 I would like to thank Mr. Sanjay Srivastava for reading my research paper and providing valuable advices and for reproofing the paper. I sincerely thank to my parents, family, and friends, who provide the advice and financial support. The product of this research paper would not be possible without all of them. REFERENCES [1].Naveen ElGamal, Data Warehouse Testing, EDBT/ICDT, March 2013 [2].Kuldeep Deshpande, Model Based testing of Data warehouse, International Journal of Computer Science Issues (IJCSI), vol 10, Issue 2, March 2013 [3].Syntel, Proven Testing Techniques In Large Data Warehousing Projects : A white paper, Syntel 2012 [4].Rajini Jindal and Shweta Taneja, Comparitive Study Of Data Warehouse Design Approaches: A survey, International Jornal of Database Management System (IJDMS), vol February 2012 [5].Naveen ElGamal, Ali Ei Bastawissy and Galal Edeen, Towards A Data warehouse esting Framework, Ninth International Conference On ICT ad Knowledge Engineering, IEEE 2011 [13].Mookerjea A. and Malisetty P., 2008, Data Warehouse/ETL Testing: Best Practices, [14].Weka tutorials: [15]. [16].Sneed M. Harry, 2006, Testing a Data Warehouse an Industrial Challenge, in proceedings of the Testing: Academic & Industrial Conference on Practice and Research Techniques, IEEE Computer, p Author Details Mrs. Surekha.M. MTech, Dept of CSE, MGM College of Engineering, Noida. Uttar Pradesh Technical University. Dr. Sanjay Srivastava Professor & HOD, Dept of CSE., MGM College of Engineering, Noida. Uttar Pradesh Technical University. [6].Manoj Philip Mathen, Data Warehouse Testing : a white paper, Infosys, March 2010 [7].Execution-MiH, Data Warehouse Testing is different. [8].Golfarelli M. and Rizzi S., 2009, A Comprehensive Approach to Data Warehouse Testing, in ACM 12th international workshop on Data Warehousing and OLAP (DOLAP 09), Hong Kong, China. Dr.Vineeta Khemchandani Assossiate professor, JSSATE,Noida Uttar Pradesh Technical University. [9] Muhammad Shahan Ali Khan and Ahmad ElMadi, Data Warehouse Testing an Exploratory Study, MS Thesis, School of Computing, Blekinge Institute of Technology, Karlskrona, Sweden, [10] Muhammad Shafique and Yvan Labiche, A Systematic Review of Model Based Testing Tool Support, Carleton University, Technical Report, [11] Tanuška, P., Moravčík, O., Važan, P. and Miksa, F.The Proposal of the Essential Strategies of Data Warehouse Testing. in 19th Central European Conference on Information and Intelligent Systems (CECIIS), (2008), [12].Pooniah, P., 2001, Data Warehousing Fundamentals A Comprehensive Guide for IT Professionals, John Wiley & Sons, Inc
Keywords : Data Warehouse, Data Warehouse Testing, Lifecycle based Testing
Volume 4, Issue 12, December 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Lifecycle
More informationData Warehouse Testing
Data Warehouse Testing Manoj Philip Mathen Abstract Exhaustive testing of a Data warehouse during its design and on an ongoing basis (for the incremental activities) comprises Data warehouse testing. This
More informationTurkish Journal of Engineering, Science and Technology
Turkish Journal of Engineering, Science and Technology 03 (2014) 106-110 Turkish Journal of Engineering, Science and Technology journal homepage: www.tujest.com Integrating Data Warehouse with OLAP Server
More informationModel based testing of Datawarehouse
www.ijcsi.org 330 Model based testing of Datawarehouse Kuldeep Deshpande Capgemini Pune, Maharashtra, 411038, India Abstract Testing forms a major part of development lifecycle of a software system. Testing
More informationwww.ijreat.org Published by: PIONEER RESEARCH & DEVELOPMENT GROUP (www.prdg.org) 28
Data Warehousing - Essential Element To Support Decision- Making Process In Industries Ashima Bhasin 1, Mr Manoj Kumar 2 1 Computer Science Engineering Department, 2 Associate Professor, CSE Abstract SGT
More informationData Warehousing and Data Mining in Business Applications
133 Data Warehousing and Data Mining in Business Applications Eesha Goel CSE Deptt. GZS-PTU Campus, Bathinda. Abstract Information technology is now required in all aspect of our lives that helps in business
More informationA Comprehensive Approach to Master Data Management Testing
A Comprehensive Approach to Master Data Management Testing Abstract Testing plays an important role in the SDLC of any Software Product. Testing is vital in Data Warehousing Projects because of the criticality
More informationRequirements are elicited from users and represented either informally by means of proper glossaries or formally (e.g., by means of goal-oriented
A Comphrehensive Approach to Data Warehouse Testing Matteo Golfarelli & Stefano Rizzi DEIS University of Bologna Agenda: 1. DW testing specificities 2. The methodological framework 3. What & How should
More informationOptimization of ETL Work Flow in Data Warehouse
Optimization of ETL Work Flow in Data Warehouse Kommineni Sivaganesh M.Tech Student, CSE Department, Anil Neerukonda Institute of Technology & Science Visakhapatnam, India. Sivaganesh07@gmail.com P Srinivasu
More informationETL-EXTRACT, TRANSFORM & LOAD TESTING
ETL-EXTRACT, TRANSFORM & LOAD TESTING Rajesh Popli Manager (Quality), Nagarro Software Pvt. Ltd., Gurgaon, INDIA rajesh.popli@nagarro.com ABSTRACT Data is most important part in any organization. Data
More informationMETA DATA QUALITY CONTROL ARCHITECTURE IN DATA WAREHOUSING
META DATA QUALITY CONTROL ARCHITECTURE IN DATA WAREHOUSING Ramesh Babu Palepu 1, Dr K V Sambasiva Rao 2 Dept of IT, Amrita Sai Institute of Science & Technology 1 MVR College of Engineering 2 asistithod@gmail.com
More informationInternational Journal of Computer Science Trends and Technology (IJCST) Volume 2 Issue 3, May-Jun 2014
RESEARCH ARTICLE OPEN ACCESS A Survey of Data Mining: Concepts with Applications and its Future Scope Dr. Zubair Khan 1, Ashish Kumar 2, Sunny Kumar 3 M.Tech Research Scholar 2. Department of Computer
More informationWhitepaper. Data Warehouse/BI Testing Offering YOUR SUCCESS IS OUR FOCUS. Published on: January 2009 Author: BIBA PRACTICE
YOUR SUCCESS IS OUR FOCUS Whitepaper Published on: January 2009 Author: BIBA PRACTICE 2009 Hexaware Technologies. All rights reserved. Table of Contents 1. 2. Data Warehouse - Typical pain points 3. Hexaware
More informationDeriving Business Intelligence from Unstructured Data
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 9 (2013), pp. 971-976 International Research Publications House http://www. irphouse.com /ijict.htm Deriving
More informationAn Approach for Facilating Knowledge Data Warehouse
International Journal of Soft Computing Applications ISSN: 1453-2277 Issue 4 (2009), pp.35-40 EuroJournals Publishing, Inc. 2009 http://www.eurojournals.com/ijsca.htm An Approach for Facilating Knowledge
More informationA Survey on Web Mining From Web Server Log
A Survey on Web Mining From Web Server Log Ripal Patel 1, Mr. Krunal Panchal 2, Mr. Dushyantsinh Rathod 3 1 M.E., 2,3 Assistant Professor, 1,2,3 computer Engineering Department, 1,2 L J Institute of Engineering
More informationA Review of Contemporary Data Quality Issues in Data Warehouse ETL Environment
DOI: 10.15415/jotitt.2014.22021 A Review of Contemporary Data Quality Issues in Data Warehouse ETL Environment Rupali Gill 1, Jaiteg Singh 2 1 Assistant Professor, School of Computer Sciences, 2 Associate
More informationCopyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 29-1
Slide 29-1 Chapter 29 Overview of Data Warehousing and OLAP Chapter 29 Outline Purpose of Data Warehousing Introduction, Definitions, and Terminology Comparison with Traditional Databases Characteristics
More informationA Knowledge Management Framework Using Business Intelligence Solutions
www.ijcsi.org 102 A Knowledge Management Framework Using Business Intelligence Solutions Marwa Gadu 1 and Prof. Dr. Nashaat El-Khameesy 2 1 Computer and Information Systems Department, Sadat Academy For
More informationComparative Analysis of Data warehouse Design Approaches from Security Perspectives
Comparative Analysis of Data warehouse Design Approaches from Security Perspectives Shashank Saroop #1, Manoj Kumar *2 # M.Tech (Information Security), Department of Computer Science, GGSIP University
More informationAdvanced Data Management Technologies
ADMT 2015/16 Unit 2 J. Gamper 1/44 Advanced Data Management Technologies Unit 2 Basic Concepts of BI and Data Warehousing J. Gamper Free University of Bozen-Bolzano Faculty of Computer Science IDSE Acknowledgements:
More informationData Warehouse: Introduction
Base and Mining Group of Base and Mining Group of Base and Mining Group of Base and Mining Group of Base and Mining Group of Base and Mining Group of Base and Mining Group of base and data mining group,
More informationProven Testing Techniques in Large Data Warehousing Projects
A P P L I C A T I O N S A WHITE PAPER SERIES A PAPER ON INDUSTRY-BEST TESTING PRACTICES TO DELIVER ZERO DEFECTS AND ENSURE REQUIREMENT- OUTPUT ALIGNMENT Proven Testing Techniques in Large Data Warehousing
More informationAssociate Professor, Department of CSE, Shri Vishnu Engineering College for Women, Andhra Pradesh, India 2
Volume 6, Issue 3, March 2016 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Special Issue
More informationFluency With Information Technology CSE100/IMT100
Fluency With Information Technology CSE100/IMT100 ),7 Larry Snyder & Mel Oyler, Instructors Ariel Kemp, Isaac Kunen, Gerome Miklau & Sean Squires, Teaching Assistants University of Washington, Autumn 1999
More informationA Framework for Developing the Web-based Data Integration Tool for Web-Oriented Data Warehousing
A Framework for Developing the Web-based Integration Tool for Web-Oriented Warehousing PATRAVADEE VONGSUMEDH School of Science and Technology Bangkok University Rama IV road, Klong-Toey, BKK, 10110, THAILAND
More informationData Warehousing Systems: Foundations and Architectures
Data Warehousing Systems: Foundations and Architectures Il-Yeol Song Drexel University, http://www.ischool.drexel.edu/faculty/song/ SYNONYMS None DEFINITION A data warehouse (DW) is an integrated repository
More informationMetadata Management for Data Warehouse Projects
Metadata Management for Data Warehouse Projects Stefano Cazzella Datamat S.p.A. stefano.cazzella@datamat.it Abstract Metadata management has been identified as one of the major critical success factor
More informationB.Sc (Computer Science) Database Management Systems UNIT-V
1 B.Sc (Computer Science) Database Management Systems UNIT-V Business Intelligence? Business intelligence is a term used to describe a comprehensive cohesive and integrated set of tools and process used
More informationA Critical Review of Data Warehouse
Global Journal of Business Management and Information Technology. Volume 1, Number 2 (2011), pp. 95-103 Research India Publications http://www.ripublication.com A Critical Review of Data Warehouse Sachin
More informationBig Data-Challenges and Opportunities
Big Data-Challenges and Opportunities White paper - August 2014 User Acceptance Tests Test Case Execution Quality Definition Test Design Test Plan Test Case Development Table of Contents Introduction 1
More informationMASTER DATA MANAGEMENT TEST ENABLER
MASTER DATA MANAGEMENT TEST ENABLER Sagar Porov 1, Arupratan Santra 2, Sundaresvaran J 3 Infosys, (India) ABSTRACT All Organization needs to handle important data (customer, employee, product, stores,
More informationBussiness Intelligence and Data Warehouse. Tomas Bartos CIS 764, Kansas State University
Bussiness Intelligence and Data Warehouse Schedule Bussiness Intelligence (BI) BI tools Oracle vs. Microsoft Data warehouse History Tools Oracle vs. Others Discussion Business Intelligence (BI) Products
More informationIST722 Data Warehousing
IST722 Data Warehousing Components of the Data Warehouse Michael A. Fudge, Jr. Recall: Inmon s CIF The CIF is a reference architecture Understanding the Diagram The CIF is a reference architecture CIF
More informationAn Overview of Knowledge Discovery Database and Data mining Techniques
An Overview of Knowledge Discovery Database and Data mining Techniques Priyadharsini.C 1, Dr. Antony Selvadoss Thanamani 2 M.Phil, Department of Computer Science, NGM College, Pollachi, Coimbatore, Tamilnadu,
More informationSQL Server 2012 End-to-End Business Intelligence Workshop
USA Operations 11921 Freedom Drive Two Fountain Square Suite 550 Reston, VA 20190 solidq.com 800.757.6543 Office 206.203.6112 Fax info@solidq.com SQL Server 2012 End-to-End Business Intelligence Workshop
More informationBUILDING OLAP TOOLS OVER LARGE DATABASES
BUILDING OLAP TOOLS OVER LARGE DATABASES Rui Oliveira, Jorge Bernardino ISEC Instituto Superior de Engenharia de Coimbra, Polytechnic Institute of Coimbra Quinta da Nora, Rua Pedro Nunes, P-3030-199 Coimbra,
More informationFusion Applications Overview of Business Intelligence and Reporting components
Fusion Applications Overview of Business Intelligence and Reporting components This document briefly lists the components, their common acronyms and the functionality that they bring to Fusion Applications.
More informationAn Introduction to Data Warehousing. An organization manages information in two dominant forms: operational systems of
An Introduction to Data Warehousing An organization manages information in two dominant forms: operational systems of record and data warehouses. Operational systems are designed to support online transaction
More informationIntegrated Data Mining and Knowledge Discovery Techniques in ERP
Integrated Data Mining and Knowledge Discovery Techniques in ERP I Gandhimathi Amirthalingam, II Rabia Shaheen, III Mohammad Kousar, IV Syeda Meraj Bilfaqih I,III,IV Dept. of Computer Science, King Khalid
More informationInternational Journal of Scientific & Engineering Research, Volume 5, Issue 4, April-2014 442 ISSN 2229-5518
International Journal of Scientific & Engineering Research, Volume 5, Issue 4, April-2014 442 Over viewing issues of data mining with highlights of data warehousing Rushabh H. Baldaniya, Prof H.J.Baldaniya,
More informationA Review of Data Mining Techniques
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 4, April 2014,
More informationNamrata 1, Dr. Saket Bihari Singh 2 Research scholar (PhD), Professor Computer Science, Magadh University, Gaya, Bihar
A Comprehensive Study on Data Warehouse, OLAP and OLTP Technology Namrata 1, Dr. Saket Bihari Singh 2 Research scholar (PhD), Professor Computer Science, Magadh University, Gaya, Bihar Abstract: Data warehouse
More informationDimensional Modeling for Data Warehouse
Modeling for Data Warehouse Umashanker Sharma, Anjana Gosain GGS, Indraprastha University, Delhi Abstract Many surveys indicate that a significant percentage of DWs fail to meet business objectives or
More informationEnterprise Data Quality
Enterprise Data Quality An Approach to Improve the Trust Factor of Operational Data Sivaprakasam S.R. Given the poor quality of data, Communication Service Providers (CSPs) face challenges of order fallout,
More informationTDWI strives to provide course books that are content-rich and that serve as useful reference documents after a class has ended.
Previews of TDWI course books are provided as an opportunity to see the quality of our material and help you to select the courses that best fit your needs. The previews can not be printed. TDWI strives
More informationWhitepaper. Data Warehouse/BI Testing Offering. Published on: January 2010 Author: Sena Periasamy
Published on: January 2010 Author: Sena Periasamy Hexaware Technologies. All rights reserved. Table of Contents 1. 2. Data Warehouse - Typical pain points 3. Hexaware Solution 4. DWH Testing Why is it
More informationBIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by:
BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE Cerulium Corporation has provided quality education and consulting expertise for over six years. We offer customized solutions to
More informationAn Overview of Data Warehousing, Data mining, OLAP and OLTP Technologies
An Overview of Data Warehousing, Data mining, OLAP and OLTP Technologies Ashish Gahlot, Manoj Yadav Dronacharya college of engineering Farrukhnagar, Gurgaon,Haryana Abstract- Data warehousing, Data Mining,
More informationDesign of Electricity & Energy Review Dashboard Using Business Intelligence and Data Warehouse
Design of Electricity & Energy Review Dashboard Using Business Intelligence and Data Warehouse Atharva Girish Puranik, Abhijit Gohokar, Ravi Batheja, Nirman Rathod, Ojasvini Bali Abstract The advances
More informationCONCEPTUALIZING BUSINESS INTELLIGENCE ARCHITECTURE MOHAMMAD SHARIAT, Florida A&M University ROSCOE HIGHTOWER, JR., Florida A&M University
CONCEPTUALIZING BUSINESS INTELLIGENCE ARCHITECTURE MOHAMMAD SHARIAT, Florida A&M University ROSCOE HIGHTOWER, JR., Florida A&M University Given today s business environment, at times a corporate executive
More informationEnterprise Solutions. Data Warehouse & Business Intelligence Chapter-8
Enterprise Solutions Data Warehouse & Business Intelligence Chapter-8 Learning Objectives Concepts of Data Warehouse Business Intelligence, Analytics & Big Data Tools for DWH & BI Concepts of Data Warehouse
More informationMDM and Data Warehousing Complement Each Other
Master Management MDM and Warehousing Complement Each Other Greater business value from both 2011 IBM Corporation Executive Summary Master Management (MDM) and Warehousing (DW) complement each other There
More informationA Survey on Data Warehouse Architecture
A Survey on Data Warehouse Architecture Rajiv Senapati 1, D.Anil Kumar 2 1 Assistant Professor, Department of IT, G.I.E.T, Gunupur, India 2 Associate Professor, Department of CSE, G.I.E.T, Gunupur, India
More informationA Comparative Study on Operational Database, Data Warehouse and Hadoop File System T.Jalaja 1, M.Shailaja 2
RESEARCH ARTICLE A Comparative Study on Operational base, Warehouse Hadoop File System T.Jalaja 1, M.Shailaja 2 1,2 (Department of Computer Science, Osmania University/Vasavi College of Engineering, Hyderabad,
More informationQA Tools (QTP, QC/ALM), ETL Testing, Selenium, Mobile, Unix, SQL, SOAP UI
QA Tools (QTP, QC/ALM), ETL Testing, Selenium, Mobile, Unix, SQL, SOAP UI From Length: Approx 7-8 weeks/70+ hours Audience: Students with knowledge of manual testing Student Location To students from around
More informationUnderstanding Data Warehousing. [by Alex Kriegel]
Understanding Data Warehousing 2008 [by Alex Kriegel] Things to Discuss Who Needs a Data Warehouse? OLTP vs. Data Warehouse Business Intelligence Industrial Landscape Which Data Warehouse: Bill Inmon vs.
More informationDATA WAREHOUSING AND OLAP TECHNOLOGY
DATA WAREHOUSING AND OLAP TECHNOLOGY Manya Sethi MCA Final Year Amity University, Uttar Pradesh Under Guidance of Ms. Shruti Nagpal Abstract DATA WAREHOUSING and Online Analytical Processing (OLAP) are
More informationHow to Enhance Traditional BI Architecture to Leverage Big Data
B I G D ATA How to Enhance Traditional BI Architecture to Leverage Big Data Contents Executive Summary... 1 Traditional BI - DataStack 2.0 Architecture... 2 Benefits of Traditional BI - DataStack 2.0...
More informationBusiness Intelligence In SAP Environments
Business Intelligence In SAP Environments BARC Business Application Research Center 1 OUTLINE 1 Executive Summary... 3 2 Current developments with SAP customers... 3 2.1 SAP BI program evolution... 3 2.2
More informationData warehouse and Business Intelligence Collateral
Data warehouse and Business Intelligence Collateral Page 1 of 12 DATA WAREHOUSE AND BUSINESS INTELLIGENCE COLLATERAL Brains for the corporate brawn: In the current scenario of the business world, the competition
More informationTrustworthiness of Big Data
Trustworthiness of Big Data International Journal of Computer Applications (0975 8887) Akhil Mittal Technical Test Lead Infosys Limited ABSTRACT Big data refers to large datasets that are challenging to
More informationIntroduction to Data Mining
Introduction to Data Mining Jay Urbain Credits: Nazli Goharian & David Grossman @ IIT Outline Introduction Data Pre-processing Data Mining Algorithms Naïve Bayes Decision Tree Neural Network Association
More informationResearch on Airport Data Warehouse Architecture
Research on Airport Warehouse Architecture WANG Jian-bo FAN Chong-jun Business School University of Shanghai for Science and Technology Shanghai 200093, P. R. China. Abstract Domestic airports are accelerating
More informationCourse 803401 DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
Oman College of Management and Technology Course 803401 DSS Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization CS/MIS Department Information Sharing
More informationEstablish and maintain Center of Excellence (CoE) around Data Architecture
Senior BI Data Architect - Bensenville, IL The Company s Information Management Team is comprised of highly technical resources with diverse backgrounds in data warehouse development & support, business
More informationOLAP and OLTP. AMIT KUMAR BINDAL Associate Professor M M U MULLANA
OLAP and OLTP AMIT KUMAR BINDAL Associate Professor Databases Databases are developed on the IDEA that DATA is one of the critical materials of the Information Age Information, which is created by data,
More informationData Warehousing and OLAP Technology for Knowledge Discovery
542 Data Warehousing and OLAP Technology for Knowledge Discovery Aparajita Suman Abstract Since time immemorial, libraries have been generating services using the knowledge stored in various repositories
More informationSQL Server 2005 Features Comparison
Page 1 of 10 Quick Links Home Worldwide Search Microsoft.com for: Go : Home Product Information How to Buy Editions Learning Downloads Support Partners Technologies Solutions Community Previous Versions
More informationTesting Big data is one of the biggest
Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing
More informationMicrosoft Data Warehouse in Depth
Microsoft Data Warehouse in Depth 1 P a g e Duration What s new Why attend Who should attend Course format and prerequisites 4 days The course materials have been refreshed to align with the second edition
More informationApplied Business Intelligence. Iakovos Motakis, Ph.D. Director, DW & Decision Support Systems Intrasoft SA
Applied Business Intelligence Iakovos Motakis, Ph.D. Director, DW & Decision Support Systems Intrasoft SA Agenda Business Drivers and Perspectives Technology & Analytical Applications Trends Challenges
More informationOutline Business Intelligence Roadmap: The Complete Project Lifecycle for Decision-Support Applications
Outline Business Intelligence Roadmap: The Complete Project Lifecycle for Decision-Support Applications Introduction to the BI Roadmap Business Intelligence Framework DW role in BI From Chaos to Architecture
More informationChapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
More informationMeta-data and Data Mart solutions for better understanding for data and information in E-government Monitoring
www.ijcsi.org 78 Meta-data and Data Mart solutions for better understanding for data and information in E-government Monitoring Mohammed Mohammed 1 Mohammed Anad 2 Anwar Mzher 3 Ahmed Hasson 4 2 faculty
More informationApplication Of Business Intelligence In Agriculture 2020 System to Improve Efficiency And Support Decision Making in Investments.
Application Of Business Intelligence In Agriculture 2020 System to Improve Efficiency And Support Decision Making in Investments Anuraj Gupta Department of Electronics and Communication Oriental Institute
More informationCourse Outline: Course: Implementing a Data Warehouse with Microsoft SQL Server 2012 Learning Method: Instructor-led Classroom Learning
Course Outline: Course: Implementing a Data with Microsoft SQL Server 2012 Learning Method: Instructor-led Classroom Learning Duration: 5.00 Day(s)/ 40 hrs Overview: This 5-day instructor-led course describes
More informationTOWARDS A FRAMEWORK INCORPORATING FUNCTIONAL AND NON FUNCTIONAL REQUIREMENTS FOR DATAWAREHOUSE CONCEPTUAL DESIGN
IADIS International Journal on Computer Science and Information Systems Vol. 9, No. 1, pp. 43-54 ISSN: 1646-3692 TOWARDS A FRAMEWORK INCORPORATING FUNCTIONAL AND NON FUNCTIONAL REQUIREMENTS FOR DATAWAREHOUSE
More informationImplementing a Data Warehouse with Microsoft SQL Server 2012
Course 10777 : Implementing a Data Warehouse with Microsoft SQL Server 2012 Page 1 of 8 Implementing a Data Warehouse with Microsoft SQL Server 2012 Course 10777: 4 days; Instructor-Led Introduction Data
More informationDistance Learning and Examining Systems
Lodz University of Technology Distance Learning and Examining Systems - Theory and Applications edited by Sławomir Wiak Konrad Szumigaj HUMAN CAPITAL - THE BEST INVESTMENT The project is part-financed
More informationImplementing a Data Warehouse with Microsoft SQL Server 2012 MOC 10777
Implementing a Data Warehouse with Microsoft SQL Server 2012 MOC 10777 Course Outline Module 1: Introduction to Data Warehousing This module provides an introduction to the key components of a data warehousing
More informationData Mining for Successful Healthcare Organizations
Data Mining for Successful Healthcare Organizations For successful healthcare organizations, it is important to empower the management and staff with data warehousing-based critical thinking and knowledge
More informationMS 20467: Designing Business Intelligence Solutions with Microsoft SQL Server 2012
MS 20467: Designing Business Intelligence Solutions with Microsoft SQL Server 2012 Description: This five-day instructor-led course teaches students how to design and implement a BI infrastructure. The
More informationSimCorp Solution Guide
SimCorp Solution Guide Data Warehouse Manager For all your reporting and analytics tasks, you need a central data repository regardless of source. SimCorp s Data Warehouse Manager gives you a comprehensive,
More informationTHE QUALITY OF DATA AND METADATA IN A DATAWAREHOUSE
THE QUALITY OF DATA AND METADATA IN A DATAWAREHOUSE Carmen Răduţ 1 Summary: Data quality is an important concept for the economic applications used in the process of analysis. Databases were revolutionized
More informationA Model-based Software Architecture for XML Data and Metadata Integration in Data Warehouse Systems
Proceedings of the Postgraduate Annual Research Seminar 2005 68 A Model-based Software Architecture for XML and Metadata Integration in Warehouse Systems Abstract Wan Mohd Haffiz Mohd Nasir, Shamsul Sahibuddin
More informationMDM for the Enterprise: Complementing and extending your Active Data Warehousing strategy. Satish Krishnaswamy VP MDM Solutions - Teradata
MDM for the Enterprise: Complementing and extending your Active Data Warehousing strategy Satish Krishnaswamy VP MDM Solutions - Teradata 2 Agenda MDM and its importance Linking to the Active Data Warehousing
More informationBringing agility to Business Intelligence Metadata as key to Agile Data Warehousing. 1 P a g e. www.analytixds.com
Bringing agility to Business Intelligence Metadata as key to Agile Data Warehousing 1 P a g e Table of Contents What is the key to agility in Data Warehousing?... 3 The need to address requirements completely....
More informationBusiness Intelligence in E-Learning
Business Intelligence in E-Learning (Case Study of Iran University of Science and Technology) Mohammad Hassan Falakmasir 1, Jafar Habibi 2, Shahrouz Moaven 1, Hassan Abolhassani 2 Department of Computer
More informationOracle9i Data Warehouse Review. Robert F. Edwards Dulcian, Inc.
Oracle9i Data Warehouse Review Robert F. Edwards Dulcian, Inc. Agenda Oracle9i Server OLAP Server Analytical SQL Data Mining ETL Warehouse Builder 3i Oracle 9i Server Overview 9i Server = Data Warehouse
More informationData Warehouse Testing An Exploratory Study
Master Thesis Software Engineering Thesis no: MSE-2011-65 09 2011 Data Warehouse Testing An Exploratory Study Muhammad Shahan Ali Khan Ahmad ElMadi School of Computing Blekinge Institute of Technology
More informationStudent Performance Analytics using Data Warehouse in E-Governance System
Performance Analytics using Data Warehouse in E-Governance System S S Suresh Asst. Professor, ASCT Department, International Institute of Information Technology, Pune, India ABSTRACT Data warehouse (DWH)
More informationAn Overview of Database management System, Data warehousing and Data Mining
An Overview of Database management System, Data warehousing and Data Mining Ramandeep Kaur 1, Amanpreet Kaur 2, Sarabjeet Kaur 3, Amandeep Kaur 4, Ranbir Kaur 5 Assistant Prof., Deptt. Of Computer Science,
More informationThe University of Jordan
The University of Jordan Master in Web Intelligence Non Thesis Department of Business Information Technology King Abdullah II School for Information Technology The University of Jordan 1 STUDY PLAN MASTER'S
More informationWhat is Customer Relationship Management? Customer Relationship Management Analytics. Customer Life Cycle. Objectives of CRM. Three Types of CRM
Relationship Management Analytics What is Relationship Management? CRM is a strategy which utilises a combination of Week 13: Summary information technology policies processes, employees to develop profitable
More informationA Survey of ETL Tools
RESEARCH ARTICLE International Journal of Computer Techniques - Volume 2 Issue 5, Sep Oct 2015 A Survey of ETL Tools Mr. Nilesh Mali 1, Mr.SachinBojewar 2 1 (Department of Computer Engineering, University
More informationAnalyzing Polls and News Headlines Using Business Intelligence Techniques
Analyzing Polls and News Headlines Using Business Intelligence Techniques Eleni Fanara, Gerasimos Marketos, Nikos Pelekis and Yannis Theodoridis Department of Informatics, University of Piraeus, 80 Karaoli-Dimitriou
More informationWebinar. Feb 23 2012
An Feb 23 2012 Webinar David White Senior Product Manager David.white@assure.net Tel: +972-54-6750323 Shir Goldberg Co-Founder & VP Biz Dev shir.goldberg@assure.net Tel: +1 919 827 1194 This presentation
More informationA Data Warehouse Design for A Typical University Information System
(JCSCR) - ISSN 2227-328X A Data Warehouse Design for A Typical University Information System Youssef Bassil LACSC Lebanese Association for Computational Sciences Registered under No. 957, 2011, Beirut,
More informationA Survey of Real-Time Data Warehouse and ETL
Fahd Sabry Esmail Ali A Survey of Real-Time Data Warehouse and ETL Article Info: Received 09 July 2014 Accepted 24 August 2014 UDC 004.6 Recommended citation: Esmail Ali, F.S. (2014). A Survey of Real-
More information