Decision Support Systems and Intelligent Systems, Seventh Edition Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization 5-1
Learning Objectives Describe the issues in management of data. Understand the concepts and use of DBMS. Learn about data warehousing and data marts. Explain business intelligence/business analytics. Examine how decision making can be improved through h data manipulation and analytics. Understand the interaction betwixt the Web and database abase technologies. og es Explain how database technologies are used in business analytics. Understand d the impact of the Web on business intelligence and analytics. 5-2
Information Sharing a Principle Component of the National Strategy for Homeland Security Vignette Network of systems that provide knowledge integration and distribution Horizontal and vertical information sharing Improved communications Mining of data stored in Web-enabled warehouse 5-3
Data Raw data collected manually or by instruments Quality is critical Quality determines usefulness Contextual data quality Intrinsic data quality Accessibility data quality Representation data quality Often neglected or casually handled Problems exposed when data is summarized 5-4
Data Management 5-5
Data, Information, Knowledge Data Items that are the most elementary descriptions of things, events, activities, and transactions May be internal or external Information Organized data that has meaning and value Knowledge Processed data or information that conveys understanding or learning applicable to a problem or activity 5-6
5-7
Data Problems Data Quality Data integrity Data Access Data integration XML Integration software 5-8
Data Quality Source of data quality problems Data entry by employee Change to source system Data migration / conversion Mixed expectation by users External data System errors Data entry by customers 5-9
Data Quality problems ( categories ) Contextual ( محتوی ): relevancy ای ذاتی ( Intrinsic ) : accuracy Accessibility :دسترسی access security Representation بيرونی :شکل ease of understanding d 5-10
Data integrity Uniformity : within specified limits Version : original data Completeness check: summarize correct Conformity o check : correlation o Drill down : tracing 5-11
Data Cleanse data When populating warehouse Data quality action plan Best practices for data quality Measure results Data integrity issues Uniformity Version Completeness check Conformity check Genealogy or drill-downdown 5-12
Data access Data Integration Access needed to multiple sources Often enterprise-wide Disparate and heterogeneous databases XML becoming language standard 5-13
External Data Sources Web Intelligent agents Document management systems Content management systems Commercial databases Sell access to specialized databases 5-14
5-15
Data Store & Data Warehouse Characteristics 5-16
Database Management Systems Software program Supplements operating system Manages data Queries data and generates reports Data security Combines with modeling language for construction of DSS 5-17
Database Models Hierarchical Top down, like inverted tree Fields have only one parent, each parent can have multiple children Fast Network Relationships created through linked lists, using pointers Children can have multiple parents Greater flexibility, substantial overhead Relational Flat, two-dimensional tables with multiple access queries Examines relations between multiple tables Flexible,,q quick, and extendable with data independence Object oriented Data analyzed at conceptual level Inheritance, abstraction, encapsulation 5-18
5-19
Database Models, continued Multimedia Based Multiple data formats JPEG, GIF, bitmap, PNG, sound, video, virtual reality Requires specific hardware for full feature availability Document Based Document storage and management Intelligent Intelligent agents and ANN Inference engines ( Oracle Query optimizer) 5-20
5-21
Data Warehouse Subject oriented Scrubbed so that data from heterogeneous sources are standardized Time series; no current status Nonvolatile Read only Summarized Not normalized; may be redundant Data from both internal and external sources is present Metadata included Data about data Business metadata Semantic metadata 5-22
5-23
5-24
Architecture May have one or more tiers Determined by warehouse, data acquisition (back end), and client (front end) One tier, where all run on same platform, is rare Two tier usually combines DSS engine (client) with warehouse More economical Three tier separates these functional parts 5-25
5-26
5-27
Business rules Migrating Data Stored in metadata repository Applied to data warehouse centrally Data extracted from all relevant sources Loaded d through h data-transformation t ti tools or programs Separate operation and decision support environments Correct problems in quality before data stored Cleanse and organize in consistent manner 5-28
5-29
Data Warehouse Design Dimensional modeling Retrieval based Implemented by star schema Grain Central fact table Dimension tables Highest level of detail Drill-down analysis 5-30
Data Warehouse Development Data warehouse implementation ti techniques Top down Bottom up Hybrid Federated Projects may be data centric or application centric Implementation factors Organizational issues Project issues Technical issues Scalable Flexible 5-31
Data Marts Dependent Created from warehouse Replicated Functional subset of warehouse Independent Scaled down, less expensive version of data warehouse Designed for a department or SBU Organization may have multiple data marts Difficult to integrate 5-32
5-33
5-34
5-35
5-36
Business Intelligence and Analytics Business intelligence Acquisition of data and information for use in decision-making activities Business analytics Models and solution methods Data mining Applying models and methods to data to identify patterns and trends 5-37
OLAP Activities performed by end users in online systems Specific, open-ended query generation SQL Ad hoc reports Statistical analysis Building DSS applications Modeling and visualization capabilities Special class of tools DSS/BI/BA front ends Data access front ends Database front ends Visual information access systems 5-38
Data Mining Organizes and employs information and knowledge from databases Statistical, ti ti mathematical, ti artificial i intelligence, and machine-learning techniques Automatic and fast Tools look for patterns Simple models Intermediate t models Complex Models 5-39
Data Mining Data mining i application classes of problems Classification Clustering Association Sequencing Regression Forecasting Others Hypothesis or discovery driven Iterative Scalable 5-40
Tools and Techniques Data mining i Statistical methods Decision trees Case based reasoning Neural computing Intelligent agents Genetic algorithms Text Mining i Hidden content Group by themes Determine relationships 5-41
Data Mining application Marketing Banking Retails and sales Manufacturing / production Airline Health 5-42
Knowledge Discovery in Databases (KDD) Data mining used to find patterns in data Identification of data Preprocessing Transformation to common format Data mining through algorithms Evaluation 5-43
Data Visualization Technologies supporting visualization and interpretation Digital imaging, GIS, GUI, tables, multidimensions, graphs, VR, 3D, animation Identify relationships and trends Data manipulation allows real time look at performance data 5-44
Multidimensionality Data organized according to business standards, not analysts Conceptual Factors Dimensions Measures Time Significant overhead and storage Expensive Complex 5-45
Analytic systems Real-time queries and analysis Real-time decision-making Real-time data warehouses updated daily or more frequently Updates may be made while queries are active Not all data updated continuously Deployment of business analytic applications 5-46
GIS Computerized system for managing and manipulating data with digitized maps Geographically oriented Geographic spreadsheet for models Software allows web access to maps Used for modeling and simulations 5-47
5-48
Web Analytics/Intelligence Web analytics Application of business analytics to Web sites Web intelligence Application of business intelligence techniques to Web sites 5-49
Case study A university DSS for Budgeting A University DSS for Location analysis AU University it DSSf for Classroom assignment How Data warehouse / Data mining will help University Staff 5-50