Filtering the Web to Feed Data Warehouses

Transcription

1 Witold Abramowicz, Pawel Kalczynski and Krzysztof We^cel Filtering the Web to Feed Data Warehouses Springer

2 Table of Contents CHAPTER 1 INTRODUCTION Information Systems Information Filtering Systems Database Systems Transactional Systems Analytical Systems Organization of this Book 5 CHAPTER 2 DATA WAREHOUSE: CORPORATE KNOWLEDGE REPOSITORY Introduction Data Warehouse Definition and Features Definition Metadata Characteristic Features of Data in the Data Warehouse Data Warehouse System Architecture of the Data Warehouse System, Metadata Structures Data Warehouse Products Deploying Data Warehouse in the Organization Data Warehouse Life Cycle Analysis and Research Identifying Architecture and Demands Design and Development Implementation and On-going Administration Knowledge Management in Data Warehouses Knowledge Management Knowledge in Terms of Data Warehousing Knowledge Discovery in Data Warehouses Significance of Business Metadata Evolution of the Data Warehouse Criticism of the Traditional Data Warehouse Virtual Data Warehouse Information Data Superstore Exploration Warehouse Internet/Intranet Data Warehouse Web Farming Enterprise Information Portals 35

3 viii TABLE OF CONTENTS 2.7 Chapter Summary References 37 CHAPTER 3 KNOWLEDGE REPRESENTATION STANDARDS Introduction Basic Concepts Metadata Representation Metadata Interoperability Theory of Metadata Markup Languages Background XML Document Document Presentation Document Linking Programming Interfaces Dublin Core Dublin Core Metadata Elements Dublin Core in HTML Warwick Framework Meta Content Framework Origins of MCF Conceptual Building Blocks of MCF XML Syntax Directed Labelled Graph Formalism Resource Description Framework Background Formal RDF Data Model The RDF Syntax RDF Schema Common Warehouse Metamodel History of OMG Projects Objectives of the CWM Metadata Architecture CWM Elements Conclusions for CWM Chapter Summary References 72 CHAPTER 4 INFORMATION FILTERING AND RETRIEVAL FROM WEB SOURCES Introduction Document, Information, Knowledge Indexing Hypertext Information on the Web Constraints of this Book 78

4 TABLE OF CONTENTS ix 4.2 Information Retrieval Systems Definitions Information Retrieval System Architectures and Models Sample Information Retrieval Systems Information Filtering Systems Filtering Versus Retrieval Information Filtering Models and Architectures Sample Filtering Systems Internet Sources of Business Information Business View on Internet Information Sources General Characteristics of Business Information Sources Information Overflow Filtering the Web to Feed Business Information Systems Problems with Web Filtering and Retrieval New Information Filtering System Model Proposal Transparent Filtering and Retrieval Chapter Summary References 101 CHAPTER 5 ENHANCED DATA WAREHOUSE Introduction Justification of the Need for Integration Value of Knowledge Attention Economy Content Management and Lifecycle of Content Example of Integration: Metadata and Data Preliminary Vision of the System Analytical Point of View Ill Trends Ill Goals of the System Ill User Requirements Towards the Information Retrieval Systems Software Agents Introduction Intelligent Agents or Just Agents? Software Agents or Just Agents? Possible Applications of Agents Definitions of Software Agents Agent Properties Classifications of Software Agents Agent-based Systems and Multi-agent Systems Proposed Solution: enhanced Data Warehouse Introduction Overview of the edw System Assumptions for the edw System Components Agent-based System Architecture 127

5 xii TABLE OF CONTENTS Application for edw Chapter Summary References 229 CHAPTER 9 CONTEXT QUERIES AND ENHANCED REPORTS Introduction Context Queries Definition of Context Justification of Transparent Retrieval Elements of Context Conceptual Similarity Measure Simple Temporal Similarity Measure Parameterized Temporal Similarity Measure Pertinence enhanced Report User Interface in Accessing the Information How enhanced Report is Created Reporting Application Basic Assumptions Description of the Algorithms Context Query Agent Computational Complexity User Interface in Reporting Application Results Histograms: The Helpful Tool for Analysis Non-parameterized Histogram Past-oriented Analysis Future-oriented Analysis General Documents Detailed Documents Compact and Dispersed Histograms Chapter Summary References 258 CHAPTER 10 CONCLUSIONS Concluding Remarks Improvements Open Issues and Future Work 262 INDEX 265