SECOND EDITION BUSINESS INTELLIGENCE A MANAGERIAL APPROACH INTERNATIONAL EDITION Efraim Turban University of Hawaii Ramesh Sharda Oklahoma State University Dursun Deleii Oklahoma State University David King JDA Software Group, Inc. With contributions by Janine E. Aronson The University of Georgia Prentice Hall Boston Columbus Indianapolis New York San Francisco Upper Saddle River Amsterdam Cape Town Dubai London Madrid Milan Munich Paris Montreal Toronto Delhi Mexico City Sao Paulo Sydney Hong Kong Seoul Singapore Taipei Tokyo
CONTENTS Preface 15 Chapter 1 Introduction to Business Intelligence 23 Opening Vignette: Norfolk Southern Uses Business Intelligence for Decision Support to Reach Success 24 1.1 Changing Business Environments and Computerized Decision Support 26 The Business Pressures-Responses-Support Model,26 1.2 A Framework for Business Intelligence (Bl) 28 Definitions of Bl 28 A Brief History of Bl 29 The Architecture of Bl 30 Styles of Bl 32 The Benefits of BI 32 Event-Driven Alerts 35 1.3 Intelligence Creation and Use and Bl Governance 36 A Cyclical Process of Intelligence Creation and Use 36 Intelligence and Espionage 37 1.4 Transaction Processing versus Analytic Processing 37 1.5 Successful Bl Implementation 38 The'Typical Bl User Community 38 Appropriate Planning and Alignment with the Business Strategy 39 Real-Time, 6n-Demand Bl Is Attainable 40 Developing or Acquiring Bl Systems 40 Justification and Cost-Benefit Analysis 40 Security and Protection of Privacy 41 Integration of Systems and Applications 41 1.6 Major Tools and Techniques of Business Intelligence 41 The Tools and Techniques 41 Selected Bl Vendors 41 1.7 Plan of the Book 42 1.8 Resources, Links, and theteradata University Network Connection 43 Resources and Links 43 Cases 43 Vendors, Products, and Demos 44 Periodicals 44 The Teradata University Network Connection 44 The Book's Web Site 44
10 Contents Chapter Highlights 44 Key Terms 45 Questions for Discussion 45 Exercises 45 End of Chapter Application Case 46 References 47 Chapter 2 Data Warehousing 49 Opening Vignette: DirecTV Thrives with Active Data Warehousing 50 2.1 Data Warehousing Definitions and Concepts 52 What Is a Data Warehouse? 52 Characteristics of Data Warehousing 52 Data Marts 53 Operational Data Stores (ODS) 53 Enterprise Data Warehouses (EDWs) 54 Metadata 55 2.2 Data Warehousing Process Overview 56 2.3 Data Warehousing Architectures 58 Alternative Data Warehousing Architectures 61 Which Architecture Is the Best? 63 2.4 Data Integration and the Extraction, Transformation, and Load (ETL) Processes 65 Data Integration 65. Extraction, Transformation, and Load (ETL) 67 2.5 Data Warehouse Development 69 Data Warehouse Vendors 72 Data Warehouse Development Approaches 72 Additional Data Warehouse Development Considerations. 74 Representation of Data in Data Warehouse 75 Analysis of Data in Data Warehouse 76 OLAP versus OLTP 77 OLAP Operations 77 2.6 Data Warehousing Implementation Issues 80 Massive Data Warehouses and Scalability 84 2.7 Real-Time Data Warehousing 85 2.8 Data Warehouse Administration, Security Issues, and Future Trends 90 The Future of Data Warehousing 91 2.9 Resources, Links, and the Teradata University Network Connection 93 Resources and Links 93 Cases 93 Vendors, Products, and Demos 93
Contents 11 Periodicals 93 Additional References 94 The Teradata University Network (TUN) Connection 94 Chapter Highlights 94 Key Terms 95 Questions for Discussion 95 Exercises 95 End of Chapter Application Case 97 References 98 Chapter 3 Business Performance Management 101 Opening Vignette: Double Down at Harrah's 102 3.1 Business Performance Management (BPM) Overview 105 BPM Defined 105 BPM and Bl Compared 105 3.2 Strategize: Where Do We Want to Go? 107 * Strategic Planning 107 The Strategy Gap 108 3.3 Plan: How Do We Get There? 109 Operational Planning 109 Financial Planning and Budgeting 110 3.4 Monitor: How Are We Doing? 111. Diagnostic Control Systems 111 Pitfalls of Variance Analysis 112 3.5 Act and Adjust: What Do We Need to Do Differently? 115 3.6 Performance Measurement 117 KPIs and Operational Metrics 117 Problems with Existing Performance Measurement Systems 118 Effective Performance Measurement 120.3.7 BPM Methodologies 123 Balanced Scorecard (BSC) 123 Six Sigma 126 3.8 BPM Technologies and Applications 132 BPM Architecture 132 Commercial BPM Suites 134 BPM Market versus the Bl Platform Market 135 3.9 Performance Dashboards and Scorecards 137 Dashboards versus Scorecards 137 Dashboard Design 138 What to Look for in a Dashboard 139 Data Visualization 139 Chapter Highlights 142 Key Terms 143
12 Contents Questions for Discussion 143 Exercises 144 End of Chapter Application Case 145 References 147 Chapter 4 Data Mining for Business Intelligence 151 Opening Vignette: Data Mining Goes to Hollywood! 152 4.1 Data Mining Concepts and Definitions 155 Definitions, Characteristics, and Benefits 157 How Data Mining Works 161 4.2 Data Mining Applications 165 4.3 Data Mining Process 168 Step 1: Business Understanding 169 Step 2: Data Understanding 170 Step 3: Data Preparation 170 Step 4: Modeling Building 172 Step 5: Testing and Evaluation 174 Step 6: Deployment 174 Other Data Mining Standardized Processes and Methodologies 176 4.4 Data Mining Methods 177 Classification 178 Estimating the True Accuracy of Classification Models 178 Cluster Analysis for Data Mining 184 Association Rule Mining 186 4.5 Artificial Neural Networks for Data Mining 189 Elements of ANN 190 Applications of ANN 192 4.6 Data Mining Software Tools 194 4.7 Data Mining Myths and Blunders 199 Chapter Highlights 200 Key Terms 201 Questions for Discussion 202 Exercises 202 End of Chapter Application Case 205 References 206 Chapter 5 Text and Web Mining 209 Opening Vignette: Mining Text for Security and Counterterrorism 210 5.1 Text Mining Concepts and Definitions 212 5.2 Natural Language Processing 215 5.3 Text Mining Applications 220 Marketing Applications 220 Security Applications 220 Biomedical Applications 223 Academic Applications 225
Contents 13 5.4 Text Mining Process 226 Task 1: Establish the Corpus 227 Task 2: Create the Term-Document Matrix 228 Task 3: Extract the Knowledge 230 5.5 Text Mining Tools 235 Commercial Software Tools 235 Free Software Tools 236 5.6 Web Mining Overview 236 5.7 Web Content Mining and Web Structure Mining 238 5.8 Web Usage Mining 250 5.9 Web Mining Success Stories 242 Chapter Highlights 246 Key Terms 246 Questions for Discussion 247 Exercises 247 End of Chapter Application Case 248 References 249... Chapter 6 Business Intelligence Implementation: Integration and Emerging Trends 251 Opening Vignette: Bl Eastern Mountain Sports Increases Collaboration and Productivity 252 6.1 Implementing Bl: An Overview 255 Bl Implementations Factors 255 Managerial Issues Related to Bl Implementation 256 6.2 Bl and Integration Implementation 258 Types of Integration 258 Why Integrate? 258 Levels of Bl Integration 259 Embedded Intelligent Systems 259 6.3 Connecting Bl Systems to Databases and Other Enterprise Systems 260 Connecting to Databases 260 Integrating Bl Applications and Back-End Systems 260 Middleware 261 6.4 On-Demand Bl 262 The Limitations of Traditional Bl 263 The On-demand Alternative 263 6.5 Issues of Legality, Privacy, and Ethics 265 Legal Issues 265 Privacy 265 Ethics in Decision Making and Support 267 6.6 Emerging Topics in Bl: An Overview 268 The Future of Business Intelligence 268
14 Contents Glossary 295 Index 303 6.7 The Web 2.0 Revolution 268 Representative Characteristics of Web 2.0 269 Web 2.0 Companies and New Business Models 269 6.8 Online Social Networking: Basics and Examples 270 A Definition and Basic Information 270 Mobile Social Networking 271 Major Social Network Services: Facebook and Orkut 271 Implications of Business and Enterprise Social Networks 272 6.9 Virtual Worlds 275 6.10 Social Networks and Bl: Collaborative Decision Making 279 The Rise of Collaborative Decision Making 280 Collaboration in Virtual Teams' Decision Making 280 6.11 RFID and New Bl Application Opportunities 282 6.12 Reality Mining 286 Key Terms 289 Questions for Discussion 289 Exercises 289 End of Chapter Application Case 291 References 291