enterprise professional expertise distilled

Size: px

Start display at page:

Download "enterprise professional expertise distilled"

Rachel McCormick
8 years ago
Views:

1 Oracle Information Integration, Migration, and Consolidation The definitive guide to information integration and migration in a heterogeneous world Use Oracle technologies and best practices to manage, maintain, migrate, and mobilize data Tom Laszewski Prakash Nauduri Jason Williamson [ enterprise professional expertise distilled PUBLISHING BIRMINGHAM - MUMBAI

best practices to manage, maintain, migrate, and mobilize data Tom Laszewski Prakash

2 Preface 1 Chapter 1: Getting Started with Information Integration 7 Why consider information integration? 8 Business challenges in data integration and migration 9 Technical challenges of information integration 10 General approaches to information integration and migration 10 Data integration 10 Data migration 11 Architectures: federated versus shared 13 Data sharing integration 14 Considerations when choosing an integration approach 14 Integration and SOA, bringing it together 16 Architected for the Internet 16 Scalability 17 Availability 17 Greater software options 17 On-demand reporting 18 Security 18 Overcoming barriers to change 18 Custom integration applications and utilities 19 Custom workflow 19 The real world: studies in integration 20 Banking case 20 Education case 21 High technology case 22 Summary 24

migration 11 Architectures: federated versus shared 13 Data sharing integration 14 Considerations when choosing an integration approach 14 Integration and SOA, bringing it together 16 Architected for

3 Chapter 2: Oracle Tools and Products 25 Database migration products and tools 27 SQL Loader 28 Oracle external tables 29 Oracle Warehouse Builder 30 SQL Developer Migration Workbench 31 Oracle Data Integrator 32 Oracle Enterprise Manager tuning and diagnostic packs 33 Physical federation products 35 Oracle Data Integrator 35 Oracle GoldenGate 36 Oracle CDC adapters 37 Oracle Master Data Management 38 Oracle Data Quality and Profiling 39 Virtual federation products 40 Oracle Gateways and Heterogeneous Services 41 Oracle Business Intelligence Suite 42 Oracle SOA adapters 43 Oracle Web Center and Portal 44 Oracle Business Activity Monitoring 45 Data services 45 Oracle Data Integration Suite 46 Data consolidation 47 Oracle Exadata 47 Data grid 49 Oracle Coherence 49 Oracle TimesTen 50 Oracle Exalogic 51 Information Lifecycle Management 52 Oracle Information Lifecycle Management 52 Oracle-to-Oracle 53 Oracle Streams 53 Oracle Data Pump 54 Oracle XStream 54 Application integration 55 Oracle SOA Suite 55 Oracle Advanced Queuing 56 Oracle Application Information Architecture 56 Products matrix summary 58 Products not covered 61 Summary 61

Management 38 Oracle Data Quality and Profiling 39 Virtual federation products 40 Oracle Gateways and Heterogeneous Services 41 Oracle Business Intelligence Suite 42 Oracle SOA adapters 43 Oracle Web

4 Chapter 3: Application and Data Integration Case Study 63 What is the POV? 64 Solving a business problem 67 Estimated level of effort 69 Software and hardware requirements 71 Software 71 Hardware and network 72 Original architecture nightly batch process 73 Batch cycle diagram technical architecture 74 Functional specifications 76 Functional design diagram 78 Technical specifications 79 Technical specifications diagram 81 Assumptions, out of scope, and success criteria 83 Assumptions 83 Out of scope 84 Success criteria 85 Technical implementation details 85 Reading from the Oracle Database 85 Writing to flat files 86 Executing the z/os COBOL module 87 Reading from VSAM files 88 Writing to IBM MQSeries 88 BPEL process 89 Security 89 Actual level of effort and outcome 90 Challenges and lessons learned 91 Cultural change in technology organizations 93 Next steps 94 Summary 95 Chapter 4: Oracle Database Migrations 97 Database migration scenarios 98 Migrating an Oracle database from one platform to another 99 Migrating relational databases to Oracle 103 Using Oracle SQL Developer Version 3.0 for migrations to Oracle 105 Prerequisites for using SQL Developer 106 Creating a migration repository 106 JDBC Drivers setup 106 Creating a connection for a privileged database user in Oracle using SQL Developer 108 Creating a directory for a migration project 111 Migration process using SQL Developer 111

diagram technical architecture 74 Functional specifications 76 Functional design diagram 78 Technical specifications 79 Technical specifications diagram 81 Assumptions, out of scope, and success

5 Migration steps in SQL Developer 112 Selection of the database connection for the repository 112 Project creation 113 Gathering source database metadata 113 Online capture 114 Offline mode 114 Convert the captured database model to an Oracle model 119 Target Oracle schema generation 120 Data migration 123 Enabling a factory approach to database migrations using SQL Developer 127 Data migration using Oracle SQL*Loader/External tables 129 Using Oracle SQL*Loader 130 Using Oracle External Table 132 Using Oracle Data Integrator (ODI) for data migration 134 Production rollout using Oracle GoldenGate 135 Impact of database migrations on applications 137 Summary 138 Chapter 5: Database Migration Challenges and Solutions 139 Database schema migration challenges 140 Database object naming/definition issues 141 Use of special characters in object names 141 Use of reserved words in object names and their definitions 142 Use of case-sensitive object names 143 Length of object names 144 Data type conversion issues 145 Numeric data 145 Identity columns 146 Date/timestamp data 148 User-defined data types 149 Database feature mapping 149 Clustered indexes 149 Database schema layout 151 Empty strings and NULL value handling 152 Data case-sensitivity 152 EBCDIC/ASCII conversions 155 Globalization 158 Database migration case studies 160 Case Study #1: DB2/400 migration to Oracle using Oracle DRDA Gateway for DB2 160 Case Study #2: Sybase migration to Oracle 161 Case Study #3: Mainframe data migration/archiving from various databases such as DB2, IDMS, and VSAM 162 Summary 163

migration using Oracle SQL*Loader/External tables 129 Using Oracle SQL*Loader 130 Using Oracle External Table 132 Using Oracle Data Integrator (ODI) for data migration 134 Production rollout using

6 Chapter 6: Data Consolidation and Management 165 What is enterprise data? 166 Transactional data 167 Analytical data 167 Master data 168 Enterprise data hub 170 Oracle Master Data Management 170 Oracle Customer Hub 171 Oracle Product Hub 173 Oracle Supplier Hub 173 Oracle Supplier Hub capabilities 173 Oracle Site Hub 175 Oracle RAC 176 Data grids using Oracle caching 177 Database-centric TimesTen 179 Application-centric Coherence 179 Oracle as a service 179 Reasons to consider Consolidation 180 Information Lifecycle Management 182 Active data archiving 182 Passive data archiving 182 Oracle Exadata 182 Data management at IHOP, a case study 183 Summary 185 Chapter 7: Database-centric Data Integration 187 Oracle GoldenGate 191 Configuring GoldenGate for IBM DB2 to Oracle data replication 194 Prerequisites 195 Configuration overview 195 On the Oracle database server (target) 199 Oracle Database Gateways 200 Oracle heterogeneous connectivity solution architecture 201 Heterogeneous Services 203 Database Gateways (Heterogeneous Services agent) 204 Overview of Database Gateway installation and configuration 205 Oracle Data Integrator 208 ODI repositories 210 ODI Studio 210 ODI runtime agent 211 ODI console 211 Data management case study 214

Supplier Hub capabilities 173 Oracle Site Hub 175 Oracle RAC 176 Data grids using Oracle caching 177 Database-centric TimesTen 179 Application-centric Coherence 179 Oracle as a service 179 Reasons to

7 Company overview 214 Company challenges 215 Overstock.com's value proposition 215 Integration framework 216 Summary 218 Chapter 8: Application and Process Integration 219 History of application integration 220 Point-to-Point API-based integration 221 EDI 223 Message and integration brokers 223 XML over HTTP or FTP 225 History of Oracle integration products 225 Oracle Interconnect 226 Oracle ProcessConnect 227 Oracle Enterprise Service Bus Oracle Workflow process integration 228 Oracle commercial off-the-shelf (COTS) application integration history 228 Oracle application and process integration software stack 230 Oracle Business Process Analysis 231 Oracle Business Process Management 232 SOA Adapters 233 Oracle Business Rules 237 Oracle BPEL 237 Oracle Service Bus 238 Oracle Complex Events Processing (CEP) 239 Oracle Business-to-Business (B2B) 240 Oracle Service Component Architecture (SCA) 240 Oracle Web Services Registry 241 Oracle Web Services Manager 241 Metadata Services (MDS) 241 AIA Going beyond the Oracle SOA Suite 242 AIA fundamentals 242 Enterprise Business Objects 243 Enterprise Business Messages 244 Enterprise Business Service 244 Enterprise Business Flow 244 Application Business Connector Service 245 Tools development environment 245 Oracle AIA Foundation and Process Integration Packs 247 Oracle JDeveloper 247 Eclipse 248 Oracle SOA Suite integration best practices 248

EDI 223 Message and integration brokers 223 XML over HTTP or FTP 225 History of Oracle integration products 225 Oracle Interconnect 226 Oracle ProcessConnect 227 Oracle Enterprise Service Bus 227 -

8 Tabic of Contents Oracle success stories 252 Success one Saleforce.com and Oracle E-Business Suite 252 Solution 253 Benefits 254 Success two cross-industry Oracle eam print solution 254 Solution 255 Benefits 255 Summary 256 Chapter 9: Information Lifecycle Management for Transactional Applications 259 Data growth challenges 260 How enterprises try to solve data growth issues 261 Hardware refresh 261 SQL/DB tuning 262 Delete historical data 262 What is Information Lifecycle Management? 263 What benefits can ILM offer? 264 Active Application Archiving 265 Application Retirement 271 Start with Application Portfolio Management 274 Application Retirement solution from Solix Technologies and Oracle partner 278 Summary 280 Appendix 281 Cloud integration 281 Implications of web services for all Integration 284 Data, process, and application integration convergence 286 Job scheduling, ETL/ELT and BPEL product convergence 287 Middle tier integration appliances 290 Security 290 Mobile data and collective intelligence 292 Summary 293 Index 295

Management for Transactional Applications 259 Data growth challenges 260 How enterprises try to solve data growth issues 261 Hardware refresh 261 SQL/DB tuning 262 Delete historical data 262 What is

Oracle Business Activity Monitoring 11g New Features

Oracle Business Activity Monitoring 11g New Features Gert Schüßler Principal Sales Consultant Oracle Deutschland GmbH Agenda Overview Architecture Enterprise Integration Framework