Christoph Bussler B2B Integration Concepts and Architecture With 165 Figures and 4 Tables IIIBibliothek Springer
Contents Part I Introduction to Business-to-Business Integration.... 1 1 History 3 1.1 Why Integration? 4 1.2 Evolution of Business-to-Business Integration Technology 5 1.2.1 Homegrown Integration 5 1.2.2 Point-to-Point Integration 6 1.2.3 Hub-and-Spoke Integration 10 1.2.4 Process-Based Integration 12 1.2.5 Naive B2B Integration 15 1.2.6 ASP Integration 16 1.2.7 Mature B2B Integration Technology 17 1.3 Business Need for B2B Integration Technology 19 1.3.1 Early B2B Integration 20 1.3.2 Early A2A Integration 20 1.3.3 Early Combination of A2A and B2B Integration 22 1.3.4 Hosted Application Integration 24 1.3.5 Mature B2B Integration Technology 24 1.4 Summary 26 2 Introduction to Business-to-Business Integration Technology 29 2.1 Requirements for Integration Concepts and Functionality 29 2.1.1 Endpoint 29 2.1.2 Hosted Trading Partner 30 2.1.3 Data Format and Event 30 2.1.4 B2B Protocol 31 2.1.5 Back-end Application System Adapter and Behavior 31 2.1.6 Business Process 32 2.1.7 History 32 2.1.8 Business Intelligence 33 2.2 Integration Concepts 33 2.2.1 Message 33 2.2.2 Event 35 2.2.3 Transformation and Translation 37 2.2.4 Business Event 40 2.2.5 Business Process and Endpoint Behavior 46
2.2.6 Advanced Business Process 55 2.2.7 Trading Partner and Back-end Application System 57 2.2.8 Endpoint Attribute, Capability and Agreement 57 2.3 Integration Technology Architecture 58 2.3.1 User Interface 60 2.3.2 Integration Logic 62 2.3.3 Connectivity 63 2.3.4 Persistence 65 2.3.5 Layer Component Invocation Model 66 2.3.6 Summary 66 2.4 Integration Technology Deployment 66 3 Types of Integration 69 3.1 Point-to-Point Back-end Application System Integration 70 3.2 Multipoint Back-end Application System Integration 70 '3.3 Back-end Application System Metadata Synchronization 71 3.4 Supply Chain Integration of Two Trading Partners 72 3.5 Supply Chain Integration of Several Trading Partners 73 3.6 Remote Back-end Application System 74 3.7 Marketplace Integration 75 3.8 Hub 76 3.9 Interactive Application 78 3.10 Intra-Enterprise Integration 79 3.11 Application Service Provider 81 3.12 ASP Aggregation 84 3.13 ASP Aggregator Aggregation 85 3.14 Hosted Integration 87 3.15 Reverse Hosting 88 3.16 Business-to-Consumer Integration 89 3.17 Summary '. 90 4 Classification 91 4.1 A2A, B2B and ASP Integration 91 4.2 Classification of Integration 92 4.2.1 Business Data Awareness 93 4.2.2 Integration Instance Representation 93 4.2.3 Hosting Paradigm 93 4.2.4 Definition Paradigm 94 4.2.5 Endpoint Specificity 94 4.2.6 Homogeneity 94 4.2.7 Endpoint State Awareness 95 4.2.8 Endpoint Behavior Awareness 95 4.2.9 Invocation Paradigm 96 4.2.10 Data Integration 96 4.2.11 Process Integration 96
4.2.12 User Interface Integration 97 4.2.13 Batch Integration 97 4.2.14 Reliability 97 4.3 Classification of Selected Integration Technologies 97 4.3.1 Streaming Query 98 4.3.2 Publish/Subscribe Technology 99 4.3.3 Remote Procedure Call 100 4.4 Classification of Mature B2B Integration 101 4.5 Summary 102 Part II Business-to-Business Integration Concepts 103 5 Preliminaries 105 5.1 B2B Integration Boundary 105 5.1.1 Event and Process Boundary 105 5.1.2 Integration Logic Boundary 107 5.2 Instance, Type and Metatype 108 5.2.1 Instance 109 5.2.2 Type 109 5.2.3 Metatype 110 5.2.4 Early and Late Binding 110 5.2.5 Dynamic Type Change Ill 5.2.6 My Instance is Your Type 112 5.3 Version, Variant and Configuration 114 5.3.1 Version 114 5.3.2 Configuration and Change Propagation 115 5.3.3 Dynamic Change 118 5.3.4 Singular Version : 120 5.3.5 Variant 121 5.4 Public and Private Behavior 121 5.4.1 Public Process 121 5.4.2 Private Process 123 5.4.3 Process Binding 124 5.4.4 Schematic Overall Process Layout 125 5.5 Interaction Between Enterprises 126 5.5.1 Synchronous vs. Asynchronous Invocation and Behavior... 126 5.5.2 Immediate and Delayed Behavior 127 5.5.3 Conversation 128 5.5.4 Direct vs. Indirect Communication 128 5.5.5 Interaction Scope 128 5.6 Interaction Within Enterprises 129 5.6.1 Function Integration 130 5.6.2 Data Integration 131 5.6.3 Event Integration 131 XV
5.7 Summary 131 6 The Ideal Integration 133 6.1 Single Secure and Reliable Network 133 6.2 Trusted Communication 134 6.3 Single Semantic Data Model and Integration Behavior 134 6.3.1 Data Model 135 6.3.2 Integration Behavior 136 6.4 Ideal Integration World 137 6.4.1 What's Left to be Done for Integration? 137 6.4.2 Ideal Integration Concepts 137 6.5 Characterization of Integration Concepts 138 6.5.1 Making Networks Reliable and Secure 138 6.5.2 Establishing Trusted Communication 138 6.5.3 Bridging Semantic Differences: Uniform Semantics 139 6.5.4 Achieving Homogeneous Integration 139 7 Concepts 141 7.1 Event 141 7.1.1 Message 141 7.1.2 Event and Data Type 144 7.1.3 Event Life Cycle 146 7.1.4 Event Addressing 148 7.1.5 Wire Event, Translation and Clear Text Event 151 7.1.6 Clear Text Event, Transformation and Business Event 155 7.1.7 Business Event Type Change Management 165 7.1.8 Event and Vocabulary 167 7.1.9 Business Event and Business Object 171 7.1.10 Event Correlation 174 7.1.11 Event Validation and Data Type Validation 177 7.1.12 Summary 180 7.2 Process 180 7.2.1 Hierarchical Decomposition 181 7.2.2 Data and Data Flow 183 7.2.3 Context-Dependent Event Validation Rule 190 7.2.4 Control Flow 192 7.2.5 Further Aspects 195 7.2.6 Static and Dynamic Process 195 7.2.7 Patterns 197 7.2.8 Life Cycle and Execution Model 198 7.2.9 Transactions 201 7.2.10 Compensation 202 7.3 Interface Process 204 7.3.1 Data 205 7.3.2 Instantiation Model 205
XVII 7.3.3 Data Flow 208" 7.3.4 Interface Process-Specific Process Steps 211 7.3.5 Execution Model 215 7.3.6 Batch Processing and Complex Event Relationships 217 7.3.7 B2B and A2A Protocols 219 7.4 Business Process 220 7.4.1 Data 221 7.4.2 Event Address Resolution 221 7.4.3 External Execution Logic 223 7.4.4 User Interactions 224 7.4.5 Business Rule 224 7.5 Binding Process...: 225 7.5.1 Data and Data Flow 225 7.5.2 Intermediate Storing of Events 227 7.5.3 Instantiation Model and Dynamic Process Binding 227 7.5.4 Behavior Transformation 229 7.5.5 Concurrent Processes and Process Coordination 229 7.6 Process Layout Revisited 230 7.7 Endpoint 231 7.7.1 Type 231 7.7.2 Trading Partner Community 232 7.7.3 Property 233 7.7.4 Organization Modeling 234 7.7.5 Endpoint Relationship 236 7.7.6 Capability 236 7.7.7 Hosting 237 7.7.8 Versioning : 238 7.8 Endpoint Agreement 238 7.8.1 Agreement : 238 7.8.2 Unilateral Agreement 240 7.8.3 Bilateral Agreement 240 7.8.4 Multiendpoint Agreement 241 7.8.5 Trading Partner Community Agreement 242 7.8.6 Agreement for Anonymous Endpoints 242 7.8.7 Multi-Interface Process Agreements 242 7.8.8 Agreement Conflict Resolution 243 7.8.9 Interface Process Instantiation Revisited 244 7.9 Error Handling and Compensation 245 7.9.1 Error Types 245 7.9.2 Dynamic Instance Modification 248 7.9.3 Compensation 249 7.9.4 Abort 250 7.10 Complete Integration Model 250 7.10.1 Completeness 250
7.10.2 Correctness 251 7.10.3 Semantic Correctness 251 7.11 Summary 252 8 Additional Functionality 253 8.1 History 253 8.2 Consistency and Reliability 255 8.3 Security 256 8.3.1 Requirements 256 8.3.2 Identification 256 8.3.3 Authentication 256 8.3.4 Authorization 257 8.3.5 Integrity 257 8.3.6 Confidentiality 258 8.3.7 Nonrepudiation 258 9 Recursive Application of Concepts to B2B Integration 261 9.1 Graphical Notation 261 9.2 Trading Partner Agreement Negotiation 261 9.3 Endpoint Identifier Synchronization 263 9.4 Endpoint Definition Update 265 9.5 B2B Protocol Change Management 266 Part III Business-to-Business Integration Technology Architecture 267 10 Architecture Overview 269 10.1 Layered Architecture 270 10.2 Component Structure 271 10.2.1 Component Interface 271 10.2.2 Component Parts 271 10.3 State-Based Architecture 272 10.4 Coordinated Architecture 272 10.4.1 User Interface Invocations 273 10.4.2 Invocations Processing Incoming Events 273 10.5 Integration Example..' 274 11 User Interface 275 11.1 Overview 275 11.2 Modeling Environment 277 11.2.1 Modeling Component 277 11.2.2 Testing Component 277 11.3 Management Environment 278 11.3.1 Endpoint Management Component 278 11.3.2 Error-Handling Component 279 11.3.3 Monitoring Component 280 11.4 Analysis Environment 281
11.5 End User Environment 282 11.6 System Administration Environment 282 12 Integration Logic 283 12.1 Overview 283 12.2 Integration Logic Component Coordinator 284 12.3 Initiating Event Processing 285 12.4 Interface Process Execution 286 12.5 Binding Process Execution 287 12.6 Business Process Execution 287 12.7 Outbound Binding and Interface Process Execution 288 12.8 Outbound Wire Event Processing 288 12.9 Summary 289 13 Connectivity 291 13.1 Overview 291 13.2 Receiving a Message 291 13.3 Security Verification 292 13.4 Endpoint Agreement Verification 293 13.5 B2B Protocol Execution 293 13.6 Outgoing Wire Event 294 13.7 Back-end Application System Adapter Execution 295 14 Persistence 297 14.1 Database 297 14.2 Persistent and Transactional Queues 298 14.3 Transactions and Distributed Transactions 298 15 Implementation Principles 299 15.1 Metamodel and Integration Execution Interpreter 299 15.1.1 Metamodel 299 15.1.2 Integration Execution Interpreter 300 15.2 Centralized and Transactional Architecture 300 15.3 Integration Testing and Monitoring 302 15.4 External Program Integration 302 15.4.1 Application Adapters 303 15.4.2 External Data Format Interpreter 303 15.4.3 And Then There is Integration Reality 304 Part IV Business-to-Business Integration Technology Deployment 305 16 Modeling Methodology 307 16.1 Overview 308 16.2 Business Behavior 308 16.2.1 Business Process Modeling 309 16.2.2 Business Event Definition 309 XIX
XX 16.3 Business Partner and Endpoint Definition 310 16.3.1 Trading Partner Definition 310 16.3.2 Back-end Application System Definition 312 16.3.3 Summary 313 16.4 Endpoint Agreement Definition 313 16.5 Modeling Traps 314 16.5.1 Point-to-Point Integration 314 16.5.2 Split of Round-trip Behavior 315 16.5.3 No Business Process 315 16.5.4 No Real Business Events 316 16.5.5 Inclusive Interface Processes 316 16.6 Deployment 316 16.7 Integration Project Management 317 17 Advertisement, Discovery and Agreement 319 17.1 Advertisement 319 17.2 Discovery 321 17.3 Agreement 322 18 Monitoring and Business Intelligence 323 18.1 Status Monitoring 323 18.2 Business Intelligence 324 18.2.1 Querying the Correct Integration Concepts 325 18.2.2 Taking Event Behavior into Account 326 19 Change Management 327 19.1 Reasons for Change 327 19.1.1 Internally vs. Externally Caused Changes 327 19.1.2 Compatible and Incompatible Changes 329 19.2 Business Behavior 329 19.2.1 Business Process Type Change 329 19.2.2 Business Event Type Change 330 19.3 Business Partner and Endpoint Definition 330 19.3.1 Endpoint Definition Change 330 19.3.2 Interface Process Type Change 331 19.3.3 Binding Process Type Change 332 19.3.4 Connectivity Change 332 19.4 Endpoint Agreement Definition 332 19.5 Deployment 333 19.6 Self-Service Changes 334 Part V Integration Standards, Products, Research and the Future of Integration 337 20 Standards 339 20.1 Standards in Today's World 339
20.1.1 Portability and Interoperability Standards :. 339 20.1.2 Current Situation in Context of B2B Integration Standards. 340 20.1.3 Elements of Interoperability Standards 341 20.1.4 Domain-Specific and Domain-Neutral Standards 342 20.1.5 And Where Does XML fit? 343 20.1.6 Standards Compliance 343 20.1.7 Standards Organizations 344 20.2 Process Standards 347 20.2.1 BPEL4WS 347 20.2.2 DAML-S 347 20.2.3 ebxmlbpss 348 20.2.4 RosettaNet 348 20.2.5 Other Process Standards 349 20.2.6 Future Process Standard? 349 20.3 Payload and Vocabulary Standards 349 20.3.1 ACORD 349 20.3.2 EDI 350 20.3.3 EPISTLE 351 20.3.4 HL7 352 20.3.5 OAGI 352 20.3.6 RosettaNet 353 20.3.7 SWIFT 353 20.3.8 Other Payload Standards 354 20.3.9 Vocabulary Standards 354 20.4 Security Standards 356 20.4.1 SAML 356 20.4.2 SSL 357 20.4.3 XACML 357 20.4.4 XKMS 357 20.4.5 XML Encryption 357 20.4.6 XML Signature 358 20.5 Endpoint and Agreement Standards 358 20.5.1 CPP 358 20.5.2 CPA '. 359 20.5.3 ebxml Registry 359 20.5.4 EDI 838 360 20.5.5 UDDI 360 20.6 Packaging and Transport Standards 361 20.6.1 ebxml MSS 361 20.6.2 EDIINT 362 20.6.3 FTP 362 20.6.4 HTTP 363 20.6.5 MIME 363 20.6.6 SMTP 363 XXI
XX11 20.6.7 SOAP 363 20.6.8 WSDL 364 20.7 Transaction Standards 364 20.7.1 BTP 364 20.7.2 WS-Coordination and WS-Transaction 365 20.8 Complete Standards 365 20.8.1 ebxml 365 20.8.2 RosettaNet 366 20.8.3 SWIFT 366 20.8.4 Web Services Architecture 366 20.9 Adapter Standard J2EE Connector Architecture 367 20.10 Application of Standards in B2B Integration Architecture 368 21 Products 371 21.1 BEA's WebLogic Integration 372 21.2 IBM's CrossWorlds 373 21.3 Microsoft's BizTalk Server 375 21.4 Oracle's 9iAS Integration 377 21.5 Further Products 378 22 Research 379 22.1 Event Definition and Transformation 379 22.2 Web Services and Web Service Composition 380 22.3 Quality of Service 382 22.4 Process 383 22.5 Adapter 384 22.6 Ontology 384 22.7 Integration Architecture 385 22.8 Business Process Monitoring 386 22.9 Agreements 386 23 The Future of Integration 387 23.1 Why Integration? 387 23.2 Integration, Quo Vadis? 388 23.3 The Grand Challenge 388 23.4 The Grander Challenge: Self-Forming Virtual Enterprises 390 Part VI References and Index 393 References 395 Index..403