WebSphere Information Integrator

Transcription

1 WebSphere Information Integrator

2 Information Integrator.ppt 2 Enterprise Information is in Isolated Silos CUSTOMER SERVICE MARKETING FINANCE SALES & SUPPORT CUSTOMERS & PARTNERS LEGAL HR R&D Independent Sources and Systems

3 Information Integrator.ppt 3 Complex Enterprise Initiatives CUSTOMER SERVICE MARKETING FINANCE SALES & SUPPORT CUSTOMERS & PARTNERS LEGAL HR R&D CALL CENTER CRM / ERP SELF-SERVICE COMPLIANCE WEBSITES Imaging/ Document Mgmt Report Mgmt Web Content/ Media Asset Mgmt Database/ Custom Systems Network File Systems Workflow/ Business Process Mgmt

4 Information Integrator.ppt 4 Middleware Makes it Simple, and Better CUSTOMER SERVICE MARKETING FINANCE SALES & SUPPORT CUSTOMERS & PARTNERS LEGAL HR R&D CALL CENTER CRM / ERP SELF-SERVICE COMPLIANCE WEBSITES WebSphere Information Integrator (WII) Imaging/ Document Mgmt Report Mgmt Web Content/ Media Asset Mgmt Database/ Custom Systems Network File Systems Workflow/ Business Process Mgmt

5 WebSphere Information Integrator Information Consumers Processes, Applications, Clients Multiple access paradigms Multiple Integration disciplines Text Search SQL Query XQuery Content API Federation Replication Publication Find Data and Content Access, Transformation, Caching Metadata Management Any source Structured Semi-structured Unstructured DB2 Oracle SQL Server Message systems Content stores Applications XML, web services, Information Integrator.ppt 5

6 Information Integrator.ppt 6 Integrated Access to Information Our customer service reps need integrated access to information so they can address customer problems the first time they call. How can IBM help us? WebSphere Information Integrator enables you to access many data sources, including DB2, MS SQL server, Oracle, files system, XML, web services, ODI CIO IBM

7 WebSphere Information Integrator Makes All Data Readily Available Customer Data Policies Query Claims Information One interface one source Claims Payment Data sources Information Integration services Data users Information Integrator.ppt 7

8 WebSphere Information Integrator Benefits For the Customer Service Representative - one request to access all information Claims, Payments,. Incident files, For the Developer a portlet with a single SQL query For the Administrator single view of servers, wrappers, nicknames CLAIMS claimid integer payment decimal Information Integrator Claims Payments Incident files. xsd:string, ELEMENT <custssn> xsd:string, incidents (incident) <score> xsd:int, DB2 SQL Svr ELEMENT. incidentdate (#PCDATA). Information Integrator.ppt 8

9 DEMO: WebSphere Information Integrator Federated view Federated View of all customer information A single SQL query Schema mapping DB2 ddl DB2 ddl SQL-svr DB2 ddl XSD ddl Wrappers for Individual source SQL Svr Wrapper XML Wrapper Data sources Claims DB2 Payments Incident files. xsd:string, ELEMENT <custssn> xsd:string, incidents (incident) <score> xsd:int, SQL Svr ELEMENT. incidentdate (#PCDATA). Information Integrator.ppt 9

10 Sample WebSphere Information Integrator Federation Data Sources and Wrappers Information Integrator.ppt 10 Relational Source ODBC Source Non-relational Wrappers DB2 UDB Informix Oracle Sybase Teradata MS SQL Server ODBC WIICE Source FileNet (6) IBM (6) Microsoft (2) Red Brick Warehouse Classic Federation (5) IMS, VSAM, CA-Datacom, CA-IDMS, Adabas Ingres Lotus Notes Microsoft Access Microsoft Excel MySQL PostgreSQL Progress SAS Sybase SQL Anywhere U2 (UniData/UniVerse) and more Web Services SAP PeopleSoft Siebel Content Data (4) Additional Non- Relational (4) Life Sciences (6) Legacy Data Access via WS II Classic Federation for z/os (6) Build custom wrappers Java and C++ SDK

11 WebSphere Information Integrator Data Federation Technologies Information Integrator.ppt 11 Insert, update, or delete rows from federated relational databases Dynamic query service Arbitrary SQL statements to be executed at runtime Leverages intelligence about optimizing access to the data sources Provided by the data source wrapper, database Additional logic through User Defined Functions Cost based pushdown query optimization Define data caches over any federated data Materialized Query Tables (MQTs) based on an input query workload Cube Views over distributed or remote star schemas Unicode support at the integration engine

12 WebSphere Information Integrator (WII) Information Consumers Processes, Applications, Clients Multiple access paradigms Multiple Integration disciplines Text Search SQL Query XQuery Content API Federation Replication Publication Find Data and Content Access, Transformation, Caching Metadata Management Any source Structured Semi-structured Unstructured DB2 Oracle SQL Server Message systems Content stores Applications XML, web services, Information Integrator.ppt 12

13 Information Integrator.ppt 13 Choose the Replication that Fits Your Need SQL-based replication architecture Warehouses, data consistency, distribution and consolidation Replicate data among mixed relational data sources committed source changes are staged in relational tables before being replicated to target systems Flexibility and efficiency in managing scheduling, transformation, and distribution topologies Queue (Q) Replication Business continuity, workload distribution, and multi-site update Moving transactions between DB2 databases Committed source changes are written in messages Low latency and high throughput Send data across networks in compact messages Managed conflict detection and resolution

14 Information Integrator.ppt 14 Replication: Capture Stage Apply SQL Replication 1. Captures changes (log or trigger-based) and inserts into a staging table 2. Apply process asynchronously pulls the updates to the target systems Log based IMS DB2 Staging tables DB2 Control CD Control Trigger based SQL Capture CD CD SQL Federation Apply Engine Any Source External application Between heterogeneous databases Nicknames

15 Information Integrator.ppt 15 Replication: Capture Format Apply Queue (Q) Replication 1. Changes captured from the log and placed on a WebSphere message queue (XML) 2. Apply process retrieves the changes and applies them to the target system (in parallel) Control Control DB2 Source Q Capture WebSphere MQ Apply DB2 Target Log based Federation Engine Between DB2 source and target

16 Information Integrator.ppt 16 Q Replication Services and Utilities Apply reads from queue and apply transactions (in parallel) Subset data via pub/sub and filters Transformations options to choose Conflict detection and resolution Other utilities Table differences and repairs The Alert Monitor and Replication Analyzer

17 WebSphere Information Integrator Information Consumers Processes, Applications, Clients Multiple access paradigms Multiple Integration disciplines Text Search SQL Query XQuery Content API Federation Replication Publication Find Data and Content Access, Transformation, Caching Metadata Management Any source Structured Semi-structured Unstructured DB2 Oracle SQL Server Message systems Content stores Applications XML, web services, Information Integrator.ppt 17

18 Information Integrator.ppt 18 Event Publishing Link data events with business processes Application independent integration Removes the extra overhead from the transaction itself Eliminates hand coding typically required to detect data changes Decouples targets from source data sources DB2 data event publication capabilities From DB2 and legacy z/os data sources Leverages leading WebSphere MQ messaging Supports heterogeneous targets and clients DB2 Publishes data events using XML messages Flexible data format Widely used in the industry

19 Event Publishing from DB2 and Mainframe Sources Each message represents a database transaction XML format option for publishing Publish to WebSphere MQ queue DB2 Source Log based Control Capture WebSphere MQ XML Messages Event Publishing from DB2 IMS Log based VSAM CICS Change Capture Agents Correlation & Publication Services WebSphere MQ XML Messages IDMS Log based metadata catalog (Classical) Event Publishing from mainframe sources Information Integrator.ppt 19

20 Information Integrator.ppt 20 Event Publishing Options for DB2 Format Only data from committed transactions is published Data is self describing with XML tags Row based = one row per message Transaction based = one transaction per message Row Content Subset by column, subset by predicate Changed column values only or all column values New data values only or include old values Easy-to-use wizards to configure event publishing Adminq Q Capture DB2 Source Restartq Local queue Sendq Remote queue Local queue Recvq Local queue End User App Any Target

21 Correlation and Publication Services for Mainframe Sources Information Integrator.ppt 21 Correlation service Sorts data by unit-of-work identifiers At end of unit-of-work Rollback: Commit: flush all data for this unit-of-work reformat data into relational XML messages push data to the publication service Metadata catalog holds mapping between IMS and VSAM changes and relational table/column definitions that will be published Publication service Manages publication to WebSphere MQ persistent queue Initiates recovery data update with the correlation service Queue info is defined in configuration files metadata catalog publication service WebSphere MQ for z/os correlation service Changes

22 WebSphere Information Integrator Information Consumers Processes, Applications, Clients Multiple access paradigms Multiple Integration disciplines Text Search SQL Query XQuery Content API Federation Replication Publication Find Data and Content Access, Transformation, Caching Metadata Management Any source Structured Semi-structured Unstructured DB2 Oracle SQL Server Message systems Content stores Applications XML, web services, Information Integrator.ppt 22

23 Information Integrator.ppt 23 Finding Information Across the Enterprise Our Customer Service Representatives spend too much time trying to find the correct forms and policies needed to service customer requests. WebSphere Information Integrator OmniFind is designed specifically for enterprise search. It s state-of-the-art relevance engine can quickly categorize, summarize, and find the information you are looking for. ODI CIO IBM

24 Information Integrator.ppt 24 Enterprise Search Complexities in enterprise searching Less content lower chance for perfect matching Heterogeneous nature (form and size) affects search precision Less well linked fewer link and anchor text cues IBM enterprise searching Sophisticated relevancy algorithms for corporate content Delivers the best results with sub-second response Scales for large collections 500K+ documents and 1000s of concurrent users Fits easily into enterprise applications Java APIs with document level security Eases administration and maintenance Easy to install, common configurations, analysis under-the-covers

25 Information Integrator.ppt 25 WebSphere Information Integrator OmniFind Edition Powering intranets, extranets, and public corporate websites Free-form intelligent text search to enterprise sources Even sources with no or limited native text search capabilities High quality, scalable, and secure (J2EE) Millions of documents and thousands of users Seamless upgrade from WebSphere Portal search Leverage existing taxonomies, rules, user experience OmniFind components Crawlers access a wide range of information sources A search engine determines document relevancy State-of-the-art relevancy algorithms for corporate content An indexer provides high speed linkage Between key document attributes and the documents

26 DEMO: OmniFind Information Integrator.ppt 26

27 Example of WebSphere Information Integrator Partners Information Integrator.ppt 27 Enhance analysis and reporting Enable applications Enrich function Extend reach ANSI Expedite deployment

28 Information Integrator.ppt 28 Itergo Federate its Databases with WebSphere Information Integrator Challenge Simplify access to disparate data for inventory management and customer care Solution Federated access over Oracle inventory scan data base and DB2 employee and inventory basic and planning database for integrated view of asset and contact information. Federated access across disparate warehouses and data marts for unified client view [WebSphere] Information Integrator is a strategic product for all cases where different database systems needs to be federated. Thomas Dalewski Systems Engineer, Itergo Business benefits Simplify asset management and comparison of target/actual inventory Improve customer service with up to the minute insurance claim reports Technology benefits Saves over 10% of IT employee time in data prep and reporting One tool to access diverse systems across the company Avoid extensive changes to existing infrastructure

29 Don t Cut Your Customer Information Into Pieces Information Integrator.ppt 29