Implementing efficient system i data integration within your SOA. The Right Time for Real-Time

Transcription

1 Implementing efficient system i data integration within your SOA The Right Time for Real-Time

2 Do your operations run 24 hours a day? What happens in case of a disaster? Are you under pressure to protect your business applications? Are your production systems maxed out? Can you handle the growing volumes of data? How do you ensure consistent data? Do you react to your business fast enough? How do you integrate new applications? Do you know how your business is doing right now? Are your information systems in sync? How do you plan to get ahead of your competition? Is your data out of date? Are you confident about the accuracy of your data? What happens when you can t access production systems? 2

3 Data Challenges Data is everywhere Data access is complex Data is difficult to integrate Numerous data sources Decentralized silos of info Fragmented or inconsistent data Stored in different types of data sources No aggregated, real-time view of information Costly to build, maintain, and troubleshoot Demanding requirements Hard to enforce data security consistently 3

4 Business and IT Drivers Demand Agility Business Respond rapidly to new opportunities and customer demands Increase real-time information sharing in the enterprise Leverage existing relevant information to better understand the business Ensure regulatory compliance with information IT Requirements for realtime, access to data from numerous data sources Integrate data that resides both inside and outside the company Increase data consistency and quality Reduce increasing data access complexity and costs Be agile to the data needs of the business Meet regulatory compliance and data privacy laws 4

5 Current Situation Portals Web Applications BI Applications ESB, EAI, BPM DB HR Sales Web Services iseries Inventory Data contained in multiple database and applications No aggregated, real-time view of data Point-to-point connection between the consumer and the data source Direct dependency on data models of data sources Increases complexity of the applications greater cost & time to develop and maintain 5

6 Business Benefits Faster Time to Value Enables rapid development and deployment of data services minimize coding Transforms data into reusable, actionable information as a service Reduced TCO Decouple consumers from data implementation provide change isolation Provides data governance security, auditing Greater Business Agility Manages enterprise data complexity and consistency Easily adapts to business demands and application requirements Increases information sharing 6

7 What We Do DataMirror s unique technology provides continuous data integration, protection and event detection without impacting the performance of operational systems. 7

8 Business Problems Data Protection for High Availability and Disaster Recovery Real-time Integration for Business Intelligence and Reporting Mitigate risk and offload production systems Yesterday s data inadequate for inventory and purchasing decisions Integration of Production Data for e-business Applications Up to date information flowing to and from web applications Real-time Event Detection Pro-actively monitor and respond to business changes Without Slowing the Performance of Production Systems 8

9 The DataMirror Advantage Databases Databases DB2, Oracle, SQL Server, etc Message Queues Database Log XML Documents 9

10 DataMirror Transformation Server High performance, peer-to-peer data integration solution Detects, translates, and communicates information changes (realtime) Eliminates batch windows High Volumes with Minimal System Impact Information always fresh & synchronized Native database interfaces - fast/efficient Push vs. Pull technology Replication options for data warehousing environments Role-based user security GUI improves ease of use Central, live monitor 10

11 Transformation Server Overview High performance, peer-to-peer, multi-platform data integration solution Captures, transforms and flows data in real time across heterogeneous platforms and databases Creates real-time data flows that facilitate a range of critical business applications: Active Data Warehousing Business Activity Monitoring Business Intelligence CRM Data Distribution Disaster Recovery & Avoidance - EAI - e-business - Mainframe Integration - Regulatory Compliance - Supply Chain Management 11

12 Transformation Server Transformation Server (TS) is a software solution that: Connects two or more databases together employing replication Works on a variety of systems (Windows NT, Mainframe, iseries, Sun, HP, etc.) Works with a variety of databases (Oracle, DB2, etc.) Employs Changed Data Capture technology Captures, transforms and flows the data in real-time Capture: Grab/copy changes to data as the change occurs Transform: Modify the data using filters, calculations or functions Flow: Send the data to another database Real-time: Without any delay, changes are immediately sent Can be used in any industry 12

13 Real-time Data Integration

14 Transformation Server: What can it do? Data replication Real-time Multi-platform Multi-mode Bi-directional Joins Custom extensions Column level filtering Row filtering Data transformation Single point of admin Fault tolerance And very fast... 14

15 TS Architecture 15

16 Business Benefits of Transformation Server Ease to Deploy: TS easy-to-use GUI makes it simple to select source and target databases and configure transformations Low Impact Using log-based CDC, TS captures changed data without impacting the performance of mission-critical applications Real-time Data changes are detected real-time and flows immediately to target systems Flexible Customers use Transformation Server to solve many different problems across a wide range of platforms 16

17 Data in Motion Database technologies store data. Message Oriented Middleware technologies move data. Until now, there has not been an easy way to allow the database to integrate with message oriented middleware data at rest VS data in motion Gartner Transformation Server/ES is all about getting data in motion 17

18 What does TS/ES do? Detects events as they occur in mission-critical production applications Creates useful business information to feed into the message queues of leading enterprise application integration (EAI), business process management (BPM), and service-oriented architecture (SOA) environments. TS/ES TCP/IP TCP/IP DB Update Logs Publisher Subscriber Message Queue 18

19 Event Detection What is an event? Could be anything? Financial suspicious transaction Retail stock shortage, loyalty rewards, late delivery Telco new customer, number of support calls Manu low inventory, large order Healthcare potential drug interaction To improve customer service, increase revenue or lower costs companies can proactively react to these business events How? Initiating a business process via a message queue Sending packaged transactions into an SOA or as a web service 19

20 The DataMirror Fit We bridge the gap between where the data is and where it will make a competitive difference Targets (MQSeries, webmethods, Tibco, BEA msg queues) Event Data flow source XML RFID EDI X12 CDC Real-time, Low-Impact, Data Auditing 20

21 Transformation Server/ES: MOM Support Transformation Server/ES uses JMS (Java Message Service) to write to JMS Compliant Message Oriented Middleware. Configure the MOM as a JMS provider, Define JMS connection factories, queues, and topics in the Java Naming and Directory Interface (JNDI) namespace for use by Transformation Server /ES. 21

22 Content Enrichment Combines content associated with the event from other systems ERP Purchase Order Event Server XML Document Message Queue CRM Customer Information 22

23 Content Based Routing Routes the data to different message queues based on content of a message Content based routing ERP Purchase Order Event Server Message Queue Message Queue CRM Message Queue Customer Information 23

24 Graphical XML Mapping Tool Automatically adjusts the structure of an XML document using drag and drop GUI 24

25 Automatic XML Mapping CUSTOMER ORDER TABLE Order Number Order Date Product Code S906 02/14/05 X5PR CUSTOMER TABLE Customer Code CUS112 <CustomerOrder> <Customer> <CustomerName>ABCDelivery</CustomerName> <CustomerCode>CUS112</CustomerCode> <CustomerAddress1>1234 Avenue Street</CustomerAddress1> <CustomerAddress2>Waterloo</CustomerAddress2> </Customer> <Order> <OrderNumber>S906</OrderNumber> <OrderDate>02/14/05</OrderDate> <ProductCode>X5PR</ProductCoder> <CustomerCode>CUS112</CustomerCode> </ Order> </CustomerOrder> Customer Code Customer Name Customer Address 1 Customer Address 2 CUS112 ABC Delivery 1234 Avenue St Waterloo 25

26 TS/ES Example National Retailer of Home Electronic, Furniture and Appliances Business challenge Need to centrally manage inventory allocation to stores Technical challenge Need to flow sales data in real-time between the POS systems and the Stock Allocation Application Stock Allocation Application requires integration at the application level 26

27 TS/ES Example TS/ES detects new sales order, transforms the data, and sends it in a message format for immediate delivery to a message queue POS Uses CDC to detect new sales orders POS Sales Order Sales Order TS/ES Sales/Inventory Information Message Queue POS Sales Order Stock Allocation and Delivery Info Stock Allocation and Delivery Info MOVEX 27

28 Telecom company - Environment Integrate billing system and other applications using Transformation Server/ES and TIBCO message queues (which they already own) Data captured from source is converted into XML format and applied to the TIBCO message queue TIBCO then transports the message to other applications Billing System Customer Transactions TS/ES Customer Transactions Corporate Systems TIBCO Example: Prepaid customers TS detects customers who are running low on minutes and sends XML to TIBCO TIBCO routes XML to CRM application to notify the customer via a text message Example: Phone activations 28

29 Business Benefits of TS/ES Ease to Deploy Quick set up of event detection and message delivery Low Impact Captures events without impacting the performance of mission-critical applications Real-time Events are detected in real-time and flow immediately to messaging middleware Flexible Native connection of source databases across multiple computing platforms for message delivery to any JMS compliant message queue 29

30 Multi-Platform Support DATABASES Source & Target DATABASES Target Only MESSAGE QUEUE Target Support OPERATING SYSTEMS HARDWARE PLATFORMS NETWORK PROTOCOLS DB2 / UDB TERADATA JMS OS/400 IBM iseries TCP/IP ORACLE NETEZZA MQ Series OS/390 IBM zseries SYBASE Tibco AIX IBM pseries MS SQL Server WebMethods HP-UX HP-9000 PointBase BEA SOLARIS INTEL MS Windows HP ALPHA LINUX(INTEL) SUN 30

31 Business Benefits Of Data Resiliency High Availability Perform backups without interruption Provide a service during periods of scheduled maintenance Business Continuity Rapidly resume service in the event of a failure Allow batch jobs to re-start from a known good copy of the data Disaster Recovery Rapidly resume service at a remote data centre in the event of a disaster Other Offload query and reporting workload Supports IBM Clustering Architecture Supports Storage Area Network (SAN) environments 31

32 Single Integrated Product Data Mirroring Monitoring Strengths Single install (more reliable) Object Mirroring Unified administration (easier to use) Less complex switching (faster and more reliable) Avoids duplicate processing jobs (uses less CPU) Switching 32

33 About DataMirror Founded in 1993 Stock Symbols (TSX: DMC) Fiscal 2007 Revenue: $46.5 million US International Offices in North America, South America, Asia, UK, Belgium, Germany, France, Spain 300+ employees worldwide 2,100+ customers worldwide; 10,000+ licenses deployed Leading provider of real-time information integration solutions and services 33

34 Benelux customers 34

35 Thank You How to reach us: 35