Shadowbase Data Replication Solutions William Holenstein Senior Manager of Product Delivery Shadowbase Products Group 1
Agenda Introduction to Gravic Shadowbase Product Overview Shadowbase for Business Continuity Shadowbase for Data Synchronization Shadowbase for Application Integration Shadowbase Success Stories What s New for Shadowbase For More Information 2
Introduction to Gravic A History of Excellence 1979 Founded, development organization & service bureau 1984 Introduced NonStop replication product TMF Auditor 1995 Lowest-latency process-to-process replication Shadowbase Focused Technology Direction Product solutions for a wide array of enterprise data replication and synchronization requirements Patents on critical and innovative technology Total Replication Solutions Leverage product, services, and partners to offer complete business problem solution Industries include financial services, trading systems, banks, telecommunications, healthcare, etc. 3
Selected Shadowbase Customers Banking & Financial Services: Telecommunications: U.S. Cellular MOTOROLA Other: 4
Shadowbase Product Overview Shadowbase Replication is an Enabling, Extensible Technology! Business Continuity & Availability Disaster Recovery (Uni-Dir Active-Passive Architectures) Sizzling Hot Takeover (Bi-Dir Active/Almost Active Architectures) Continuous Processing (Bi-Dir Active/Active Architectures) Eliminate Application Downtime for Migrations & Upgrades (ZDM) Data Synchronization and Application Integration Homogeneous & Heterogeneous Environments Data Transformation, Scrubbing, Filtering, & Cleansing Data Warehouse Feeds, Build OLQP Environments Real-Time Business Intelligence, Integrating Modern DB s, etc. Event Trigger Processing (Pub/Sub Functionality), Application Modernization Utility Uses Restore Corrupted Databases On-line Audit Compliance Reporting and Analysis Test Database Creation, QA Database Refresh, etc. 5
Shadowbase Product Overview Enscribe SQL/MP SQL/MX* HP NonStop Enscribe HP NonStop SQL/MP SQL/MX Sybase Oracle MySQL DB2 Unix/Linux Oracle SQL Server Sybase DB2 Oracle Sybase Oracle SQL Server DB2 Linux, Unix, Windows AS400 VMS Windows Any ODBC Target Platform/Database Enscribe HP NonStop SQL/MP SQL/MX* Enscribe HP NonStop SQL/MP SQL/MX* Oracle SQL Server Linux, Unix, Windows Sybase Oracle SQL Server Linux, Unix, Windows Sybase 6
Highest Availability Higher Availability Shadowbase for Business Continuity Disaster Recovery (High Availability) Active/Passive Architecture Uni-directional Replication Target Application Not Running (or Running Read-Only) Users Connected to Primary Node Sizzling-Hot Takeover (Higher Availability) Active/Almost Active Architecture Bi-directional Replication Target Application Running Ready To Take Over Immediately Users Connected to Primary Node Disaster Tolerant (Continuous Availability) Active/Active Architecture Bi-directional Replication Application Running on All Nodes Processing Requests Users Connected to All Nodes Can Data Collisions Occur? Avoid Collisions vs. Identify and Resolve Collisions Paradigm Shift 15
Shadowbase for Business Continuity Business Continuity: Disaster Recovery Protection Classic DR: Active Passive Uni-directional DR Application Active on Primary Node Only Passive Node May be used for Read-only OLQP Primary Clients Shadowbase GE Centricity Backup 16
Shadowbase for Business Continuity Business Continuity: Sizzling-Hot Takeover Billing/Customer Service Sizzling-Hot Takeover: Active Almost Active Target Appl Hot (Improves RTO) Bi-Dir Configured No Data Collisions Easy to Validate Backup - (Submit Verification Tx) Facilitates Failover Testing - (Failovers Easy to Test) Bi-directional Replication 9
Shadowbase for Business Continuity Business Continuity: Active-Active - No Collisions No Collisions: Active Active All Applications Active Users Load Balanced Across Nodes (pre-assigned a primary node) Avoids Data Collisions Customers A-M Customers N-Z Bi-directional Replication 10
Shadowbase for Business Continuity Business Continuity: Active/Active Collisions Can Occur Data Content Resolution: Active Active All Applications Active Requests Load Balanced Across Nodes Data Collisions Occur, Resolved via Row Contents (e.g., Most Recent Update Timestamp Wins) ATM Switch Bi-directional Replication 11
Shadowbase Zero Downtime Migrations Zero Application Downtime for Planned Outages Eliminates Planned Downtime for improving overall availability for applications Migrate or upgrade the application, system, O/S, or database without affecting the user s access to the application 12
Shadowbase Success Stories - Steps 1-6 Zero Application Downtime Migrations/Upgrades Users Sequence: 1-Current Production NonStop Server Current Application NonStop Server NEW Application 2-Create NEW DB and/or Application 3-Test New Environment 4-Load & Synchronize New Database With Current Current Current NEW NEW 5-Verify New Matches Current Enscribe SQL Enscribe SQL 6-Optionally Add Failback Shadowbase 6 Shadowbase 13
Shadowbase Success Stories - Step 7 Zero Application Downtime Migrations/Upgrades Users Sequence: 1-Current Production NonStop Server Current Application 7A 7C NonStop Server NEW Application 2-Create NEW DB and/or Application 3-Test New Environment 4-Load & Synchronize New Database With Current Current Current NEW NEW 5-Verify New Matches Current Enscribe SQL Enscribe SQL 6-Optionally Add Failback 7B 7-Cutover Users Shadowbase 7D Shadowbase 14
Shadowbase for Data Synchronization Shadowbase Manages all Data Mapping between Source and Target Schemas and Formats Many datatypes mapped automatically (e.g., CHAR, numerics, many dates/times, etc.) Complex datatypes managed via either Data Mapping scripts or Shadowbase s embedded User Exit capability Data Scrubbing & Cleansing Supported Blank and null-fill processing, date/time cleansing, etc. Data Filtering and/or Aggregation Supported Remove events being replicated based on data content Consolidate multiple events into one 15
Shadowbase for Data Synchronization Replicated Data can be Fanned Out or Consolidated In One to many (e.g., for normalizing arrays into many rows) and many to one (e.g., for data summarization) architectures supported Non-Relational to/from Relational Data Formats Supported Data normalization support provided (e.g., for redefinition support, array resolution, etc.) For example NonStop Enscribe to Oracle Access to External Information/Databases Supported Shadowbase user exits allow direct access to external databases, data sources, interprocess messaging, etc. Information can be added into or removed from the events being replicated (user exit has full control over what to do with the events to replicate) 16
Shadowbase for Data Synchronization Data Integration & Sync: Large Scale Service Integrating HP NonStop trading applications with online trading applications Internet client Windows NonStop Cluster Traditional Brokers UNIX Linux AS/400 Internet Shadowbase Internet client Oracle Sybase SQL Server DB2 Firewall Firewall 17
Shadowbase for Application Integration Shadowbase Enables Event Driven Architectures Shadowbase monitors the TMF transaction log and can trigger on all DML or DDL database activity (e.g., inserts, updates, or deletes) Shadowbase Provides Real-Time Data Delivery As soon as the event occurs in the database, Shadowbase processes it Shadowbase Integrates at the Data Layer No need to modify application code (assuming you *have* the code) Avoid inefficient polling of the database for changes Shadowbase acts as the hub, feeding pertinent database change events to all other system(s) Build efficient data-driven Pub/Sub architectures using replication 18
Shadowbase for Application Integration Database Event Capture and Delivery Function: Application(s) Selected DB Activity Application IPC Feed Middleware Feed Shadowbase sees all changes to the application s data and can act on them. Database Audit Trail Collector OR OR Business Logic Consumer Uses: Shadowbase acts as a capture process for change events from the database/audit trail and notifies or delivers them to downstream files, applications, or middleware. 19
Application Integration Trading System Watch List Trading Application NonStop-based trading application security buy/sell orders need to be fed into Windows-based.net application (to maintain a security watch list function). Trade Database Security Watch List Queue File Audit Trail Collector Business Logic Consumer RBC MQ Feed Process MQ Series (.net target) 20
Application Integration Real-Time Fraud Detection ATM/POS Application NonStop-based ATM/POS application feeding transactions into RiskShield (a Unix-based real-time fraud detection system) ATM/POS Database Business Logic Consumer Shadowbase Audit Trail Collector Fraud Detection Application Business Logic Consumer Business Logic Consumer Shadowbase NonStop UNIX 21
Shadowbase Success Stories Multi-use Implementations at First Data Corporation Traditional Disaster Recovery Bi-directional Active/Active Business Continuity Bi-directional Integration with Active Data Warehouse and Real-Time Fraud Detection 22
Shadowbase Success Stories Implementations at First Data Corporation 1) Business Continuity Disaster Recovery 2) Business Continuity Active/Active Switch Clients Shadowbase ATMs Shadowbase \NonStop \NonStop \NonStop \NonStop 3) Data Integration Active Data Warehouse/Real-time Fraud Detection Client Services Shadowbase Oracle \NonStop 23
What s New for Shadowbase (1 of 2) Shadowbase Online Verification Database Compare (Controlled Release 2011-2012) Enscribe-to-Enscribe (Now) SQL-to-SQL Next NonStop to Open Server After Shadowbase Online Resynchronization Database Repair (Controlled Release 2011-2012) Shadowbase SOLV ETL Snap-shot loading via ETL into target databases (Available Now) ACI BASE24 Support Disaster Recovery - Active/Passive (Available Now) Sizzling Hot Takeover - Active/ Almost Active (Available Now) Active/Active Partitioned (Available Now) Active/Active (TBD) 24
What s New for Shadowbase (2 of 2) NonStop Disk Queuing Shadowbase QMGR (Available Now) Shadowbase FixIT! & Shadowbase File Chaser FixIT New utility to undo source file changes File Chaser New utility to inject non-audited log files into replication stream Sync Replication Shadowbase Zero Data Loss (ZDL) Shadowbase Asynchronous Data Replication Engine with Guaranteed Data Delivery (Zero Data Loss at Failure) Incorporates HP TMF Synchronous Gateway API Beta Program 2012 Sync Replication Shadowbase Plus SR Leverages Shadowbase ZDL Architecture to Provide Zero Data Loss and Full Active/Active Capabilities (e.g., Collision Avoidance) Beta Program Late 2012 25
Why Choose Shadowbase? Proven Technology Shadowbase is deployed at hundreds of sites, including many of the most-demanding NonStop sites Many Flexible Solutions for Your Business Challenges Business Continuity, Data Integration & Synchronization, Data Warehouse Feeds, Application Integration, Real-time Business Intelligence Global 24x7 Support Organization Gravic s expert global 24x7 support organization is always available Affordable, and Committed to the NonStop Platform Improves TCO via Overall Cost Advantage and Features One Product, Many Solutions We are investing with HP in many innovative enhancements Only on NonStop 26
For More Information Breaking the Availability Barrier Series Volume 1: Survivable Systems for Enterprise Computing Volume 2: Achieving Century Uptimes with Active/Active Volume 3: Active/Active Systems in Practice 27
Questions? Gravic, Inc. 301 Lindenwood Drive Suite 100 Malvern, PA 19355 USA Shadowbase@gravic.com SBSales@gravic.com Phone: +1.610.647.6250 Fax: +1.610.647.7958 28