New HP Solution for Replicating NonStop SQL DDL: SDR

Transcription

1 New HP Solution for Replicating NonStop SQL DDL: SDR Bob Loftis, HP Product Manager Johanne Corbeil, SDR Support Mgr Oct 2nd, Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

2 Agenda Where HP NonStop SDR fits Product overview Release plan Q&A 2

3 NonStop Business Continuity Strategy Provide high performance, reliable, NonStop to NonStop database replication products that: Allow smooth migration and upgrade Support no lost business in disaster events very hot standby Provide zero lost transactions where required Provide access to our partners who offer heterogeneous data transformation, and replication options 3

4 NonStop Customers Over 300 current Business Continuity customers Banking Exchanges Telecomm Retail Healthcare Government Some success stories online, but most prefer no publicity Ensuring business processes 4

5 HP NonStop Disaster Proof Disaster Tolerant Solutions That Work! No lost transactions: 550 tps Fast Takeover ~30 seconds All HP systems performed as expected All data protected on Storageworks XP All shared network gear (Procurve, Brocade, etc.) See our ATC white paper at: 5

6 Integrated HP NonStop Server products Transaction Management Facility (TMF) Foundation for transaction integrity and data protection Remote Database Facility (RDF) High-performance database replication fast Takeover AutoTMF NonStop TMF protection for non audited databases AutoSYNC Synchronization non database files Integrated products providing business continuity without specialist programming knowledge 6

7 And introducing this month, our latest addition HP NonStop SQL DDL Replicator, or, SDR! Automatic SQL DDL replication 7

8 Why HP NonStop SDR? Much requested and needed To automate procedures To reduce errors To be more efficient To be more cost effective It s so easy from the team that brings you AutoTMF and AutoSYNC 8

9 Agenda Where HP NonStop SDR fits Product overview Release plan Q&A 9

10 NonStop SQL DDL Replicator (SDR) Extracts, replicates and applies NS SQL/MP DDL operations to backup tables Designed to work with RDF All SQL DDL operations replicated CREATE, DROP, COMMENT operations ALTER TABLE and ALTER INDEX (including split and merge partitions) Can replicate DDL on non-audited tables (configurable) No impact on performance or operations of applications on primary 10

11 SDR and RDF SDR is a companion to, and depends upon, RDF SDR requires no operator intervention when RDF is being initialized, configured, started or stopped SDR and RDF coordinate replication to execute DDL in proper sequence RDF data replication configuration (volumes, network, etc.) used for DDL replication Like RDF, operates automatically, day in and out No operator intervention for normal operations 11

12 SDR Supports Typical RDF Topologies Simplex Centralized Multiple duplicates Ring A-Z A-Z Reciprocal Network Transaction Replication Chain A-L M-Z 12

13 One Exception - Unsupported Topology Same primary to same backup with same volume pair Multiple Same volume pair \PRIM RDF PRIMA EXCLUDE TEST.* \BACK $P1 $B1 INCLUDE TEST.* RDF PRIMB 13

14 TMF and RDF Now SDR and RDF Audited data updates captured by TMF are replicated by RDF Similarly, SQL DDL updates captured by SDR are replicated by RDF 14

15 Data Replication TMF and RDF (1 of 4) Applicatio n Utilities Data Manager DP2 Primary DB Applications and utilities update data in the primary tables 15

16 Data Replication TMF and RDF (2 of 4) Applicatio n Utilities Data Manager DP2 Primary DB TMF Data Update Extraction TMF captures, updates and stores changes in the audit trails 16

17 Data Replication TMF and RDF (3 of 4) Applicatio n Utilities Data Manager DP2 Primary DB TMF Data Update Extraction RDF transports data updates to the backup system RDF Data Update Replication Data Manager DP2 17

18 Data Replication TMF and RDF (4 of 4) Applicatio n Utilities Data Manager DP2 Primary DB TMF Data Update Extraction RDF applies data updates to the backup tables RDF Data Update Replication Data Manager DP2 Backup DB 18

19 Now SDR and RDF Audited data updates captured by TMF are replicated by RDF Similarly, SQL DDL updates captured by SDR are replicated by RDF 19

20 DDL Replication SDR and RDF (1 of 4) Applicatio n Utilities SQL Primary DB Applications and utilities apply DDL changes to primary tables 20

21 DDL Replication SDR and RDF (2 of 4) Applicatio n Utilities SQL Primary DB SDR DDL Extraction SDR captures the DDL operations performed on the primary tables 21

22 DDL Replication SDR and RDF (3 of 4) Applicatio n Utilities SQL Primary DB SDR DDL Extraction RDF transports captured DDL operations to the backup system RDF SDR DDL Replication 22

23 DDL Replication SDR and RDF (4 of 4) Applicatio n Utilities SQL Primary DB SDR DDL Extraction SDR applies replicated DDL operations to the backup tables RDF SDR DDL Replication DDL Execution SQL Backup DB 23

24 SDR Product Components SDRCOM Command Interpreter SDRMON Monitor Process SDRRUNTM Runtime for DDL Extraction SDRUPDT Updater for DDL Replication Message, Help, Template and Filter files 24

25 SDR Installation Download or IPSETUP the SDR PAK file 1. Run INSTALL macro 2. Create SDR database (SDRCOM command) 3. Install product license 4. SDRCOM INSTALL SDR Updates SQL software to extract DDL operations Required after any update to SQL components 5. Update EMS Templates 6. Update Cold Load procedures to start SDR monitor 25

26 DDL Extraction On Primary SDR Runtime captures SQL DDL SQL statement DEFINEs Network topology for distributed tables Writes DDL to audited SDR Depot file Inserts STOP-RDF-UPDATE in audit trail Does not require RDF to be configured or active Does not affect SQL DDL processing 26

27 DDL Extraction Step by Step (1 of 5) Application SQLCI SQL Primary DB SQL utilities execute DDL changes to the primary tables 27

28 DDL Extraction Step by Step (2 of 5) Application SQLCI SQL SDR Runtime Primary DB SDR captures DDL operations executed on the primary tables 28

29 DDL Extraction Step by Step (3 of 5) Application SQLCI SQL SDR Runtime Primary DB TMF Audit Trail DDL SDR stores DDL in audited Depot file and TMF captures changes 29

30 DDL Extraction Step by Step (4 of 5) Application SQLCI SQL SDR Runtime Primary DB TMF Audit Trail DDL Stop RDF Update SDR inserts SRU in the audit trail to control RDF updaters on backup 30

31 DDL Extraction Step by Step (5 of 5) Application SQLCI SQL SDR Runtime Primary DB RDF TMF Audit Trail DDL Stop RDF Update RDF extracts DDL and SRU from audit trail for replication Backup System 31

32 DDL Replication On Backup RDF transports extracted DDL description Replicated audited update to SDR Depot file RDF updaters suspend updating SDR Updater monitors RDF configuration and detects it has work to do SDR analyzes, translates, and executes DDL SDR notifies RDF to resume updating 32

33 DDL Replication Step by Step (1 of 5) RDF Image Trail DDL Stop RDF Update RDF RDF Updaters RDF Updaters find updates to Depot file from primary 33

34 DDL Replication Step by step (2 of 5) RDF Image Trail Stop RDF Update RDF RDF Updaters DDL Updaters apply updates to Depot file on the backup 34

35 DDL Replication Step by step (3 of 5) RDF Image Trail RDF RDF Updaters SDR Updater DDL RDF Updaters stop when processing SRU and SDR Updater reads DDL from replicated Depot file 35

36 DDL Replication Step by step (4 of 5) RDF Image Trail RDF RDF Updaters SDR Updater SDR applies DDL operation to backup tables DDL SQL Backup DB 36

37 DDL Replication Step by step (5 of 5) RDF Image Trail RDF RDF Updaters SDR Updater Resume Updating SDR starts RDF Updaters 37

38 SDR Performance No significant impact on SQL DDL operations A few SDR file updates Uses SQL s transaction No impact on RDF audit extraction Extractor to Receiver audit transfer unimpeded RDF updating interrupted for DDL execution Usually under 5 seconds, but more for long DDL ops like CREATE INDEX or partition split/move 38

39 Monitoring and Manual Control of SDR Simple SDRCOM commands STATUS commands to show DDL details and state of replication HOLD SDR Updater SDR issues EMS message when DDL is ready EXECUTE or CANCEL pending statement RELEASE Updater to resume automatic operation 39

40 SDR Configuration Based on RDF SDR works out of the box SDR requires no separate configuration; all basic settings are adopted from RDF config: Primary and Backup nodes Primary -> Backup volume mapping Includes/Excludes, MAPFILE REPLICATEPURGE NETWORK 40

41 SDR Configuration Options To customize SDR, you can change: Retention: how long to keep extracted DDL CreateID: backup table owner AutoCreateCatalog: don t need to synchronize cats KeepPHYSVOL: retain Virtual-to-Physical volumes UnAuditedDDL: replicate DDL on unaudited tables UserTransaction: how to handle DDL in a user tx 41

42 Interesting Situation User Transaction DDL in User Transactions User can embed DDL in BeginTX/EndTx with database updates Believed to be very rare in the real world your input is most welcome SDR requires user intervention OR assumed commit 42

43 Interesting Situation Network Tables DDL for Distributed Table Requires coordination of RDF updating on multiple backup nodes User must have RDF/IMPX Otherwise, configure SDR network (SDRCOM NETWORK) on all nodes 43

44 NonStop SDR Summary Easy to install, easy to use User interface SDRCOM is like RDFCOM Once installed, just leave SDR running Must be deployed on primary and target Requires SUPER group to configure and control Captures DDL on primary system Independent of RDF and, like TMF-RDF, can be configured after SQL DDL capture Executes DDL on backup Works closely with RDF to ensure correct sequence 44

45 Agenda Where HP NonStop SDR fits Product overview Release Plan Q&A 45

46 General Product Information Marketing ID (H, Q) SA47v1 Product ID T2828 H01 Supported on S-Series, NS-Series, NS BladeSystems One version works on all supported NSOS releases One version works with RDF IMP, IMPX, and ZLT except: T0346ABJ (superceded by T0346ABR) T0346ABO (superceded by T0346ABS) Base release T0346H08 Targeted for release late October Try it you ll like it! 46

47 NonStop Remote Database Facility High throughput and low CPU utilization, out of the box White hot standby included Focused on data integrity (nodes in sync) Active/active split reciprocal Easy installation and maintenance March 2009: 9 enhancements availability, performance, manageability 47

48 Look for us in Mannheim 48

49 Stay prepared, be NonStop test! hp.com/go/nonstopcontinuity Thanks! Questions? 49