IBM DB2 Recovery Expert June 11, 2015

Transcription

1 Baltimore/Washington DB2 Users Group IBM DB2 Recovery Expert June 11, IBM Corporation

2 Topics Backup and Recovery Challenges FlashCopy Review DB2 Recovery Expert Overview Examples of Feature and Function Benefits of System Level Backup (SLB) Recovery Expert and Disaster Recovery Summary 2

3 Backup and Recovery Challenges Backup and Recovery is complicated Managing and verifying recovery assets is essential, yet difficult Need to balance high availability with time to copy Customers often don t revisit new Backup & Recovery technologies/options High cost in resources (CPU and I/O) Perform complex tasks with smaller number of skilled professionals Swift recovery required Recovery normally not practiced 3

4 What causes unplanned outages? 40% 20% 40% Hardware Outage Operator Errors Application Errors 4

5 Database Downtime Affects Your Business Average cost of database downtime $1.5M USD/year Revenue at risk Customer satisfaction declines Missed service level agreements Brand damage and loss of goodwill Customer s desire immediate gratification!! Time consuming, rarely used, manual backup/recovery procedures don t scale as data volumes grow Inability to backup all data because of shrinking maintenance windows and growing data volumes Difficult to get complete database backup impacting availability Modernization: No longer have the luxury of doing backup and recoveries the traditional way 5 *Source Aberdeen Group, 2010

6 Elements Once you have an event Up to 70% of recovery time is think time! Not processing time Total Recovery Time Diagnose Investigate Analyze Recover 0% 50% 100% Source : McGladrey and Pullen 6

7 FLASHCOPY REVIEW 7

8 FlashCopy Overview FlashCopy (FC) is an optional licensed feature of IBM storage subsystems Creates instant copy of a volume or a dataset at specific time Advantages Can copy huge volumes of data very quickly (seconds to a few minutes) Minimal disruption for the running applications Copy process is offloaded to storage subsystem - lower CPU and I/O Faster Backups fit backup window Many options available including Volume and Dataset level FC Copy and NoCopy FC Incremental FC Space Efficient FC Consistency Group FC Remote Pair FC 8

9 Source and Target Volumes FlashCopy Establish command issued 1) Source and Target volume relationship established 2) Track bit map created 3) Source volumes available immediately for updates Source Target Track Bit Map Establish FC 4) In background copy, tracks are copied from Source to Target 5) Track bit map is updated Source Background Copy Target Track Bit Map 9

10 FlashCopy Background Copy FlashCopy target can be immediately used for recovery If background copy not complete Fast Reverse Restore If background copy complete FlashCopy used Offload process can happen any time after backup If background copy complete, no I/Os will be directed to production If background copy is not complete, could be small performance impact on production I/O Performance Implications Background copy at lower priority Minimizes production impact Recommendation: Wait for background copy BEFORE offloading to tape 10

11 FlashCopy for a Consistency Group Source S1 Target T1 FlashCopy Establish 1) S1 is Frozen, no more writes Source S2 Target T2 2) S2 is Frozen, no more writes Source S3 Target T3 3) S3 is Frozen, no more writes T1 T3 have Consistent FlashCopy THAW after Establish Phase 1) Source updates proceed on S1, S2, S3 11

12 Suspend I/O Resume FlashCopy Consistency Groups Source Source Source Source Source S1 S2 S3 S4 S5 (Loadlibs) (DB2 Log) (DB2 DB) (IMS Log) (IMS DB) Target Target Target Target Target T1 T2 T3 T4 T5 (Loadlibs) (DB2 Log) (DB2 DB) (IMS Log) (IMS DB) Time Maximum time I/O frozen 12

13 The Benefits of Storage Aware Database Tools Fast backups and restores Enables fast copy for DBAs Integrates DBMS and Storage Functions Reduces host CPU and I/O resource utilization Mainframe Database Systems Storage Aware Database Tools Backup, Clone, DR Source Database 13

14 IBM DB2 Backup and Recovery Tools - Our Goals Create recovery assets with minimal impact to database availability Little or NO database unavailable time Limit resource usage: Save CPU, I/O, and storage Recover as quickly and efficiently as possible Efficient complete recovery strategy Limit the amount of data needed to recover Recover to any point in time RBA, LRSN, Timestamp, current Validate recovery Ensure TSs and indices are recovered correctly Most important, remove most of the think time in database recovery 14

15 IBM DB2 RECOVERY EXPERT FOR Z/OS 15

16 Recovery Expert is a Backup and Recovery Solution Provides fast and low cost method of backup and recovery Wide range of backup and recovery solutions - including recovering from a dropped object to a major disaster(local mass recovery) -- and everything in between A System Level Backup is a backup of the entire DB2 environment at a point in time. Much more than a backup & recovery product, DBA rich functionalities Intelligent Recovery Manager Insurance Policy 16

17 Recovery Expert is an Insurance Policy Protects your critical DB2 for z/os objects and data Extensive validity checking Consistent guaranteed backups Finds related objects Validates all objects are included for recovery During system configuration analysis At backup set up and execution time During health check process Ensures the quickest, most efficient recovery Restartable & Consistent image of DB2 DR Plan B & Complement for mirroring a non- Can be used as part of process to be restored to production environment. 17

18 Recovery Expert is an intelligent backup and recovery manager Reduces the complication of recovery! Analyzes your recovery resources Easy to choose recovery points Create detailed recovery plans Provides cost-based recovery estimates in real-time Detects and recovers related objects Detects objects not updated since last recovery point and will not be recovered Utilizes new technologies and recovery strategies Generates the optimized JCL Provides reporting for review and control Minimizes the exposure & risk! Pro-actively create recovery plans to validate the ability to recover Health check functionality validates the ability to recover to selected points in time 18

19 Where is SLB recorded? Meta Data Repository Store information on SLBs created Track database characteristics and status Volume, table spaces, indexes, etc. Tape offload tracking Sent to remote site for restart and recovery automation Source Volumes 19

20 Backup Resource Utilization Test Results Traditional IC Strategy Flash Copy Image Copy Recovery Expert SLB Elasped Time in Minutes EXCPs in Millions CPU in Minutes 20

21 Image Copy Creation Image copies created from a system level backup Eliminate batch window requirements Image copies can be created and registered in DB2 SYSCOPY Eliminates I/O contention to maintain production performance All image copies created at the same point in time Reduces recovery time 21

22 Recovery Expert is Easy to Use! Only backup and recovery product in market that offers choice of either ISPF or Web Browser UI Same look-and-feel and function across either interface Menu-driven, self-guided solution Simple navigation through backup and recovery tasks One screen, one job - replaces thousands of image copies Choose your object(s), select a recovery point, generate and execute the job 22

23 DB2 System Backup Profiles - Panels 23

24 Backup Profile Screen IBM FlashCopy EMC Snap 24

25 Offload 25

26 One job DB2 Recovery Expert SLB control statements 26

27 One Job Offload Step Offloads Control Statements 27

28 Establish/Thaw Benchmark Source Establish/Thaw FC Target Track Bit Map Specifications 1) 13 TB of data 2) 461 volumes 3) DS8300 4) 2817-M80 z196 5) 4, TX/second 6) Backup Elapsed = 0.37 secs IMS Recovery Expert for z/os Backup Summary Report Utility Executed:... Backup Profile Name:... ROCKET1.BKUP1 IMS Subsystem:... IMSP IMS Version: Backup Type:... Flash Copy Backup Contains:... Database, Log Data (Mixed) Partial Backup:... No Nbr of Volumes: Backup Date:... 02/01/2012 Backup Time: Consistency Method:... Flash Consistency Group Supports Database Restore: No I/O Suspend Time: I/O Resume Time: Backup Elapsed: Seconds 28

29 Replaces thousands of image copies Elapsed Time Savings = SLB 29

30 Recovery Advisor 30

31 Recovery Expert Meta Data Repository Backup and Recovery Assets Needed: System Level Backup/Image Copy Archive Logs Up-to-date Recovery Expert Meta Data Repository DB2 for z/os RE MetaData Repository Timestamp Orig Vers Chg d Vers Info gathered about: Log/BSDS DB2 data and more Schema Level Repository (SLR) Job Timestamp Orig Vers Chg d Vers 31

32 DB2 RE Web-Based Interface 32

33 User Interface Web UI Recovery Advisor wizard allows you to build recovery for any object data and/or DDL Result will be recovery plans with cost associated to each Log Analysis wizard allows you to find and store QUIET times based for a set of objects and store this in an RE repository for later use System Restore wizard allows you to build restore JCL using any SLB supported by RE. This includes DFSMSdss The Log Based Recovery Advisor will assist you through the steps of generating DDL and recovering dropped objects at a DB2 location using DB2 log files The Specifications wizard allows you to build profiles of OBJECTs. You can use these similar to the BACKUP PROFILEs in ISPF 33

34 DB2 Recovery Expert Examples 34

35 Recovery Advisor 35

36 Filtering Functionality Include Objects 36

37 DB2 Object Profiles - Panels

38 DB2 Object Profiles - Panels

39

40 Select the version of the object to reverse 40

41

42 Quiet Time Scan Period Quiet times meeting criteria 42

43 43

44 44

45 45

46 DB2 Recovery Options - Panels

47

48 DB2 V10 RECOVER with Backout Relative Cost

49 DB2 v10 Online Schema Recovery DB2 v10 provides more Online Schema options Defer Alter for various object types with no recovery possible With Recovery Expert Ability to reverse conversion Recover up to QUIESCE point prior to REORG materializing 49

50 IBM Flashcopy EMC SNAP DFSMSdss Fastrep IC Log Apply Undo SQL Redo SQL DB2 Utility DDL + DCL Data Recover Index Data Traditional Fastrep IC DB2 Recovery Expert for z/os V3.1 Storage Integrated DB2 Recovery Example DB2 Catalog BSDS Managed DB2 Application Recovery DB2 RE Intelligent Recovery Manager DB2 RE Repository DB2 Log Restore From SLB Recover Utility SQL Recovery Index Rebuild Dropped Object Recovery Check Utility Post Recovery Image Copy Traditional IC Fast-replication Data Set Restore Image Copies DB2 Recovery Expert Invoked Recovery Processes DB2 System Backup DB2 Spaces 50

51 Powerful features of Recovery Expert 51

52 Benefits of Recovery Expert System Level Backup 52

53 Assist with System Level Backup 53

54 Assist with System Level Backup 54

55 Health Checking Health Check can execute online or batch.. Online Health Check recovering to current.

56 DB2 RE SLB Health Check report Displaying objects can NOT Displaying be recovered. objects can be recovered with an additional image copy. No image copies taken after load replace log no.

57 DB2 RECOVERY EXPERT DISASTER RECOVERY

58 Disaster Recovery 58

59 Disaster Recovery DR Prep 59

60 Customer s Disaster Recovery Process SLB Frequency - Nightly Primary Production Site DB2 IBM DB2/IMS Recovery Expert DR - Prep Storage Processor APIs Executes on local Mainframe, copies archive logs and necessary recovery assets. recovery assets Frequency 15 mins. Secondary Production Site DB2 IBM DB2/IMS Recovery Expert Execute 4 jobs created by DR-Prep process for complete DBMS Recovery, resulting in reduced RTO. Primary Disaster Restart Site (remote tape-based disaster restart) Source Database Volumes Offload Vtape Replication RPO mins. System Level Backup SLB Tape Processing SLB and Archive Log Tapes Frequency - Nightly SLB Tape Processing 60

61 Disaster Recovery Image copies Volume Copies Mirroring 61 Recovery Expert brings it all together!

62 Integration with other Tools IBM DB2 Cloning Tool Clone from a System Level Backup (SLB) Use an SLB created via IBM DB2 Recovery Expert as input Duplicate your production environment quickly and easily IBM DB2 Automation Tool DB2 Automation Tool can drive the process of creating numerous image copies from an SLB Can reuse IBM DB2 Automation Tool object profiles 62

63 CPU Savings 1600 Elapsed Time Savings Traditional IC Fast Rep IC -400 Today Year 1 Year 2 Year 3 Year 4 Year 5 Admin Cost Savings 70% Think Time Time to Recover 63 63

64 Backup and Recovery Summary Complexity of backup and recovery Backup practices are sometimes not cohesive Recovery requires lots of time, effort and resources to plan/create/maintain Unexpected stressful situations with executive scrutiny Why Recovery Expert Manages backup strategies provides visibility Reduces application service down time with faster and guaranteed recovery Easily back out unwanted schema changes or errors Improves availability and application time to market Industry-leading capability in DB2 10/11 Best storage-aware database product in industry Multi-vendor support Operational simplicity and efficiency Ensures assets exist prior to backup/recovery Integration with IBM DB2/IMS Cloning Tool for z/os for additional value 64

65 Questions 65