BCV5 TM FAST AND EFFICIENT DB2 DATA MIGRATIONS

Transcription

1 BCV5 TM FAST AND EFFICIENT DB2 DATA MIGRATIONS Corporations maintain large amounts of data in DB2 databases, and it is normal to fi nd several DB2 subsystems for production, test and development. Refreshing testbeds from production systems is a vital part of development, testing and quality assurance life cycle. Obtaining relevant test data requires copying from one DB2 subsystem to anor. The window of opportunity for copying or migrating DB2 data is constantly decreasing as demands from 24x7 operations are increasing. Limited resources and shrinking batch windows make data delivery to QA diffi cult. CV5 quickly and effi ciently copies, refreshes and B replicates DB2 objects. BCV5 copies DB2 databases or tables within same or different DB2 systems. When measured against conventional copying methods, BCV5 saves around 90% on elapsed copy time and resources consumed (SSU, SRU). For one customer a ten-hour unload/load process was reduced to slightly over one hour. A BCV5 copy task integrates both physical data movement and DDL related requirements. It copies DB2 data, i.e. databases or tables with or without auxiliary objects indexes, views, triggers, procs and runstats. BCV5 automatically handles OBID translation and RBA adaptation. Copy jobs are completed in minutes rar than hours. DBAs are no longer forced to wait for weekend time slots and are able to run copying jobs on regular weekday shifts. Test data on demand is a dream come true for QA, development and test staff. BCV5 offers relief where need is greatest. It signifi cantly cuts down runtime and cost. It reduces CPU consumption by 90%+ and shortens preparation lead time required by staff. Automation Reduces Manual Effort and Keystroke Errors BCV5 is a completely automated expert system. The integrated ISPF interface allows copy process to be easily defi ned. Specifying select/exclude patterns identifi es objects to be copied and appropriate processing options. BCV5 s powerful renames mask facility makes adhering to naming conventions during target DB2 system a simple and error free task. A BCV5 copy process executes eir under control of product or an in-house scheduler. Once copy process is started re is nothing else to do. BCV5 automatically generates DDL for selected objects/ databases using specifi ed target names. It executes DDL in target DB2 environment, tailors respective JCL and generates required statements for copy utility. What if target objects already exist? BCV5 still automates everything. It is an expert system with a comprehensive check facility that ensures that target DB2 objects match source objects. Structural differences are detected and successful completion of copy process is guaranteed. Flexible Selection of Image Copies BCV5 permits copying directly from tablespaces or a set of image copies. Its fl exible selection facility allows choosing image copy (set) to copy from. Using latest, a specifi c generation or dated image copy is easy and straight forward. It identifi es right image copy datasets and pulls m into copy process. 1 5 UBS Hainer GmbH

2 Benefits Automates DB2 Cloning/Migrating/Refreshing Saves 90% CPU resources and run time Eliminates manual efforts freeing up technical staff Reduces overtime work and manual intervention Integrates seamlessly into IT environments Eliminates RUNSTATS, Rebuild Index, etc. Reduces DASD space required for direct copying RUNSTATS Cost Time and Money DB2 s optimizer needs valid RUNSTATS data to fi nd effi cient access paths. The RUNSTATS utility is known as a long running CPU hog. BCV5 eliminates costly RUN- STATS executions. Its copy statistics feature extracts current RUNSTATS from source environment and loads m into target in seconds. It is no longer necessary to wait for hours while RUNSTATS fi nishes running. Why is BCV5 so fast? BCV5 copies data at page level using a proprietary high performance copy utilty. While UNLOAD/LOAD process slowly extracts single rows one at a time, BCV5 copies complete page over to target and replaces DB2-internal OBIDs with respective target values. BCV5 also uses parallelism as a performance enhancement technique. It operates in a multi-thread mode and copies ten to eighteen tablespaces or tablespace partitions in parallel. This alone makes it up to ten times faster than DSN1COPY. One or performance enhancement feature involves copying indexspaces. Copying indexspaces is much faster than rebuilding m. How can BCV5 save 90% CPU Time? Row-wise processing consumes many more CPU cycles than VSAM copying. Clients report that only one-fi fth to one-tenth of service units used by Unload/Load are required to run BCV5. Add to se savings those resulting from avoiding index rebuilds and runstats executions. LOADs demand heavy DB2 subsystem resources. The load job s CPU consumption is reported in job listing, but very high service units used by DB2 is no normally tallied. The immense amount of data, that corporations need to maintain, demands use of effi cient tools. It is not longer feasible to waste time and service units needlessly. There is an added bonus for users with really large tables. BCV5 does not require storage for unloaded data. BVC5 copies data directly from source pageset to target pageset. Making Copy Process Easy A fast and effi cient cloning tool is only part of solution. The BCV5 user interface is intuitive and easily meets needs of both experienced effi ciency-minded experts and less technical application level users. Those who prefer PC environment can use BCV5 s graphical workstation. Detailed online help is always one click away. Who needs BCV5? Cost savings are obviously appreciated by those who have budget responsibility. Avoiding an expensive and onerous hardware upgrade can reduce negative impact to an IT budget. The IBM and third party software upgrade fees associated with getting a bigger machine often dwarf hardware cost. Application development teams, QA groups, technical support staff, auditors and, of course, end users need data to get ir jobs done. BCV5 reduces 2 5 UBS Hainer GmbH

3 » BCV5 allows us to copy much more data than we ever could have copied with our old LOAD based processes. This is great improvement for our QA environments. «Checks and/or generates DDL Automates tasks for: OBID, RBA, LRSN, Grants, etc. Flexible space allocation Offers intuitive ISPF interface for easy management Provides a batch interface to create large numbers of copies Offers optional components for data reduction, data masking, and DDL structure analysis amount of weekend and off-shift time usually required for copy and refresh process. This allows more quality work to get completed during regular shift hours. Shops running with reduced or less experienced staff are among BCV5 s most vocal supporters. Getting job done is, after all, true mission of IT. When data is not available, job does not get accomplished and whole organization pays price. A Quick View of BCV5 BCV5 provides fast, effi cient and manageable copying of DB2 data. It automatically generates and executes jobs to: extract object defi nitions from DB2 catalog of source system, transfer defi nitions to target system, rename objects as specifi ed and apply m in target DB2 system (CREATE, or DROP and CREATE), compare source defi nitions with existing target objects for compatibility, copy pagesets from source to target DB2, make target objects ready and start m. The product provides two user interfaces with identical functions. One is based on ISPF and or on a workstation GUI. To defi ne a copy task, select and d efi n e: DB2 subsystems, source and target which are identical if copying within a single subsystem, objects: databases or tables to be copied, renaming rules to copy objects, wher indexes are to be copied, wher related RUNSTATS should be transferred to target system catalog, wher or related objects (GRANTS, BINDS, VIEWS) should also be transferred, wher source objects should be put in "read only" mode during copy, wher BCV5 should be used to avoid impacting source objects. Once a task is defi ned it may be executed at any time under BCV5 s control or under shop s scheduler or manually on a stage by stage basis. User creates a copy task using ISPF or Workstation or Batch Interface Source DB2 Extract meta data from DB2 Catalog Set objects read only option optionally Copy Pagesets or Imagecopies BCV5 Task Definition and Execution Target DB2 Check, amend, add DDL Make objects ready and execute objects BCV5 Workflow 3 5 UBS Hainer GmbH

4 » With BCV5 we have been able to reduce our batch processing cycle by 2 1/2 hours and are meeting our SLA commitment for reporting database for first time ever. «Optional Components BCV6 In-Flight Cloning When data must come from tables that require 24x7 enterprise availability re is an issue for IT. Users need to query and update tables without interruption. Stopping source objects is not a viable option. Without stopping source objects, it can be very diffi cult to copy tables while preserving consistency between tables and indexes and between different tables. BCV5 minimizes copy time, but cannot avoid impact of changes made to objects while y are being copied. The good news is that DB2 stores information about all se table changes in its log. BCV5 is an automated solution that uses information in log to bring copied tablespace to a consistent state. RM Reduction and Masking Data privacy regulations impact how test centers use production data. Providing production data for testing purposes requires that database administrators do not copy data directly without fi rst masking sensitive data fi elds. RM modifi es sensitive data during copy process following user specifi cations. RM provides a selection of masking methods and supports user algorithms making this process fl exible and powerful. At same time that sensitive data fi elds are being protected, RM also allows data reduction to take place. It supports using fi ltering criteria to select subsets from source data. This is particularly useful for unit and regression testing where only certain data is needed from a large data source. IB Icebox Archive DB2 data and populate different environments. Need to provide DB2 data from last week, last month or last year? Want an automatic and effi cient procedure to recreate everything, DDL and data in record time? IB takes fast snapshots on demand or periodically, and restores objects or databases where/when needed using names specifi ed. Issues of compatibility or completeness no longer cause concern. BCV5 IB packages DB2 Version x imagecopy and later restores it to any or DB2 target version required. Upgrade to a newer version of DB2 knowing that former image copies will be still available for future needs. RC Remote Copy Some production systems are to such an extent physically isolated that it is extremely diffi cult to migrate data effi ciently to test systems: separate sysplex neir shared DASD nor bridging volumes with or systems. The RC component of BCV5 makes data transfer between isolated systems an easy task. RC uses TCP/IP to transfer tablespaces, indexspaces as well as meta data from one system to anor. The entire cloning process is automated, error prone manual interventions are avoided. BI Batch Interface BI eliminates need for most manual procedures. It supports effi cient use of batch processing to enhance throughput. It provides a powerful defi nition language for using all of BCV5 s features and functions in a simple and fl exible way. The Batch Interface function is best way to implement mission critical trigger processes that require integrity, reliability and performance. It is interface to BCV5 to defi ne and control copy tasks by your own applications. 4 5 UBS Hainer GmbH

5 3 3 UBS Hainer GmbH UBS UBS Hainer GmbH 5 5 UBS Hainer GmbH AA Alter Automation Altering DB2 objects is an ULT4DB2 BPA4DB2 XDM BTO Table TEST Copying THE IMPROVE DATA UBS PROVISIONING FAST LOG PERFORMANCE TEST TRACKER DATA PROVISION AND LOWER COSTS exhausting task, especially when changing attributes that cannot be modifi ed with a simple DB2 ALTER command. Such Making cases require Copy Process backing Easy up data of objects, This capability to prevent prolonged unavailability of vital dropping A fast and se, effi cient recreating copying m tool with is only respective one part of DDL applications Comprehensive can translate Approach into a large sum of money for modifi solution. cations, The XDM and Table n loading Copying user data interface back is into intuitive different Based businesses analysis involved. of metrics collected, BPA4DB2 objects. recommends: and easily Authorizations meets needs and auxiliary of both objects experienced (triggers, effi views, ciency minded experts and less technical application level users. synonyms, ULT4DB2 also etc,) of makes se data objects propagation also need to affordable. be backed The up No need of any technical knowledge about DBMS is immense and costs restored. in This CPU complex consumption on procedure often production proves to be a required. Users only specify what y want to do in order DB2 that or propagator programs require are signi- major to copy challenge from here for to performance re. sensitive production and fi cantly decreased by ULT4DB2. test environments. AA automates alter process and implements Who BPA4DB2 Who needs offers most XDM guidance effective Table Copying? Utilizes ULT4DB2? and for effi an cient entire solution redesign available. of current bufferpool setup, if required. It also identifi es object test related data provision problems or as data well as migration. diffi culties Cost that savings result from are programmers use ULT4DB2 to repair of original data. It Database In short, everyone who wants to improve and accelerate applies structural administration, changes application while safeguarding development integrity and maintenance poor appreciated SQL. BPA4DB2 by those fully who supports have Group budget Bufferpool responsibility. Tuning result of an incorrect program execution, a wrongly and Application allows continuous development auditing teams, of QA Coupling groups, Facility. technical scheduled job or some user error. Auditors and SC administrators support Structure staff, auditors deploy Compare and, ULT4DB2 of Enhanced course, to end determine production users need update applications sequences. Performance data to often get ir require Data and jobs Efficiency centers modifying done. XDM replace Table existing Copying expensive database reduces data to BPA4DB2 amount is of designed weekend to and make off-shift bufferpool time monitoring usually needed and propagator support tools by new ULT4DB2 functionality. because ULT Using production offers reduced data to bufferpool for copy tuning and refresh simple. process. It helps This to turn allows an more occasional quality CPU consumption and reasonable license conditions. populate project work to into get an an completed altered effi cient DB2 during ongoing test regular database task. shift A demands task hours. that Shops extra Database administrators use ULT4DB2 to analyze helps work save running from money with and reduced database avoid or problems. update frequencies and idle administrators. less times. experienced ULT4DB2 SC staff uses supports are an among expert DB2 system Versions our most engine 8, vocal 9 and to supporters. generate 10 in single a Getting report and data-sharing identifying job done all modes. source/ is, after Measurements are scheduled once a day or every x hours. target all, discrepancies. true mission of It IT. uses When data AA feature is not available, to automate The job does host not based get accomplished routines analyze and each whole measurement organization fi le alter process and make manual intervention obsolete.» The copy speed of BCV5 is very and pays check price. for preset quality criteria sending an alert Benefits The if appropriate. reduction in Database cost and administration time to accomplish freed this from task is impressive, it rivals hardware considerable tedious A Quick observation View according of XDM of I/O to Table customer performance Copying feedback. and related issues.» Easier to handle than mainstream assisted copy mechanisms. «It gets all tools needed for analysis and assessment analyzers and executes faster «of XDM Table metrics Copying gared. provides effi cient, manageable and fast copying of relational data. It automatically: Extracts defi nitions from source system Transfers defi nitions to target system, renames objects as specifi ed and applies m at target system (CREATE, or DROP and CREATE) The DB2 High-End Product Line: BCV4 The DB2 High-End Product Line: Full DB2 Subsystem Clones in minutes versus days BCV4 Compares source defi nitions with existing target The ease. DB2 It is High-End not unusual Product for a data Line: model to evolve during a BCV5 Full objects DB2 Subsystem for compatibility. Clones Uses in minutes this information versus days to development process. If a new fi eld has been introduced, Save BCV4 adapt 90% CPU target & Run environment Time with (Drop/Create). each DB2 copy BCV5 BTO can generate values for it while it is copying data. Full Copies DB2 pagesets from source to target BCV6 Save Changing Subsystem Clones 90% CPU data & types Run Time are in with handled minutes each transparently. versus days DB2 copy If BCV5 Makes target objects ready and starts m changes Log BCV6 enhanced Provides to a data model are more complex, it is possible summary/detailed copies for 24x7 reports DB2 refresh/migration by after Save to integrate 90% CPU scripts & Run into Time copy with each process. DB2 copy Log enhanced process fi copies nished, for which 24x7 is DB2 benefi refresh/migration cial for BPA4DB2 BCV6 Premier BTO scheduler automated processes Log DDL advisor for DB2 buffer pool optimization Platform Offers enhanced independent a Control copies Language for 24x7 test case to DB2 creation import/export refresh/migration made task BTO can replicate DDL of environment easy and create completely new environments. The integrated structure ULT4DB2 BPA4DB2 defi nitions, BPA4DB2 to defi ne tasks without starting a Easily Premier»FatClient«, Premier identify advisor advisor & to restore defi ne for DB2 unwanted tasks from buffer pool changes batch, and optimization of DB2 to comparison for feature DB2 buffer can also pool modify optimization existing data target simplify integration of XDM Table Copying into ULT4DB2 TUC4DB2 structures, ULT4DB2 present and create missing objects. Since copy (web) apps Easily process identify is rule & based, restore unwanted BTO settings changes do of not DB2 need data to be RTS Easily & identify Policy driven restore automation unwanted of DB2 changes data of maintenance DB2 data TUC4DB2 modifi ed if structure of objects change. XM4DB2 TUC4DB2 RTS & Policy driven automation of DB2 data maintenance RTS Policy driven automation of DB2 data maintenance Pro-active Conclusion surveillance for a greater DB2 availability XM4DB2 XM4DB2 BTO is a user friendly tool for extracting related data from Pro-active surveillance Pro-active a database for surveillance system. It allows a greater for greater users to DB2 DB2 easily availability availability populate test, development, and or environments. BTO saves Contact SQLQAM resources Us while For shortening More Information development cycle through We Analysis of SQL statements and changes in access a private paths effi cient offer test a free case 30-day provisioning. trial evaluation as well as private web web demo. demo. Learn more about BCV5 and our line Contact Learn more about ULT4DB2 and our complete line of Us For More Information DB2 of We Contact z/os DB2 offer z/os Us products a free free products For 30-day 30-day More at: at: Information trial trial evaluation evaluation as as well well as as a private a private For For web We more more offer demo. a information information free Learn 30-day please more more please trial about about evaluation send an send BPA4DB2 XDM an Table as well to: and to: Copying as a private our complete and [email protected] [email protected] line components, web demo. Learn of DB2 z/os Database more products Cloning about BTO at: and Row and our Level complete Processing, at: product line at: PRESENTED BY BY PRESENTED BY BY Tel.: Tel.: [email protected] [email protected]