IBM DB2 Data Archive Expert for z/os:

Transcription

1 Front cover IBM DB2 Data Archive Expert for z/os: Put Your Data in Its Place Reduce disk occupancy by removing unused data Streamline operations and improve performance Filter and associate data with DB2 Grouper Paolo Bruni Walter Huth Ernie Mancill Iain Warnock ibm.com/redbooks

2

3 International Technical Support Organization IBM DB2 Data Archive Expert for z/os: Put Your Data in Its Place February 2004 SG

4 Note: Before using this information and the product it supports, read the information in Notices on page xix. First Edition (February 2004) This edition applies to Version 1 of IBM DB2 Archive Expert for z/os (program number ) and Version 1 of IBM DB2 Grouper for z/os (program number 5799-GXQ). Copyright International Business Machines Corporation All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

5 Contents Figures ix Tables xv Examples xvii Notices xix Trademarks xx Preface xxi The team that wrote this redbook xxi Become a published author xxiii Comments welcome xxiii Part 1. Introduction Chapter 1. Archiving data with IBM DB2 Data Archive Expert Need for archiving data IBM DB2 Data Archive Expert The archive process The tool s architecture Data Archive Expert as DB2 application Part 2. Getting ready to use the product Chapter 2. The evaluation test data Our test data Test referential integrity Chapter 3. Installing and customizing DB2 Data Archive Expert Pre-installation activities Program directory Preventive service planning Review PTF cover letters Review and verify product prerequisites Installation steps: Details Step 1. Create the metadata database and table space Step 2. Create the metadata tables Step 3. Define the DB2 Data Archive Expert stored procedures Step 4. Java environment variable settings Step 5. Insert default properties Step 6. Create temporary database Step 7. Grant the appropriate authorizations Step 8. Verify that DSNUTILS is installed Step 9. Make DB2 Data Archive Expert available to users Optionally add DAE to the Administration Tool Launchpad Optionally install DB2 Grouper Execute installation verification Chapter 4. Installing and customizing DB2 Grouper Copyright IBM Corp All rights reserved. iii

6 4.1 Pre-installation activities Program Directory Preventive Service Planning Review PTF cover letters Review and verify product prerequisites Installation steps for host: Details Step 1. Installing Grouper metadata for z/os Step2. Defining Grouper Java stored procedures to DB Step 3 Java environment variable settings Bind packages and plans Installation verification Chapter 5. Stored procedures and batch execution Batch processing considerations Preliminary topics Data Archive Expert stored procedures Example batch jobs Table archive specification Building file archive specifications and using templates Retrieval specification in batch File retrieval from batch Table to file archive specification in batch Continuation of parameters and row filters Chapter 6. Optionally defining DB2 Grouper Client Setting up the Grouper Client Download the Grouper Client Run the install shield z/os Server connectivity configuration Client configuration Installation verification Part 3. Data archival Chapter 7. Scenario 1: Archiving from a table to a file Starting point Define the archive specification Run the archive specification Second run of the archive specification Result Considerations Intermediate table used when archiving to file File archives require a complete run Names of the archive data sets How to find describing information to a given archive data set Recommendation for data set names Chapter 8. Scenario 2: Archiving from a table to a table Starting point Define the archive specification Run the archive specification Result of the archive specification A second run of archive specification Using different archive tables per archive run iv DB2 Data Archive Expert for z/os

7 Chapter 9. Scenario 3: Archiving from RI related tables and deleting from one The objectives of this scenario Digging into the scenario Data before starting the archive specification Start by defining the archive unit Define archive target Run your specification - Step Run your specification - Step Second run using the same target tables Checking whether too many rows have been archived Chapter 10. Scenario 4: Archiving from RI related tables and deleting from them Archiving parts in jumbo containers Step 1 - Defining the table archive specification Define archive unit for jumbo containers Define row filter for the jumbo containers Archive unit table delete rules Define archive table targets Errors when saving the table archive specification Limitations due to on delete cascade rule Solution to the On delete cascade rule Running the table archive Table archive job validation Step 2 - Completing the table archive Step 3 - Defining archiving a table archive to file Defining the file archive specification Running the file archive specification Chapter 11. Scenario 5: Archiving Grouper discovered related tables Using the Grouper Client with Data Archive Expert Introduction and some definitions Using Grouper to manage non-enforced relationships Using Grouper to discover application relationships Chapter 12. Additional archive considerations Knowing your data DB2 enforcement Orphaned rows REXX exec to locate archived tables Part 4. Data retrieval Chapter 13. Scenario 1: Retrieving a single table from a table archive Retrieve overview Retrieve preparation Default retrieve creator name Retrieve authorizations Building and running a single table retrieve specification Building a new retrieve specification Defining a single table retrieve specification Running a retrieve specification Preparing to run the retrieve specification Defining the single table row filter Confirming the retrieve Contents v

8 13.5 Additional tasks Chapter 14. Scenario 2: Retrieving multiple tables from a file archive on tape The tables involved Define retrieve specification for multiple tables Job to run retrieve stored procedure Additional tasks Chapter 15. Scenario 3: Retrieving into the original tables Defining retrieve specification to replace rows Preparing to retrieve from the archive Defining the retrieve specification Add row filter to span archive versions Updating the target table names Running the retrieve specification Additional tasks Part 5. Operational considerations Chapter 16. Planning for and managing change in an archive environment Schema changes and impact on archival Chapter 17. Security and authorizations DB2 authorizations DB2 installation authorities DB2 archive and retrieve authorities Data set authorizations Access to archive data sets Granting access to others Access to table archives Access to retrieve tables Access to file archives Chapter 18. Performance Performance considerations Part 6. Appendixes Appendix A. REXX sample programs A.1 ARCHIVEEXECSP table archive REXX A.2 OFFLINEARCHSP file archive REXX A.3 RETRIEVEEXECSP table retrieve REXX A.4 OFFLINERETEXECSP file retrieve REXX A.5 OFFLINEONLARCSP table to file archive REXX Appendix B. Additional material Locating the Web material Using the Web material System requirements for downloading the Web material How to use the Web material Related publications IBM Redbooks Other publications Online resources vi DB2 Data Archive Expert for z/os

9 How to get IBM Redbooks Help from IBM Abbreviations and acronyms Index Contents vii

10 viii DB2 Data Archive Expert for z/os

11 Figures 1-1 An archiving model showing typical archiving components Disk-space savings achieved by archiving inactive data Archiving data The overall Data Archive Expert architecture Hierarchy of tables and their relationships OMVS Home Directory for user PAOLOR OMVS result of java -version WLM Display to verify GOAL mode DSNJDBC Package List Display DSNREXX Package List Display WLM dialog WLM Definition Menu WLM Application Selection List WLM dialog WLM Activate service policy pop-up Data Archive Expert DB2_Home error USS ISPF Shell dialog USS ISPF Directory List Data Archive Expert related tables panel Grouper WLM environment definition DB2 Administration Tool Menu DB2 Administration Tool Utility Listdef Menu DB2 Administration Tool template list panel DB2 Administration Tool Utility template panel DB2 Administration Tool Utility template panel DB2 Administration Tool DSN prompting DB2 Administration Tool data set name specification DB2 Administration Tool data set name specification results Archive specification definition panel File archive targets panel Map source tables to utility template panel Utility template specification Utility template selection list panel Using a row filter spanning many lines Sample Grouper Client Directory Client DB2 Version window Add database wizard - Source Add database wizard - Protocol Add database wizard - TCP/IP Add database wizard - Database Add database wizard - ODBC Add database wizard - Node options Add database wizard - Security options Connection configuration confirmation Connect to the database Successful connection Windows environment variable EGFCLIENTHOME Grouper Client login Copyright IBM Corp All rights reserved. ix

12 6-15 Grouper Launchpad Grouper Main window Create new set window Grouper tree with new group Configure group options window Add tables filter specification Grouper select objects window Run group discovery window\ Group discovery confirmation window Confirmation window Send group discovery job window Job Status window Group_1 related discovered tables Relationships window Relationship properties window How to invoke Data Archive Expert Data Archive Expert - Main panel Data Archive Expert - Settings Data Archive Expert - Main panel again Data Archive Expert s Archive Specification List panel Archive Specification Definition Data Archive Expert s pull-down menu for specifying starting table Data Archive Expert s pull-down menu for finding related tables Archive Unit Definition Data Archive Expert s pull-down menu for specifying rules Request to specify a row filter Data Archive Expert s panel for specifying a row filter - Part Data Archive Expert s panel for specifying a row filter - Part Data Archive Expert s overview about archive unit definitions Request to define data set targets Selecting Data Archive Expert s default data set generation Data Archive Expert s confirmation of data set specifications Request to save the archive specification Data Archive Expert s confirmation message Specification saved Request an archive specification run Confirm an archive specification run Result of an archive specification run Data Archive Expert confirms a completed archive specification run Request for a second run Data Archive Expert s presentation of a confirmation panel Changing the row filter before staring the second run Result of the second archive specification run Request for an historical overview about the specification Data Archive Expert s overview about an archive specification DAE s details about a specific run of an archive specification Test if inactive rows have been removed Browse data set containing archived rows Data Archive Expert main panel Archive Specification List Archive Specification Definition Archive Specification Definition - 1. pull-down menu Archive Specification Definition - 2. pull-down menu Archive Unit Definition panel for Specification Activity x DB2 Data Archive Expert for z/os

13 8-7 Archive Table Rules Archive Unit Definition panel, still Activity Row Filter - Part Row Filter - Part Archive Unit Definition - Completed panel Archive Specification Definition, activity 1 completed Table Archive Targets Table Archive Targets Archive Specification Definition panel Archive Specification List panel Archive Specification List panel, initiating a RUN - Part Archive Specification List panel, initiating a RUN - Part Archive Run Statistics panel Back to the Archive Specification List panel Initiate a second run of your archive specification Modifying the row filter for your second archive run Result of second run of your archive specification Requesting an overview about your archive specification runs Overview of your archive specification runs Details of a performed archive specification run The data schema Data Archive Expert s main menu panel Data Archive Expert s settings panel Archive Specification List panel Data Archive Expert s pull-down menu for filtering specification list Creating a new archive specification Data Archive Expert s panel for general archive specification definitions Data Archive Expert s pull-down menu for selecting the starting point table Selecting the starting point table from a table list Data Archive Expert s pull-down menu for finding related tables Selecting archive unit tables from the list of related tables Data Archive Expert s confirmation of selected tables Initiate the addition of a table to the archive unit tables Data Archive Expert s pull-down menu for specifying a table or a list of tables Request to define rules for the archive unit tables Data Archive Expert s pull-down menu for defining rules, here delete=yes Request to define rules for another table Data Archive Expert s pull-down menu for defining rules, here: junction table Request to define a row filter for a non-starting-point table Data Archive Expert s error message for row-filter definition request Request to define a row filter on the starting-point table Specifying a row filter with qualified column names Request for checking the connections between the tables Data Archive Expert connections of LINEITEM_TEST table Request to specify connections for a table Defining connections in DAE - Selecting the starting column Defining connections in DAE - Starting column accepted Defining connections in DAE - Request to select a child table Defining connections in DAE - Select child table from a list Defining connections in DAE - Selecting a target column Defining connections in DAE - Confirmation panel Request to list existing connections Data Archive Expert s list of connections per table Figures xi

14 9-34 Request for checking the existence of another connection Data Archive Expert s presentation of existing connections for this table Request to connect a manually added table Data Archive Expert s presentation of a defined table connection Request to specify table archives Request to specify archive table names (in one table space) Specifying archive table names per table of the archive unit Data Archive Expert s request to provide a table space name for the archive DAE s pull-down menu for specifying the table space name Accepted table space name Request to save the specification Data Archive Expert returns DB2 s SQLCODE Specification saved in state PDEF Specifying a row filter with unqualified columns Data Archive Expert returns DB2 s SQLCODE -206 upon saving Specifying a third version of row filter - now with subselect Request to save the specification now successful Request to run the archive specification Confirmation to run the archive specification Result of the first step of the first specification run - Part Result of the first step of the first specification run - Part Request to complete the first run - Part Request to complete the first run - Part Result of the completion step of the first run - Part Result of the completion step of the first run - Part Data Archive Expert s run completion panel List of archive specifications Request to run the specification again Confirmation to run the specification again Result of first step of second run - Part Result of first step of second run - Part Invoking Data Archive Expert s history of a specification Request to complete the second run Result of the second complete run - Part Result of the second complete run - Part History of a specification after two runs Tables and RI being used Defining the jumbo archiving specification Selecting the required related tables Displayed list of tables making up the archive unit Defining row filer for PART table Result of pressing enter key to save the row filter Archive unit after updating the rules flags Specifying the target database, table space and table names Error due on delete cascade Final delete rules for archiving Jumbo parts JCL used to run the Jumbo archive Results of archiving Jumbo sized parts Archive history for the Jumbo archive Completing the Jumbo archive - Deleting source rows AHXJ034 error message when using an archive table as input Defining the table to file archive specification Definition option 1 - Browsing the archive unit xii DB2 Data Archive Expert for z/os

15 10-18 Definition option 2 - Selecting the archive version Definition option 3 - Age options, shown for information only Definition option 4: Defining the file archive target data sets Selecting the template for the target data sets on tape JCL to run the table archive to file archive stored procedure Grouper Client signon Non-enforced referential constraints window Add table relationships window Select table drop down Link parent column to child column window Link key columns window Dependent columns drop down Non-enforced referential constraints confirmation Archive specification to use Grouper Data Archive Expert table selection list Data Archive Expert select starting point table Data Archive Expert related tables window Data Archive Expert select related tables panel Data Archive Expert archive unit specification Starting point table row filter Table archive targets Archive specification list Archive run statistics Grouper RI set created from DAE archive specification Configure group discovery options Run group discovery Group discovery run confirmation Send group discovery job confirmation Discovery results displayed in group tree Relationships results window Non enforced referential constraints - Add relationship Add table relationships Link key columns Data Archive Expert select starting point tables window Data Archive Expert select related tables panel Archive unit definition from Grouper discovery Orphan detection warning at definition time Orphan detection error at run time Data Archive Expert primary option panel The improved Data Archive Expert settings panel Defining a new single table retrieve specification Naming the single retrieve specification Filter for an archive list Selecting a single archive specification Selecting the single table archive version Specifying a row filter for a single table Specifying a single target table Saving the single table retrieve specification Running the single table retrieve specification Confirm row filter before running retrieve Retrieve run statistics Return to retrieve specification list panel Tables and relationships used in this scenario Figures xiii

16 14-2 Defining a new retrieve specification modelled upon a file archive Selecting the specify target tables for retrieve Specifying the retrieve table names for the jumbo containers Job to run the retrieve from file archive stored procedure Relationship between tables Order archive history details Selecting the required order archive versions for retrieving Row filter spanning two archive version Specifying target table names that are the same as the source tables Running retrieve of orders from the table archives with a row filter Schema change to source table Retrieve attempt into a target table with changed schema Archive table creator and name Retrieve table creator and name xiv DB2 Data Archive Expert for z/os

17 Tables 2-1 Test tables details DB2 enforced relationships Application enforced relationship Stored procedure name and usage ARCHIVEEXECSP parameter list OFFLINEARCHSP parameter list RETRIEVEEXECSP parameter list OFFLINERETEXECSP parameter list OFFLINEONLARCSP parameter list Host and directory names Result of queries to count the rows due for archiving Copyright IBM Corp All rights reserved. xv

18 xvi DB2 Data Archive Expert for z/os

19 Examples 3-1 Sample Data Archive JCL procedure Sample Java environment variables shipped with Data Archive Expert Modified Java environment variables JCL to invoke the IVP archive specification through batch Preventive Service Planning sample Sample SQL insert statement for Grouper metadata Sample Grouper JCL procedure DB2 Grouper Java environment variables Bind JCL for SQLJ plan JCL to exec ARCHIVEEXECSP REXX modification REXX modification REXX modification Batch archive specification output OFFLINEARCHSP REXX modification OFFLINEARCHSP REXX modification Sample JCL to run AHXARFIL REXX JCL to run file archive specification to tape JCL to execute AHXTARET table retrieve in batch Sample output from batch table retrieve execution JCL to execute OFFLINERETEXCSP stored procedure in batch Sample output from batch file retrieve execution JCL to execute AHXTB2FI archiving from table to file archives in batch Sample output from table archive to file archive batch execution Modified TEMPLATE.JCL sample Specifications in Data Archive Expert s metadata table The small sample table subject to table archiving Content of the archive table Content of the source table after archive execution Retrieving all rows with a first view Retrieving all rows with a second view Original content of NATION Original content of PART Original content of PARTSUPP Original content of CUSTOMER Original content of ORDER Original content of LINEITEM Create table space for archive tables Data Archive Expert s log shows row filter within SELECT statement SQL query to control the result of the specification run The result set of the control query Content of the archive table for CUSTOMER Content of the archive table for LINEITEM Content of the archive table for NATION Content of the archive table for ORDER Content of the archive table for PART Not-deleted order line items Creation of a view to see current and archived rows Copyright IBM Corp All rights reserved. xvii

20 9-18 Combined list of current and archived rows Checking for rows we want to retrieve from the archive RI using on delete cascade Job statistics for one of the archived tables Metadata query example Metadata query results Granting select authority to user RACF group View joining the retrieved and live parts tables SQL code View of a single archive table View of two single table archives DB2 Performance Expert accounting report - SQL attribution DB2 Performance Expert Accounting report - SQL attribution DB2 Performance Expert accounting report SQL section - Commit frequency DB2 PE accounting report highlight section - Commit frequency Examples of unload and load utility control statements A-1 ARCHIVEEXECSP REXX A-2 OFFLINEARCHSP REXX A-3 RETRIEVEEXECSP REXX A-4 OFFLINERETEXECSP REXX A-5 OFFLINEONLARCSP REXX xviii DB2 Data Archive Expert for z/os

21 Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-ibm product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY U.S.A. The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Any references in this information to non-ibm Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrates programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy, modify, and distribute these sample programs in any form without payment to IBM for the purposes of developing, using, marketing, or distributing application programs conforming to IBM's application programming interfaces. Copyright IBM Corp All rights reserved. xix

22 Trademarks The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: ibm.com z/os AIX AS/400 DB2 Connect DB2 Universal Database DB2 DRDA Home Director IBM MVS Notes OS/390 QMF Redbooks RACF RETAIN S/390 Redbooks(logo) The following terms are trademarks of other companies: Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.unix is a registered trademark of The Open Group in the United States and other countries. Other company, product, and service names may be trademarks or service marks of others. xx DB2 Data Archive Expert for z/os