IBM zenterprise Data Compression (zedc)

Transcription

1 IBM zenterprise Data Compression (zedc) z13tllb1

2 Deploying zedc - Review Operating system requirements Requires z/os 2.1 (with PTFs) and the zedc Express for z/os feature z/os V1.13 and V1.12 offer software decompression support only z/vm V6.3 support for z/os V2.1 guest: Server requirements Available on zec12, zbc12 and z13 zedc Express feature for PCIe I/O drawer (FC#0420) Each feature can be shared across up to 15 LPARs Up to 8 features available on zec12/zbc12/z13 Recommended high availability configuration per server is four features This provides up to 4 GB/s of compression/decompression Provides high availability during concurrent update (half devices unavailable during update) Recommended minimum configuration per server is two features Steps for installing zedc Express in an existing zec12/zbc12/z13 Apply z/os Service; Hot plug zedc Express; update your IODF, and Dynamic Activate zedc should be installed on all systems accessing compressed data * * For the full zedc benefit, zedc should be active on ALL systems that might access or share compressed format data sets. This eliminates instances where software inflation would be used when zedc is not available. z13tllb2

3 QSAM/BSAM Data Set Compression with zedc Reduce the cost of keeping your sequential data online zedc compresses data up to 4X, saving up to 75% of your sequential data disk space Capture new business opportunities due to lower cost of keeping data online Better I/O elapsed time for sequential access Potentially run batch workloads faster than either uncompressed or QSAM/BSAM current compression Sharply lower CPU cost over existing compression Enables more pervasive use of compression Up to 80% reduced CPU cost compared to tailored and generic compression options Simple Enablement Use a policy to enable the zedc Example Use Cases SMF Archived Data can be stored compressed to increase the amount of data kept online up to 4X zsecure output size of Access Monitor and UNLOAD files reduced up to 10X and CKFREEZE files reduced by up to 4X Up to 5X more XML data can be stored in sequential files The IBM Employee Directory was stored in up to 3X less space z/os SVC and Stand Alone DUMPs can be stored in up to 5X less space Disclaimer: Based on projections and/or measurements completed in a controlled environment. Results may vary by customer based on individual workload, configuration and software levels. z13tllb3

4 QSAM/BSAM Data Set Compression with zedc Setup is similar to setup for existing types of compression (generic and tailored) It can be selected at either or both the data class level or system level. Data class level In addition to existing tailored (T) and generic (G) values, new zedc Required (ZR) and zedc Preferred (ZP) values are available on the COMPACTION option in data class. When COMPACTION=Y in data class, the system level is used System level In addition to existing TAILORED and GENERIC values, new zedc Required (ZEDC_R) and zedc Preferred (ZEDC_P) values are available on the COMPRESS parameter found in IGDSMSxx member of SYS1.PARMLIB. Activated using SET SMS=xx or at IPL Data class continues to take precedence over system level. The default continues to be GENERIC. zedc compression for new extended format data sets is Optional All previous compression options are still supported For the full zedc benefit, zedc should be active on ALL systems that might access or share compressed format data sets. This eliminates instances where software inflation would be used when zedc is not available. z13tllb4

5 BSAM/QSAM zedc Compression Results 30 Uncompressed 25 Current Compression Gigabytes or 10 Seconds zedc Size (GB) Elapsed (10 s) CPU (10 s) 5 0 Large Extended Generic Tailored zedc Data Set Type *Measurements completed in a controlled environment. Results may vary by customer based on individual workload, configuration and software levels. z13tllb5

6 zedc with IBM Sterling Connect:Direct for z/os 5.2 High performance data compression for Managed File Transfer Sterling Connect:Direct can automatically leverage zedc Express Accelerator for file compression and decompression as files are transferred Works with various dataset and file types on z/os File transfers can be z/os to z/os, or z/os to Distributed (UNIX, Linux, Linux on z System, and Windows) Fully compatible with zlib compression used in IBM Sterling Connect: Direct today no changes required at end points Up to 80% reduction in elapsed time to transfer a file from z/os to z/os (results vary by dataset type and characteristics of the data) with minimal CPU increase Significant improvement in CPU time with zedc over zlib software compression (sender TCB time and receiver TCB time) Users currently using compression will see a comparable compression ratio Disclaimer: Results based on internal controlled measurements using IBM Encryption Facility for files containing public domain books. Results may vary by customer based on individual workload, data, configuration and software levels. z13tllb6

7 zedc with WebSphere MQ for z/os V8 WebSphere MQSeries has always provided compression options for message data passed over MQ channels via the COMPMSG attribute. The existing zlib options are the following: ZLIBFAST - Message data compression is performed using the zlib compression technique. A fast compression time is preferred. ZLIBHIGH - Message data compression is performed using the zlib compression technique. A high level of compression is preferred. Starting with WebSphere MQ for z/os V8 the COMPMSG(ZLIBFAST) attribute will now use zedc when available to perform compression and decompression of message data. z13tllb7

8 Compression Coprocessor (CMPSC) vs. zedc Using the right hardware compression acceleration for each of your workloads On Chip Compression Coprocessor In every IBM eserver zseries today (and tomorrow) Mature: Decades of use by Access Methods and DB2 Work is performed jointly by CPU and Coprocessor Proprietary Compression Format Use Cases PCIe Adapter z Enterprise Data Compression Introduced with IBM zenterprise EC12 GA2 and IBM zenterprise BC12 and z13 Mature: Industry Standard with decades of software support Work is performed by the PCIe Adapter Standards Compliant (RFC1951) Small object compression Rows in a database Users VSAM for better disk utilization DB2 for lower memory usage The majority of customers are currently compressing their DB2 rows Large Sequential Data QSAM/BSAM Online Sequential Data Objects stored in a data base Users QSAM/BSAM for better disk utilization and batch elapsed time improvements SMF for increased availability and online storage reduction Industry Standard Data Cross Platform Data Exchange Users Java for high throughput standard compression via java.util.zip Encryption Facility for z/os for better industry data exchange IBM Sterling Connect: Direct for z/os for better throughput and link utilization ISV support for increased client value z13tllb8

9 ISVs exploit zedc zedc was expressly created using industry standard APIs to encourage ISVs to leverage its high-speed compression value in applications ISVs create. With access to zedc, ISV applications are more valuable to end users. Contact these, or your, ISV providers directly for additional information for their future plans Alebra Parallel Data Mover (PDM) Uses zedc compression in lieu of Software-based compression to provide excellent qualities of service. ASE OMCS Takes SLIKZIP and SLIKSFTP performance to a whole new level PKWARE PKZIP and SecureZIP v15 Accelerated deflate compression and automatic detection of zedc Software AG Entire Net-Work High performance transaction processing z13tllb9

10 IBM Offers Multiple Compression Technologies for the Mainframe Type Optimized for: Performance Overhead Supported data Frequency of access post compression CMPSC compression on z System processor chip Optimal for DB2 or select DFSMS files On Chip, relatively little CPU overhead and less I/O, Fast DB2 - Optimized for rowwise access to data is required DFSMS files for VSAM and non-vsam extended format data sets Often Other software compression (zlib, or similar) Most compression uses industry std today. Used by many file types Higher CPU - software instructions executed. Note: if Java then eligible for ziip (or zaap) Any. De facto standard for almost any type of data. Often Tape HW compression Tape compression optimized for use with large files, archival purposes Performed by the tape subsystem Any. Often Rare (application dependent) Archival / Backup Archive data and data to backup/copy CPU overhead, longer wall clock time DFSMShsm, DFSMSdss Often Rare (application dependent) Real time compression IBM NAS storage No performance degradation SVC Designed for active primary data. zedc Express Active, for cross platform data exchange. Enables compression of active and inactive data Processing on zedc Express-expect minimal CPU overhead, low latency SMF though logger zlib compatible Java BSAM/QSAM Extended format SOD DFSMShsm /dss Encryption Facility Frequent access required. Useful for files that previously used software compression as well z13tllb10