Oracle Database. Performance. and Scalability. A Quantitative Approach. Henry H. Liu. as Computer SOCIETY A JOHN WILEY & SONS, INC.

Transcription

1 Oracle Database Performance and Scalability A Quantitative Approach Henry H. Liu as Computer SOCIETY A JOHN WILEY & SONS, INC., PUBLICATION

2 Contents PREFACE xxv Why This Book / xxv Who This Book is For / xxvi How This Book is Organized / xxvii Software and Hardware / xxviii How to Use This Book / xxix How to Reach The Author / xxxi ACKNOWLEDGMENTS xxxiii INTRODUCTION 1 Features of Oracle / 2 Objectives / 4 Conventions / 5 Performance versus Scalability / 6 PART 1 GETTING STARTED WITH ORACLE 1 Basic Concepts 1.1 Standard versus Flavored SQLS / Relational versus Object-Oriented Databases / 11 vii

3 Vlli CONTENTS 1.3 An Instance versus a Database / Summary / 12 Recommended Reading / 12 Exercises / 12 2 Installing Oracle Software Installing Oracle 1 lg Server Software / Configuring a Listener / Creating an Oracle Database / Installing Oracle 1 lg Client Software / Oracle Grid Control versus DB Control / Summary / 33 Recommended Reading / 33 Exercises / 33 3 Options for Accessing an Oracle Server A Command Line Interface (CLI) versus a GUI-Based Console / The Oracle Enterprise Manager Java Console (OEMJC) / Using the SQL*Plus Tool / Oracle Enterprise Manager DBConsole / Other Tools for Developers / Case Study: Creating ER Diagrams with Visio via ODBC / Case Study: Accessing Oracle in Java via JDBC / Summary / 49 Recommended Reading / 50 Exercises / 50 4 A Quick Tour of an Oracle Server New Oracle Schemas Beyond "Scott" / Oracle Users versus Schemas / Tablespaces, Segments, Extents, and Data Blocks / Tables, Indexes and Index Types for Structured Data / Domain and LOB Index Types for Unstructured Data / Views, Materialized Views, and Synonyms / Stored Procedures, Functions, and Triggers / Referential Integrity with Foreign Keys / Summary / 73

4 ix Recommended Reading / 73 Exercises / 74 PART 2 ORACLE ARCHITECTURE FROM PERFORMANCE AND SCALABILITY PERSPECTIVES 75 5 Understanding Oracle Architecture The Version History of Oracle / Oracle Processes / Oracle Memory Areas / Dedicated versus Shared Oracle Server Architecture / Performance Sensitive Initialization Parameters / Oracle Static Data Dictionary Views / Oracle Dynamic Performance (V$) Views / Summary / 98 Recommended Reading / 98 Exercises / 99 6 Oracle log Memory Management SGA Sub-Areas / SGA Sizing: Automatic Shared Memory Management (ASMM) / PGA Sizing: PGA_AGGREGATE_TARGET / Summary / 108 Recommended Reading / 109 Exercises / Oracle llg Memory Management Automatic Memory Management (AMM) / Memory Sizing Options Configurable at Database Creation Time / Checking Memory Management and Usage Distribution at Run Time / Summary / 115 Recommended Reading / 115 Exercises / Oracle Storage Structure Overview / Managing Tablespaces / 119

5 for X CONTENTS 8.3 Managing Data Files / Managing Redo Logs / Summary / 125 Recommended Reading / 125 Exercises / Oracle Wait Interface (OWI) Ratio-based versus OWI-based Oracle Performance Tuning Methodologies / Wait Event The Core Concept of OWI / Classification of Wait Events from OWI / The Other Part (CPU Time) of the Equation Elapsed Time = CPU Time + Wait Time / AWR as a Compass to Tuning Oracle Performance and Scalability / Summary / 137 Recommended Reading / 137 Exercises / Oracle Data Consistency and Concurrency Select... Update Statement / ACID Properties of Transactions / Read Phenomena and Data Inconsistencies / Oracle Isolation Levels / Multi-Version Concurrency Control (MVCC) and Read Consistency / Oracle Locks / Lock Escalations versus Conversions / Oracle Latches / Oracle Enqueues / Deadlocks / Taking Advantage of Oracle's Scalable Concurrency Model / Case Study: A JDBC Example / Summary / 158 Recommended Reading / 159 Exercises / 159

6 Xi 11 Anatomy of an Oracle Automatic Workload Repository (AWR) Report Importance of Performance Statistics / AWR Report Header / Report Summary / Cache Sizes / Load Profile / Instance Efficiency Percentages (Target 100%) / Shared Pool Statistics / Top Five Timed Events / Main Report / Wait Events Statistics / Time Model Statistics / Wait Class / Wait Events / Background Wait Events / Operating System Service Statistics / 177 Statistics / Service Wait Class Stats / SQL Statistics / SQL ordered by Elapsed Time / SQL ordered by CPU Time / SQL ordered by Gets / SQL ordered by Reads / SQL ordered by Executions / SQL ordered by Parse Calls / SQL ordered by Sharable Memory / SQL ordered by Version Count / Complete List of SQL Text / Instance Activity Statistics / Instance Activity Stats / Instance Activity Stats Absolute Values / Instance Activity Stats Thread Activity / IO Stats / Tablespace IO Stats / File IO Stats / Buffer Pool Statistics / Advisory Statistics / Instance Recovery Stats / Buffer Pool Advisory / PGA Aggr Summary / PGA Aggr Target Stats / 202

7 PGA Aggr Target Histogram / PGA Memory Advisory / Shared Pool Advisory / SGA Target Advisory / Streams Pool Advisory / Java Pool Advisory / Wait Statistics / Undo Statistics / Latch Statistics / Latch Activity / Latch Sleep Breakdown / Latch Miss Sources / Parent and Child Latch Statistics / Segment Statistics / Segments by Logical Reads / Segments by Physical Reads / Segments by Row Lock Waits / Segments by ITL Waits / Segments by Buffer Busy Waits / Dictionary Cache Stats / Library Cache Activity / Memory Statistics / Process Memory Summary / SGA Memory Summary / SGA Breakdown Difference / Streams Statistics / Resource Limit Stats / init.ora Parameters / Summary / 225 Recommended Reading / 225 Exercises / Oracle Advanced Features and Options Oracle 8i New Features / Java / Oracle intermedia, Spatial, Time Series, and Visual Image Retrieval / Oracle Parallel Server / Optimizer Plan Stability / Locally Managed Tablespaces / Online Index Creation and Rebuild / Online Read-Only Tablespaces / 231

8 XiU Temporary Tables / Non-Blocking OCI (Oracle Call Interface) / Function-Based Indexes / Logical ROWIDs / Enhanced Partitioning / Connection Load Balancing / Client Load Balancing / Oracle Enterprise Manager / Oracle 9i New Features / Real Application Clusters (RAC) / Data Guard / Performance Tuning Intelligent Advisors / Actual Operation-Level Query Statistics / Dynamic Sampling of Optimizer Statistics / Cloning Production Database with Oracle Enterprise Manager / Renaming Columns and Constraints / Dynamic Memory Pools / Flashback Query / List Partitioning / Oracle log New Features / Automatic Storage Management (ASM) / Asynchronous Commit / Database Replay / Read Performance Statistics Directly from the SGA / Automatic Workload Repository (AWR) / Automatic Database Diagnostic Monitor (ADDM) / Automatic Shared Memory Tuning / Automatic Optimizer Statistics Gathering / SQL Tuning Features / Grid Computing / Oracle llg New Features / Automatic Memory Management / Intelligent Cursor Sharing / Database Resident Connection Pool (DRCP) / Server Result Cache / Database Smart Flash Cache / Database Replay SQL Performance Analyzer (SPA) Integration / Calibration / Partitioning Enhancements / 252

9 X/V CONTENTS SQL Plan Management / Zero-Size Unusable Indexes and Index Partitions / Invisible Indexes / Virtual Columns / Summary / 255 Recommended Reading / 255 Exercises / Top 10 Oracle Performance and Scalability Features Real Application Clustering (RAC) / Dedicated versus Shared Server Models / Proven Transaction and Concurrency Models / A Highly Efficient SQL Optimization Engine / Efficient Parallel Processing with Modern Multi-Core CPUs / Partitioning / An All-Encompassing, Powerful Performance, and Scalability Troubleshooting Tool AWR / The Most Comprehensive Set of Internal Performance Metrics / Database Resident Connection Pool / In-Memory Database Cache (IMDB) / Summary / 263 Recommended Reading / 264 Exercises / Oracle-Based Application Performance and Scalability by Design Rapid Development Methodologies / Planning / Vision / Objectives / ROI Analysis / Feasibility Study / Project Team Formation / Requirements Gathering / Use Cases / User Views / Business Processes, Entities, and Business Rules / 274

10 XV 14.4 Conceptual Design via Data Modeling / Entity-Relationship Diagramming / The Information Engineering (IE) Format for ERDs / UML Format for ERDs / Relational Format for ERDs / Logical Design via Normalization / Operational Anomalies / Review of Relation Theory / Functional Dependencies and Lossless-Join Decompositions / First Normal Form (INF): Avoiding Multi-Valued Columns / Second Normal Form (2NF): Eliminating Partial Dependencies / Third Normal Form (3NF): Eliminating Transitive Dependencies: / Boyce-Codd Normal Form (BCNF): Eliminating Key Non-Key Dependencies / Fourth Normal Form (4NF): Trivializing or Keying Multi-Valued Dependencies / Fifth Normal Form (5NF): Trivializing or Keying Join Dependencies / Which Level of Normalization to Settle Down? / Denormalization? / Physical Design / Naming Conventions / Creating Tablespaces / Creating a Schema User with Proper Privileges / Creating Application Schema Objects / Changing Schema Objects / Enforcing Business Rules and Data Integrity / Adding Views / Creating Sequences and Synonyms / Adding Indexes / Security / Implementation / Choosing an Effective and Efficient Coding Path / Leveraging Proven Oracle Database Design Principles / 316

11 Leveraging Proven Application Design Patterns / Enforcing with an Effective and Efficient Testing Process / Release To Market (RTM) / Continuous Improvements / Summary / 323 Recommended Reading / 324 Exercises / Project: Soba A Secure Online Banking Application on Oracle Getting SOBA Up and Running / Prerequisite Software / Initial Software Stack Setup / Creating SOBA Database on Oracle / Installing SOBA on Eclipse IDE / Configuring SOBA to Work with Oracle / Configuring SOBA to Work with Hibernate / Building SOBA and Deploying SOBA with Ant to Run on Tomcat / Overview of Spring Framework / Background / Spring for Building Flexible Applications Faster / Spring Inversion of Control (loc) and Dependency Injection / Features of Spring 3.0 / MVC Architecture / MVC Architecture in General / Spring MVC in Action with SOBA / Spring MVC Framework Applied to SOBA / Spring DispatcherServlet and WebApplicationContext / Logic Flow of SOBA Defined in Spring MVC Framework / A Web Entry Point Defined in a Spring MVC Web Form / Handler Mapping / Implementing Spring Controllers / A Typical View Defined in a Spring MVC Web Form / 358

12 XVii A Typical Form Success Controller and its Resultant View / POJOs Referenced in the CreateCustomerFormController / Hibernate Object-Relational Mapping (ORM) Applied to SOBA / Benefits of Using Hibernate / Metadata Mapping with Hibernate / Configuring Hibernate to Work with Oracle / Hibernate DAO / RESTful Web Services Applied to SOBA / Introduction to RESTful Web Services / RESTful Constraints / RESTful Interface Design Principles / Spring's Support for RESTful Web Services / Server Code / Client Code / Spring Security Applied to SOBA / Basic Concepts / Security Configured in web.xml / Security Configured in soba-security.xml / Implementing Spring Security in Views / Spring ACL Applied to SOBA / Creating ACL Tables in Oracle / Configuring Spring ACL / Maintaining ACLs for SOBA Domain Objects / Applying ACLs to Business Operations / Testing ACLs with SOBA / Summary / 413 Recommended Reading / 414 Exercises / 414 PART 3 OPTIMIZING ORACLE PERFORMANCE AND SCALABILITY Logistics of the Oracle Cost-Based Optimizer (CBO) Life of a SQL Statement in Oracle / Oracle SQL Optimizer: Cost-Based / 420 Rule-Based versus

13 xviii CONTENTS 16.3 CBO Statistics / Pivot Role of Gathering Database Statistics to CBO / Methods of Gathering CBO Statistics / Locking and Unlocking CBO Statistics / Explain Plan A Handle to CBO / Data Access Methods CBO's Footprints / Looking Up CBO's Plan Hidden in V$SQL_PLAN / When CBO may Generate Suboptimum Execution Plans / Summary / 429 Recommended Reading / 429 Exercises / Oracle SQL Tuning Tuning Joins / Tuning Subqueries / Case Study: Performance of SUBQUERY versus JOIN / Case Study: Performance of IN versus EXISTS / Case Study: A SQL Tuning Yielded a 12x Performance Gain / Summary / 447 Recommended Reading / 447 Exercises / Oracle Indexing Rules of Thumb on Indexing / Creating and Using Ubiquitous b-tree Indexes / Advanced Indexing Scheme I: Covering Indexes versus Index-Organized Tables / Advanced Indexing Scheme II: Function-Based Indexes (FBIs) / Unusual Indexing Scheme I: BITMAP Indexes / Unusual Indexing Scheme II: Reverse Key Indexes / Unusual Indexing Scheme III: Compressed Composite Indexes / How To Create Oracle Indexes / Summary / 457 Recommended Reading / 458 Exercises / 458

14 XiX 19 AutoJTune Features Oracle Automatic Database Diagnostic Monitor (ADDM) / Automatic Undo Management / Data Recovery Advisor / Memory Advisors / MTTR Advisor / Segment Advisor / SQL Advisors / SQL Performance Analyzer / Summary / 470 Recommended Reading / 471 Exercises / CASE STUDIES: ORACLE MEETING REAL WORLD PERFORMANCE AND SCALABILITY CHALLENGES Case Study: Achieving High Throughput with Array Processing Context / Performance Model / Tests / Solution / Effects of Array Processing / Summary / 484 Recommended Reading / 484 Exercises / Case Study: Performance Comparison of Heap-Organized versus Index-Organized Tables Context / Conversion from Heap-Organized to Index-Organized / Creating Indexes / Creating Constraints / EXPLAIN PLANs / Oracle SQL Traces / Summary / 490 Recommended Reading / 491 Exercises / 491

15 22 Case Study: SQL Tuning: "IN" versus "OR" versus Global Temporary Table Context / Test Program / Observation 1: IN_CreateStatement is the Best Performer / Observation 2: Batch Insert Saves Time / Temptable Performed Better without an Index Hint than with an Index Hint / Effects of APPEND Hint for Populating Temptable / Effects of Number of Iterations / OR and IN without the Index Hint / Limitation on the Number of Literal Values and the Size of OR Statement / Dealing with More Than 1000 Literal Values for an IN Based SQL Query / A Recommendation for Dealing with 1000 Literal Value Limit in an IN Statement / Summary / 502 Recommended Reading / 503 Exercises / Case Study: Data Access Paths (Double Buffering) Data Access Paths in General / Data Buffering / Inode Locking / Write-Syne Daemon / Test Environments / Solaris on Veritas / Solaris onufs / Windows on NTFS / Test Results with Solaris on Veritas / Test Run #1 145 ms Average Read Time / Test Run #2 401 ms Average Read Time / Test Run #3 261 ms Average Read Time / Test Run # ms Average Read Time / Analysis / Test Results with Solaris on UFS / Test Run #1 447 ms Average Read Time / Test Run #2 10ms Average Read Time / Analysis / 525

16 XXi 23.5 Test Results with Windows on NTFS / Test Run 8 ms Average Read Time / Analysis / Moral of the Case Study / 528 Recommended Reading / 529 Exercises / Case Study: Covering Index Getting to Know the Application Architecture / Quantifying the Problems / Analyzing Bottlenecks / Applying Optimizations/Tunings / Verifying the Fixes / Report Summary / Wait Events Statistics / SQL Statistics / Stats / Buffer Pool Statistics / Wait Statistics / init.ora Parameters / Moral of the Case Study / 545 Recommended Reading / 546 Exercises / Case Study: CURSOR_SHARING The Concept of a Bind Variable / 548 Oracle CURSOR_SHARING Parameter / 549 Getting to Know the Application Architecture / 550 Quantifying Problems / 550 Analyzing Bottlenecks / Report Summary / SQL Statistics / Stats / Wait Statistics / init.ora Parameters / 558 = Applying Tuning: CURSOR_SHARING FORCE / Report Summary / Wait Events Statistics / 563 Applying Tuning: CURSOR_SHARING = SIMILAR / Report Summary / Wait Events Statistics / 566

17 25.8 Moral of the Case Study / 569 Recommended Reading / 569 Exercises / Case Study: Bulk Transactions Application Architecture / Quantifying Problems / Identifying Performance and Scalability Optimization Opportunities / Report Summary / Wait Events Statistics / SQL Statistics / Wait Statistics / Effects of Bulk Transactions on Performance / Report Summary / Wait Events Statistics / SQL Statistics / Wait Statistics / Moral of the Case Study / 592 Recommended Reading / 593 Exercises / Case Study: Missing Statistics Decaying Performance due to Missing Statistics / First Run with no Statistics / Report Summary / Wait Events Statistics / SQL Statistics / Stats / Wait Statistics / init.ora Parameters / Second Run with Missing Statistics / Report Summary / Wait Events Statistics / SQL Statistics / IO Stats / Wait Statistics / Third Run with Updated Statistics / Report Summary / Wait Events Statistics / Operating System Statistics / SQL Statistics / 614

18 XX/// Wait Statistics / Moral of the Case Study / 61.8 Recommended Reading / 618 Exercises / Case Study: Misconfigured SAN Storage Architecture of the Apple's Xserve RAID / Problem Analysis / Report Summary / Wait Events Statistics / Stats / init.ora Parameters / Reconfiguring the RAID and Verifying / Report Summary / Wait Events Statistics / Stats / Moral of the Case Study / 629 Recommended Reading / 630 Exercises / 630 APPENDIX A ORACLE PRODUCT DOCUMENTATIONS 633 A. 1 Oracle Database Concepts / 633 A.2 Oracle Database Administrator's Guide / 633 A.3 Oracle Database Reference / 634 A.4 Oracle Database Performance Tuning Guide / 634 A.5 Oracle Database 2 Day + Performance Tuning Guide / 634 A.6 Oracle Database 2 Day DBA / 634 A.7 Oracle Database SQL Language Reference / 634 A.8 Oracle Database Sample Schemas / 635 A.9 Oracle Database PL/SQL Packages and Types Reference / 635 A. 10 Oracle Database PL/SQL Language Reference / 635 A.l 1 Oracle Database JDBC Developer's Guide and References / 635 APPENDIX B USING SQL*PLUS WITH ORACLE 636 B. l Installation / 636 B.2 SQLTlus and tnsnames.ora File / 637 B.3 Basics of SQL*Plus / 638

19 B.4 Common SQL*Plus Commands / 638 B.5 Using SQL*Plus to Execute SQL Statements / 639 B.6 Using SQLTlus to Execute PL/SQL Blocks / 640 B.7 Using SQL*Plus Autotrace to Obtain EXECUTION PLANs and Optimizer Statistics / 640 B.8 Using SQL*Plus Timing Command / 641 B.9 Exporting/Importing Oracle Databases with SQL*Plus / 642 B.10 Creating AWR Reports with SQL*Plus / 643 B.l 1 Checking Tablespace Usage with SQL*Plus / 644 B.12 Creating EM DBConsole with SQL*Plus / 646 APPENDIX C APPENDIX D APPENDIX E A COMPLETE LIST OF ALL WAIT EVENTS IN ORACLE 11g 648 A COMPLETE LIST OF ALL METRICS WITH THE V$STATNAME VIEW 656 A COMPLETE LIST OF ALL STATISTICS WITH THE V$SYSSTAT VIEW 667 INDEX 681