Key Performance Metrics of Oracle Platforms. Technical Presentation May 2014

Key Performance Metrics of Oracle Platforms Technical Presentation May 2014

Methodology Benchware mission: Quality assurance calibrate efficiency of Oracle platforms Application(s) Middleware Oracle application Platform evaluation quantify price-performance ratio of Oracle platforms Database System Capacity planning deliver key performance metrics of Oracle platforms for capacity planning DataGuard Network Fusion I/O Interconnect File System Volume Management Operating System Server Virtualization Storage System Storage Network Oracle platform copyright 2014 by benchware.ch slide 3

Methodology Benchware tools: Benchware Loader processor performance server system performance storage system performance database load performance database OLTP performance database scan performance data aggregation performance Benchware Monitor Collect performance statistics form v$ views Benchware Loader DataGuard Network Fusion I/O Interconnect Database System File System Volume Management Operating System Server Virtualization Storage System Storage Network Benchware Monitor Oracle platform copyright 2014 by benchware.ch slide 4

Methodology Benchware methodology: Benchmark load is generated with representative Oracle database operations even for cpu, server and storage Benchware Loader Benchware Monitor Benchware methodology describes Oracle viewpoint of performance even for cpu, server and storage DataGuard Network Fusion I/O Interconnect Database System File System Volume Management Operating System Server Virtualization Storage System Storage Network Oracle platform copyright 2014 by benchware.ch slide 5

Key Performance Metrics Quality Assurance or Performance calibration Does a platform meet performance requirements? Are vendor's performance numbers achievable? Are there any performance bottlenecks in the platform, which have impact to application performance? Does the platform at least deliver the same performance after the system change? DataGuard Network Fusion I/O Interconnect Application(s) Middleware Database System File System Volume Management Operating System Server Virtualization Storage System Storage Network copyright 2014 by benchware.ch slide 8

Key Performance Metrics Platform evaluation Which platform delivers best price-performance ratio, taking into consideration Oracle license costs? How to get adequate figures in a short time for management decisions? Application(s) Middleware Database System 1,0 1,0 1,1 2,5 0,7 2,1 Price Performance DataGuard Network Fusion I/O Interconnect File System Volume Management Operating System Server Virtualization Storage System Storage Network Current System New System A New System B copyright 2014 by benchware.ch slide 9

Key Performance Metrics Capacity planning What are the performance limitations of a platform? How much of the resources are already utilized? How much reserve of resources is still available? Application(s) Middleware Database System DataGuard Network Fusion I/O Interconnect File System Volume Management Operating System Server Virtualization Storage System Storage Network copyright 2014 by benchware.ch slide 10

Benchware Performance Suite Library of Oracle performance tests Oracle Processor (CPU) Performance Tests CPU-bound operations with typical Oracle data types OLTP DWH Proof of CPU efficiency Key Performance Metrics Unit pl/sql operations arithmetic addition, string operations, SQL built-in functions pl/sql algorithms multithreading virtualization encryption speed throughput [s] [ops] fibonacci, prime numbers Oracle Server (SRV) Performance Tests Server-bound in-memory SQL transactions without any I/O operation OLTP DWH Proof of Server efficiency Key Performance Metrics Unit in-memory SQL full scan all rows per transaction primary key access 1 row per transaction secondary key access Ø 25 rows per transaction scalability virtualization cc-numa speed service time throughput [µs] [ms] [µs] [ms] [dbps] [tps] [rps] [s] seconds [ms] milli seconds (10-3 ) [µs] micro seconds (10-6 ) [dbps] [rps] [tps] [ops] database blocks per second rows per second transactions per second operations per second [MBps] [GBps] [iops] Mega Byte per second Giga Byte per second i/o operations per second less important important very important copyright 2014 by benchware.ch slide 12

Benchware Performance Suite Library of Oracle performance tests Oracle Storage (STO) Performance Tests I/O-bound operations for all typical Oracle I/O operations OLTP DWH Proof of Storage efficiency Key Performance Metrics Unit sequential I/O 1 MByte, read and write random I/O 8 kbyte (default), read and write data integrity tiering, pooling virtualization replication service time throughput [µs] [ms] [MBps] [GBps] [iops] Oracle OLTP (DBX) Performance Tests I/O-bound operations for all typical Oracle I/O operations OLTP DWH Proof of Storage efficiency Key Performance Metrics Unit OLTP select primary key access 1 row per transaction secondary key access Ø 25 rows per transaction OLTP update scalability speed service time throughput [ms] [s] [ms] [s] [rps] [tps] primary key access 1 row per transaction secondary key access Ø 25 rows per transaction [s] seconds [ms] milli seconds (10-3 ) [µs] micro seconds (10-6 ) [dbps] [rps] [tps] [ops] database blocks per second rows per second transactions per second operations per second [MBps] [GBps] [iops] Mega Byte per second Giga Byte per second i/o operations per second less important important very important copyright 2014 by benchware.ch slide 13

Benchware Performance Suite Library of Oracle performance tests Oracle Load (DBL) Performance Mixed resource usage: CPU, memory, storage transactional data load via buffer cache configurable tx size OLTP DWH Proof of Database efficiency scalability LGWR process direct bulk load scalability compression LGWR process Key Performance Metrics speed service time throughput speed service time throughput Unit [μs] [ms] [s] [μs] [ms] [s] [rps] [tps] [μs] [ms] [s] [μs] [ms] [s] [rps] [tps] Oracle Data Aggregation (DBA) Performance Mixed resource usage: CPU, memory, storage OLTP DWH Proof of Database efficiency Key Performance Metrics Unit data aggregation & reports simulated by creating b-tree indexes scalability sorting speed service time throughput [μs] [ms] [s] [μs] [ms] [s] [rps] [tps] [s] seconds [ms] milli seconds (10-3 ) [µs] micro seconds (10-6 ) [dbps] [rps] [tps] [ops] database blocks per second rows per second transactions per second operations per second [MBps] [GBps] [iops] Mega Byte per second Giga Byte per second i/o operations per second less important important very important copyright 2014 by benchware.ch slide 14

Throughput Benchware Performance Suite All load profiles from single process to saturation 6 000 5 000 4 000 Y-axis reports understandable key performance metric, e.g. throughput Transactions per second [tps] Rows per second [rps] Operations per second [ops] Mega byte per second [MBps] I/O operations per second [IOPS] 950 µs Optional additional information for each measuring point describes quality of performance, e.g. I/O service time in µsec Operations per core 3 000 2 000 1 000 0 1 2 4 8 16 32 64 Degree of parallelism X-axis reports benchmark load, e.g. degree of parallelism Inter SQL or Intra SQL degree of parallelism Parallelism 1 shows best case: only one process Number of involved RAC nodes copyright 2014 by benchware.ch slide 15

Conclusion Key Performance Metrics are the foundation for understanding Oracle platform performance Decisions taken on key performance metrics are based on facts, not on assumptions The Benchware Performance Suite delivers readily understandable key performance metrics for all platform components from Oracle s point of view copyright 2014 by benchware.ch slide 18

swiss precision in performance measurement www.benchware.ch info@benchware.ch