Vertical Scaling of Oracle 10g Performance on Red Hat Enterprise Linux 5 on Intel Xeon Based Servers Version 1.0 March 2009
Vertical Scaling of Oracle 10g Performance on Red Hat Enterprise Linux 5 on Inel Xeon Based Servers 1801 Varsity Drive Raleigh NC 27606-2072 USA Phone: +1 919 754 3700 Phone: 888 733 4281 Fax: +1 919 754 3701 PO Box 13588 Research Triangle Park NC 27709 USA Linux is a registered trademark of Linus Torvalds. Red Hat, Red Hat Enterprise Linux and the Red Hat "Shadowman" logo are registered trademarks of Red Hat, Inc. in the United States and other countries. All other trademarks referenced herein are the property of their respective owners. 2009 by Red Hat, Inc. This material may be distributed only subject to the terms and conditions set forth in the Open Publication License, V1.0 or later (the latest version is presently available at http://www.opencontent.org/openpub/). The information contained herein is subject to change without notice. Red Hat, Inc. shall not be liable for technical or editorial errors or omissions contained herein. Distribution of modified versions of this document is prohibited without the explicit permission of Red Hat Inc. Distribution of this work or derivative of this work in any standard (paper) book for commercial purposes is prohibited unless prior permission is obtained from Red Hat Inc. The GPG fingerprint of the security@redhat.com key is: CA 20 86 86 2B D6 9D FC 65 F6 EC C4 21 91 80 CD DB 42 A6 0E www.redhat.com 2
Table of Contents 1. Introduction & Executive Summary... 4 2. Performance Testing Methodology... 5 3. Oracle OLTP Performance & Scaling on RHEL 5 / Harpertown (Intel E5440)... 6 3.1 Configuration... 6 3.2 Results... 6 4. Oracle OLTP Performance & Scaling on RHEL 5 / Tigerton (Intel X7350)... 7 4.1 Configuration... 7 4.2 Results... 7 5. Oracle OLTP Performance & Scaling on RHEL 5 / Dunnington (Intel X7600)... 8 5.1 Configuration... 8 5.2 Results... 8 6. Conclusions... 9 7. References... 9 3 www.redhat.com
1. Introduction & Executive Summary Customers seriously considering migrating mission-critical applications from UNIX to Red Hat Enterprise Linux (RHEL) are demanding up to date vertical scaling data for Oracle performance. This is an update of an earlier study which demonstrated scaling up to 8 cores. The goal of this study was to characterize the performance and vertical scaling of Oracle OLTP performance on RHEL 5 running on Intel Xeon based servers (up to 24 cores). The OLTP workload was used because it represents a very common type of database workload which exercises both the memory and I/O sub-systems. The performance metric is TPM (Transactions Per Minute). Since this TPM performance metric is for a synthetic benchmark workload, the actual TPM for a real application will depend on the characteristics of the application. Figure 1 illustrates the excellent scaling achieved up to 24 cores. Figure 1 www.redhat.com 4
2. Performance Testing Methodology Database performance and scalability often depend on many factors. However, it is impractical to try and collect data for all values of all the factors that can influence Oracle performance on RHEL. In order to get some useful information out to our sales, support and consultants in the field in a timely manner some judgment must be exercised in selecting the subset of the data that can be collected with the time and resources available. Specifically selected were: A. Workload Types: Online Transaction Processing (OLTP) Decision Support System (DSS) The OLTP workload was used because it represents a very common type of database workload which exercises both the memory and I/O sub-systems. DSS workloads are less common and require large storage sub-systems. Since access to such storage subsystems was limited, we limited this version of the study to OLTP workloads. B. File Systems: EXT3 GFS NFS RAW device pseudo-files The EXT3 file system was selected as the basis for most of the experiments. EXT3 is a journalled file system and is the default system on Red Hat Enterprise Linux. Using a file system and/or LVM volumes for the Oracle databases maps to a large percent of users of Oracle on RHEL. C. I/O Modes: Synchronous I/O Asynchronous I/O (AIO) Direct I/O (DIO) AIO with DIO (AIO + DIO) Raw I/O In previous experiments it was observed that AIO+DIO consistently performed better than Synch I/O, Asynch I/O (AIO) and Direct I/O (DIO) for OLTP workload. So, studying AIO+DIO would yield the upper bound OLTP performance and scaling. AIO+DIO is what we recommend to our customers for OLTP workloads. D. X86_64 Servers: Intel Xeon AMD Opteron Processors from Intel s Harpertown, Tigerton and Dunnington families were used. The enterprise customers, simulated in these experiments, used the above OLTP workload with an average database size between 50-100 GB. 5 www.redhat.com
3. Oracle OLTP Performance & Scaling on RHEL 5 / Harpertown (Intel E5440) 3.1 Configuration Dual Socket, Quad-Core (Total of 8 Cores) Processor Intel Xeon E5440 (Harpertown) 2.83 GHz 8 GB RAM EqualLogic PS3800XV iscsi Array Storage 4.8 TB (16 x 300 GB, 15 K RPM SAS Drives) Operating System Red Hat Enterprise Linux (RHEL) 5.1 File System Database EXT3 Oracle 10g R2 3.2 Results Figure 2 www.redhat.com 6
4. Oracle OLTP Performance & Scaling on RHEL 5 / Tigerton (Intel X7350) 4.1 Configuration Quad Socket, Quad-Core (Total of 16 Cores) Processor Intel Xeon X7350 (Tigerton) 2.93 GHz 32 GB RAM HP StorageWorks 4400 Enterprise Virtual Array (EVA) Storage 5.6 TB (20 x 280 GB Drives) Operating System Red Hat Enterprise Linux (RHEL) 5.3 File System Database EXT3 Oracle 10g R2 4.2 Results Figure 3 7 www.redhat.com
5. Oracle OLTP Performance & Scaling on RHEL 5 / Dunnington (Intel X7600) 5.1 Configuration Quad Socket, Hex-Core (Total of 24 Cores) Processor Intel Xeon X7600 (Dunnington) 2.66 GHz 32 GB RAM HP StorageWorks 2000 Modular Smart Array (MSA) Storage 1.716 TB (12 x 146 GB Drives) for Data + 2 x 80 GB Fusion IO SSD for Logs Operating System Red Hat Enterprise Linux (RHEL) 5.3 File System Database EXT3 Oracle 10g R2 5.2 Results Figure 4 www.redhat.com 8
6. Conclusions Database OLTP workloads represent a large portion of enterprise database customers real environments today. Chip vendors are driving scalability inovation through lager processor counts and cores/chip. As this trend continues to increase from dual-to-quad, quad-to-hex core on x86_64 servers, Open source Red Hat Enterprise Linux will continue to optimize the OS for database scalability for enterprise applications like Oracle such that users derive incremental improvement in real customer environments as cpu-cores increase. While the hardware design ultimately determines the position of the scale curve, the OS and it capabilities effect the slope of the curve. This study demonstrates that given adequate I/O bandwidth, Oracle database OLTP performance scales very well up to 24 cores when Red Hat Enterprise Linux (RHEL) 5 on Intel Xeon servers. In the future, we expect to demonstrate vertical scaling of database OLTP performance to servers with: even larger number of cores / hyper-threads newer chip technology, e.g., Intel Nahalem 7. References 1. Red Hat Reference Architecture: Tuning & Optimizing Red Hat Enterprise Linux (RHEL) for Oracle 9i and 10g Databases. Version 1.1, November 2007. https://bu-platform.devel.redhat.com/bu/prgrms/refarch/oracle-tuning-guide%201-1%2011-28-2007.pdf 2. Red Hat Reference Architecture: Performance & Scalability of Virtualized Oracle 10g Servers on Red Hat Enterprise Linux, Version 1.0, June 2008. https://bu-platform.devel.redhat.com/bu/prgrms/refarch/oracle-10g-recommendationsv1.2.pdf 3. Red Hat Reference Architecture: Oracle 10g Server on Red Hat Enterprise Linux 5 Deployment Recommendations, Version 1.2, November 2008. https://buplatform.devel.redhat.com/bu/prgrms/refarch/virtualized%20oracle%20server%20perf ormance%20v1.pdf 9 www.redhat.com