Common Exadata Mistakes. Andy Colvin Practice Director, Enkitec IOUG Collaborate 2014

Similar documents
Tuning Exadata. But Why?

Expert Oracle Exadata

<Insert Picture Here> Best Practices for Extreme Performance with Data Warehousing on Oracle Database

Exadata and Database Machine Administration Seminar

2009 Oracle Corporation 1

EXADATA HEALTH AND RESOURCE USAGE MONITORING ORACLE WHITE PAPER NOVEMBER 2014

Oracle Database In- Memory Op4on in Ac4on

Expert Oracle Exadata

Inge Os Sales Consulting Manager Oracle Norway

Performance Baseline of Hitachi Data Systems HUS VM All Flash Array for Oracle

Exadata Database Machine Administration Workshop NEW

Best Practices for Deploying & Tuning Oracle Database 12c on RHEL6

Safe Harbor Statement

Overview: X5 Generation Database Machines

Main Memory Data Warehouses

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

Oracle Exadata Database Machine for SAP Systems - Innovation Provided by SAP and Oracle for Joint Customers

Drilling Deep Into Exadata Performance With ASH, SQL Monitoring and Exadata Snapper

An Oracle White Paper May Exadata Smart Flash Cache and the Oracle Exadata Database Machine

An Oracle White Paper September Oracle Database Smart Flash Cache

ORACLE EXADATA STORAGE SERVER X4-2

An Oracle White Paper October Best Practices for Database Consolidation On Exadata Database Machine

Extreme Data Warehouse Performance with Oracle Exadata

Exadata Database Machine

An Oracle White Paper December Exadata Smart Flash Cache Features and the Oracle Exadata Database Machine

Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle

Capacity Management for Oracle Database Machine Exadata v2

Oracle Database In-Memory A Practical Solution

Basic Tuning Tools Monitoring tools overview Enterprise Manager V$ Views, Statistics and Metrics Wait Events

Applying traditional DBA skills to Oracle Exadata. Marc Fielding March 2013

SUN ORACLE DATABASE MACHINE

1. This lesson introduces the Performance Tuning course objectives and agenda

SUN ORACLE DATABASE MACHINE

An Oracle White Paper June A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

Exadata for Oracle DBAs. Longtime Oracle DBA

Oracle Database In-Memory The Next Big Thing

Oracle Database 12c: Performance Management and Tuning NEW

Benchmarking Hadoop & HBase on Violin

Is there any alternative to Exadata X5? March 2015

Exadata: from Beginner to Advanced in 3 Hours. Arup Nanda Longtime Oracle DBA (and now DMA)

Flash Performance for Oracle RAC with PCIe Shared Storage A Revolutionary Oracle RAC Architecture

Resource Manager Overview. Sue Lee, Director of Development 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Novinky v Oracle Exadata Database Machine

Maximizing SQL Server Virtualization Performance

An Oracle White Paper December A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

SUN ORACLE EXADATA STORAGE SERVER

HP reference configuration for Scalable Warehouse Solution for Oracle: HP DL980 G7 and P2000 G3 MSA

Azure VM Performance Considerations Running SQL Server

Oracle Database 11g: Performance Tuning DBA Release 2

Oracle Big Data, In-memory, and Exadata - One Database Engine to Rule Them All Dr.-Ing. Holger Friedrich

Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture

How To Use Exadata

Hadoop Meets Exadata. Presented by: Kerry Osborne. DW Global Leaders Program Decemeber, 2012

Exadata Performance, Yes You Still Need to Tune Kathy Gibbs Senior Database Administrator, CONFIO Software

PERFORMANCE TUNING ORACLE RAC ON LINUX

America s Most Wanted a metric to detect persistently faulty machines in Hadoop

ORACLE EXADATA DATABASE MACHINE X2-8

An Oracle White Paper October A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

The Data Placement Challenge

Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology

BENCHMARKING CLOUD DATABASES CASE STUDY on HBASE, HADOOP and CASSANDRA USING YCSB

Objectif. Participant. Prérequis. Pédagogie. Oracle Database 11g - Performance Tuning DBA Release 2. 5 Jours [35 Heures]

Lessons Learned while Pushing the Limits of SecureFile LOBs. by Jacco H. Landlust. zondag 3 maart 13

HP POLYSERVE SOFTWARE

Enkitec Exadata Storage Layout

This article is the second

Condusiv s V-locity Server Boosts Performance of SQL Server 2012 by 55%

Oracle Database 10g: Performance Tuning 12-1

Oracle Aware Flash: Maximizing Performance and Availability for your Database

HDS UCP for Oracle key differentiators and why it should be considered. Computacenter insight following intensive benchmarking test

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

PARALLELS CLOUD STORAGE

How to Migrate your Database to Oracle Exadata. Noam Cohen, Oracle DB Consultant, E&M Computing

SQL Server Upgrading to. and Beyond ABSTRACT: By Andy McDermid

Monitor Your Engineered Systems From a Single Pane Of Glass

An Oracle White Paper October Oracle Database Appliance

Exceptions to the Rule: Essbase Design Principles That Don t Always Apply

Distributed Architecture of Oracle Database In-memory

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Instant-On Enterprise

Virtuoso and Database Scalability

An Oracle White Paper June High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database

Q & A From Hitachi Data Systems WebTech Presentation:

MACHINE X2-8 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

Oracle Software. Hardware. Training. Consulting. Mythics Complete.

Parallels Cloud Server 6.0

How To Build An Exadata Database Machine X2-8 Full Rack For A Large Database Server

<Insert Picture Here> Oracle Exadata Database Machine Overview

WHITE PAPER Optimizing Virtual Platform Disk Performance

PARALLELS CLOUD SERVER

Where is the memory going? Memory usage in the 2.6 kernel

ORACLE EXADATA STORAGE SERVER X2-2

Oracle Database Public Cloud Services

Hadoop Internals for Oracle Developers and DBAs Exploring the HDFS and MapReduce Data Flow

ORACLE INSTANCE ARCHITECTURE

Recommended hardware system configurations for ANSYS users

ORACLE EXADATA STORAGE SERVER X3-2

Sizing and Best Practices for Deploying Oracle 11g Transaction Processing Databases on Dell EqualLogic Storage A Dell Technical Whitepaper

Transcription:

Common Exadata Mistakes Andy Colvin Practice Director, Enkitec IOUG Collaborate 2014

About Enkitec Global systems integrator focused on the Oracle platform Established in August, 2004 Headquartered in Dallas, Texas Consultants average 15+ years of Oracle experience Worldwide leader in Exadata implementations

About Me 8 years at Enkitec Supporting Oracle since 1999 Working with Exadata since 2010 Oracle ACE Author of Expert Oracle Exadata second edition Blog blog.oracle-ninja.com Twitter - @acolvin

Enkitec E4 2014 2 day Exadata conference in Dallas June 1 3, 2014 http://www.enkitec.com/e4 Tom Kyte Maria Colgan Tanel Poder Kerry Osborne Sue Lee Doug Burns Martin Bach

Why Exadata? Many databases are I/O bound Slower fibrechannel Older hardware Shared infrastructure Exadata solves these problems 40gbps InfiniBand Dedicated Storage

Quick Exadata Primer Smart scans are the secret sauce Smart scans kick in with full object scans Without smart scans, you re probably in The 3X Club

Conventional RAC System Database Server Buffered reads Database Server 8k Oracle Blocks Storage Area Network

Quick Exadata Primer Direct path Read to PGA Database Server Buffered reads Database Server Smart Scan/ Offloaded opera;on Oracle Records Storage Server 8k Oracle Blocks Standard Opera;on Storage Server Storage Server

Common Exadata Mistakes Classified into 2 types Performance degrading issues Issues that make Exadata management tougher Rule #1 You aren t special

SGA Sizing

Improperly Sized SGAs Large SGAs can be counterproductive (in a warehouse) A determining factor for full scans is the small table threshold (_small_table_threshold parameter)

Small Table Threshold Default setting based on size of buffer cache Relative size of a segment to the buffer cache Calculation has changed over various versions Direct path reads required for smart scans

What Size SGA? For pure DW, smaller is better think 8GB You ll get more smart scans, which use PGA memory OLTP is trickier OLTP queries typically need larger SGA Start small - you ll never get to shrink your SGA later

Hugepages

Hugepages Allocates memory in bigger chunks Default page size 4KB Huge page size 2MB Controlled via vm.nr_hugepages kernel parameter [root@enkx3db01 ~]# grep hugepages /etc/sysctl.conf vm.nr_hugepages=26014

Benefits of using Hugepages Less pages to manage = less resource consumption Huge pages cannot be swapped to disk Before Hugepages After Hugepages

Life Without Hugepages X2-2 Half Rack 96GB RAM per node [root@xxxxx ~]# cat /proc/meminfo MemTotal: 98848968 kb MemFree: 3093112 kb Buffers: 487884 kb.... PageTables: 28487608 kb is this bad??? VmallocChunk: 34359438787 kb HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 Hugepagesize: 2048 kb

After Enabling Hugepages X2-2 Half Rack 96GB RAM per node [root@xxxxx ~]# cat /proc/meminfo MemTotal: 98848968 kb MemFree: 25423728 kb Buffers: 360304 kb.... PageTables: 408268 kb happy users VmallocChunk: 34359442083 kb HugePages_Total: 30726 HugePages_Free: 10070 HugePages_Rsvd: 8018 Hugepagesize: 2048 kb

Hugepages in the Database Controlled with use_large_pages parameter TRUE start up with huge pages if available 11.2.0.3 can use a mix of huge/small pages FALSE ignore huge pages that are available ONLY instance starts if enough hugepages are available

Hugepages in the Database Excerpt from 11.2.0.4 alert log Starting ORACLE instance (normal) ********** Large Pages Information ********** Per process system memlock (soft) limit = 53 GB Total Shared Global Region in Large Pages = 24 GB (100%) Large Pages used by this instance: 12289 (24 GB) Large Pages unused system wide = 1425 (2850 MB) Large Pages configured system wide = 13714 (27 GB) Large Page size = 2048 KB **********************************************

Caveats to Hugepages Only for SGA PGA cannot utilize hugepages Incompatible with AMM (memory_target) Compatible with ASMM (sga_target)

Allocating Hugepages Allocate enough pages to account for all SGA memory See MOS note #401749.1 for script Don t allocate everything to huge pages Over allocation leads to memory starvation, node evictions

Over Indexing (and under indexing)

Index Use on Exadata Index use is #1 smart scan killer Direct path reads required for smart scans Mark indexes invisible in a warehouse Global change at the database level

Index Use on Exadata (non-oltp) Look at long running queries with SQL monitoring report If it s using indexes, try running with FULL hint to force full table scans Try marking indexes invisible (in test)

Index Use on Exadata (OLTP) You ll still need many indexes in OLTP environment It can be a delicate balance Test, test, test before dropping indexes Start without them, add as necessary

Parallelization

Parallelization Parallel will (typically) force direct path reads Direct path reads are required for smart scans Beware allocating too many slaves Remember that smart scans already parallelize on I/O

Parallel Slave Allocation With no other activity, the more PX is better

Parallel Slave Allocation More PX slaves = a busier system

Auto Degree of Parallelism Oracle calculates DOP on the fly Beware of Auto DOP Test extensively before implementing It s getting better (big changes in 11.2.0.4) Requires DBMS.RESOURCE_MANAGER.CALIBRATE_IO Set PARALLEL_DEGREE_POLICY = AUTO

Controlling Parallelism Use Database Resource Manager (DBRM) Don t set DEFAULT for segment PX degree Try lower PX degree to start storage is already parallel Slowly ratchet up DOP operations powers of 2

Disk Selection

Exadata Storage Concepts Exadata is all about smart storage Offload your workload via full scans Single block reads come from flash

Exadata Disk Types 2 varieties of disks High performance V2 X3: 600GB 15,000RPM X4: 1.2TB 10,000RPM High capacity 2TB 4TB 7,200RPM

Disk Read Performance Comparison X3-2 High Capacity drive [20:4] random read throughput: 127.24 MBPS, and 200 IOPS drive [20:5] random read throughput: 126.07 MBPS, and 200 IOPS X3-2 High Performance drive [20:4] random read throughput: 162.67 MBPS, and 407 IOPS drive [20:5] random read throughput: 162.66 MBPS, and 422 IOPS X4-2 High Capacity drive [20:4] random read throughput: 143.54 MBPS, and 203 IOPS drive [20:5] random read throughput: 143.76 MBPS, and 203 IOPS X4-2 High Performance drive [20:4] random read throughput: 155.27 MBPS, and 323 IOPS drive [20:5] random read throughput: 155.99 MBPS, and 329 IOPS results pulled from cellcli e calibrate force

Flash Read Performance Comparison X3-2 Flash Read Test [FLASH_2_2] random read throughput: 543.70 MBPS, and 37332 IOPS [FLASH_2_3] random read throughput: 543.33 MBPS, and 37303 IOPS X4-2 Flash Read Test [FLASH_2_2] random read throughput: 539.26 MBPS, and 45683 IOPS [FLASH_2_3] random read throughput: 539.42 MBPS, and 45184 IOPS X4-2 High Capacity drive [20:4] random read throughput: 143.54 MBPS, and 203 IOPS drive [20:5] random read throughput: 143.76 MBPS, and 203 IOPS X4-2 High Performance drive [20:4] random read throughput: 155.27 MBPS, and 323 IOPS drive [20:5] random read throughput: 155.99 MBPS, and 329 IOPS results pulled from cellcli e calibrate force

Which Disk Type? High performance for latency-sensitive applications Heavy OLTP workloads Write back flash cache changes this significantly For everything else, high capacity Flash cache masks slower disks 3.2TB of flash per cell on X4 (before compression)

Patching

Exadata Patching If you don t patch, you WILL hit bugs Patching isn t something to be scared of any more GI/RDBMS patch (bundle patch) OS/Firmware patch (Storage server patch) See MOS note #888828.1 for details

Exadata Patching If you can apply a RAC PSU, you can apply an Exadata bundle patch Storage server patches are infrequent Patches include bug fixes, new features

ASR

Automatic Service Request Free with your support contract No privacy issues one way communication Requires external VM or host running Solaris or OEL Speeds up service request resolution time

Automatic Service Request ASR creates service requests when hardware breaks

exachk

exachk MOS note #1070954.1 Checks cluster and database against Oracle best practices at the time of release Requires root passwords for initial configuration Generates HTML reports with scorecard

exachk Recommendations Configure exachk to run in daemon mode Prevents requirement for root passwords Focus on the failures, not the score

Other Common Issues Not using OEM 12c Role separated installations Larger RECO vs DATA diskgroup split Trying to make Exadata like your old platform

Questions andy.colvin@enkitec.com @acolvin blog.oracle-ninja.com