What is so smart about it?

Similar documents
Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture

2009 Oracle Corporation 1

Inge Os Sales Consulting Manager Oracle Norway

How To Build An Exadata Database Machine X2-8 Full Rack For A Large Database Server

<Insert Picture Here> Oracle Exadata Database Machine Overview

SUN ORACLE EXADATA STORAGE SERVER

Oracle Exadata Database Machine for SAP Systems - Innovation Provided by SAP and Oracle for Joint Customers

An Oracle White Paper June A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

Exadata and Database Machine Administration Seminar

ORACLE EXADATA STORAGE SERVER X2-2

SUN ORACLE DATABASE MACHINE

An Oracle White Paper October A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

ORACLE EXADATA STORAGE SERVER X4-2

An Oracle White Paper December A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

ORACLE EXADATA DATABASE MACHINE X2-8

Exadata Database Machine Administration Workshop NEW

MACHINE X2-8 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

Exadata Database Machine

An Oracle White Paper September A Technical Overview of the Sun Oracle Exadata Storage Server and Database Machine

An Oracle White Paper April A Technical Overview of the Sun Oracle Database Machine and Exadata Storage Server

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

SUN ORACLE DATABASE MACHINE

Exadata Performance, Yes You Still Need to Tune Kathy Gibbs Senior Database Administrator, CONFIO Software

MACHINE X2-22 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

Overview: X5 Generation Database Machines

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

How To Use Exadata

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

How Oracle Exadata Delivers Extreme Performance

Expert Oracle Exadata

Applying traditional DBA skills to Oracle Exadata. Marc Fielding March 2013

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

HP Oracle Database Platform / Exadata Appliance Extreme Data Warehousing

Oracle Database In-Memory The Next Big Thing

Exadata for Oracle DBAs. Longtime Oracle DBA

<Insert Picture Here> Best Practices for Extreme Performance with Data Warehousing on Oracle Database

ORACLE DATA SHEET RELATED PRODUCTS AND SERVICES RELATED PRODUCTS

An Oracle White Paper May Exadata Smart Flash Cache and the Oracle Exadata Database Machine

Novinky v Oracle Exadata Database Machine

SMB Direct for SQL Server and Private Cloud

ORACLE EXADATA STORAGE SERVER X3-2

MACHINE X3-8 ORACLE DATA SHEET ORACLE EXADATA DATABASE FEATURES AND FACTS FEATURES

Capacity Management for Oracle Database Machine Exadata v2

Oracle Big Data, In-memory, and Exadata - One Database Engine to Rule Them All Dr.-Ing. Holger Friedrich

Expert Oracle Exadata

Safe Harbor Statement

An Oracle White Paper December Exadata Smart Flash Cache Features and the Oracle Exadata Database Machine

Oracle Aware Flash: Maximizing Performance and Availability for your Database

Automatic Data Optimization

Boost Database Performance with the Cisco UCS Storage Accelerator

ORACLE SUPERCLUSTER T5-8

ORACLE EXADATA DATABASE MACHINE X4-2

Main Memory Data Warehouses

Optimize Oracle Business Intelligence Analytics with Oracle 12c In-Memory Database Option

Exadata: from Beginner to Advanced in 3 Hours. Arup Nanda Longtime Oracle DBA (and now DMA)

Oracle Database 12c Built for Data Warehousing O R A C L E W H I T E P A P E R F E B R U A R Y

Is there any alternative to Exadata X5? March 2015

Enkitec Exadata Storage Layout

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Oracle Database Cloud Service Rick Greenwald, Director, Product Management, Database Cloud

ORACLE EXADATA DATABASE MACHINE X3-2

An Oracle White Paper November Hybrid Columnar Compression (HCC) on Exadata

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

Oracle Exadata Database Machine Aké jednoznačné výhody prináša pre finančné inštitúcie

Query Acceleration of Oracle Database 12c In-Memory using Software on Chip Technology with Fujitsu M10 SPARC Servers

Copyright 2012, Oracle and/or its affiliates. All rights reserved. Oracle Internal Only

Oracle Database Cloud Exadata Service

Oracle Big Data SQL Technical Update

HP ProLiant DL580 Gen8 and HP LE PCIe Workload WHITE PAPER Accelerator 90TB Microsoft SQL Server Data Warehouse Fast Track Reference Architecture

Maximum Availability Architecture

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

Cost/Benefit Case for IBM PureData System for Analytics

SAP HANA - Main Memory Technology: A Challenge for Development of Business Applications. Jürgen Primsch, SAP AG July 2011

Virtual Compute Appliance Frequently Asked Questions

ORACLE EXADATA DATABASE MACHINE X5-2

ORACLE BUSINESS INTELLIGENCE, ORACLE DATABASE, AND EXADATA INTEGRATION

Removing Performance Bottlenecks in Databases with Red Hat Enterprise Linux and Violin Memory Flash Storage Arrays. Red Hat Performance Engineering

Performance Baseline of Hitachi Data Systems HUS VM All Flash Array for Oracle

How to Migrate your Database to Oracle Exadata. Noam Cohen, Oracle DB Consultant, E&M Computing

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

Cost/Benefit Case for IBM PureData System for Analytics Comparing Costs and Time to Value with Oracle Exadata Database Machine

OLTP Meets Bigdata, Challenges, Options, and Future Saibabu Devabhaktuni

Microsoft s SQL Server Parallel Data Warehouse Provides High Performance and Great Value

Flash Performance for Oracle RAC with PCIe Shared Storage A Revolutionary Oracle RAC Architecture

The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays

Oracle - Engineered for Innovation. Thomas Kyte

An Oracle White Paper October Oracle Database Appliance

Oracle Database Scalability in VMware ESX VMware ESX 3.5

Tuning Exadata. But Why?

SUN HARDWARE FROM ORACLE: PRICING FOR EDUCATION

ORACLE EXALYTICS IN-MEMORY MACHINE X3-4

Infrastructure Matters: POWER8 vs. Xeon x86

An Oracle White Paper June High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database

Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array

An Oracle White Paper September Oracle Exadata Database Machine - Backup & Recovery Sizing: Tape Backups

An Oracle White Paper December Consolidating and Virtualizing Datacenter Networks with Oracle s Network Fabric

Integration and the Evolving IT Datacenter.

An Oracle White Paper August Oracle WebCenter Content 11gR1 Performance Testing Results

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

Extreme Data Warehouse Performance with Oracle Exadata

Transcription:

Exadata Smart Scan What is so smart about it? Uwe Hesse Senior Principal Instructor Oracle Certified Master http://uhesse.com Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Exadata Quarter Rack Hardware Viewpoint Quarter Rack 4-2 Half Rack Full Rack Multiple Racks

X2-2 Database Servers (Sun Fire X4170 M2) 2 Six-Core Intel Xeon X5675 Processors Up to 144 GB DRAM (16 x 8GB) Dual-port 10GbE PCIe card Dual-port InfiniBand QDR (40 Gb/s) HCA 4 x 2.5 300GB Disk Drives Disk Controller HBA with 512 MB BBWC Redundant Power Supplies, Fans ILOM Installed Software: Oracle Database 11.2 Oracle Linux or Solaris 4-3

Exadata Storage Server Hardware (Sun Fire X4270 M2) 2 Six-Core Intel Xeon L5640 Processors 24 GB DRAM (6 x 4GB) 12 x 3.5 Disk Drives (600GB SAS or 2TB SAS) 4 x 96GB Flash PCIe Cards Dual-port InfiniBand QDR (40Gb/s) HCA Disk Controller SAS2 HBA with 512MB BBWC Redundant Power Supplies, Fans ILOM Installed Software: Oracle Exadata Storage Server Software Oracle Linux 4-4

InfiniBand Network Unified InfiniBand Network Storage Network RAC Interconnect High Performance, Low Latency Network 40 Gb/s bandwidth Zero-copy Zero-loss Datagram Protocol (ZDP RDSv3) SAN-like Efficiency (Zero copy, buffer reservation) 4-5

Exadata Quarter Rack Database Viewpoint 4-6

Database Viewpoint is unchanged Competitor: Exadata is still Oracle! Right that is actually a good thing because: No change is needed for the Database Design No change is needed for the Application Code Migration to Exadata is relatively easy therefore DBA knowledge remains valid 4-7

Exadata in the Marketplace Rapid adoption in all geographies and industries 4-8

Classic Database I/O and SQL Processing Model SELECT customer_id 1 6 FROM orders WHERE order_amount>20000; Rows returned Extents identified 2 5 SQL processing: 2 MB returned I/O issued 3 4 I/O executed: 10 GB returned 4-9

Exadata Smart Scan Idea The fastest way of doing something is not to do it Do not deliver the whole Data Volume up to the DB Layer! Instead, filter resp. project already on the Storage Layer! We want DB Intelligence built into the Storage Layer... 4-10

Remove the Storage Network Bottleneck 4-11

Exadata Smart Scan Model SELECT customer_id 1 6 FROM orders WHERE order_amount>20000; Rows returned idb command constructed and sent to Exadata cells 2 5 Consolidated result set built from all Exadata cells SQL processing in Exadata cells 3 4 2 MB returned to server 4-12

Exadata Smart Scan Predicate filtering: Only the requested rows are returned to the database server rather than all the rows in a table. Column filtering: Only the requested columns are returned to the database server rather than all the columns in a table. For example: SQL> SELECT col1,col2 FROM t WHERE condition; http://uhesse.com/2011/01/19/exadata-part-i-smart-scan/ 4-13

Smart Scan Prerequisites Smart Scan is only possible for Full Table Scans or Full Index Scans. Smart Scan can only be used for Direct-Path Reads: Direct-path reads are automatically used for parallel queries. Direct-path reads may also be used for serial queries. 4-14

Exadata Smart Scan Join processing: Star join processing is performed within Exadata Storage Server Scans on TDE encrypted data Scans on HCC compressed data 4-15

Exadata Hybrid Columnar Compression: Overview Warehouse Compression Optimized for Speed 10x average storage savings 10x scan I/O reduction Optimized for query performance Archival Compression Optimized for Space 15x average storage savings Up to 50x on some data Greater access overhead For cold or historical data Reduced Warehouse Size Better Performance Reclaim Disks Keep Data Online Can mix compression types by partition for Information Life Cycle Management 4-16

Exadata Hybrid Columnar Compression Data Organization Compression Unit Block Header CU Header C1 C2 Block Header C2 C3 C4 C5 Block Header C5 C6 Block Header C7 C8 A compression unit is a logical structure spanning multiple database blocks. Each row is self-contained within a compression unit. Data is organized by column during data load. Each column is compressed separately. Smart Scan is supported. http://uhesse.com/2011/01/21/exadata-part-iii-compression/ 4-17

Exadata Storage Index Idea The fastest way of doing something is not to do it Even faster than offload scanning to the Storage Layer: Exclude areas from scanning when we know the requested Data can t be there http://uhesse.com/2011/01/20/exadata-part-ii-storage-index/ 4-18

Storage Index with Partitions: Example ORDER# ORDER_DATE SHIP_DATE ITEM (Partition Key) 1 2007 2007 2 2008 2008 3 2009 2009 Queries on SHIP_DATE do not benefit from ORDER_DATE partitioning: However, SHIP_DATE is highly correlated with ORDER_DATE. Storage index enhances performance for queries on SHIP_DATE: Takes advantage of the ordering created by partitioning 4-19

Smart Scan related Statistics & Wait-Events Important Statistics: cell physical IO interconnect bytes cell physical IO interconnect bytes returned by smart scan cell physical IO bytes saved by storage index Important Wait-Events: cell smart table scan cell smart index scan cell single block physical read cell multiblock physical read http://uhesse.com/2011/07/06/important-statistics-wait-events-on-exadata/ 4-20

Benefits Multiply Multiple terabytes of user data normally require multiple terabytes of I/O. Storage index skips worthless I/O. Less with Exadata Hybrid Column Compression Smart Scan filters the remaining Candidate Data and reduces the Data Volume sent to the Database Layer. Even less with partition pruning Results in real-time on Database Machine 4-21

The smartest thing about Smart Scan If you ask me: Smartest thing is that it works transparently together with the same Oracle Database Code as used on Non-Exadata platforms Transparently except that it is 10 times faster Exadata is still Oracle! Love it :-) 4-22