Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture

Similar documents
How To Build An Exadata Database Machine X2-8 Full Rack For A Large Database Server

<Insert Picture Here> Oracle Exadata Database Machine Overview

2009 Oracle Corporation 1

SUN ORACLE DATABASE MACHINE

How To Use Exadata

An Oracle White Paper June A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

ORACLE EXADATA DATABASE MACHINE X2-8

Exadata Database Machine

An Oracle White Paper December A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

MACHINE X2-22 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

SUN ORACLE EXADATA STORAGE SERVER

Inge Os Sales Consulting Manager Oracle Norway

Oracle Exadata Database Machine for SAP Systems - Innovation Provided by SAP and Oracle for Joint Customers

An Oracle White Paper October A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

SUN ORACLE DATABASE MACHINE

Overview: X5 Generation Database Machines

MACHINE X2-8 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

ORACLE EXADATA STORAGE SERVER X4-2

ORACLE EXADATA STORAGE SERVER X2-2

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

ORACLE DATA SHEET RELATED PRODUCTS AND SERVICES RELATED PRODUCTS

An Oracle White Paper April A Technical Overview of the Sun Oracle Database Machine and Exadata Storage Server

MACHINE X3-8 ORACLE DATA SHEET ORACLE EXADATA DATABASE FEATURES AND FACTS FEATURES

Capacity Management for Oracle Database Machine Exadata v2

Exadata Performance, Yes You Still Need to Tune Kathy Gibbs Senior Database Administrator, CONFIO Software

An Oracle White Paper May Exadata Smart Flash Cache and the Oracle Exadata Database Machine

An Oracle White Paper September A Technical Overview of the Sun Oracle Exadata Storage Server and Database Machine

ORACLE EXADATA DATABASE MACHINE X4-2

Main Memory Data Warehouses

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

ORACLE EXADATA STORAGE SERVER X3-2

Oracle Database In-Memory The Next Big Thing

ORACLE EXADATA DATABASE MACHINE X5-2

SMB Direct for SQL Server and Private Cloud

ORACLE EXADATA DATABASE MACHINE X3-2

<Insert Picture Here> Oracle 11g R2 The best Database for SAP Customers Relationship and Technology Update

Applying traditional DBA skills to Oracle Exadata. Marc Fielding March 2013

HP Oracle Database Platform / Exadata Appliance Extreme Data Warehousing

ORACLE SUPERCLUSTER T5-8

Oracle Database Cloud Exadata Service

Exadata Database Machine Administration Workshop NEW

An Oracle White Paper December Exadata Smart Flash Cache Features and the Oracle Exadata Database Machine

How Oracle Exadata Delivers Extreme Performance

Novinky v Oracle Exadata Database Machine

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

Maximum Availability Architecture

Oracle Database Cloud Service Rick Greenwald, Director, Product Management, Database Cloud

<Insert Picture Here> Best Practices for Extreme Performance with Data Warehousing on Oracle Database

Oracle Aware Flash: Maximizing Performance and Availability for your Database

Exadata and Database Machine Administration Seminar

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

SUN HARDWARE FROM ORACLE: PRICING FOR EDUCATION

An Oracle White Paper September Oracle Exadata Database Machine - Backup & Recovery Sizing: Tape Backups

SUN HARDWARE FROM ORACLE: PRICING FOR EDUCATION

Oracle Database Cloud Service Lösungen und Strategien. Paul Wehner, Senior Director Sales Consulting, Oracle Frankfurt

Removing Performance Bottlenecks in Databases with Red Hat Enterprise Linux and Violin Memory Flash Storage Arrays. Red Hat Performance Engineering

Boost Database Performance with the Cisco UCS Storage Accelerator

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

Data Warehousing. Jens Teubner, TU Dortmund Winter 2015/16. Jens Teubner Data Warehousing Winter 2015/16 1

ORACLE EXALYTICS IN-MEMORY MACHINE X3-4

Automatic Data Optimization

An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise

Exadata for Oracle DBAs. Longtime Oracle DBA

TUT NoSQL Seminar (Oracle) Big Data

Safe Harbor Statement

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

Introduction to Database as a Service

ORACLE BIG DATA APPLIANCE X3-2

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>

Dell Microsoft Business Intelligence and Data Warehousing Reference Configuration Performance Results Phase III

Optimizing Storage for Better TCO in Oracle Environments. Part 1: Management INFOSTOR. Executive Brief

Oracle Exadata Database Machine Aké jednoznačné výhody prináša pre finančné inštitúcie

Maximum Availability Architecture

Flash Performance for Oracle RAC with PCIe Shared Storage A Revolutionary Oracle RAC Architecture

THE SUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

HPC Update: Engagement Model

Oracle Database Deployments with EMC CLARiiON AX4 Storage Systems

Oracle Database Reliability, Performance and scalability on Intel Xeon platforms Mitch Shults, Intel Corporation October 2011

An Oracle White Paper January Improving SAS Customer Intelligence Solution Performance with Oracle SPARC SuperCluster

Oracle

Application-Tier In-Memory Analytics Best Practices and Use Cases

EMC XtremSF: Delivering Next Generation Performance for Oracle Database

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

Oracle Big Data SQL Technical Update

DATA WAREHOuSIng eb Data Warehouse 6700

Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array

EMC XtremSF: Delivering Next Generation Storage Performance for SQL Server

An Oracle White Paper June High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant

<Insert Picture Here>

ARCHITECTING COST-EFFECTIVE, SCALABLE ORACLE DATA WAREHOUSES

Transcription:

<Insert Picture Here> Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture Ron Weiss, Exadata Product Management

Exadata Database Machine Best Platform to Run the Oracle Database Best Machine for Data Warehousing Best Machine for OLTP Best Machine for Database Consolidation 2 2

Exadata Hardware Architecture Scaleable Grid of industry standard servers for compute and storage Eliminates long-standing tradeoff between Scalability, Availability, Cost Database Grid 8 Dual-processor x64 database servers or 2 Eight-processor x64 database servers InfiniBand ib Network Redundant 40Gb/s switches Unified server & storage network Intelligent Storage Grid 14 High-performance low-cost storage servers 100 TB High Performance disk or 336 TB High Capacity disk 5.3 TB PCI Flash Data mirrored across storage servers 3 3

Exadata Storage Server Hardware (Sun Fire X4270 M2) 12 x 3.5 Disk Drives (600GB SAS or 2TB SAS) Disk Controller SAS2 HBA with 512M battery backed cache 2 six-core Intel Xeon L5640 Processors 24 GB DRAM (6 x 4GB) Dual-port InfiniBand QDR (40Gb/s) HCA 4 x 96GB Flash PCIe Cards Dual-redundant, hot-swappable power supplies ILOM Installed Software: Oracle Exadata Storage Server Software Oracle Linux 4 4

Flash in the Exadata Storage Server Flash vs Disk tradeoff 10X-100X better performance but 10X more expensive Exadata goal is get performance of Flash but at the price point of disk 4 x 96GB Sun F20 Flash Accelerator PCIe Cards in each storage server 384 GB of Flash per Exadata Storage Server Choice of PCIe form factor over SSD for performance reasons No disk controller bottleneck 5 5

InfiniBand Network Unified InfiniBand Network Storage Network RAC Interconnect External Connectivity (optional) High Performance, Low Latency Network 80 Gb/s bandwidth per link (40 Gb/s each direction) SAN-like efficiency (Zero copy, buffer reservation) Simple manageability like IP network Protocols Zero-copy Zero-loss Datagram Protocol (ZDP RDSv3) Linux Open Source, Low CPU overhead (Transfer 3 GB/s with 2% CPU usage) Internet Protocol over InfiniBand (IPoIB) for external connectivity Looks like normal Ethernet to host software (tcp/ip, udp, http, ssh, ) 6 6

InfiniBand Network Uses Sun Datacenter 36-port Managed QDR (40Gb/s) InfiniBand switches Runs subnet manager and automatically discovers network topology Only one subnet manager active at a time 2 leaf switches to connect individual server IB ports 1 spine switch in Full Rack and Half Rack for scaling out to additional Racks Database Server and Exadata Servers Each server has Dual-port QDR (40Gb/s) IB HCA Active-Passive Bonding Assign Single IP address Performance is limited by PCIe bus, so active-active not needed Connect one port from the HCA to one leaf switch and the other port to the second leaf switch for redundancy 7 7

Database Machine Models X2-2 and X2-8 - Two types of Database Machine models Difference is the number and size of the database servers X2-2 uses smaller two-socket X4170 M2 servers 6 cores per socket X2-8 uses larger eight-socket X4800 server 8 cores per socket 8 8

X2-2 Database Servers (Sun Fire X4170 M2) 4 x 2.5 300GB Disk Drives Disk Controller HBA with 512M battery backed cache 2 six-core Intel Xeon X5670 Processors 96 GB DRAM (12 x 8GB) Dual-port 10 GbE PCIe card Dual-port InfiniBand QDR (40Gb/s) HCA Dual-redundant, hot-swappable power supplies ILOM 4 x 1GbE Interfaces Installed Software: Oracle Linux / Solaris (future) Oracle Database 11.2 Software 9 9

X2-8 Database Server (Sun Fire X4800) 8 x 2.5 300GB Disk Drives 8 x 10 GbE network ports 1 TB DRAM 8 eight-core Intel Xeon X7560 Processors 4 Dual-port InfiniBand QDR (40Gb/s) Express Modules Installed Software: Four redundant, hotswappable power supplies ILOM 8 x 1 GbE network ports p Oracle Linux / Solaris (future) Oracle Database 11 11.2 2 Software 10 10

Complete Family Of Database Machines For OLTP, Data Warehousing & Consolidated Workloads Oracle Exadata X2-2 Oracle Exadata X2-8 Quarter Rack Half Rack Full Rack Full Rack 11 11

Exadata Database Machine X2-8 Full Rack Extreme Performance for Consolidation, Large OLTP and DW 2 x 64 Eight-processor Database servers (Sun Fire 4800) High Core, High Memory Database Servers 128 CPU cores (64 per server) 2 TB (1 TB per server) 10 GigE connectivity to Data Center 16 x 10GbE ports (8 per server) 14 Exadata Storage Servers X2-2 All with High Performance 600GB SAS disks OR All with High Capacity 2 TB SAS disks 3 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Redundant Power Distributions Units (PDUs) Add more racks for additional scalability 12 12

Exadata Database Machine X2-2 Full Rack Pre-Configured for Extreme Performance 8 x 64 Dual-procesor Database Servers (Sun Fire X4170 M2) 96 cores (12 per server) 768 GB memory (96GB per server) 10 GigE connectivity to Data Center 16 x 10GbE ports (2 per server) 14 Exadata Storage Servers X2-2 All with High Performance 600GB SAS disks OR All with High Capacity 2 TB SAS disks 3 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Add more racks for additional scalability 13 13

Exadata Database Machine X2-2 Half Rack Pre-Configured for Extreme Performance 4 x 64 Dual-procesor Database Servers (Sun Fire X4170 M2) 48 cores (12 per server) 384 GB memory (96GB per server) 10 GigE connectivity to Data Center 8 x 10GbE ports (2 per server) 7 Exadata Storage Servers X2-2 All with High Performance 600GB SAS disks OR All with High Capacity 2 TB SAS disks 3 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Can Upgrade to a Full Rack 14 14

Exadata Database Machine X2-2 Quarter Rack Pre-Configured for Extreme Performance 2 x 64 Dual-procesor Database Servers (Sun Fire X4170 M2) 24 cores (12 per server) 192 GB memory (96GB per server) 10 GigE connectivity to Data Center 4 x 10GbE ports (2 per server) 3 Exadata Storage Servers X2-2 2 All with High Performance 600GB SAS disks OR All with High Capacity 2 TB SAS disks 2 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Can Upgrade to an Half Rack 15 15

Scale to 8 Racks by Just Adding Cables Full Bandwidth and Redundancyy Half and Full racks can be connected Eight X2-2 Full Racks 768 CPU cores and 6.1 TB memory for database p processing g 1,344 CPU cores for storage processing 42.4 TB Flash Storage 800 TB or 2,688 TB Raw Disk Storage Eight X2-8 Racks 1,024 CPU cores and 16 TB of memory for o da database abase processing p ocess g 1,344 CPU cores for storage processing 42.4 TB Flash Storage 800 TB or 2,688 TB Raw Disk Storage 16 16

X2-2 and X2-8 Full Rack X2-8 Full Rack X2-2 Full Rack Database Servers 2 8 Cores (Total) 128 (2.26 GHz) 96 (2.93 GHz) Memory (Total) 2048 GB 768 GB 1 GbE Ports (Total) 16 32 10 GbE Ports(Total) 16 16 InfiniBand Switches 3 Exadata Storage Servers 14 Flash (Total) Raw Storage (Total) 53TB 5.3 100 TB or 336 TB Raw Disk Data Bandwidth Raw Flash Data Bandwidth 25 GB/s* 50 GB/s Flash IOPS (8k Reads) 1,000,000 * Using High Performance 15K RPM disks 17 17

Database Server Operating System Choices Two Operating System Choices on the database servers Oracle Linux Solaris 11 Express (x86) Coming Soon Customers choose their preferred database server OS at installation time No pricing difference No performance difference Choice driven by familiarity and expertise with the OS 18

Keys to Speed and Cost Advantage Exadata Intelligent Storage Grid Exadata Hybrid Columnar Compression Exadata Smart Flash Cache 19

Exadata Intelligent Storage Grid Most Scalable Data Processing Data Intensive processing runs in Exadata Storage Grid Filter rows and columns as data streams from disks (112 Intel Cores) Example: How much product X sold last quarter Exadata Storage Reads 10TB from disk Exadata Storage Filters rows by Product & Date Sends 100GB of matching data to DB Servers Scale-out storage parallelizes execution and removes bottlenecks 20

Exadata Intelligent Storage Exadata Intelligent Storage Grid Exadata storage servers also run more complex operations in storage Join filtering Incremental backup filtering I/O prioritization Storage Indexing Database level security Offloaded scans on encrypted data Data Mining Model Scoring Smart File Creation 10x reduction in data sent to DB servers is common 21

Exadata Hybrid Columnar Compression Highest Capacity, Lowest Cost Data is organized and compressed by column Dramatically better compression Query Faster and Simpler Backup, DR, Caching, Reorg, Clone Speed Optimized Query Mode for Data Warehousing 10X compression typical Runs faster because of Exadata offload! Space Optimized Archival Mode for infrequently accessed data 15X to 50X compression typical Benefits Multiply py 22

Exadata Smart Flash Cache Extreme Performance OLTP Exadata has 5TBof flash 56 Flash PCI cards avoid disk controller bottlenecks Intelligently manages flash Smart Flash Cache holds hot data Gives speed of flash, cost of disk Exadata flash cache achieves: Over 1 million IO/sec from SQL (8K) Sub-millisecond response times 50 GB/sec query throughput 23

Smart Flash Cache Understands different types of I/Os from database Skips caching I/Os to mirror copies Skips caching backups Skips caching data pump I/O Skips caching tablespace formatting Resistant to table scans Control File Reads and Writes are cached File header reads and writes are cached Data Blocks and Index blocks are cached 24 24

Smart Flash Cache Keep Directive DBA can enforce that an object is kept in flash cache ALTER TABLE calldetail STORAGE (CELL_FLASH_CACHE KEEP) Can be set like other storage clause values At table level, partition level, during creation time etc. Table scans on objects marked with cell_flash_cache keep run through the flash cache Disk bandwidth full rack 25GB/s Flash bandwidth full rack 50GB/s 25 25

Exadata Storage Index Transparent I/O Elimination with No Overhead A Table B C D 1 3 5 Index Min B = 1 Max B =5 Exadata Storage Indexes maintain summary information about table data in memory Store MIN and MAX values of columns Typically one index entry for every MB of disk Eliminates disk I/Os if MIN and MAX can never match where clause of a query 5 8 3 Min B = 3 Max B =8 Completely automatic and transparent Select * from Table where B<2 - Only first set of rows can match 26

Most Secure Database Machine Moves decryption from software to hardware Over 5x faster Leverages AES-NI compliant hardware Near zero overhead for fully encrypted database Queries decrypt data at hundreds of Gigabytes/second DB2, Teradata and Netezza do not have database managed encryption Must write into every application module 27

Exadata I/O Resource Management Mixed Workloads and Multi-Database Environment Ensure different databases are allocated the correct relative amount of I/O bandwidth Database A Database B Database A: 33% I/O resources Database B: 67% I/O resources Ensure different users and tasks within a database are allocated the correct relative amount of I/O bandwidth Database A: Reporting: 60% of I/O resources ETL: 40% of I/O resources Database B: Interactive: 30% of I/O resources Batch: 70% of I/O resources Exadata Cell InfiniBand Switch/Network Exadata Cell Exadata Cell 28

Best Machine for Database Consolidation ERP CRM Warehouse Data Mart HR Exadata serves as farm/cloud for databases Large memory enables many databases to be consolidated Extreme performance for complex workloads that mix OLTP, DW, batch, reporting I/O and CPU resource management isolates workloads 29

Best and Fastest HA StorageTek Tape Active Data Guard Full backup 20 TB/hour disk-to-disk in Exadata 8 TB/hour Exadata to tape backup Tape drive limited Incremental backup is 10x faster GoldenGate Replication Real-Time Active Replica Data Guard keeps up with 5TB/hour compressed loads 30

Exadata Summary Best for OLTP Smart Flash Cache 1 Million I/Os per Second Complete Ready-to-Run Run System Best for Warehousing Intelligent Scale-Out storage 10x faster queries 10x Data Compression Best for Consolidation Terabytes of Memory Mix OLTP, DW, batch, reporting in single machine Full database encryption with near zero overhead Runs all Oracle Applications unchanged 31

32