<Insert Picture Here> Extreme Performance

Similar documents
2009 Oracle Corporation 1

Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture

An Oracle White Paper April A Technical Overview of the Sun Oracle Database Machine and Exadata Storage Server

An Oracle White Paper October A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

An Oracle White Paper September A Technical Overview of the Sun Oracle Exadata Storage Server and Database Machine

HP Oracle Database Platform / Exadata Appliance Extreme Data Warehousing

SUN ORACLE DATABASE MACHINE

An Oracle White Paper June A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

SUN ORACLE DATABASE MACHINE

How To Build An Exadata Database Machine X2-8 Full Rack For A Large Database Server

An Oracle White Paper December A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server

<Insert Picture Here> Oracle Exadata Database Machine Overview

Oracle Exadata Database Machine for SAP Systems - Innovation Provided by SAP and Oracle for Joint Customers

An Oracle White Paper May Exadata Smart Flash Cache and the Oracle Exadata Database Machine

SUN ORACLE EXADATA STORAGE SERVER

How To Use Exadata

Inge Os Sales Consulting Manager Oracle Norway

Overview: X5 Generation Database Machines

Applying traditional DBA skills to Oracle Exadata. Marc Fielding March 2013

Capacity Management for Oracle Database Machine Exadata v2

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Database In-Memory The Next Big Thing

ORACLE EXADATA DATABASE MACHINE X2-8

An Oracle White Paper December Exadata Smart Flash Cache Features and the Oracle Exadata Database Machine

ORACLE EXADATA STORAGE SERVER X4-2

ORACLE EXADATA STORAGE SERVER X2-2

Exadata Database Machine Administration Workshop NEW

VTrak SATA RAID Storage System

Maximum Availability Architecture

Exadata for Oracle DBAs. Longtime Oracle DBA

Exadata Performance, Yes You Still Need to Tune Kathy Gibbs Senior Database Administrator, CONFIO Software

Boost Database Performance with the Cisco UCS Storage Accelerator

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

An Oracle White Paper September Oracle Exadata Database Machine - Backup & Recovery Sizing: Tape Backups

High Availability Databases based on Oracle 10g RAC on Linux

Exadata Database Machine

<Insert Picture Here>

Oracle Database Deployments with EMC CLARiiON AX4 Storage Systems

MACHINE X2-22 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

Exadata and Database Machine Administration Seminar

Expert Oracle Exadata

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

Optimizing Storage for Better TCO in Oracle Environments. Part 1: Management INFOSTOR. Executive Brief

How To Perform A Database Server On A Microsoft Server On An 8080 Gb/Snet 2.5 (Microsoft) Or 8080 (Microsnet) Or 880 Gbee (Microbio) On A Flash Disk

ORACLE DATABASE HIGH AVAILABILITY STRATEGY, ARCHITECTURE AND SOLUTIONS

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

HP ProLiant DL580 Gen8 and HP LE PCIe Workload WHITE PAPER Accelerator 90TB Microsoft SQL Server Data Warehouse Fast Track Reference Architecture

<Insert Picture Here> Best Practices for Extreme Performance with Data Warehousing on Oracle Database

ORACLE DATABASE 10G ENTERPRISE EDITION

Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

MACHINE X2-8 ORACLE EXADATA DATABASE ORACLE DATA SHEET FEATURES AND FACTS FEATURES

ORACLE DATA SHEET RELATED PRODUCTS AND SERVICES RELATED PRODUCTS

ORACLE BUSINESS INTELLIGENCE, ORACLE DATABASE, AND EXADATA INTEGRATION

ORACLE EXADATA STORAGE SERVER X3-2

Enkitec Exadata Storage Layout

Performance Baseline of Hitachi Data Systems HUS VM All Flash Array for Oracle

Exadata: from Beginner to Advanced in 3 Hours. Arup Nanda Longtime Oracle DBA (and now DMA)

MACHINE X3-8 ORACLE DATA SHEET ORACLE EXADATA DATABASE FEATURES AND FACTS FEATURES

Oracle Maximum Availability Architecture Best Practices for Oracle Exadata (CON8392)

Oracle Aware Flash: Maximizing Performance and Availability for your Database

Oracle Database Cloud Exadata Service

Scalable NAS for Oracle: Gateway to the (NFS) future

IT CHANGE MANAGEMENT & THE ORACLE EXADATA DATABASE MACHINE

An Oracle White Paper June High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database

Overview of I/O Performance and RAID in an RDBMS Environment. By: Edward Whalen Performance Tuning Corporation

Dell Microsoft Business Intelligence and Data Warehousing Reference Configuration Performance Results Phase III

The Methodology Behind the Dell SQL Server Advisor Tool

SMB Direct for SQL Server and Private Cloud

Flash Performance for Oracle RAC with PCIe Shared Storage A Revolutionary Oracle RAC Architecture

Maximizing Backup and Restore Performance of Large Databases

SAN Conceptual and Design Basics

Removing Performance Bottlenecks in Databases with Red Hat Enterprise Linux and Violin Memory Flash Storage Arrays. Red Hat Performance Engineering

Deploying Microsoft SQL Server 2005 Business Intelligence and Data Warehousing Solutions on Dell PowerEdge Servers and Dell PowerVault Storage

An Oracle White Paper September Sun Oracle Database Machine. Extreme Performance for Data Warehousing

SAN TECHNICAL - DETAILS/ SPECIFICATIONS

Backup and Recovery Solutions for Exadata. Ľubomír Vaňo Principal Sales Consultant

Novinky v Oracle Exadata Database Machine

Certification: HP ATA Servers & Storage

Main Memory Data Warehouses

Ultimate Guide to Oracle Storage

Oracle Big Data SQL Technical Update

TekSouth Fights US Air Force Data Center Sprawl with iomemory

Oracle Exadata Database Machine Aké jednoznačné výhody prináša pre finančné inštitúcie

Maximum performance, minimal risk for data warehousing

HP Proliant BL460c G7

Microsoft SQL Server 2008 R2 Enterprise Edition and Microsoft SharePoint Server 2010

An Oracle White Paper November Hybrid Columnar Compression (HCC) on Exadata

REMOTE SITE RECOVERY OF ORACLE ENTERPRISE DATA WAREHOUSE USING EMC DATA DOMAIN

Backup and Recovery Solutions for Exadata. Cor Beumer Storage Sales Specialist Oracle Nederland

ORACLE EXADATA DATABASE MACHINE X3-2

SQL Server Business Intelligence on HP ProLiant DL785 Server

<Insert Picture Here> Oracle Database Directions Fred Louis Principal Sales Consultant Ohio Valley Region

Database Decisions: Performance, manageability and availability considerations in choosing a database

Comprehending the Tradeoffs between Deploying Oracle Database on RAID 5 and RAID 10 Storage Configurations. Database Solutions Engineering

<Insert Picture Here> Oracle Cloud Storage. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

Oracle Database 11g Comparison Chart

Oracle Database Scalability in VMware ESX VMware ESX 3.5

Cost-Effective Business Intelligence with Red Hat and Open Source

Transcription:

<Insert Picture Here> Extreme Performance

<Insert Picture Here> HP Oracle Exadata Product Overview

HP Oracle Exadata Storage Server Optimized Storage Product for the Oracle Database Extreme I/O and SQL Processing performance for data warehousing Combination of hardware and software Hardware by Software by 3

Exadata Benefits Extreme Performance 10X to 100X speedup for data warehousing Database Aware Storage Smart Scans Massively Parallel Architecture Dynamically Scalable Unlimited Linear Scaling of Data Bandwidth Transaction/Job level Quality of Service Mission Critical Availability and Protection Disaster recovery, backup, point-in-time recovery, data validation, encryption 4

The Performance Challenge Storage Data Bandwidth Bottleneck Current warehouse deployments often have bottlenecks limiting the movement of data from disks to servers Storage Array internal bottlenecks on processors and Fibre Channel Loops Limited Fibre Channel host bus adapters in servers Under configured and complex SANs Pipes between disks and servers are 10x to 100x too slow for data size 5

Solutions To Data Bandwidth Bottleneck Add more pipes Massively parallel architecture Make the pipes wider 5X faster than conventional storage Ship less data through the pipes Process data in storage 6

Exadata A New Architecture Breaks Data Bandwidth Bottleneck Exadata Ships Less Data Through Pipes Query processing is moved into storage to dramatically reduce data sent to servers while offloading server CPUs Exadata has More Pipes Modular storage cell building blocks organized into Massively Parallel Grid Bandwidth scales with capacity Exadata has Bigger Pipes InfiniBand interconnect transfers data 5x faster than Fibre Channel Exadata Moves a Lot Less Data a Lot Faster 7

HP Exadata Storage Server Hardware Exadata Storage Server Racked Exadata Storage Servers Building block of massively parallel Exadata Storage Grid Up to 1GB/sec data bandwidth per cell HP DL180 G5 2 Intel quad-core processors 8GB RAM Dual-port 4X DDR InfiniBand card 12 SAS or SATA disks Software pre-installed Oracle Exadata Storage Server Software Oracle Enterprise Linux HP Management Software Hardware Warranty 3 YR Parts/3 YR Labor/3 YR On-site 24X7, 4 Hour response 8

HP Exadata Storage Server Hardware Details Redundant 110/220V Power Supplies 8 GB DRAM P400 Smart Array Disk Controller card - 512M battery backed cache 12 x 3.5 Disk Drives 2 Intel Xeon Quad-core Processors InfiniBand DDR dual port card LO100c Management Card Included Software: Oracle Exadata Storage Server Software Oracle Enterprise Linux HP Management Software 9

SAS or SATA Disks in Exadata Servers Choice of either 450 GB 15,000 RPM SAS disks 1 TB 7,200 RPM SATA disks Choose SAS Based Servers for High Performance SAS Advantages SAS SATA Advantage Throughput (MB/s) 1,000 750 1.33X Average Seek Time (ms) 3.6 7.4 2.05X Disk level read errors (per year) 6.3 63 10.00X Years to disk failure 15.2 11.4 1.33X Choose SATA Based Servers for High Capacity SATA Advantages SAS SATA Advantage Capacity (TB) 5.4 12 2.22X 10

Scalable Scale to 18 cells in one rack Add racks to scale further Each cell connects to 2 InfiniBand switches for Redundancy This delivers 4x the bandwidth SAS raw capacity per rack: 97TB SATA raw capacity per rack: 216TB Peak throughput per rack : >18GB/s InfiniBand links across racks for full connectivity 11

Extreme Performance in Action Scan TB of User Data In 3.5 sec. 70 60 50 40 30 20 10 0 14 28 42 56 70 84 80 70 60 50 40 30 20 10 0 Elapsed Time Secs Scan Rate(GB/Sec) 12

Massively Parallel Storage Grid Exadata Storage servers are organized into a massively parallel storage grid Scalable Scales to hundreds of storage servers Data automatically distributed across storage servers by ASM Transparently redistributed when storage servers are added or removed Data bandwidth scales linearly with capacity Available Data is mirrored across storage servers Failure of disk or storage server transparently tolerated Simple Works transparently - no application changes 4 GB/sec 8 GB/sec 16 GB/sec Exadata bandwidth scales linearly with capacity 13

Exadata Performance Scales 10 Hour Table Scan Time Exadata delivers brawny hardware for use by Oracle s brainy software 5 Hour 1 Hour Typical Warehouse Exadata 1TB 10 TB 100TB Performance scales with size Result More business insight Better decisions Improved competitiveness Table Size 14

HP Oracle Database Machine Pre-Configured High Performance Data Warehouse 8 DL360 Oracle Database servers 2 quad-core Intel Xeon, 32GB RAM Oracle Enterprise Linux Oracle RAC 14 Exadata Storage Cells (SAS or SATA) Up to 21 TB uncompressed user data (SAS) Up to 46 TB uncompressed user data (SATA) 4 InfiniBand switches 1 Gigabit Ethernet switch Keyboard, Video, Mouse (KVM) hardware Hardware Warranty 3 YR Parts/3 YR Labor/3 YR On-site 24X7, 4 Hour response time Add more racks for unlimited scalability 15

Exadata Product Capacity Raw Storage User Data Data Bandwidth HP Exadata Storage Server Hardware SAS 5.4 TB 1.5 TB 1 GB/s HP Exadata Storage Server Hardware SATA 12 TB 3.3 TB 0.75 GB/s HP Oracle Database Machine Hardware SAS 75 TB 21 TB 14 GB/s HP Oracle Database Machine Hardware SAT 168 TB 46 TB 10.5 GB/s 16

Exadata Configuration Single-Instance Database RAC Database InfiniBand Switch/Network Exadata Cell Exadata Cell Exadata Cell Each Exadata Cell is a self-contained server which houses disk storage and runs the Exadata software Databases are deployed across multiple Exadata Cells Database enhanced to work in cooperation with Exadata intelligent storage No practical limit to number of Cells that can be in the grid 17

Exadata Architecture Single-Instance Database DB Server DB Server RAC Database DB Server DB Instance DBRM ASM DB Instance DBRM ASM DB Instance DBRM ASM Enterprise Manager InfiniBand Switch/Network idb Protocol over InfiniBand with Path Failover OEL CELLSRV IORM MS RS Exadata Cell OEL CELLSRV IORM MS RS Exadata Cell OEL CELLSRV IORM MS RS Exadata Cell Cell Control CLI 18

Smart Scan Offload Processing Exadata Storage Servers implement smart scans to greatly reduce the data that needs to be processed by database hosts Offload predicate evaluation Only return relevant rows and columns to host Join filtering Data reduction is usually very large 10x data reduction is common Completely transparent Even if a cell or disk fails during a query Smart Scan Example: Telco wants to identify customers that spend more than $200 on a single phone call The information about these premium customers occupies 2MB in a 1 terabyte table 19

Traditional Scan Processing SELECT customer_name FROM calls WHERE amount > 200; Table Extents Identified I/Os Issued Rows Returned DB Host reduces terabyte of data to 1000 customer names that are returned to client I/Os Executed: 1 terabyte of data returned to hosts With traditional storage, all database intelligence resides in the database hosts Very large percentage of data returned from storage is discarded by database servers Discarded data consumes valuable resources, and impacts the performance of other workloads 20

Exadata Smart Scan Processing SELECT customer_name FROM calls WHERE amount > 200; Smart Scan Constructed And Sent To Cells Smart Scan identifies rows and columns within terabyte table that match request Rows Returned Consolidated Result Set Built From All Cells 2MB of data returned to server Only the relevant columns customer_name and required rows where amount>200 are are returned to hosts CPU consumed by predicate evaluation is offloaded Moving scan processing off the database host frees host CPU cycles and eliminates massive amounts of unproductive messaging Returns the needle, not the entire hay stack 21

Additional Smart Scan Functionality Join filtering Star join filtering is performed within Exadata storage cells Dimension table predicates are transformed into filters that are applied to scan of fact table Backups I/O for incremental backups is much more efficient since only changed blocks are returned Create Tablespace (file creation) Formatting of tablespace extents eliminates the I/O associated with the creation and writing of tablespace blocks 22

Smart Scan Transparency Smart scans are transparent to the application No application or SQL changes required Returned data is fully consistent and transactional If a cell dies during a smart scan, the uncompleted portions of the smart scan are transparently routed to another cell Smart Scans correctly handle complex cases including Uncommitted data and locked rows Chained rows Compressed tables National Language Processing Date arithmetic Regular expression searches Partitioned tables High Throughput, Reduced Overhead, No Complex Tuning 23

Exadata Storage Grid I/O Resource Management Database A Database B..... Storage Switch/Network Database C With traditional storage,creating a managing shared storage is hampered by the inability to balance the work between users on the same database or on multiple databases sharing the storage subsystem Hardware isolation is the approach to ensure separation Exadata I/O resource management ensures user defined SLAs are met Coordination and prioritization between different groups/classes of work within a database and between databases 24

Exadata I/O Resource Management DW and Mixed Workload Environments Ensure different users and tasks within a database are allocated the correct relative amount of I/O resources For example: Interactive: 50% of I/O resources Reporting: 30% of I/O resources ETL: 20% of I/O resources Database Server Exadata Cell Exadata Cell Exadata Cell 25

Exadata I/O Resource Management Multi-Database OLTP Environment Ensure different databases are allocated the correct relative amount of I/O bandwidth Database A: 33% I/O of resources Database B: 67% I/O of resources Ensure different users and tasks within a database are allocated the correct relative amount of I/O bandwidth Database A: Reporting: 60% of I/O resources ETL: 40% of I/O resources Database B: Interactive: 30% of I/O resources Batch: 70% of I/O resources Database A (Single-Instance) Database B (RAC) Exadata Cell Exadata Cell Exadata Cell 26

Exadata Scale-Out Storage Grid Dynamic virtualized storage resources using Automatic Storage Management (ASM) Simple and non-intrusive resource allocation, and reallocation, enabling true enterprise grid storage Database work spread across storage resources for optimal performance Powerful storage allocation options and management Flexible configuration for performance and availability Single-Instance Database Exadata Cell InfiniBand Switch/Network Exadata Cell RAC Database Exadata Cell 27

Exadata Storage Layout Physical disks map to a Cell Disks Cell Disks partitioned into one or multiple Grid Disks ASM diskgroups created from Grid Disks Transparent above the ASM layer Grid Disk 1 ASM disk Physical Disk Cell Disk Sys Area Grid Disk n Sys Area ASM disk 28

Exadata Storage Layout Example Cell Disks Cell Disk Exadata Cell Exadata Cell Cell Disk is the entity that represents a physical disk residing within a Exadata Storage Cell Automatically discovered and activated 29

Exadata Storage Layout Example Grid Disks Grid Disk Exadata Cell Exadata Cell Cell Disks are logically partitioned into Grid Disks Grid Disk is the entity allocated to ASM as an ASM disk Minimum of one Grid Disk per Cell Disk Can be used to allocate hot, warm and cold regions of a Cell Disk or to separate databases sharing Exadata Cells 30

Exadata Storage Layout Example ASM Disk Groups and Mirroring Hot ASM Disk Group Exadata Cell Exadata Cell Cold ASM Disk Group Hot Hot Hot Hot Hot Hot Cold Cold Cold Cold Cold Cold Two ASM disk groups defined One for the active, or hot portion, of the database and a second for the cold or inactive portion ASM striping evenly distributes I/O across the disk group ASM mirroring is used protect against disk failures Optional for one or both disk groups 31

Exadata Storage Layout Example ASM Mirroring and Failure Groups ASM Failure Group Exadata Cell Exadata Cell ASM Failure Group Hot Hot Hot Hot Hot Hot Cold Cold Cold Cold Cold Cold ASM Disk Group ASM mirroring is used protect against disk failures ASM failure groups are used to protect against cell failures 32

Exadata Storage Management & Administration Enterprise Manager Manage & administer Database and ASM Exadata Storage Plug-in Enterprise Manager Grid Control Plug-in to monitor & manage Exadata Storage Cells Comprehensive CLI Local Exadata Storage cell management Distributed shell utility to execute CLI across multiple cells Lights-out 100 Remote management and administration of hardware 33

Data Protection Solutions All single points of failure eliminated by the Exadata Storage architecture Hardware Assisted Resilient Data (HARD) built in to Exadata Storage Prevent data corruption before it happens Data Guard provides disaster protection and data corruption protection Automatically maintained second copy of database Flashback provides human error protection Snapshot-like capabilities to rewind database to before error Recovery Manager (RMAN) provide backup to disk Archiving and corruption protection Can be used with Oracle Secure Backup (OSB) or third party tape backup software These work just as they do for traditional non-exadata storage Users and database administrator use familiar tools 34

Exadata Co-Existence and Migration Databases can be concurrently deployed on Exadata and traditional storage Tablespaces can exist on Exadata storage, traditional storage, or a combination of the two, and is transparent to database applications SQL offload processing requires all pieces of a tablespace reside on Exadata Online migration if currently using ASM and ASM redundancy Migration can be done using RMAN or Data Guard Exadata Database Server Non-Exadata Online Migration 35

Telco Exadata Speedup 10X to 72X 28x Average Speedup 36

Retailer Exadata Speedup 3x to 50x Merchandising Level 1 Detail: Period Ago Merchandising Level 1 Detail: Current - 52 weeks Supply Chain Vendor - Year - Item Movement Merchandising Level 1 Detail by Week Materialized Views Rebuild Date to Date Movement Comparison - 53 weeks Prompt04 Clone for ACL audit Sales and Customer Counts Gift Card Activations 16x Average Speedup Recall Query - 5.0 10.0 15.0 20.0 25.0 30.0 35.0 40.0 45.0 50.0 37

Exadata Benefits Extreme Performance 10X to 100X speedup for data warehousing Database Aware Storage Smart Scans Massively Parallel Architecture Dynamically Scalable to hundreds of cells Linear Scaling of Data Bandwidth Transaction/Job level Quality of Service Mission Critical Availability and Protection Disaster recovery, backup, point-in-time recovery, data validation, encryption 38

Resources Oracle.com: http://www.oracle.com/exadata Oracle Exadata Technology Portal on OTN: http://www.oracle.com/technology/products/bi/db/exadata Oracle Exadata white papers: http://www.oracle.com/technology/products/bi/db/exadata/pdf/exad ata-technical-whitepaper.pdf http://www.oracle.com/technology/products/bi/db/exadata/pdf/migr ation-to-exadata-whitepaper.pdf 39

40