Update Exadata X6 Database Machine

Transcription

2 Exadata Vision Dramatically Better Platform for All Database Workloads Ideal Database Hardware - Scale-out, database optimized compute, networking, and storage for fastest performance and lowest costs Smart System Software specialized algorithms vastly improve all aspects of database processing: OLTP, Analytics, Consolidation Full-Stack Integration Database-to-disk optimization, automation, testing, patching, and support to reduce operational costs Identical On-Premises and Oracle Public Cloud Copyright 2016 Oracle and/or its affiliates. All rights reserved. 2

4 Ideal Hardware Architecture for Database Most Advanced - Highest Performance - Always Available - Starts Small, Scales Huge Ideal Server Architecture Ideal Network Architecture Ideal Storage Architecture Ideal Flash Architecture Ideal Capacity Architecture Scale-Out with Fastest CPUs Unified Ultra-fast InfiniBand Scale-Out Servers, Database Offload Ultra-fast NVMe PCIe Flash Tier PCIe Flash & Huge 8TB SAS3 Disks PCI Flash Copyright 2015 Oracle and/or its affiliates. All rights reserved. 5

5 Exadata X6-2 Hardware Details (changes in red) Scale-Out 2-Socket Database Servers Fastest Intel CPUs - 22 core Broadwell E v4 (25% faster) DDR4 DRAM frequency increased 13% Database Server Ultra-Fast Unified InfiniBand Internal Fabric High-Capacity (HC) Storage Scale-Out Intelligent 2-Socket Storage Servers Intel 10 core Broadwell CPUs offload database processing (25% faster) 8TB Helium Disk Drives (2X Larger since Oct 15) 2X larger & 2X faster 3D V-NAND NVMe Flash cards High Capacity Rack PB Disk, 180 TB PCIe Flash Extreme Flash Rack TB PCIe Flash Extreme Flash (EF) Storage Copyright 2015 Oracle and/or its affiliates. All rights reserved. 6

6 Elastic Configurations Incrementally Scale Compute & Storage Achieve any Level of Performance with Minimum Hardware Incrementally add DB or Storage Servers Database Server 44 CPU Cores Extreme Flash Storage 25.6 TB PCI Flash 20 CPU Cores High-Capacity Storage Add Racks to Continue Scaling Start Small 2 Database Servers 3 Storage Servers 12.8 TB PCI Flash 96 TB Disk 20 CPU Cores Full Rack Multi-Rack Enable Database CPU cores as needed with Capacity on Demand Expand older Exadata machines with new servers Copyright 2015 Oracle and/or its affiliates. All rights reserved. 7

7 Exadata X6 Delivers Breakthrough DB IO Performance 350 GB/sec Analytic Throughput 5.6 Million 8K OLTP Read IOPS 5.2 Million 8K OLTP Write IOPS 250 us IO latency at 2.4 Million IOPS 2.5X Scales higher as racks are added Performance of 1 Exadata Rack with 10 DB servers and 12 Extreme Flash storage servers Copyright 2015 Oracle and/or its affiliates. All rights reserved. 8

8 Exadata X6 Pricing Unchanged to Greatly Improve Value Huge benefits over X5 for same price 2X disk capacity, 2X flash capacity, 2X faster flash 25% faster X6-2 Broadwell CPUs Faster DRAM Minimum DB licenses unchanged (COD) 16 cores for Eighth Rack, 28 cores for Quarter Rack Oracle SuperCluster updated to X6 storage New X6-8 8-socket Exadata updated to X6 storage Copyright 2016 Oracle and/or its affiliates. All rights reserved. 9

10 Smart System Software Introduced in 2015 Smart Analytics 5X faster scans by converting data to Columnar format in Flash Cache 3X faster JSON/XML by offloading to storage servers VM VM Smart Consolidation Zero Overhead VMs Snapshots for Test/Dev Set flash cache minimum size per DB to ensure QOS InfiniBand Partitioning IPv6 for Ethernet Smart OLTP 3X faster OLTP messaging using direct DB to InfiniBand access Instant detection of Node Failure Sub-second Capping of I/O Latency by rerouting IOs to faster storage FIN VM SALES VM DB Vault Option Spatial & Graph Option Smart Licensing Capacity-on-Demand reduces DB license cost by disabling unneeded cores Trusted Partitions limit license scope of specialized options Copyright 2016 Oracle and/or its affiliates. All rights reserved. 12

11 Exadata Software Super Fast Software Updates 2.5X speed up in Storage Server Software Update Parallel firmware upgrades across components such as hard disks, flash, ILOM/BIOS, InfiniBand card Reduced reboots for Software updates Imaging speedup X5 High Capacity cell reimaged in less than 20 minutes Copyright 2016 Oracle and/or its affiliates. All rights reserved. 15

12 VLAN Support in OEDA VLAN tagging using Oracle Exadata Deployment Assistant for Ethernet networks Isolate Backup or Data Guard traffic from Client traffic Isolate traffic between virtual machines Provide QoS for Client traffic when configured on the switch Reduce switch port utilization in customer data centers Backup and Client networks can share the same network cables Best Practices VLAN networks must be bonded If backup network is tagged then the client network be tagged as well Restrictions IPv6 VLANs are not supported on Admin network and VMs Copyright 2016 Oracle and/or its affiliates. All rights reserved. 16

13 High Redundancy on Quarter and Eighth Racks Problem: On an eighth or a quarter rack the Voting Disks were on a Normal Redundancy disk group and thus susceptible to concurrent failures Solution: Create Voting Disks on database servers in addition to those on storage servers Best Practice: Use HIGH redundancy for DATA diskgroup and place voting disk in HIGH redundancy diskgroup Oracle Exadata Deployment Assistant automatically creates quorum disks Quorum Disk Manager Utility creates and manage quorum disks Minimum Grid Infrastructure Software version required: Oracle Database 12c Release 1 (12.1) release with these patches: and Copyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential Highly Restricted 17

14 Storage Index Preservation across Rebalance In event of a disk failure data needs to be rebalanced out to disks on other cells Previously, storage indexes created for the regions on the failed disk were lost and recreated on the next scan Storage index entries will be moved along with data to the new disk during cell to cell offloaded rebalance Maintains application performance during rebalance Minimum Grid Infrastructure software version: Oracle Database 12c Release 1 (12.1) release with patch Region Index Min B = 1 Max B = 3 Min B = 8 Max B = 9 Min B = 5 Max B = 7 A B C D Copyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential Highly Restricted 19

15 Increased Maximum Number of Database Processes Significant increase in maximum number of database processes Machine Type InfiniBand Bonding Type Maximum Number of Processes with No Parallel Queries Maximum Number of Processes with All Running Parallel Queries 8-socket (X2-8, X3-8) Active passive 28,500 25,000 8-socket (X4-8, X5-8) Active bonding 100,000 44,000 2-socket (X2-2, X3-2) Active passive 12,500 10,000 2-socket (X4-2, X5-2) Active bonding 25,000 14,000 If a subset of the workload is running parallel queries, the maximum database process count will be between the values in the Maximum Number of Processes with No Parallel Queries" column and the Maximum Number of Processes with All Running Parallel Queries" column Minimum Database and Grid Infrastructure software version: Oracle Database 12c Release 1 (12.1) release with patches , and Copyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential Highly Restricted 20

16 Miscellaneous Enhancements Adaptive Scrubbing Schedule Repeat scrubbing in a week for disk drives with bad sectors IPv6 Support in ASR Manager Systems using IPv6 can now connect to Auto Service Request (ASR) using ASR Manager 5.4 CREATE DIAGPACK to package trace files for alerts CREATE DIAGPACK command now supports creating diagnostic packages for a specified alert using the alertname parameter ASM Disk Size Checked When Reducing Grid Disk Size Prevents users from accidentally decreasing the size of a grid disk before decreasing the size of an ASM disk Copyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential Highly Restricted 21

17 Firmware Updates Bug fixes for 600GB and 8TB disk drives 600GB firmware update addresses issues with high rates of sector failures in some older 600GB disk drive as described in MOS note TB disk update improves recovery from media errors Updated firmware for hard disk controller in Exadata X2-2, X3-2, X4-2, X2-8, X3-8, and X4-8 to improve the robustness of handling rare critical errors impacting HBA functionality New InfiniBand switch firmware version to support an updated Service Processor Module and bug fixes ILOM/BIOS firmware to improve robustness and security Copyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential Highly Restricted 22

19 Shared Storage Has Many Advantages over Local Storage Servers SAN/LAN Shared Storage Much better space utilization Much better security, management, reliability Enables DB consolidation, DB high availability, RAC scale-out Shares storage performance Aggregate performance of shared storage can be dynamically used by any server that needs it Copyright 2016 Oracle and/or its affiliates. All rights reserved. 24

20 Flash Performance is Wasted by Shared Storage Arrays SAN Link = 40Gb 5 GB/sec Latest PCIe Flash 5.4 GB/sec Recent improvements flash performance are causing 100X bottlenecks across shared storage stack Speed of one flash card is now similar to fastest SAN or LAN link Throughput of a few flash cards is too fast to transfer to servers All-Flash Storage Array IO Path: many steps, each adds latency and creates bottlenecks Flash Chips SSD Ctrl SAS/SATA Array Heads SAN/LAN Switches SAN/LAN Host HBA PCIe CPU Copyright 2016 Oracle and/or its affiliates. All rights reserved. 25

21 Storage Arrays Fundamentally Bottleneck Flash Tiered, Hybrid or All Flash 10X Bottleneck! Even with 20x 10Gb/s Links Servers 25 GB/s Storage Array 250 GB/s Flash Bandwidth Flash Drives are much faster than SANs and LANs One PCI flash drive is 4X faster than a 10Gb Ethernet link 50 shared flash drives require 200x 10Gb Ethernets between host and array! Shared Arrays throttle modern flash by an order of magnitude Copyright 2016 Oracle and/or its affiliates. All rights reserved. 26

22 GB/sec Exadata X6 IO is Much Faster than All-Flash EMC One High Capacity Exadata beats the fastest EMC XtremIO all-flash array in every performance metric 2X lower latency (0,50 vs 0,25ms) Analytic Scans 24 8 X-Brick EMC XtremIO X 1 Rack HC Exadata OLTP Write IOPS 2 M 8 X-Brick EMC XtremIO 4.5 M 2.2X 1 Rack HC Exadata EMC Performance does not scale higher, Exadata scales by adding racks Copyright 2016 Oracle and/or its affiliates. All rights reserved. 27

23 GB/sec Exadata X6 IO is Much Faster than All Flash Pure Storage One High Capacity Exadata beats the fastest Pure Storage all-flash array in every performance metric 4X lower latency (1.00 vs 0,25ms) Analytic Scans 9 Pure Storage //M X 1 Rack HC Exadata OLTP Write IOPS 1.2 M Pure Storage //M M 3.7X 1 Rack HC Exadata Pure Storage Performance does not scale higher, Exadata scales by adding racks Copyright 2016 Oracle and/or its affiliates. All rights reserved. 28

24 Only Exadata Achieves Full Performance of Shared Flash Actual Throughput Exadata Single Rack Actual Throughput Wasted Flash Potential Pure Storage Largest Wasted Flash Potential EMC XtremeIO 4-brick Potential Throughput* Leading All-Flash Storage Arrays achieve under 3% of potential flash throughput Pure Storage EMC XtremIO 132 MB/sec per flash drive 120 MB/sec per flash drive Spinning disk level throughput! AND can t scale-out for higher performance AND can t share even this slow performance due to bottleneck at server inputs Exadata X6 achieves full flash throughput 5400 MB/sec per drive Exadata also achieves much faster OLTP IOs 5.6 Million IOPs, 250us latency even at 2.4M IOs *Potential Throughput based on number of flash devices Copyright 2016 Oracle and/or its affiliates. All rights reserved. 29

25 Exadata Storage Eliminates the Flash Bottleneck Full Scale-Out, PCIe NVMe Flash, Application Offload, Database Aware Exadata Moves Queries to Storage, not Storage to Queries ONLY platform with shared storage benefits and NO FLASH BOTTLENECK State-of-the-art PCIe Flash with NVMe Scale out architecture avoids bottlenecks Adds flash capacity and performance by adding servers Shared storage with memory level bandwidth is a paradigm change in the industry Get near DRAM throughput (800GB/s), with the capacity of shared flash SQL 40 Gb/s 40 Gb/s Smart Scan InfiniBand Switch 40 Gb/s 40 Gb/s 300 GB/s Scan Bandwidth PCIe Copyright 2016 Oracle and/or its affiliates. All rights reserved. 30

26 Preview: Redesigning Scan Offload for Memory Throughput With Exadata Flash throughput approaching memory throughput, SQL bottleneck moves from IO to CPU Exadata will automatically transform table data into In-memory DB columnar formats in Exadata flash cache Dual format architecture extended from DRAM to flash Enables fast vector processing for storage server queries Smart Scan results sent to DB using In-Memory Columnar format to reduce DB CPU usage Uniquely optimizes next generation flash as memory In-Memory Columnar scans In-Flash Columnar scans Production in 2016 Copyright 2016 Oracle and/or its affiliates. All rights reserved. 32

28 Smart Platform Extended into CPU Chip SPARC M7 Software in Silicon Traditional DB algorithms too complex for chips Software in Silicon Big Change: In-memory algorithms are much simpler 5 years ago Oracle initiated a revolutionary project Build fastest ever microprocessor Most processing cores (32) Most concurrent threads (256) Fastest Memory Bandwidth (160 GB/sec) Add In-Memory DB operations directly on chip Copyright 2015 Oracle and/or its affiliates. All rights reserved. 34

29 Real-Time Enterprise Up-to-the-minute Analytics Analytics at memory speed 1000 s GB/s is much greater old 1-40 GB/s bottlenecks Real-Time Enterprise TB s In-memory ETL (GB/s) Data Warehouse Server Column format Millions IOPs Typical fast IO 40GB/s on-disk on-disk Row format Data Warehouse Key business processes radically transformed by orders magnitude Costs also dramatically reduced Copyright 2015 Oracle and/or its affiliates. All rights reserved.

30 Real-Time Enterprise Big Data Analytics Accelerating Big Data analytics Real-Time Enterprise TB s In-memory Column format Millions IOPs Big Data Info Big Data: Oracle NoSQL Endeca Hadoop ( distills ) Digital Universe Zetta bytes on-disk Statistics ( analyze ) Row format Copyright 2015 Oracle and/or its affiliates. All rights reserved.

31 But: Cores & Caches Completely Saturated During Scans Scan via software consumes all of the cores 8 Cores 8 Cores > 160 GB/s mc L3$ CACHE L3$ CACHE mc Data (columnar) mc L3$ CACHE On-chip Crossbar L3$ CACHE mc Result 8 Cores 8 Cores Notice that if cores perform in-memory scans, that caches are polluted (data missed into cache) Copyright 2015 Oracle and/or its affiliates. All rights reserved. 37

32 SPARC M7: Software In Silicon Features Security in Silicon: Silicon Secured Memory Cryptography Acceleration Query Acceleration: Database Analytics Accelerator Engines Capacity in Silicon: Decompression Engines Copyright 2015 Oracle and/or its affiliates. All rights reserved. 38

33 COHERENCE, SMP & I/O INTERCONNECT ACCELERATORS MEMORY CONTROL COHERENCE, SMP & I/O INTERCONNECT Query Acceleration: Behind The Scenes Equivalent of 32 extra cores plus 64 extra decompress cores DAX L3 Cache DRAM CORE CLUSTER CORE CLUSTER CORE CLUSTER CORE CLUSTER OZIP decompress L3$ & ON-CHIP NETWORK CORE CLUSTER CORE CLUSTER CORE CLUSTER CORE CLUSTER ACCELERATORS MEMORY CONTROL SRAM Buffer Dictionary & Lookup Tables Bloom Filter Unpack Input Predicate Evaluation Run Length Expand Pack Output Filter Rows by Bit Vector DAX L3 Cache DRAM Copyright 2015 Oracle and/or its affiliates. All rights reserved. 39

34 SPARC M7 In-memory Advantages SPARC M7 fastest for analytics Industry-leading SPARC M7 memory bandwidth for In-memory DAX offloads the cores & avoids cache pollution by not scanning with cores DAX decompresses OZIP data at same rate as scan-only DAX performs one-step range scans DAX M7 cores freed for OLTP Analytics DAX DAX: Database Accelerator Processes: Decode values (DAX) & Sum aggregation (cores) Hash Joins (cores) Bloom Filter Joins (DAX & cores) Scans (DAX) Range Scans (DAX) SQL: select sum(lo_extendedprice*lo_discount) as revenue from lineorder, date_dim where lo_orderdate = d_datekey and d_year = 2012 and lo_quantity between 6 and 25 and lo_discount between 1 and 3 Copyright 2015 Oracle and/or its affiliates. All rights reserved. 40

35 Software in Silicon: SPARC DAX DAX does scans, filtering, decompression directly DAX frees cores for other computations 8 Cores 8 Cores > 160 GB/s mc L3$ CACHE L3$ CACHE mc Data (columnar) DAX mc L3$ CACHE On-chip Crossbar L3$ CACHE DAX mc Result 8 Cores 8 Cores Cores initiate DAX operations, but are mostly freed for other computational work Copyright 2015 Oracle and/or its affiliates. All rights reserved. 41

36 In-Memory Query Acceleration Dedicated Analytics accelerators built on chip Independently process streams of compressed data placed in system memory Like adding 32 additional specialized cores to chip Up to 220 Billion rows per second! SPARC M7 Core Core Core Core Frees processor cores to run other applications, such as OLTP Decompresses data simultaneously to processing SQL functions SQL Accel SQL Accel Cache SQL Accel SQL Accel Like adding 64 additional specialized cores Copyright 2015 Oracle and/or its affiliates. All rights reserved. 42

37 Read DAX Write Read Write Software in Silicon: Accelerating Oracle Database 12c Decompress at memory speeds Software Decompress More than Doubles data size Write Read Software Scan Multiple steps time 10X Faster SQL: SELECT count(*) WHERE lo_orderdate = d_datekey AND lo_partkey = AND d_year_monthnum BETWEEN AND ; 5/11/2016 Copyright 2015 Oracle and/or its affiliates. All rights reserved. Oracle Confidential NDA required.

38 Oracle M7 SuperCluster with Exadata Storage & Software Consolidate Applications and Database, Large OLTP, Large In-Memory DB General-purpose NAS Storage SuperCluster M7-8 Zero Overhead Virtual Machines Unified Ultra-fast InfiniBand Database & Application Servers Up to 8 SPARC M7 processors and 4 TB of RAM Software-in-Silicon Ultra-fast memory interconnect Secure application and Oracle Database virtualization Exadata X6 Storage Servers All Exadata Storage Server features Elastic Storage Configuration SQL in Silicon Copyright 2016 Oracle and/or its affiliates. All rights reserved.

40