Red Hat Ceph Storage and Samsung NVMe SSDs for intensive workloads

Similar documents
Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

Building All-Flash Software Defined Storages for Datacenters. Ji Hyuck Yun Storage Tech. Lab SK Telecom

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

Data Sheet FUJITSU Storage ETERNUS CD10000

Deploying Ceph with High Performance Networks, Architectures and benchmarks for Block Storage Solutions

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance

Data Sheet FUJITSU Server PRIMERGY CX420 S1 Out-of-the-box Dual Node Cluster Server

Data Center Solutions

io3 Enterprise Mainstream Flash Adapters Product Guide

Data Center Storage Solutions

Samsung 2bit 3D V-NAND technology

Scaling from Datacenter to Client

ioscale: The Holy Grail for Hyperscale

HUAWEI TECHNOLOGIES CO., LTD. HUAWEI FusionServer X6800 Data Center Server

Optimizing SQL Server Storage Performance with the PowerEdge R720

ZD-XL SQL Accelerator 1.5

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

QuickSpecs. PCIe Solid State Drives for HP Workstations

Data Center Solutions

Removing Performance Bottlenecks in Databases with Red Hat Enterprise Linux and Violin Memory Flash Storage Arrays. Red Hat Performance Engineering

Solution Brief July All-Flash Server-Side Storage for Oracle Real Application Clusters (RAC) on Oracle Linux

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

MESOS CB220. Cluster-in-a-Box. Network Storage Appliance. A Simple and Smart Way to Converged Storage with QCT MESOS CB220

Building a Flash Fabric

Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

Data Center Storage Solutions

MaxDeploy Hyper- Converged Reference Architecture Solution Brief

HP ProLiant DL580 Gen8 and HP LE PCIe Workload WHITE PAPER Accelerator 90TB Microsoft SQL Server Data Warehouse Fast Track Reference Architecture

ACCELERATE SQL SERVER 2014 WITH BUFFER POOL EXTENSION ON LSI NYTRO WARPDRIVE

Installing Hadoop over Ceph, Using High Performance Networking

Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

Direct NFS - Design considerations for next-gen NAS appliances optimized for database workloads Akshay Shah Gurmeet Goindi Oracle

Running Highly Available, High Performance Databases in a SAN-Free Environment

Red Hat Ceph Storage Hardware Guide

Colgate-Palmolive selects SAP HANA to improve the speed of business analytics with IBM and SAP

Samsung 3bit 3D V-NAND technology

Best Practices for Optimizing SQL Server Database Performance with the LSI WarpDrive Acceleration Card

OCZ s NVMe SSDs provide Lower Latency and Faster, more Consistent Performance

Samsung emmc. FBGA QDP Package. Managed NAND Flash memory solution supports mobile applications BROCHURE

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

The Shortcut Guide to Balancing Storage Costs and Performance with Hybrid Storage

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA

Data Sheet FUJITSU Server PRIMERGY CX272 S1 Dual socket server node for PRIMERGY CX420 cluster server

Boost Database Performance with the Cisco UCS Storage Accelerator

High Performance SQL Server with Storage Center 6.4 All Flash Array

Data Sheet FUJITSU Storage ETERNUS DX200F All-Flash-Array

Choosing the Best Network Interface Card Mellanox ConnectX -3 Pro EN vs. Intel X520

IOmark- VDI. Nimbus Data Gemini Test Report: VDI a Test Report Date: 6, September

NV-DIMM: Fastest Tier in Your Storage Strategy

TOP FIVE REASONS WHY CUSTOMERS USE EMC AND VMWARE TO VIRTUALIZE ORACLE ENVIRONMENTS

SOLUTION BRIEF AUGUST All-Flash Server-Side Storage for Oracle Real Application Clusters (RAC) on Oracle Linux

The Flash Transformed Data Center & the Unlimited Future of Flash John Scaramuzzo Sr. Vice President & General Manager, Enterprise Storage Solutions

Data Sheet FUJITSU Storage ETERNUS DX200F All Flash Array

Dell s SAP HANA Appliance

Microsoft s Open CloudServer

Lenovo Database Configuration for Microsoft SQL Server TB

Samsung Enterprise Alliance Program

Data Sheet FUJITSU Server PRIMERGY CX400 M1 Multi-Node Server Enclosure

SSD Performance Tips: Avoid The Write Cliff

Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software

Building a Scalable Storage with InfiniBand

Optimizing SQL Server AlwaysOn Implementations with OCZ s ZD-XL SQL Accelerator

Software-defined Storage at the Speed of Flash

Symantec NetBackup 5000 Appliance Series

Samsung DDR4 SDRAM DDR4 SDRAM

Hyperscale Use Cases for Scaling Out with Flash. David Olszewski

Advantages of Intel SSDs for Data Centres

StarWind Virtual SAN for Microsoft SOFS

Solid State Storage in the Evolution of the Data Center

VDI Without Compromise with SimpliVity OmniStack and Citrix XenDesktop

The Flash-Transformed Financial Data Center. Jean S. Bozman Enterprise Solutions Manager, Enterprise Storage Solutions Corporation August 6, 2014

Flash at the price of disk Redefining the Economics of Storage. Kris Van Haverbeke Enterprise Marketing Manager Dell Belux

SUN STORAGE F5100 FLASH ARRAY

Zadara Storage Cloud A

N /150/151/160 RAID Controller. N MegaRAID CacheCade. Feature Overview

Big data management with IBM General Parallel File System

SAMSUNG INTERACTIVE WHITEBOARD SOLUTION

CHOOSING THE RIGHT STORAGE PLATFORM FOR SPLUNK ENTERPRISE

DELL SOLID STATE DISK (SSD) DRIVES

Choosing the Best Network Interface Card for Cloud Mellanox ConnectX -3 Pro EN vs. Intel XL710

How To Speed Up A Flash Flash Storage System With The Hyperq Memory Router

HGST Virident Solutions 2.0

Intel RAID SSD Cache Controller RCS25ZB040

Virtualizing Microsoft SQL Server on Dell XC Series Web-scale Converged Appliances Powered by Nutanix Software. Dell XC Series Tech Note

APACHE HADOOP PLATFORM HARDWARE INFRASTRUCTURE SOLUTIONS

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

SMB Direct for SQL Server and Private Cloud

NVMe SSD User Installation Guide

Frequently Asked Questions March s620 SATA SSD Enterprise-Class Solid-State Device. Frequently Asked Questions

Deliver More Applications for More Users

HP reference configuration for entry-level SAS Grid Manager solutions

SUN ORACLE DATABASE MACHINE

Scalable. Reliable. Flexible. High Performance Architecture. Fault Tolerant System Design. Expansion Options for Unique Business Needs

HUAWEI Tecal E6000 Blade Server

IS IN-MEMORY COMPUTING MAKING THE MOVE TO PRIME TIME?

Transcription:

Red Hat Ceph Storage and Samsung NVMe SSDs for intensive workloads Power emerging OpenStack use cases with high-performance Samsung/ Red Hat Ceph reference architecture

Optimize storage cluster performance with Samsung NVMe and Red Hat Ceph Summary Red Hat Ceph Storage has long been the de facto standard for creating OpenStack cloud solutions across block and object storage, as a capacity tier based on traditional hard disk drives (HDDs). Now a performance tier using a Ceph storage cluster and NVMe solid state drives (SSDs) can be deployed in OpenStack environments. It is optimized to support the bandwidth, latency and input/output operations per second (IOPS) requirements of high-performance workloads and use cases, such as distributed MySQL databases, Telco network personal video recorder (NDVR) long-tail content retrieval and financial services. The Samsung NVMe Reference Design is engineered to provide a well-balanced storage server node that includes matching s, networking, storage and PCIe connectivity to deploy large numbers of NVMe SSDs and maximize the performance of Ceph. The Ceph Reference architecture can deliver 693K IOPS to I/O-intensive workloads and 28.5 G/s network throughput on a 3-node cluster. As a result, it is an optimized pool of high-speed storage designed for OpenStack deployments, virtual infrastructures, and financial service providers, as well as private and public clouds. In addition, the Reference architecture can increase the storage efficiency in test or development environments that need to be deployed and dismantled quickly. Technology Ceph is an established open source software technology for scale out, capacity-based storage under OpenStack. Ceph provides block-level, object and file-based storage access to clusters based on industry-standard servers. Now, Ceph supports a performance-optimized storage cluster utilizing high-performance Samsung NVMe SSDs deployed using a Samsung NVMe Reference Design. Ceph Reference Architecture Red Hat Ceph Storage Red Hat Enterprise Linux x86 Figure 1: Ceph/NVME Reference Architecture x86 40 GbE NIC Samsung NVMe Reference Design Samsung NVMe SSDs: Samsung enterprise NVMe SSDs are increasingly being used as data storage media in computing, communication and multimedia devices, and offer superior reliability compared to traditional HDDs. Advances in semiconductor flash memory have enabled the development of SSDs that are much larger in capacity compared to HDDs and can be used as direct replacements to them. SSDs also have proven to be highly cost-effective when in use, due to their much lower power consumption and maintenance costs. As the world leader in semiconductor memory technology, Samsung revolutionized the storage industry by shifting planar NAND to a vertical structure. Samsung V-NAND technology features a unique design that stacks 48 layers on top of one another instead of trying to decrease the cells pitch size. Samsung offers a comprehensive range of SSDs for deployment in a wide range of devices across virtually every industry segment. Samsung NVME Reference Design: The Samsung NVMe Reference Design system is a high-performance all-flash, scale-out storage server with up to 24x 2.5-inch hot-pluggable Samsung advanced NVMe SSDs that provides extremely high capacity in a small footprint. It is based on PCIe Gen3 NVMe SSDs, offering the lowest latency in the industry with an optimized data path from the to the SSDs. Each SSD slot provides power and cooling for up to 25 W per SSD to enable the support of currentand future-generation, large-capacity SSDs, as well as SSDs with different endurance and performance levels. 2

Experience a performance tier far exceeding the scale-out capacity of OpenStack With a Samsung PM953, the maximum capacity per system is 46 TB. With the next generation PM963 SSDs, the maximum capacity per system is 92 TB, and when using the highendurance PM1725a, the maximum capacity per system is 153 TB. This is a dual-socket Xeon -based system with an Environmental Impact Assessment (EIA) compliant 2RU chassis. It also uses 4x 40 Gb/s networking connectivity with Remote Direct Memory Access (RDMA). The Samsung NVMe Reference Design system is available through StackVelocity (a business unit of Jabil Systems) as the Greyguard platform. requirements, enabling enterprises to focus on their own business needs instead of the underlying IT infrastructure. As a software-defined storage platform, Ceph scales across physical, virtual and cloud resources, providing organizations with the ability to add capacity as needed, without sacrificing performance or forcing vendor lock-in. Some features of the combined Red Hat Ceph Storage and Samsung NVMe Reference Design are: OpenStack integration S3 and SWIFT support using RESTful interfaces High performance 700K+ IOPS for small (4 KB) random IO across a 3-node Ceph cluster 30 GB/s for large (128 KB) sequential IO across a 3-node Ceph cluster Reference Architecture is based on extensive testing jointly undertaken by Red Hat and Samsung to characterize an optimized configuration Ability to use non-proprietary, commodity-based hardware Figure 2: Samsung NVMe Reference Design With exceptional balance, the Samsung NVMe Reference Design system allows performance to scale more linearly, without tending to be overprovisioned along any component. With Ceph-distributed cluster capabilities, enterprises can now bring a performance tier reaching hundreds of thousands of IOPS to the traditional scale-out capacity tier that OpenStack offers. Features and capabilities Red Hat Ceph Storage is a massively scalable, open source, software-defined storage system that supports unified storage for a cloud environment. With object and block storage in a single platform, Red Hat Ceph Storage efficiently and automatically manages petabytes of data needed to run businesses dealing with massive data growth. Striping and replication across nodes nodes, enabling data durability, high availability and high performance Automatic rebalancing using a peer-to-peer architecture, adding instant capacity and data protection with minimal operational effort Upgrade clusters in phases adding or replacing cards online with minimal or no downtime Lower power consumption and higher reliability than similar-capacity HDD configurations Red Hat leverages the global open source community, including its own engineering resources, for development of new features and then locks down changes for predictable and stable releases. Red Hat Ceph Storage helps businesses automatically and cost-effectively manages their storage 3

Gain more use cases by combining Red Hat Ceph clusters with Samsung NVMe SSDs Throughput on a 3-node Ceph cluster for 1 MB IOs (replication factor of 2): 28.5 GB/s for sequential read and 6.2 GB/s for sequential write IOPS on a 3-node Ceph cluster for 4 KB IOs (replication factor of 2): 693K IOPS for Random Reads and 87.8K IOPS Random Writes Markets Ceph clusters combined with Samsung NVMe SSDs, create more opportunities in several use cases that are normally out of the reach of traditional OpenStack deployments, including: Fast pool of storage for private or public cloud service providers Telco edge network services Financial service workloads Test/development environments environments that need to be staged or torn down quickly Analytics workloads Multiple distributed MySQL/MariaDB databases established as Database as a Service (DBaaS) NDVR quick retrieval of long-tail content 4

Specifications, legal and additional information Technical Details Samsung and Red Hat performed extensive testing of a high- IOPS Red Hat Ceph Storage cluster running over the Samsung NVMe Reference Design. Below is the reference architecture configuration, as well as the metrics of the combined solution. 9 Client nodes Each node with 2x40GbE 40 GbE Network 1 Monitor node Figure 3: Samsung-Ceph reference architecture cluster Samsung NVMe Reference Design 3 OSD Nodes Each node with 4x40GbE Ceph reference architecture NVMe slots 24x 2.5 inch Samsung NVMe SSD slots Each slot supports up to 25 W per SSD Support PM953 NVME SSD with max capacity of 1.92 TB per SSD. Will support next-generation Samsung NVME SSDs, including PM963 and PM1725a 2x Intel E5-2699 v3 Memory slots Up to 512 GB (minimum 256 GB) Network Mellanox ConnectX -4 EN: 4 x 40 GbE for network connectivity. Version of RHEL and Ceph RHEL 7.2, Ceph Hammer LTS (0.94.5) Number of Ceph nodes 3 all-flash NVMe storage nodes, 6 client nodes; 1 monitor node Availability/redundancy 1+11,200 W power supplies, 4+1 redundant fans Remote accessibility Dedicated 1 GbE BMC (KVM/IP, IPMI) Form factor 2U EIA-310-D, L 28, H 3.43, W 17.15, UL, CE, FCC, RoHS Performance IOPS (100% random read, IO Size: 4 KB) IOPS (100% random write, IO Size: 4 KB, Replication Factor: 2) IOPS (70% random read, 30% random write) Throughput (100% sequential read, IO Size: 1 MB) Throughput (100% sequential read, IO Size: 1 MB, Replication Factor: 2) 693K 87.8K Read: 164.65K; Write: 70.72K 28.5 GB/s 6.2 GB/s Legal and additional information About Samsung Electronics Co., Ltd. Samsung Electronics Co., Ltd. inspires the world and shapes the future with transformative ideas and technologies. The company is redefining the worlds of TVs, smartphones, wearable devices, tablets, cameras, digital appliances, printers, medical equipment, network systems, and semiconductor and LED solutions. For the latest news, please visit the Samsung Newsroom at news.samsung.com. For more information For more information about the Samsung NVMe Reference Design, please visit: http://www.samsung.com/semiconductor/afard/ Copyright 2016 Samsung Electronics Co., Ltd. All rights reserved. Samsung is registered trademark of Samsung Electronics Co., Ltd. Specifications and designs are subject to change without notice. non-metric weights and measurements are approximate. All data were deemed correct at time of creation. Samsung is not liable for errors or omissions. All brand, product, service names and logos are trademarks and/or registered trademarks of their respective owners and are hereby recognized and acknowledged. Intel and Xeon are trademarks of Intel Corporation in the U.S. and/or other countries. Linux is a registered trademark of Linus Torvalds. The MariaDB trademark is wholly owned by MariaDB Corporation Ab and is a registered trademark in the United States of America and other countries. Mellanox and ConnectX are registered trademarks of Mellanox Technologies, Ltd. MySQL is a registered trademark of Oracle and/or its affiliates. The OpenStack Word Mark and the OpenStack logos are trademarks of the OpenStack Foundation. Red Hat and Red Hat Enterprises Linux are registered trademarks of Red Hat, Inc. in the U.S. and other countries. StackVelocity is a registered trademark of Jabil Circuit, Inc. Samsung Electronics Co., Ltd. (Maetan-dong) 129 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeongg-do, Korea www.samsung.com 2016-06 5