RED HAT STORAGE PORTFOLIO OVERVIEW

Transcription

1 RED HAT STORAGE PORTFOLIO OVERVIEW Andrew Hatfield Practice Lead Cloud Storage and Big Data MILCIS November 2015

2 THE RED HAT STORAGE MISSION To offer a unified, open software-defined storage portfolio that delivers a range of data services for next generation workloads thereby accelerating the transition to modern IT infrastructures.

3 THE FUTURE OF STORAGE Traditional Storage Open, Software-Defined Storage Complex proprietary silos Standardized, unified, open platforms ADMIN USER ADMIN ADMIN ADMIN Custom GUI Custom GUI Custom GUI Proprietary Software Proprietary Software Proprietary Software Proprietary Hardware Proprietary Hardware Proprietary Hardware Open Source Software USER Standard Hardware USER USER Control Plane (API, GUI) Ceph Gluster Standard Computers and Disks +++

4 WHY BOTHER? PROPRIETARY HARDWARE Common, off-the-shelf hardware SCALE-UP ARCHITECTURE Scale-out architecture HARDWARE-BASED INTELLIGENCE CLOSED DEVELOPMENT PROCESS Lower cost, standardized supply chain Increased operational flexibility Software-based intelligence More programmability, agility, and control Open development process More flexible, well-integrated technology

5 THE JOURNEY Open Software-Defined Storage is a fundamental reimagining of how storage infrastructure works. It provides substantial economic and operational advantages, and it has quickly become ideally suited for a growing number of use cases.?????? Containers HyperConvergence Analytics Cloud Infrastructure TODAY Cloud Native Apps EMERGING FUTURE

6 THE RED HAT STORAGE PORTFOLIO

7 OPEN SOURCE SOFTWARE THE RED HAT STORAGE PORTFOLIO Share-nothing, scale-out architecture provides durability and adapts to changing demands Ceph management Gluster management Ceph data services Gluster data services Self-managing and self-healing features reduce operational overhead STANDARD HARDWARE Standards-based interfaces and full APIs ease integration with applications and systems Supported by the experts at Red Hat

8 OVERVIEW: RED HAT CEPH STORAGE Powerful distributed storage for the cloud and beyond Built from the ground up as a next-generation storage system, based on years of research and suitable for powering infrastructure platforms Highly tunable, extensible, and configurable, with policy-based control and no single point of failure Offers mature interfaces for block and object storage for the enterprise TARGET USE CASES Cloud Infrastructure VM Storage with OpenStack Cinder, Glance & Nova Object storage for tenant apps Rich Media and Archival Customer Highlight: Cisco Cisco uses Red Hat Ceph Storage to deliver storage for next-generation cloud services S3-compatible object storage

9 OVERVIEW: RED HAT GLUSTER STORAGE Nimble file storage for petabyte-scale workloads Purpose-built as a scale-out file store with a straightforward architecture suitable for public, private, and hybrid cloud Simple to install and configure, with a minimal hardware footprint Offers mature NFS, SMB and HDFS interfaces for enterprise use TARGET USE CASES Analytics Machine analytics with Splunk Big data analytics with Hadoop Enterprise File Sharing Customer Highlight: Intuit Intuit uses Red Hat Gluster Storage to provide flexible, cost-effective storage for their industryleading financial offerings. Media Streaming Active Archives Enterprise Virtualization Rich Media & Archival

10 GROWING INNOVATION COMMUNITIES 78 AUTHORS/mo Contributions from Intel, SanDisk, SUSE,and DTAG. Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events COMMITS/mo 258 POSTERS/mo 41 AUTHORS/mo Over 11M downloads in the last 12 months 259 COMMITS/mo Increased development velocity, authorship, and discussion has resulted in rapid feature expansion. 166 POSTERS/mo

11 PARTNER SOLUTIONS All-flash arrays, optimized for Ceph Systems designed with storage in mind Accelerating software-defined storage SanDisk sells the InfiniFlash storage arrays, designed for use with Red Hat Ceph Storage. Optimizations contributed by SanDisk deliver high performance which allow Ceph customers to service new workloads. Supermicro's Red Hat Ceph Storage optimized solutions offer durable, softwaredefined, scale-out storage platforms in 1U/2U/4U form factors and are designed to maximize performance, density, and capacity Through silicon innovation and software optimization, Intel pushes the envelope on open, software-defined storage. A key contributor, Intel recently donated significant hardware to the Ceph project. Our relationship includes: Customer can expect to see: Intel development efforts have included: Engineering and product collaboration Community thought leadership Reference architectures, validated for SSD and performance optimizations performance, density, and capacity CephFS development Whitepapers and datasheets that support Red Hat Storage solutions

12 RED HAT STORAGE TARGET WORKLOADS

13 DIFFERENT KINDS OF STORAGE NEXT-GEN CAPACITY PERFORMANCE Object storage OpenStack DBaaS Sync and share Hyperconvergence Analytics TRADITIONAL VMWare Enterprise file sharing

14 FOCUSED SET OF USE CASES ANALYTICS CLOUD INFRASTRUCTURE RICH MEDIA AND ARCHIVAL SYNC AND SHARE ENTERPRISE VIRTUALIZATION Big Data analytics with Hadoop Machine data analytics with Splunk Virtual machine storage with OpenStack Object storage for tenant applications Cost-effective storage for rich media streaming Active archives File sync and share with owncloud Storage for conventional virtualization with RHEV

15 BIG DATA ANALYTICS HADOOP MAP REDUCE FRAMEWORK In-place Hadoop analytics in a POSIX compatible environment Hadoop Distributed File System FEATURES Allows the Hortonworks Data Platform 2.1 to be deployed on Red Hat Gluster Storage Red Hat Gluster Storage Cluster BENEFITS Flexible, unified enterprise big data repository Better analytics (Hadoop and non-hadoop) Hadoop tools can operate on data in-place Familiar POSIX-compatible file system and tools Access to the Hadoop ecosystem of tools Start small, scale as big data needs grow Access to non-hadoop analytics tools Multi-volume support (HDFS is single-volume) Consistent operating model: Hadoop can run directly on Red Hat Gluster Storage nodes Unified management (Hortonworks HDP Ambari and Red Hat Gluster Storage)

16 MACHINE DATA ANALYTICS Hot/warm data optimized for performance High-performance, scale-out, online cold storage for Splunk Enterprise 10s of TB on Splunk server DAS Cold optimized for cost, capacity and elasticity Red Hat Storage Server on commodity x86 servers FEATURES Multiple ingest options using NFS & FUSE Expand storage pools without incurring downtime Support for both clustered and non-clustered configurations BENEFITS Run high speed indexing and search on Splunk s cold data store Pay as you grow economics for Splunk cold data Reduce ingestion time for data with standard protocols Always online, fast, disk-based storage pools provide constant access to historical data

17 VIRTUAL MACHINE STORAGE OPENSTACK Keystone API Swift API Cinder API Glance API The most widely deployed 1 technology for OpenStack storage Nova API Hypervisor CEPH OBJECT GATEWAY (RGW) CEPH BLOCK DEVICE (RBD) CEPH STORAGE CLUSTER (RADOS) FEATURES Full integration with Nova, Cinder and Glance Single storage for images and ephemeral and persistent volumes Copy-on-write provisioning Swift-compatible object storage gateway Full integration with Red Hat Enterprise Linux OpenStack Platform 1 BENEFITS Provides both volume storage and object storage for tenant applications Reduces provisioning time for new virtual machines No data transfer of images between storage and compute nodes required Unified installation experience with Red Hat Enterprise Linux OpenStack Platform

18 STORAGE FOR TENANT APPLICATIONS OPENSTACK Unstructured data storage for distributed, cloud-native applications APP APP APP S3 API S3 API S3 API CEPH OBJECT GATEWAY (RGW) APP S3 API CEPH OBJECT GATEWAY (RGW) RED HAT CEPH STORAGE CLUSTER FEATURES Compatibility with S3 and Swift APIs Fully-configurable replicated or erasure coded storage backends Cache tiering pools Multi-site failover BENEFITS Supports broad ecosystem of tools and applications built for the S3 API Provides a modern hot/warm/cold storage topology that offers cost-efficient performance Advanced durability at optimal price

19 RICH MEDIA Unstructured image, video, and audio content Massively-scalable, flexible, and cost-effective storage for image, video, and audio content Red Hat Gluster Storage Cluster FEATURES BENEFITS Support for multi-petabyte storage clusters on commodity hardware Erasure coding and replication for capacityoptimized or performance-optimized pools Support for standard file & object protocols Snapshots and replication capabilities for high availability and disaster recovery Red Hat Ceph Storage Cluster Provides massive and linear scalability in onpremise or cloud environments Offers robust data protection with an optimal blend of price & performance Standard protocols allow access to broadcast content anywhere, on any device Cost-effective, high performance storage for on-demand rich media content

20 ACTIVE ARCHIVES Unstructured file data Open source, capacity-optimized archival storage on commodity hardware Red Hat Gluster Storage Cluster FEATURES Cache tiering to enable "temperature"based storage Erasure coding to support archive and cold storage use cases Support for industry-standard file and object access protocols Unstructured object data Volume backups Red Hat Ceph Storage Cluster BENEFITS Store data based on its access frequency Store data on premise or in a public or hybrid cloud Achieve durability while reducing raw capacity requirements and limiting cost Deploy on industry-standard hardware

21 FILE SYNC AND SHARE Web browser Powerful, software-defined, scaleout, on-premise storage for file sync and share with owncloud Mobile application Desktop OS OWNCLOUD ENTERPRISE EDITION RED HAT GLUSTER STORAGE FEATURES Secure file sync and share with enterprise-grade auditing and accounting Combined solution of Red Hat Gluster Storage, owncloud, HP ProLiant SL4550 Gen 8 servers BENEFITS Deployed on-premise, managed by internal IT Access sync and share data from mobile devices, desktop systems, web browsers Secure collaboration with consumer-grade ease of use Lower risk by storing data on-premise Conform to corporate data security and compliance polices Lower total cost of ownership with standard, high-density servers and open source

22 ENTERPRISE VIRTUALIZATION Scalable, reliable storage for Red Hat Enterprise Virtualization FEATURES Manage storage through the RHEV-M console Deploy on standard hardware of choice 22 Reliably store virtual machine images in a distributed Red Hat Gluster Storage volume Seamlessly grow and shrink storage infrastructure when demand changes The Journey to Software-Defined Storage BENEFITS Reduce operational complexities by eliminating dependency on complex and expensive SAN infrastructures Deploy efficiently on less expensive, easier to provision, standard hardware Achieve centralized visibility and control of server and storage infrastructure INTERNAL ONLY

23 RED HAT STORAGE FUTURE WORKLOADS

24 USE CASES: TODAY AND FUTURE CURRENT USE CASES Big Data analytics ANALYTICS Storage plug-in for Hortonworks Data Platform Machine data analytics Online cold storage for IT operations data with Splunk TARGET USE CASES Big Data analytics Persistent back-end for Spark Machine data analytics Storage for ELK, Solr

25 USE CASES: TODAY AND FUTURE CURRENT USE CASES Virtual machine storage OPENSTACK Volume, ephemeral, and image storage with Cinder, Nova, and Glance Object storage for tenant applications Swift-compatible storage for cloud applications TARGET USE CASES Database storage Storage for databases with Trove Storage back-end for Manila Shared file system-as-aservice for tenants

26 USE CASES: TODAY AND FUTURE CURRENT USE CASES TARGET USE CASES Rich media streaming RICH MEDIA AND ARCHIVAL Cost-effective storage for rich media streaming Active archives Cost-effective online storage for active archives Compliant archives Scalable, cost-effective storage for compliance and regulatory needs

27 USE CASES: TODAY AND FUTURE CURRENT USE CASES ENTERPRISE SYNC AND SHARE Enterprise sync and share Storage for Dropbox-style shared folders (file backend) TARGET USE CASES Enterprise sync and share Storage for shared folders (object backend)

28 USE CASES: TODAY AND FUTURE CURRENT USE CASES ENTERPRISE VIRTUALIZATION Conventional virtualization storage Integrated storage for Red Hat Enterprise Virtualization (with separate compute and storage clusters) TARGET USE CASES Hyper-converged architectures Hyper-converged architectures