Flash and OpenStack in the Enterprise: An Accelerating Trend

Transcription

1 Flash and OpenStack in the Enterprise: An Accelerating Trend Dave Wright Founder & CEO Roark Hiloman Data & Storage Technologist

2 Why all the excitement about Cloud? We are now 10 years in to the Virtualization Revolution in the datacenter For smaller scale use cases it still is good But, when scaling virtual environments Adding and deploying hypervisors Storage performance degradation Networking headaches Management complexity Something had to change at scale

3 Enter Cloud Computing It s no longer just about a collection of virtual machines It s all about: Abstraction Automation Resource utilization Utility consumption model Portability Dynamic and massive scale Common interfaces / APIs

4 OpenStack as a Cloud Operating System Project launched in 2010 Open source software for building and managing clouds A collection of software projects that tie into common management layer Created to Drive industry standards Accelerate cloud adoption Put an end to cloud lock-in Deliver AWS-like functionality and economics outside of AWS

5 OpenStack Ecosystem Representative Vendors Applications / PaaS Availability, Monitoring & Config. Management OpenStack Software Distributions Compute Networking Block Storage Object Storage

6 So what does OpenStack really do? Abstracted physical and virtualized resources tied into common management layer Virtual machines, Bare Metal, Storage, Networking, etc. Easy to use REST-API Self-service virtual environments for end users Dynamic resource provisioning Designed for massive scale

7 SolidFire & OpenStack The industry s most comprehensive Cinder support Unparalleled combination of guaranteed performance, high-availability and scale Enhanced features in Grizzly release; QoS settings via volume types Boot from volumes Multi-backend support Established interoperability & partnerships with industry leaders; "SolidFire has done a great job leading the Block Storage project in line with the OpenStack philosophy of delivering a pluggable architecture with integration points for multiple vendors and technologies. It's exciting to see more production implementations and configuration options available to OpenStack users. - Jonathan Bryce, Executive Director, OpenStack Foundation

8 The Problem Traditional enterprise storage doesn t work at cloud scale. Too slow, complex, and expensive.

9 The SolidFire Solution Scale-out high performance storage systems designed for next-generation datacenters Largest and Fastest all-ssd storage system Scale-Out Architecture: 48TB 3.4PB, 7.5M IOPS Lower $/GB, 20X performance of traditional SANs Extreme density and power efficiency Industry-standard hardware, 10 GigE iscsi

10 Problem of the Legacy Data Center Dedicated (Single Application) More consistent performance High operational costs Low utilization rates No high availability No on demand scalability VDI Shared (Many Applications) Capacity Optimized Inconsistent performance Low utilization rates No dynamic scalability No resource automation Lowest cost

11 The Next Generation Data Center Shared Storage Infrastructure with Guaranteed Performance VDI ALL Applications within a single infrastructure Predictable fine-grain performance control Dynamic performance and capacity scale Fully Automated High utilization Below $3/GB

12 SolidFire Functionality Scale-out Simultaneous scaling of both capacity and performance High Availability RAID-less data protection maintains data availability, security and performance regardless of failure condition. Guaranteed Performance Fine-grain performance management with Guaranteed Quality of Service (QoS) In-line efficiency In-line data reduction reduces data footprint, requires less purchased capacity Management Automation Intuitive UI, CLI, and REST-based API for ease of management complete automation

13 Flash for the Next Generation Data Center

14 Roark Hilomen Data and Storage Technologist

15 The ebay Inc. Portfolio

16 Today s Enterprise Infrastructure State of Infrastructure (Based on acquisition and peer level discussions) Islands of responsibilities (Storage, Networking, Compute, Apps, ) Automation ad hoc and in pockets of responsibilities Resources Dedicated by use case driven by business unit Solutions hand crafted or acquired through 3 rd parties, but limited in scope State of Flash Mindset barrier (endurance, cost, performance only) Vertical use cases, small islands of deployments Shared Storage still handcrafted and managed in vendor islands Ramification Lack of agility Long lead time to deploy Restricts growth and reduces efficiencies

17 The Promise of OpenStack More with Less Virtualization Orchestration of infrastructure resources Customer driven (PD, Ops, Business Unit each IaaS vertical has defined API) Normalization of resources Agility Scale Lead time shortens Shifts model from cottage industry to supply chain managed Allows shifting resources from hand crafting to innovating Common patterns becomes repeatable Simplicity in defining repeatable patterns Image Credit: Open Stack

18 The Promise of Flash Really do more with Less Facilitates overcommitting memory with minimal impact for most use cases IO Density TCO of flash vs. disk hitting inflection point in 2014 Controller able to shield users from endurance and performance limitation of denser flash Density High Performance All Major Storage Array vendors now have an all flash solution Flash is getting denser (2TB-4TB SFF/PCIE) Maturity of the technology is around the corner Density Low Cost Even higher density (8TB +) ASP price on TLC below $0.62/GB - sub $0.50/GB not far off Limited write endurance, but does it matter?

19 Convergence of OpenStack and Flash State of Infrastructure Islands of responsibilities remains, but defined API for integration points now available Automation is now end to end, from compute, networking, storage and application Resources shareable with better efficiencies Solutions hand crafted through defined building blocks and now easily repeatable State of Flash Shared Storage Storage efficiency through dedup and compression Greater density (1PB + per rack protected, prior to efficiency calculation) Enough headroom to guarantee performance SLA s Ramifications Agility Better efficiency = Lower cost Scale

20 The Challenge Flash modeled as flash not as Disk Filesystem optimized and written for flash (data placement) New Failure handling (shrink vs fail) Allow flash to be treated as a system not independent unit (Admin/GC, etc)

21 The Challenge Divergence of Flash High Performance Flash Allows over provisioning to shield from endurance and performance High IOPS/throughput Archival Flash Lowest over provisioning, enough to guarantee data retrieval and consistent performance Highest Density with Good enough performance One device, configurable on deployment/demand to handle either case

22 The Challenge Shared Flash Storage Enforceable SLA (QoS) key to OpenStack and Flash convergence Reduce cost on Protected usable, increase effective modifier Big DATA

23 Flash and OpenStack in the Enterprise: An Accelerating Trend Dave Wright Founder & CEO Roark Hiloman Data & Storage Technologist - Thank you -