Clodoaldo Barrera Chief Technical Strategist IBM System Storage. Making a successful transition to Software Defined Storage

Transcription

1 Clodoaldo Barrera Chief Technical Strategist IBM System Storage Making a successful transition to Software Defined Storage Open Server Summit Santa Clara Nov 2014

2 Data at the core of everything Data is a key element of business innovation Data growth stresses IT budgets and processes 2.5 Billion Gigabytes of data per day Data Explosion 90% of data created in last two years Data Economics 0.4% overall IT budget growth in % more data in 5 years Data Innovation 30% lower TCO with Flash 50% lower storage management cost with Software Defined Storage $! The top challenges organizations face with IT infrastructure are storage related Data Management and Cost Efficiency Open Server Summit Santa Clara Nov 2014

3 Multiple shifts affecting Storage usage IT innovation Clients Business innovation by LOB Industry Technology Cost Pressure Technology Innovation Workloads The need for agility

4 New Era Workloads Demand Next Generation Automation Defined by software for the Cloud Before Policy Policy After Software Defined Environment Application Aware Policy Policy Policy Continuous Optimization Static and manual assignment of IT resources Adaptive approaches to infrastructure automation

5 Copyright IBM Corporation 2014 SDS Definition From IDC Software-defined storage: platforms that deliver the full suite of storage services via a software stack that uses (but is not dependent on) commodity hardware built with off-the-shelf components. No proprietary hardware - custom ASICs, chipsets, memory components, or CPUs Run on multiple (physical or virtual) hardware instances that are not factory configured by the supplier. Standalone system - provides all essential northbound storage services and handles all southbound data persistence functions IDC July 2014 #247700, IDC s Worldwide Software Defined Storage 2014, Ashish Nadkarni et.al

6 SDS The Goal Through the Control Plane, Orchestration Software can configure a storage environment to match the needs of the current workload, or change parameters on existing storage. E,g, Provision new capacity to Tenant A Increase/Decrease Network bandwidth to Tenant B NAS Migrate Tenant A iscsi to faster disk Storage Software Storage Software Storage Software Policies Control Plane Storage Software Workflows

7 SDE Virtual Infrastructure Through the Control Plane, Orchestration Software can configure a complete virtual system environment in response to the requirements of a specific Tenant and Workload Virtual Servers and Networks can change more dynamically than most storage environments But Storage needs to participate in the overall management and administration structure Control Plane Virtual Network Storage Software Virtual Server Storage Software Virtual Server Virtual Network Storage Software Virtual Server Storage Software

8 behind it. Storage Classes for Cloud Each storage class could have one or more tiers of storage Storage Class (as seen by Guest VM) Block Transaction Key-Value Store Block - General Purpose Req s Attach to Hosted VMs low latency high I/Ops, low capacity Attach to Hosted VMs medium latency medium I/Ops, general purpose Notes Enterprise class attributes in performance and availability Usually fibre channel connected More complex to manage with many limitations General purpose, cost effective storage Usually NAS+Block Virtualization for cost, ease of management, and scalability Block - Ephemeral Allocated to hosted VMs for duration of VM instance medium latency medium I/Ops, Typically boot images Storage allocated as private to a VM, disappears when VM instance is deleted. Used for boot images or VM specific private disks Can be created by cloning boot image templates from service catalogue Storage for Analytics Network Attached Storage Achieve performance and scale required to meet client expectations Attach to hosted VMs or over VPN medium latency medium I/Ops NAS/FIle access large capacity May require unique hardware infrastructure May require batch-oriented usage model For dedicated solutions multi-tenancy at the NAS storage device may not be required For shared solutions fine grained multi-tenancy is a key requirement Fixed Content Object Storage Med - high latency Med - low I/Ops Local/WAN/Internet access very low cost large capacity Requires fine grained multi-tenancy REST API assumed as the carrier Storage as seen by the virtual machine guest: Block storage: A virtual block disk provisioned to the guest VM NAS storage: A network mountable file system to the guest VM Fixed content: A network mountable data store to the guest VM that is write once oriented

9 OLTP & Database IBM Cloud Services & Storage Classes Customer Workloads Business Apps HPC / Analytics Web, Collab, Infrastructure Backup, Archive Target Market Selection Cloud Storage Management & Security (provisioning, monitoring, encryption, retention, deletion, etc.) Cloud Storage Platform Services Storage for hosted VMs Block Transactional Transactional Storage Virtual Block Grid Block SmartCloud Managed Backup Smart Archive Cloud Storage Classes Block General Purpose Block Ephemeral File Network Attached Storage Storage Technology for Cloud File Server Object Store Storage Container Service API Object Tape Cloud Service Design Storage Service Design Storage Product Selection

10 An Abstracted Architecture Cloud Storage Remote User Specialty Application Gateway Object API User Snapshots Objects Geo Replication Services Object Storage User Portal Admin Portal Server/FS/Disk Server/FS/Disk Object API Snapshots User Objects Geo Replication Services Object Storage General VMs Server/FS/Disk 10 Local Facility

11 Object API Snapshots User Objects An Abstracted Architecture Transaction & Analytics Geo Replication Services Object Storage User Portal Object API General VMs Server/FS/Disk Snapshots User Objects Admin Portal Transaction VMs SAN Storage Geo Replication Services Object Storage Analytics Servers w/ SSDs SAN Storage 11 Local Facility

12 Hybrid Cloud Pictures On-Prem Cloud SAN / NAS Backup / Archive Facility Cloud Gateway Storage REST API (Objects) SAN / NAS Backup / Archive Ingest

13 Building a cloud foundation from Enterprise IT Optimize Cloud Ready Automate and Manage Image Library Consolidate and Virtualize Image App Image Image Image OS App App App OS OS OS STANDARDIZATION LIFE CYCLE MANAGEMENT

14 SDS - Overview Workloads Control Plane SDE Environment Virtual Storage + Existing SANs Grid Storage for Cloud Object File and Object data lake

15 OpenStack is a global collaboration of developers & cloud computing technologists working to produce an ubiquitous Infrastructure as a Service (IaaS) open source cloud computing platform for public & private clouds. OpenStack Compute (Nova) Provision and manage large networks of virtual machines OpenStack Object Store (Swift) Create petabytes of secure, reliable storage using standard HW OpenStack Dashboard (Horizon) Enables administrators and users to access & provision cloud-based resources through a self-service portal. OpenStack Networking (Quantum) Manage network connectivity for virtual machines OpenStack Compute Storage (Cinder) Managed persistent storage OpenStack File Storage (Manila) Managed persistent storage OpenStack Image Service (Glance) Catalog and manage massive libraries of server images OpenStack Identity (Keystone) Unified authentication across all OpenStack projects and integrates with existing authentication systems. Code available under Apache 2.0 license. Design tenets scale & elasticity, share nothing & distribute everything

16 OpenStack is not enough: System Vendor Value Add Common Cloud Management Services Orchestration Services: Server, Storage, and Network Platform Services: Simplifies deployment and lifecycle management of middleware and application patterns Infrastructure Services: Built on OpenStack but enhanced with enterprise hardening, simplified install and use Operational Extensions (APIs) (Image Lifecycle Mgmt) Orchestration Services Platform Level Services (Pattern Services) Infrastructure Level Services (Provisioning, configuration, resource allocation, security, metering, etc.) Development Extensions (Tooling) Cloud Resources Storage Compute Network

17 Thank you!