YSS-1841 IBM Cloud Storage Options. Tony Pearson IBM Master Inventor and Senior Software Engineer

Transcription

1 YSS-1841 IBM Cloud Storage Options Tony Pearson IBM Master Inventor and Senior Software Engineer

2 Cloud Storage Taxonomy Ephemeral Storage Typically boot volumes, page files and temporary data Goes away when VM is shutdown Hosted Storage File and Object access File Sync & Share Backup/Disaster Recovery Persistent Storage Persists across VM reboots Can be shared between VMs Transactional High Performance Reference Storage Archives Images/Video WORM/NENR Storage for Compute Cloud Storage as the Storage Cloud 2

3 Cloud Storage Overview Block Ephemeral Persistent Block storage offerings are differentiated by speed/throughput (as measured in IOPS) and segmented by lifecycle of the disk. Device location does not matter. Ephemeral storage is tied to the lifecycle of a single VM (i.e. it is provisioned when the VM is provisioned and destroyed when the VM is destroyed) Persistent storage has a lifecycle independent of any single VM and can be provisioned/destroyed at any time and attached/detached to many VMs during it s life File File-based offerings are uncommon among providers, especially among those targeting cloud native applications Primarily targeted at cloud enabled workloads Usage is being replaced in new application development with online object storage Object Online Archival Object storage offerings are differentiated by the durability of the data (i.e. odds of irrecoverable loss) and segmented by the availability of the data (i.e. time required to retrieve) An object in online storage is immediately accessible An object in archival storage may require minutes to hours to be accessible 3

4 What s Different about Spectrum Accelerate? 6/9-15 Modules Pre-built System Software-only FCP Ethernet IB Ethernet Host FCP + Hyper-Scale Mobility Host iscsi + Mgmt FCP Ethernet IB Internode 6-12 cores GB RAM 12 SED 1, 2, 3, 4, 6 TB Optional SSD 500, 800 GB 3-15 Modules Host iscsi + Inter-node + Management Ethernet 4-20 cores GB RAM VMware ESXi HDD, JBOD 1, 2, 3, 4 TB Optional SSD GB 6

5 IBM Spectrum Accelerate for Block-Level Hyperconvergence iscsi VM 1 VM 2 Hypervisor Spectrum Accelerate Enables the IT administrator to single-handedly manage the entire data center stack iscsi VM 3 VM 5 VM 4 Hypervisor VM 6 Hypervisor iscs I Spectrum Accelerate isc SI Spectrum Accelerate Ethernet Interconnect Allows hardware standardization of network, compute, storage, power and environmentals Leverages existing Data Center services and maintenance contracts Simplifies the architecture when lacking specialized, domainspecific skill sets 8

6 IBM Spectrum Accelerate --- as a Service! Single order for Accelerate on IBM SoftLayer Operating Expense (OPEX) - no capital required Ordered: Base of 50TiB Increments of 20 TiB Two configurations are offered: Capacity oriented (for archive type of applications) Performance oriented (for real time processing applications) Each package includes all features and unlimited traffic Capacity oriented servers Dual CPU 6 cores 32 GB RAM 11 x 4TB SATA drives 10GbE dual private links Performance oriented servers Dual CPU 8 cores 64 GB RAM 11 x 4TB SATA drives 800GB SSD 10GbE dual private links 9

7 Virtualize Your Storage with IBM Spectrum Virtualize Virtual Server Infrastructure FlashSystem V9000 Virtual Storage Infrastructure San Volume Controller Storwize V7000 V7000 Unified, V

8 Real-time Compression implementation on Spectrum Virtualize Stretch Cluster forwarding Metro Mirror, HyperSwap Upper cache FlashCopy Global Mirroring Thin Provisioning Compression offloaded to Intel QuickAssist FPGA Lower cache IBM Random Access Compression Engine Benefits Hardware-assisted real-time compression Compressed data in cache to increase hit ratios More capacity savings than data deduplication for active data Compress existing data without downtime Encryption 5x effective capacity! Compress before Encryption to optimize benefits of both 33

9 IBM Spectrum Scale Flexible File and Object Storage One big file system or divide into as many as 256 smaller file/object systems Exabyte-Scale, Global Namespace FS1... FS256 Each file system can be further divided into fileset containers Other Datacenters ROBO Metadata can be separated to its own Pool or intermixed with data Files and objects can be migrated to tape to reduce costs 36

10 IBM Spectrum Archive Overview IBM Spectrum Archive enables IBM tape libraries to read and write LTFS-format tapes as part of a Spectrum Scale global namespace Based on the integration of Spectrum Scale and LTFS technology Supports Spectrum-enabled devices TS1140 (or higher) Enterprise Drive LTO5 (or higher) Ultrium drive IBM Libraries TS4500, TS3500, TS3310, etc. Integrated functionality with Spectrum Scale Supports Policy based migrations Seamless DMAPI usage Data replication to multiple pools Supports scale-out for capacity and I/O Seamless cache controls between Spectrum Archive Nodes Tape drive performance balancing Multiple node performance balancing Tokyo Las Vegas London Clients Wide Area Network (WAN) Global Namespace LTFS LTFS LTFS LTFS 46

11 IBM Spectrum Scale for File Sync-and-Share No IT Control: Servers and storage Security Access control User provisioning Sensitive data Internal, Direct-Attach TCP/IP or RDMA network SAN Twin-tailed 57

12 Storage Efficiency with Cleversafe Original 1.20 PB Raw How to build a highly reliable storage system for 1 Petabyte of usable data? RAID 6 + Replication Onsite mirror 1.20 PB Raw Remote copy 1.20 PB Raw 1 PB 3.6 PB x 3.6x 3 FTE Replication/backup Usable Data Raw Storage 4TB Disks Racks Required Floor Space Ops Staffing Extra Software Cleversafe 567 TB Raw 567 TB Raw 567 TB Raw 1 PB 1.7 PB x 1.7x.5 FTE None $ 70% + TCO Savings Information Dispersal Algorithm (IDA) Erasure coding is used to transform encrypted pieces of data into a customizable number of slices (7 pieces into 12 slices, in this example) Highly Scalable and Reliable Only a subset of disks needed to retrieve data (any 7 disks out of 12, in this example) 58

13 Writing Data to Cleversafe Original Data Accesser Appliance, Application, VM, Docker Container or Embedded $ Original object is encrypted then cut into pieces Accesser 2 1 Encrypted, Erasure Coded Slices Information Dispersal Algorithm (IDA) Erasure coding is used to transform the data into a customizable number of slices (7/12 in this example) Slicestor Appliances SITE 1 SITE 2 SITE 3 Each slice is written to a separate storage node. In this example, the storage nodes are geographically dispersed across 3 sites. 61

14 Reading Data from Cleversafe With erasure coding k pieces are turned into n slices: Reads can be performed using any k of the n slices This example is a 7 of 12 Information Dispersal Algorithm (IDA) means only 7 slices are needed to reconstruct the original object With this IDA, a read can still be executed with any five storage nodes being unavailable out of 12. Storage Nodes SITE 1 SITE 2 SITE $ With 3 sites, even an entire site outage (plus one additional storage node outage) can be tolerated. 62

15 Cloud Storage Positioning High Performance Unified file and object storage. Optimized for high performance, across flash, disk and object store Transparent Cloud Storage Tiering (beta) Object storage on disk File, backup and archive interfaces available through variety of options IBM SoftLayer OpenStack Swift Amazon Web Services S3 Swift S3 emulation Information Lifecycle Management across tiers Unified file and object storage on tape Flash Disk Object Store Lower cost Tape 66

16 Object storage pools for IBM Spectrum Protect Cloud storage pools will exploit object-storage APIs provided by cloud, without need for gateway Native cloud storage support based on container pools (not enabled for use as copy pool or database backup media) Initial support OpenStack Swift, including IBM SoftLayer, IBM Cleversafe and IBM Spectrum Scale Client backup/restore, archive/retrieve directly to/from object-storage pool On-premises server and object storage pool On-premises server, off-premises object storage pool Off-premises server and object storage pool Clients Server Object storage Clients Server TCP/IP Object storage Clients Clients Server Object storage On-premises server replicating to server in cloud Clients Replication Storage hierarchy Server Server Object storage 80

17 Cloud Storage Taxonomy Persistent Storage Persists across VM reboots Can be shared between VMs Transactional High Performance Transactional Performance Ephemeral Storage Typically boot volumes, page files and temporary Goes away when VM is shutdown Universal Access Hosted Storage File Storage Object Storage Backup Disaster Recovery Spectrum Scale, Elastic Storage Server Reference Storage Archives Images Video NENR and WORM Lowest TCO IBM XIV / SVC / DS8000 / FlashSystem Cleversafe, Spectrum Archive Storage for the Compute Cloud Storage as the Storage Cloud 81

18 Notices and Disclaimers Copyright 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law 82

19 Notices and Disclaimers Con t. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera, Bluemix, Blueworks Live, CICS, Clearcase, Cognos, DOORS, Emptoris, Enterprise Document Management System, FASP, FileNet, Global Business Services, Global Technology Services, IBM ExperienceOne, IBM SmartCloud, IBM Social Business, Information on Demand, ILOG, Maximo, MQIntegrator, MQSeries, Netcool, OMEGAMON, OpenPower, PureAnalytics, PureApplication, purecluster, PureCoverage, PureData, PureExperience, PureFlex, purequery, purescale, PureSystems, QRadar, Rational, Rhapsody, Smarter Commerce, SoDA, SPSS, Sterling Commerce, StoredIQ, Tealeaf, Tivoli, Trusteer, Unica, urban{code}, Watson, WebSphere, Worklight, X-Force and System z Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: 83

20 Thank You Your Feedback is Important! Access the InterConnect 2016 Conference Attendee Portal to complete your session surveys from your smartphone, laptop or conference kiosk.

21 IBM Tucson Executive Briefing Center Tucson, Arizona is home for storage hardware and software design and development IBM Tucson Executive Briefing Center offers: Technology briefings Product demonstrations Solution workshops Take a video tour! 85

22 About the Speaker Tony Pearson Master Inventor Senior Software Engineer IBM Storage 9000 S. Rita Road Bldg 9032 Floor 1 Tucson, AZ (Office) [email protected] Tony Pearson is a M aster Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM Corporation in 1986 in Tucson, Arizona, USA. In his current role, Tony presents briefings on storage topics covering the entire IBM Storage product line, Software Defined Storage, Analytics, Watson, and Cloud Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with str ategic planning for IBM s integrated set of storage management software, hardware, and virtualization products. Tony wr ites the Inside System Storage blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by Networking World magazine, and #1 most read IBM blog on IBM s developerworks. The blog has been published in series of books, Inside System Storage: Volume I through V. Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a M aster of Science degree in Electrical Engineering, both from the University of Arizona. Tony has 19 patents for inventions on storage hardware and software products. 86

23 Additional Resources from Tony Pearson Twitter: twitter.com/az99øtony Blog: ibm.co/pearson Books: IBM Expert Network on Slideshare: Facebook: Linkedin: 87