Creating a Catalog for ILM Services. Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel



Similar documents
The Secret Sauce of ILM The ILM Assessment Core. Bob Rogers, Application Matrix

UNDERSTANDING DATA DEDUPLICATION. Thomas Rivera SEPATON

UNDERSTANDING DATA DEDUPLICATION. Jiří Král, ředitel pro technický rozvoj STORYFLEX a.s.

Cloud Archiving. Paul Field Consultant

Restoration Technologies. Mike Fishman / EMC Corp.

ARCHIVING FOR DATA PROTECTION IN THE MODERN DATA CENTER. Tony Walker, Dell, Inc. Molly Rector, Spectra Logic

Deduplication s Role in Disaster Recovery. Thomas Rivera, SEPATON

Storage Considerations for Database Archiving. Julie Lockner, Vice President Solix Technologies, Inc.

Deduplication s Role in Disaster Recovery. Thomas Rivera, SEPATON

Deduplication s Role in Disaster Recovery. Gene Nagle, EXAR Thomas Rivera, SEPATON

ILM: Tiered Services & The Need For Classification

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

Information-centric Policy Management. Edgar StPierre, EMC

15 Best Practices For Comparing Data Protection With Cloud Media Server

Trends in Data Protection and Restoration Technologies. Jason Iehl, NetApp

in Transition to the Cloud

Introduction to Data Protection: Backup to Tape, Disk and Beyond. Michael Fishman, EMC Corporation

ADVANCED DEDUPLICATION CONCEPTS. Larry Freeman, NetApp Inc Tom Pearce, Four-Colour IT Solutions

Trends in Application Recovery. Andreas Schwegmann, HP

Trends in Data Protection and Restoration Technologies. Mike Fishman, EMC 2 Corporation (Author and Presenter)

UNDERSTANDING DATA DEDUPLICATION. Tom Sas Hewlett-Packard

Archive and Preservation in the Cloud - Business Case, Challenges and Best Practices. Chad Thibodeau, Cleversafe, Inc. Sebastian Zangaro, HP

Active Archive - Data Protection for the Modern Data Center. Molly Rector, Spectra Logic Dr. Rainer Pollak, DataGlobal

An Introduction to Storage Management. Raymond A. Clarke, Oracle

The Storage Capacity Design Dilemma

How to Cost Effectively Retain Reference Data for Analytics and Big Data. Molly Rector, EVP Product Management & WW Marketing, Spectra Logic

Cloud Archive & Long Term Preservation Challenges and Best Practices

Understanding Enterprise NAS

Introduction to Data Protection: Backup to Tape, Disk and Beyond

Storage Cloud Environments. Alex McDonald NetApp

An ITIL Perspective for Storage Resource Management

in the Cloud - What To Do and What Not To Do Chad Thibodeau / Cleversafe Sebastian Zangaro / HP

Enterprise Architecture and the Cloud. Marty Stogsdill, Oracle

Building the Business Case for the Cloud

Today s Agile, Complex and Heterogeneous Data Centers

Best Practices for Long-Term Retention & Preservation. Michael Peterson, Strategic Research Corp. Gary Zasman, Network Appliance

Enterprise Architecture and the Cloud. Marty Stogsdill, Oracle

Data Center Transformation. Russ Fellows, Managing Partner Evaluator Group Inc.

Backup to Tape, Disk and Beyond. Jason Iehl, NetApp

Rethinking Archiving: Exploring the path to improved IT efficiency and maximizing value of archiving solution investments

LEVERAGING FLASH MEMORY in ENTERPRISE STORAGE. Matt Kixmoeller, Pure Storage

Storage Clouds. Enterprise Architecture and the Cloud. Author and Presenter: Marty Stogsdill, Oracle

Information Migration

Technology Insight Series

Storage Clouds. Karthik Ramarao. Director of Strategy and Technology and CTO Asia Pacific, NetApp Board Director SNIA South Asia

Using Classification to manage File Servers. Nir Ben-Zvi, Microsoft Corporation

EMC, VNX and ENERGY EFFICIENCY

EMC NETWORKER SNAPSHOT MANAGEMENT

Accelerating Applications and File Systems with Solid State Storage. Jacob Farmer, Cambridge Computer

Tape s evolving data storage role Balancing Performance, Availability, Capacity, Energy for long-term data protection and retention

Cloud-integrated Storage What & Why

How to Manage Critical Data Stored in Microsoft Exchange Server By Hitachi Data Systems

Deploying Public, Private, and Hybrid Storage Clouds. Marty Stogsdill, Oracle

Cloud OS Vision. Modern platform for the world s apps

Cloud-integrated Enterprise Storage. Cloud-integrated Storage What & Why. Marc Farley

Scale and Availability Considerations for Cluster File Systems. David Noy, Symantec Corporation

IBM Storage Management within the Infrastructure Laura Guio Director, WW Storage Software Sales October 20, 2008

How To Understand And Understand The Risks Of Configuration Drift

The Real-World State of Storage Management. Julie Ryan SNIA Board of Directors LSI

SERVER VIRTUALIZATION AND STORAGE DISASTER RECOVERY. Ray Lucchesi, Silverton Consulting

<Insert Picture Here> Refreshing Your Data Protection Environment with Next-Generation Architectures

Networking. Cloud and Virtual. Data Storage. Greg Schulz. Your journey. effective information services. to efficient and.

IBM System Storage DR550

Writing Storage RFP s in John Webster, Evaluator Group

Interoperable Cloud Storage with the CDMI Standard

Business Benefits of Data Footprint Reduction

WAN Optimization and Thin Client: Complementary or Competitive Application Delivery Methods? Josh Tseng, Riverbed

Overview of Storage and Data Management Industry Trends in Long Term Information Retention and Preservation

How it can benefit your enterprise. Dejan Kocic Hitachi Data Systems (HDS)

Preparing for a Security Audit: Best Practices for Storage Professionals

How To Protect Data On Network Attached Storage (Nas) From Disaster

OPTIMIZING EXCHANGE SERVER IN A TIERED STORAGE ENVIRONMENT WHITE PAPER NOVEMBER 2006

Mobile World. Chris Winter SafeNet Inc.

IBM Infrastructure for Long Term Digital Archiving

Real-time Compression: Achieving storage efficiency throughout the data lifecycle

Sibling Rivalries: Integrating Data Management Technologies

Introduction to Database as a Service

Energy Efficient Storage - Multi- Tier Strategies For Retaining Data

Continuous Data Protection

How To Create A Cloud Backup Service

Cloud Data Management Interface (CDMI) The Cloud Storage Standard. Mark Carlson, SNIA TC and Oracle Chair, SNIA Cloud Storage TWG

Reduce your data storage footprint and tame the information explosion

Moving Data and Distributing Data

EMC DATA DOMAIN EXTENDED RETENTION SOFTWARE: MEETING NEEDS FOR LONG-TERM RETENTION OF BACKUP DATA ON EMC DATA DOMAIN SYSTEMS

Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration

High Performance Computing OpenStack Options. September 22, 2015

Sujee Maniyam, ElephantScale

How To Migrate To A Network (Wan) From A Server To A Server (Wlan)

SSD and Deduplication The End of Disk?

Server and Storage Virtualization with IP Storage. David Dale, NetApp

Redefining Oracle Database Management

Three Virtualization Management Myths Busted. Rich Corley, NetApp

Using HP StoreOnce Backup Systems for NDMP backups with Symantec NetBackup

Global Headquarters: 5 Speen Street Framingham, MA USA P F

DEFINING THE RIGH DATA PROTECTION STRATEGY

Data Center Storage. Hubbert Smith. Implementation, and Management »C) Cost-Effective Strategies, CRC Press J Taylor & Francis Group

journey to a hybrid cloud

Long term retention and archiving the challenges and the solution

IBM System Storage Executive Briefing Center Topics (Tucson)

DFS For Not-So Dummies. Matthew Geddes

Transcription:

Creating a Catalog for ILM Services Bob Mister Rogers, Application Matrix Paul Field, Independent Consultant Terry Yoshii, Intel

SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. 2

Session Abstract Organizations looking to improve efficiencies in the data center should have policies in place to assign information assets to the appropriate level of service. Some organizations may find it difficult to create and use information lifecycle management policies due to their perceived complexity. This tutorial will discuss the concept of a storage services catalog and how it can be leveraged to facilitate the creation and use of storage levels of service. 3

Learning Objectives Understand what a storage services catalog is and how it can benefit organizations looking to implement storage services policies and potentially lower their costs using ILM Show examples of how service level requirements can be matched to storage services policies for different types of information assets 4

Agenda What is a Services Catalog? Why Have a Services Catalog? Information Lifecycle Management ILM Maturity Model Getting to a Services Catalog Services Catalog Example Mapping Service Levels to Infrastructure Summary 5

Why Have a Services Catalog? Provide a structure so application owners and organizational needs can select an appropriate class of service for their information Based on performance, protection requirements, costs, etc. Map service level objectives to catalog levels and then to infrastructure Allow the IT organization to match infrastructure to information, and potentially to lower their costs and improve their green footprint, while providing appropriate service levels 6

Definitions Term Service Catalog Class of Service Service Level Objectives Service Level Agreements Information valuation Meaning A list of services relating to performance, protection, and preservation based on service level objectives A level of service, such as for performance and data protection, designed to match a service level agreement Best effort attempt to meet or exceed performance and data protection metrics Formalized agreements between stakeholders describing service metrics and constraints Describes priorities between workloads and types of information assets to resolve resource constraints 7

Information Lifecycle Management Business Service Management Service Level Management Management Framework Service Level Monitoring, and Alerting Storage Resource Management Active & Passive: capacity usage, trending, charge-back,etc Storage Network Management SAN Topology, Discovery, etc Virtualization Logical Representation of Physical Devices Device Management Management of Individual Devices Information Lifecycle Management Rules-based automated actions 8

Information Lifecycle Management The policies, processes, practices, services and tools used to align the business value of information with the most appropriate and cost-effective infrastructure from the time information is created through its final disposition. Information is aligned with business requirements through management policies and service levels associated with applications, metadata and data. Source: The SNIA Dictionary, January 17, 2008 9

Service Management 10

ITIL Defined Information Technology Infrastructure Library (ITIL) A library of books describing best practices for IT Service Mgt Describes goals, activities, inputs & outputs of processes Not a standard just best practices Specific procedures can vary from organization to organization Focus is Business-IT Integration OPEN approach not tied to any particular vendor ITIL is a registered trademark of the UK Government Office of Government Commerce (OGC) 11

ILM Maturity Model Provides a standardized tool to allow organizations to determine where they stand relative to best practices in managing their information Helps organizations improve their ILM practices in order to balance their information technology service levels and to lower costs Helps organizations prioritize their IT investments, better aligning their costs with the value of their data as this changes over time 12

ILM as a Service Maturity Model Assessment ILM as a Service Spans all domains: Business Application Information Data Storage Service Lifecycle Initial (Ad Hoc) storage service strategy service lifecycle process service levels service metrics Strategy defined Repeatable (Documented) Introduction of service design processes and functions Event/fault monitoring Manual configuration management Some reporting Design of process and functions Defined & Measured (Standardized & Correlated) Storage service catalog Service level transition Capacity management ILM reporting Transition of services Quantitatively Managed (Automated ILM) Storage service catalog Configuration and asset management Tools Processes Config mgmt database All storage classes in CMDB Service operation * If ILM is being offered as a service, these Maturity Model levels can help identify areas of improvement in order to reach a desired end state Optimizing (Continuous Improvement) Highly automated CMDB processes and support Full service lifecycle with continuous improvement 13

Designing a Services Catalog Determine any existing service levels and agreements Identify gaps Expand or create a services catalog Understand costs, determine chargeback metric, and assign a price for each service level or component Design and modify the infrastructure to ensure capabilities to provide the service levels Implement service level management Monitor and measure actual service levels Get feedback and modify the service levels as needed Get new costs and update the service prices 14

Services Catalog Continuous Evolution Changing Business Needs Business & Application Business Rqmts. Cost Reduction/ Containment Operations & Service Delivery Total Cost Services Catalog Service Rqmts. Changing Service Rqmts. Architecture & Engineering Improve Service Efficiency Storage Design Technical Rqmts. Changes to Services or Designs 15

Service Catalog Drivers Information Value Based on the yield to the business brought by having information available Opportunity Cost (Risk) Based on the cost to the organization of not having information (converse of value) Infrastructure Cost Services apportioned based on IT cost center allocation 16

Creating a Price $4,000 Acquisition $3,000 Managing Planning Space $3,000 $1,000 $500 Utilities $1,000 Etc. $5,000 All Costs Allocate costs to service levels $1,000 $1,000 $19,500 per TB per year 17

Services Catalog Example Relative Cost Highest Higher Medium Lower Lowest Amount of current storage Storage growth rate High High High Medium Medium Medium Medium Low Availability Uptime 99.999% 99.99% 99.9% 99% 98% Performance Data Access Active data Over 30 day old data Over 1 year old data <0.5 Sec <2 Sec <5 Sec <1 Sec <5 Sec <10 Sec <2 Sec <10 Sec <5 Min <3 Sec <1 Min <10 Min Low Low <4 Sec <5 Min <30 Min Recovery time from failure (RTO) Active data Over 30 day old data Over 1 year old data <20 Sec <1 Min <2 Min <5 Min <10 Min <20 Min <30 Min <2 hours <4 hours <4 Hours <8 hours <24 hours <48 Hours <48 hours <48 hours Data loss tolerance (RPO) 0 1 Min 5 Min 30 Min 1 Hour Data Security Encryption in flight (at source) Encryption at rest Secure delete Data retention Indefinite 20 years 7 years 3 years 1 year 18

Services Catalog Selections Relative Cost Highest Higher Medium Lower Lowest Amount of current storage Storage growth rate High High High Medium Medium Medium Medium Low Availability Uptime 99.999% 99.99% 99.9% 99% 98% Performance Data Access Active data Over 30 day old data Over 1 year old data <0.5 Sec <2 Sec <5 Sec <1 Sec <5 Sec <10 Sec <2 Sec <10 Sec <5 Min <3 Sec <1 Min <10 Min Low Low <4 Sec <5 Min <30 Min Recovery time from failure (RTO) Active data Over 30 day old data Over 1 year old data <20 Sec <1 Min <2 Min <5 Min <10 Min <20 Min <30 Min <2 hours <4 hours <4 Hours <8 hours <24 hours <48 Hours <48 hours <48 hours Data loss tolerance (RPO) 0 1 Min 5 Min 30 Min 1 Hour Data Security Encryption in flight (at source) Encryption at rest Secure delete Data retention Indefinite 20 years 7 years 3 years 1 year 19

Mapping Service Levels to Infrastructure Relative Cost Highest Higher Medium Lower Lowest Amount of current storage Storage growth rate Availability Uptime Performance Active data Inactive Over 30 day old data Over 1 year old data Business Continuity (BC) Recovery time (RTO) Active data Over 30 day old data Over 1 year old data Large Thin provisioning No single point of failure Solid State Disk SATA disk SATA disk Clone disk Snapshot disk Virtual tape Large Thin provisioning Component redundancy FC/SAS disk SATA disk SATA disk Virtual tape Online tape Nearline tape Data loss tolerance (RPO) Journaled Point InTime (PIT) Snapshots Data Security Encryption in flight Encryption at rest Secure delete Data retention At source Included Hardware destruction ne Disk / tape Software shredding Medium Thin provisioning Component redundancy SATA disk SATA disk Online tape Nearline tape Offline tape Offline tape Medium Full provisioning Some redundancy (RAIDx) SATA disk MAID disk Online tape Offline tape Offline tape Offsite tape Small Full provisioning Some redundancy (RAIDy) MAID disk Online tape Offline tape Offsite tape Offsite tape Offsite tape VTL Online tape Offline tape ne Tape Key Deletion ne Tape ne Periodic migration and deletion at expiration ne ne ne 20

Service Level Infrastructure SAS Tier 1 Solid State Disk SATA Disk Sync Mirror SAS Tier 2 SAS Async Mirror SAS SATA Disk Tier 3 Tier 5 MAID 21

Summary A services catalog can help an organization better match their IT infrastructure to the value of their information An organization can assess its level of ILM maturity and make progress in steps to achieve its objectives Check out SNIA Tutorial: Retaining Information for 100 Years 22

About the SNIA DMF This tutorial has been developed, reviewed and approved by members of the Data Management Forum (DMF) The DMF is an industry resource to those responsible for protecting, controlling, and preserving their organization s information The DMF focuses on the technologies and trends related to Data Protection, ILM, and Long-term digital information retention and preservation DMF Workgroups: Data Protection Initiative (DPI) Defining best practices for data protection and recovery technologies such as Backup, CDP, Data deduplication and VTL Information Lifecycle Management Initiative (ILMI) Developing, educating and promoting ILM practices, implementation methods, and benefits Long-term Archive and Compliance Storage Initiative (LTACSI) Addressing the challenges of retaining, securing, and preserving digital information for the long-term 23

Q&A / Feedback Please send any comments on this tutorial to SNIA at: trackdatamgmt@snia.org The DMF would like to thank the following individuals for their contributions to the development of to this tutorial. Bob Rogers Paul Field Terry Yoshii It s easy to get involved with the DMF! - Find a passion - Join a committee - Gain knowledge & influence - Make a difference www.snia.org/forums/dmf 24