The Storage Capacity Design Dilemma

Transcription

1 The Storage Capacity Design Dilemma an ITIL approach LeRoy Budnik Knowledge Transfer

2 SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA and portions are subject to other copyrights 1. Member companies and individuals may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced without modification The SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations. This specific legal notice shall not be removed. This presentation is a project of the SNIA Education Committee. The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved Knowledge Transfer 2

3 Abstract The Storage Capacity Design Dilemma As architects, we must continually discover capability limits, constraints, and patterns and match requirements, capabilities and cost to provide an effective design. When we add the business requirements, it becomes the core mantra of ILM. Yet translating these requirements into hardware and software is not easy. In the process, we must continuously choose between complex alternatives, some of which seem equally unacceptable, and hence the dilemma. In this session, we will introduce fundamentals of storage infrastructure design from the perspective of ILM requirements. We will introduce key formulas, the science of storage capacity planning and follow a case study to demonstrate application in host, fabric and array design, to meet the requirements. The dilemmas of design decisions clear up once you know the formulas. It will change your thinking. The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 3

4 Objectives In this session, we have a dual focus on the science and consultative process of developing a mature discipline of storage capacity assessment, planning and design. The IT Information Library (ITIL) is the foundation of the methodology. Essential formulas come from a variety of sources. Objectives: Know basic storage capacity and performance formulas Design for capacity and scalability in hosts, SAN, storage arrays and backup Understand how to break out of the most common storage design dilemmas The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 4

6 Capacity Management No text Goal Scope Why? To Business Capacity understand Management Strategy the and future Plan, ensures business IT Strategy that IT requirements, and process Plan and including storage the organization s all capacity applications, provisioning operations and hardware, match IT evolving infrastructure O/S, business networking, to ensure demand peripherals that in all a cost and current human effective resources and future timely capacity mannerand performance aspects of the business requirements are provided cost effectively. The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 1 Crown Copyright with value added status 6

7 Process Outputs No Inputs text Service Resource Business Capacity Management Capacity Technology Plan Capacity SLAs, SLRs Database and Service (CDB) Catalog Baselines and profiles Business plans and Capacity storage strategy reports services components (regular, ad hoc and exception) IT plans and strategy SLA and SLR recommendations Business requirements and transaction volumes Costing and charging recommendations Operational schedules Deployment and Proactive development changes plans and and service programs improvements Revised Expected, operational scheduled schedule changes Effectiveness Incidents and reviews problems Audit Service reports Reviews SLA breaches Financial plans Budgets Monitor, Trend, forecast, analyze, mode, tune run and prototype, report on on size the and storage utilization document service of storage future performance business components requirements and Establish their impact baselines on storage and services profiles of use of the Manage demand for storage services The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 1 Crown Copyright with value added status 7

10 Workload Management Technical No Categorize text Metrics Utilization Business I/Os Functional Block Operational Size Transfer Rates Cost Process Classify Metrics MTTP Open MTTI Closed MTTM MTBF/MTTR The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 1 Crown Copyright with value added status 10

11 Producing a Capacity Plan Capacity Plan Structure No text Introduction Scope Methods Assumptions Management Summary Business Scenarios Storage Service Summary Storage Resource summary Options for Storage Service Improvement Storage Cost Model Recommendations The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 1 Crown Copyright with value added status 11

12 Costs, benefits, problems Costs Benefits Possible No text Problems Hardware, Increased Customer expectations efficiency software and exceed tools cost savings technical capacity Project Over Deferred expectation management expenditure of tuning benefits Economic provisioning Staff Unrealistic and unachievable performance targets Planned purchasing Accommodation Over optimistic vendor estimates Reduced risk Lack of Information Confident forecasts No text Reliance on Linear Prediction Proven value to application lifecycle The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 12

13 Planning and Implementation Capacity Management as a planned event! Plan the process Synchronize with the budget cycle Implement the process Review Define monitoring what existspoints Locate the Capacity data Integrate into other planning processes Train Seek the business staff confidence Establish timeline levels and Establish monitoring and place components integrated Identify infrastructure data collection for delivering the volatility (probability) Capacity Expand to Plan include: Business Capacity Service Capacity Resource Capacity The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 13

14 Process Review Review Validate Critical Key No text Performance Success Goals Metrics Factors Indicators Is Calculations Accurate Resource required business forecasts output and formulas available forecastsat the required times for the Component Knowledge Technology appropriate of utilization IT audience strategy and plans, and that the Is Acceptable plans it s activities are accurate data cost collection effective? Cost-effectiveness Accuracy Understanding of tuning of current predictions and future technologies Are Measurement potential and of actual accuracy breaches of match predicted between within the capacity management team and associated IT Storage with Capacity full notification? and Business Need. Ability to demonstrate cost effectiveness Are imposed constraints within acceptable client limits? Interaction with other Service Management processes Is reporting regular and on time? Storage capacity matches business need Is the capacity plan produced on time? Are recommendations clear and accurate? The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 14

16 Roles and Responsibilities Responsibilities Capacity Storage Team: Manager: Capacity include focus (1): (2): areas: Test Often Matches Produce performance split storage and into maintain performance capacity of new storage plans and monitoring demand capacity systems by and plan Produce Recommend capacity increasing Monitor storage planning managing service management available levels reports Size storage Recommend Tuning new capacity storage and storage design systems improvements tuning Assess Ensuring Manage Resolution new storage that technology existing performance demand storage problems capacity is used optimally Implement Recommend Use of demand service storage management level capacity reporting of capacity Studies Predict enhancements demand as required for storage services Determine Account for that workload storage changes service levels are maintained storage service and cost level justified targets The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 16

18 Systematic Approach Assessment is a systematic approach to enable diverse requirements, including availability, capacity, cost, compliance and governance to be met over time. The process achieves alignment at best cost by summarizing requirements and matching them to capabilities at each requirement state change. The range of solutions available are limited by the value of information, with the goal of minimizing budgets, both capital and expense. The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 18

19 Storage Tier A storage tier is a collection of storage capacity that meets requirements with a consistent set of attributes, capabilities and characteristics which may include: Availability Performance Quality of Service Cost Storage Tier Storage Service For example: it is possible that disks in the same array might be treated as different tiers because of RAID Level, data location on a spindle or other characteristics the choice is yours The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 19

23 Basic Storage Capacity Storage Perspective Block Storage Pool Given set of capabilities Quality of Service Range Pools are described by: Total Managed Storage Remaining Managed Storage Primordial Pool Total System Size (Raw) Concrete Pool Blocks, Metadata and Reported Capacity User Perspective (SRM) Allocated Static Dynamic Virtual Available Mapped Unmapped Used, Free, Total, Reserved The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 23

29 Storage Performance Requirements Performance requirements I/Os per second (average/peak) Bandwidth (average/peak) Jitter (range/mean+std. Deviation) Isochronous Access requirements MTFB (initial access time) Locking (concurrent access) File system affinity Security requirements Encryption level Integrity Indelibility Load characterization Random read vs. write % Sequential read vs. write % Block size distribution Other requirements Retention Retention period/expiration date Disposition (erase/shred/archive, ) Scalability (is this an SLO?) Initial size (+Max. size) Size growth % per time period Bandwidth growth % per time period Format Record vs. byte stream vs.? Media portability Co-location/Separation (for association) Level (host/datacenter/geographic) Co-operation Price The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 29 L02T09

30 Growth Growth (Capacity: Size) Normal: Trend, Horizontal, Vertical (account for each) Burst: Aggregation, Consolidation, Integration Special Cases: Line Items/Transactions Performance (Capacity: Performance, Workload Response) General metric is response time (RT) Availability Manageability (Financial: Cost) How many people does it take? The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 30

32 Q&A / Feedback Please send any questions or comments on this presentation to SNIA: Many thanks to the following individuals for their contributions to this tutorial. SNIA Education Committee LeRoy Budnik, Knowledge Transfer Phil Huml, Knowledge Transfer Bob Rogers, Application Matrix The Storage Capacity Design Dilemma 2007 Storage Networking Industry Association. All Rights Reserved. 32