The Future of Storage Management Valdis Filks Notes accompany this presentation. Please select Notes Page view. These materials can be reproduced only with written approval from Gartner. Such approvals must be requested via e-mail: vendor.relations@gartner.com. Gartner is a registered trademark of Gartner, Inc. or its affiliates.
Storage Management Is Labor-Intensive Using Too Many Manual Processes and Techniques Manual Automated Customized Formal Reporting Reporting Manual File, Data, Device Management Automated Storage Management "As hardware costs fall and users demand more capacity, the performance, administration, power, heat extraction and data center accommodation costs can all rise, especially when they exhaust supply." Five Ways to Manage Storage Assets and Defuse Explosive Growth (G00149222)
Strategic Planning Assumption By 2013, storage systems will no longer be manually tunable for performance or manual data placement. Similar to virtual memory management, the storage array's algorithms will determine data placement.
Key Issues 1. Why are we resistant to storage management, and how is it changing? 2. How is device management changing, what has changed, and what will change? 3. How will efficient organizations manage storage in 2013?
Key Issues 1. Why are we resistant to storage management, and how is it changing? 2. How is device management changing, what has changed, and what will change? 3. How will efficient organizations manage storage in 2013?
Data Without Management Is Just Storage Storage management is a dangerous, unglamorous business. Lose a CPU, get a new one. Lose the data, it cannot be replaced and you may go to jail. High-risk occupation with low rewards = conservatism.
The Development of Storage Management Maturity Model Manual DIY Immature Today Mature Today Ideal Formal SRM No Array/pointbased reporting Yes, via base SRM product, capacity planning, performance and reclamation Workflow, provisioning, root cause Storage Hardware Storage provisioning done manually Mostly manual and some pools High-level "pool"- based storage provisioning Automated storage provisioning Performance Tuning Manual movement by storage administrator Additional chargeable software options outside of the array Automated tiering, thinprovisioning Automated, tiering, primary deduplication and compression of data Internal Programs, Scripts, Reports Yes, everything done in-house Partial, using some tools Customizing reports and the formal SRM tool Some customized reports, actions Overall Assessment Based on Gartner Analysis Poor Fair Good Best
Hardware vs. Management Software Spend Storage management lacks $480M of investment. 60,000.0 50,000.0 40,000.0 2007 2008 $M 30,000.0 20,000.0 10,000.0 0.0 External Storage hw SRM sw Worldwide Server hw Server Avail, Ent Network hw Network Mgmt Perf, Event, Log sw & Fault mgmt sw Forecast: Enterprise Software Markets, Worldwide, 2008-2013, 1Q09 Update: G00166478 Forecast: External Controller-Based Disk Storage, Worldwide, 2008-2012, G00169825 Servers Worldwide: Forecast Database (HWCP-WW-DB-SV02) Dataquest Insight: Short-Term Server Forecast Assumptions, Worldwide, 2009-2010, June 2009 Update (G00169240) Forecast: Storage Management Software Market, Worldwide, 2008-2013: G00166883
Proportional Hardware vs. Management Software Spend Storage management has been neglected. 7.00% % Revenue 6.00% 5.00% 4.00% 3.00% 2.00% 1.00% 2007 2008 0.00% % SRM spend vs Storage HW % Server Mgmt SW vs Server HW % Network Mgmt sw vs Ent Network HW Forecast: Enterprise Software Markets, Worldwide, 2008-2013, 1Q09 Update: G00166478 Forecast: External Controller-Based Disk Storage, Worldwide, 2008-2012, G00169825 Servers Worldwide: Forecast Database (HWCP-WW-DB-SV02) Dataquest Insight: Short-Term Server Forecast Assumptions, Worldwide, 2009-2010, June 2009 Update (G00169240) Forecast: Storage Management Software Market, Worldwide, 2008-2013: G00166883
Costs and Technology Force Change Administration (people) costs are increasing - We no longer have or want the skills Storage capacity costs are decreasing - HDD $/GB 32% decrease per annum Storage software - SRM products become agentless, simpler - Now: Akorri, Tek-Tools, APTARE - Planned: EMC ECC, HP SE, IBM TPC, NetApp SANscreen, Symantec CC Data services and features are becoming "free" - Dell EquaLogic, HP LeftHand, IBM XIV, Sun 7000
Key Issues 1. Why are we resistant to storage management, and how is it changing? 2. How is device management changing, what has changed, and what will change? 3. How will efficient organizations manage storage in 2013?
SRM Market Maturity Simpler implementation fewer agents Smaller modular packages Specialized/niche products Growing Challengers HP IBM Leaders EMC Akorri CA Hitachi Data Systems HP IBM Brocade NTP Software NetApp Symantec Tek-Tools Northern Parklife Quest Software APTARE EMC Revenue ($M) 600 500 400 300 200 100 0 730.0 720.0 18.1% 61.2% 454.5% -4.8% 7.8% EMC IBM Hewlett- Packard 2007 2008 Growth 0.1% 4.4% NetApp Symantec CA Other Vendors 2006-8 SRM Market Total Revenue ($m) Percent 500% 400% 300% 200% 100% 0% -100% Ability to Execute Northern Parklife NTP Software CA Brocade Tek-Tools Symantec Hitachi Data Systems Akorri NetApp 710.0 700.0 690.0 680.0 APTARE 670.0 660.0 Quest Software 650.0 2006 2007 2008 Niche Players Visionaries Completeness of Vision As Of March 2009
More Storage Administrators, Not a Priority Implementing or improving backup and recovery (Mean = 5.18) 23.1 72.3 Maintaining or improving performance levels (Mean = 5.09) 18.0 71.1 Increasing data security (via data encryption or improved policies) (Mean = 5.13) 26.0 69.8 Implementing or improving archiving (Mean = 4.95) 19.3 65.2 Increasing storage utilization to delay capacity purchases (Mean = 4.59) Acquiring more SAS or SATA disk drives to meet data growth requirements (Mean = 4.33) 10.5 13.2 50.9 55.6 Implementing green storage technologies (Mean = 4.11) Minimizing change in the storage environment (Mean = 4.22) Decreasing storage administration staff to reduce costs (Mean = 3.86) 9.4 8.2 9.4 41.7 45. 7 44.9 Increasing storage staff to meet storage administration needs (Mean = 3.26) 4.0 27.9 0 10 20 30 40 50 60 70 80 Percentage of Respondents Highest Priority (Rating = 7) Overall High Priority (Rating = 5 to 7) User Survey Analysis: The Impact of the Financial Crisis on Storage Purchasing Decisions, Worldwide, 2009 What priority level will your organization assign to these storage strategies in 2009? 27 April 2009 (G00167438)
Automated Arrays Where data is moved between the tiers by the storage device without administrative intervention or application outage. - Atrato, BlueArc, Compellent, Sun7000 Plus: - Deduplication, compression, SSD, thin-provisioning, snapshots, mirroring, replication, clones Who else will do this? - Everyone, however the issues are: Backporting to traditional storage array controller designs Where arrays are not capable of doing this, additional software external to the storage device is required to move the data. Complexity?
Key Issues 1. Why are we resistant to storage management, and how is it changing? 2. How is devices management changing, what has changed, and what will change? 3. How will efficient organizations manage storage in 2013?
Storage Consolidation Is Still High Priority Storage consolidation project 41.5 Archiving project 40.0 Disaster recovery project 31.9 Expanding existing storage platform 31.9 Acquisition of new storage disk arrays Implementation or further deployment of storage tiering 27.4 27.4 Implementation or further deployment of data reduction techniques Implementation or further deployment of thin provisioning Adoption of 10 Gigabit Ethernet 20.0 22.2 23.7 Implementation or further deployment of MAID Implementation or further deployment of boot from SAN 15.6 17.0 0 5 10 15 20 25 30 35 40 45 Percentage of Respondents User Survey Analysis: The Impact of the Financial Crisis on Storage Purchasing Decisions, Worldwide, 2009 Storage Projects Being Implemented in 2009 As Planned But With a Reduced Budget 27 April 2009 (G00167438)
Software, Hybrids or Virtualization Hardware Solving the virtualization management problem - All SRM tools support this - AutoVirt, DataCore, DoubleTake, StorMagic, FalconStor, LeftHand Hybrid storage and network concentrator devices - Aprius, F5, VirtenSys and Xsigo Enterprise virtualization devices - IBM SVC, EMC V-MAX, HDS/HP/Sun USP-V, NetApp V Homegrown scripts are not automation, but a lock-in, support and maintenance cost.
No Unified System by 2013 Gartner's RTI We are not ready today - Too disparate, and lack of integration and APIs Storage needs to be fixed first Examples - Cisco Unified Computing but not the storage - HP Adaptive Enterprise some storage provisioning - IBM Tivoli CloudBurst, AutoVirt, Double-Take, StorMagic very early - EMC with VMware vsphere CLARiiON vs. VMFS - Oracle/Sun Q-Layer unknown, but do have a lot of IP "N1" and so on
The Emerging Trends Fewer people Better and simpler storage management software More automated storage devices that adapt to workloads without human intervention pnfs ratification and agreement - Virtualization - Object storage Appliances - Simple GUIs, software-intensive
Man vs. Machine to Man Manages Machine Investigate, report and plan first. Do this. What's in the storage device? Not this.
Recommendations First, improve storage management processes. Second, buy hardware. - Proactive capacity and technology planning - Document usage trends within your storage environment - Do not implement server virtualization without considering storage Combine your findings with automated intelligent storage. - Automated tiering: SSD, FC, SAS, SATA HDD, tape - High levels of device instrumentation and reporting data - Thin-provisioning and deduplication Manage the system; do not let the system manage you. - Reduce or eliminate manual data placement, device management - Reduce or eliminate internally written reporting programs Monitor and direct the system create and define the policies.
Related Gartner Research New Storage Architectures Make SSDs More Cost-Effective Valdis Filks, Stan Zaffos (G00168570) Magic Quadrant for Storage Resource Management and SAN Management Software Valdis Filks, Bob Passmore (G00168258) Use SLAs to Optimize Storage Costs Stan Zaffos (G00165398) Cost Optimization: Using SRM to Recover and Manage Storage Costs Valdis Filks (G00165988)
The Future of Storage Management Valdis Filks Notes accompany this presentation. Please select Notes Page view. These materials can be reproduced only with written approval from Gartner. Such approvals must be requested via e-mail: vendor.relations@gartner.com. Gartner is a registered trademark of Gartner, Inc. or its affiliates.
The Future of Storage Management Valdis Filks Notes accompany this presentation. Please select Notes Page view. These materials can be reproduced only with written approval from Gartner. Such approvals must be requested via e-mail: vendor.relations@gartner.com. Gartner is a registered trademark of Gartner, Inc. or its affiliates.