High-Level Storage and Data Management Trends & Observations

Transcription

1 High-Level Storage and Data Management Trends & Observations PASIG Fall 2008 Baltimore, MD November, 20th, 2008 Raymond A. Clarke Enterprise Storage Specialist, Sun Microsystems Archive & Backup Solutions Board Member, SNIA Data Management Forum 1

2 What We'll Cover Need To Know... > What's driving the Archive market > Industry Acknowledgments and Efforts > What is Archive anyway? Green Thinking Open Storage / Open Archive 2

3 Why is Backup & Archive So Important?... because The History of Data Growth is Exponential! 24 Words - Pythagorean Theorem 67 Words - Archimedes Principal 179 Words - 10 Commandments 286 Words - Lincoln's Gettysburg Address 1300 Words - US Declaration of independence Words... EU REGULATION ON THE SALE OF CABBAGES 3

4 CIS1 Slide from 2006 Now there is a SNIA 100 Year Archive TF Challenge: Manage Data for 75++ Years HW typically only backward compatible N-1 Yearly capacity increases Every 2-5 years HW becomes obsolete: > > > > > Need to migrate current data to newer HW components Replace compute parcels Replace FC Parcel for performance and capacity Replace tape drives and media to current technology Replace SATA parcels for capacity / footprint Minimize vulnerability HW migration is inevitable; PLAN for it 4

5 5

6 6

7 Digital Archiving & Data Protection(Backup) Fundamentally Different Approaches to Data Availability Data Protection Active Archive To retain data for regulatory compliance, e-discovery, corporation best practice Purpose To recover info in the event of loss, corruption, destruction, etc Data Type Dynamic data in production Fixed content with near perpetual business or compliance value Access Pattern System Activity Entire volume or directory is restored after outage Individual files or tables are recalled disparately Usually block based Usually file system or object based Records Search Offline volume remounted and manually searched Online files recalled based on specific criteria; has time stamp, descriptor and a retention parameter Both are required in today's technology environment 7

8 Demands of a New Archive Reality Is the ratio for archiving solutions changing? 10 / 90 versus 2 / 18 / 80 Next Generation Archives need to address a new dimension of the massive resting data How do you search Petabytes of data from the edge? > The new ratio has evolved into a Write / Read / Search relationship (2 / 18 / 80) > Business semantics need to drive data management not systematic schemas > Virtualization and Search become critical to the presentation of the data, something new is needed... > Compute and Store need to Converge 8

9 How do you build an Archive, sensitive to Access and Presentation, when any asset can be requested at any time? 9

10 More Reasons Why... Power Consumption is Becoming a Big Problem in Storage Cooling/HVAC Servers Storage (Disk and Tape) Network (SAN/LAN/WAN) Other 48% 37-40% IT Equipment 50-60% Other 40-50% 80% 20% External Storage Tape Drives & (All Tiers) Tape Automation (1) Storage is a significant part of datacenter energy usage, and at 20% CAGR, it is the fastest growing segment. (2) Some customers are being told that they can have no more power! Source (1): 2007 Jupiter Media Corporation and The StorageIO Group Source (2):Use Report Sun Proprietary/Confidential: Internal Onlyto Congress on Server and Data Energy Efficiency (08/2007) 10

11 2005 US State Industrial Electricity Costs( /KWH) 10 Most Expensive States Rank State Cost 1 HI DC NH RI NJ CA CT AK MA NY Least Expensive States Rank State Cost 51 KY WV ID WY UT WA ND IN NE VA

12 More Reasons Why... The Cost of Power and Cooling Storage Growth 30% annually, Power Cost Growth 28% annually, Electricity Cost Used $.145 per kwh Annual cost to power and cool tape Energy Costs Racing to Out-Pace and disk systems $/Year Hardware Costs IT Equipment Cost Cost to power disk 18x that of tape! IT Energy Cost Source: IDC Time LTO Tape System = 191 TB (85% utilization yielding 125 TB), (4) LTO3 Tape Drives, (1) 700 slot LTO library SATA Disk System = 232 TB (70% utilization yielding 125 TB), (15) Disk Controllers, (105) Expansion Trays Source: Clipper Group 2007: Tape and Disk Costs What it Really Costs to Power the Devices 12

13 Advantages of Tape vs. Disk Source: Horison Information Strategies 13

14 Regulatory Compliance & Litigation Driving Digital Archive Regulations and required retention periods for information types HIPPA SEC 17a-4 Lifetime +2 years Personal medical records 21 CFR Part 11 5 years original form Biological product manufacturing HIPPA: Health Insurance Portability and Accountability Act CFR: Code of Federal Regulations Account life + 6 years Trading account records FERC Part years Public utilities general accounting ledgers SEC: Securities and Exchange FERC: Federal Energy Regulatory Commission Sun Confidential: Internal Only SOX Audit +4 years Audit correspondence of publicly traded firms IRS 26 CFR Part 31 4 years Social Security documents Commission SOX: Sarbanes-Oxley U.S. Code: U.S. Code of Laws 14

15 What is OpenStorage? Open Architecture general purpose hardware & software implementing storage functions that scale higher at lower TCO than proprietary alternatives Open Software Creating a rock solid foundation that will scale and evolve over time while remaining secure, transparent, and flexible. open sourced code and APIs to maximize the developer opportunity Open Interoperability simple, predictable integration in heterogeneous environments (open standard) Open Servers Open Storage Open Network 15

16 Open Storage Converges Compute, Storage and the Network Open Storage > Non-Proprietary > Open Source Storage 20% > Production Ready Innovative > OpenSolaris + ZFS Integrated > Fishworks 57% Platform Scale 15% > Capacity Compute Network > Performance Breakthrough economics > Industry Std Components > Features at no extra cost 16

17 DISK11 Expansion DISK23 DISK20 DISK8 DISK11 DISK19 DISK7 Expander CTLR-1 DISK47 SAS Expander DISK46 SAS DISK35 DISK45 DISK44 DISK43 DISK42 DISK41 SAS DISK34 DISK33 DISK32 DISK31 DISK30 DISK40 CTLR-4 DISK22 DISK18 DISK6 DISK29 DISK39 CTLR-5 DISK10 DISK17 DISK5 DISK28 DISK27 CTLR-2 DISK21 DISK16 DISK38 DISK37 DISK36 CTLR-3 DISK26 DISK25 DISK24 3. DISK9 DISK15 DISK4 DISK47 DISK46 DISK3 DISK35 DISK23 DISK45 DISK14 DISK34 DISK22 DISK44 CTLR-0 DISK2 DISK33 DISK21 DISK43 CTLR CTLR CTLR CTLR CTLR CTLR DISK13 DISK32 DISK20 DISK42 SAN DISK12 DISK31 DISK19 DISK41 X4540 Thumper / Thor Storage Server DISK1 DISK30 DISK18 DISK40 2. (4U self-contained) Storage Server DISK0 DISK29 DISK17 DISK39 CTLR-1 DISK10 DISK9 DISK28 DISK16 DISK38 CTLR-4 DISK8 DISK7 DISK27 DISK15 DISK37 CTLR-5 DISK6 DISK5 DISK26 DISK14 DISK36 CTLR-2 DISK4 DISK3 DISK25 CTLR-3 DISK2 DISK24 Multiple Disk Arrays DISK13 Servers DISK12 Servers + Storage Arrays DISK1 1. DISK0 Sun offers three architectural choices... Servers + JBOD Extensible Open Storage/Open Archive SAS CTLR-0 Expansion 17

18 Open Storage Plug-Ins... NFS FCP SAS iscsi IB CIFS VTL OSD CAS IB XAM Web DAV Replication Security Galaxy servers ZFS Niagara servers DTrace FMA Containers Unified Storage SSD SAM-Q JBODs SPARC servers Search Encryption De-duplication Migration Thumper/Thor Series StorageTek Array Family Mirror/Snap StorageTek Tape Family Backup Compliance 18

19 General Design with Continuous Open Archive High Availability Infrastructure with Continuous Backup/Data Protection and Archive to Shadow File System(s) Standard IP, Meta Data Servers Tier # 1 Active Data Tier # 2 Disk Archive NFS and/or CIFS DATA IP Connections (GigE) UNIX Customer LAN or WAN Linux Windows DATA IP Connections (GigE) Tier # 3 Tape Archive 19

20 ...in Summary... Open approach, breaks proprietary vendor lock-in 10x more storage capacity per server Exponentially better Scale, Flexibility and TCO 3x better TCO than traditional storage Simplifies heterogeneous management 2x better storage density (GB/RU) Massive ISV support/integration 70% better performance (SPC) 20

21 Sun s Enterprise Archive Portfolio Example Enterprise Archive Solution Mixed Workgroup Unstructured Data Structured Data SAP Oracle Primary Disk Primary Database Archiver Database Archiver 7000 Unified Storage SAM-FS (IAS) (Larger) Video Images SAM-FS (IAS) Open Storage Honeycomb RAIN NFS 7000 Unified Storage SATA/FC Modular Disk Off-Site Tape Tape Libraries and Virtual Tape 21

22 Thank You for Your Time THANK YOU! and Attention (212) (212)