Key Considerations for Managing Big Data in the Life Science Industry

Transcription

1 Key Considerations for Managing Big Data in the Life Science Industry

2 The Big Data Bottleneck In Life Science Faster, cheaper technology outpacing Moore s law Lower costs and increasing speeds leading to more data Downstream data multipliers exceed reductions in data coming off instrument Traditional backup windows do not work in large-scale NGS data environments 2

3 Turning the Data Deluge Into An Opportunity Four Key Big Data Considerations

4 Four Key Big Data Considerations The velocity and volume of big data are growing too fast for conventional storage architectures Need a scalable solution that is optimized for Big Data Supports a tiered storage architecture Big Data cannot be lost it drives the business Protect data at every tier Automated protection minimizes mgmt opex Big Data will continue to produce value over time Match value to storage cost Single Namespace - maintain easy access to that data Cost is always part of the discussion Not cost effective to keep all data on expensive disk Tiered architecture can yield significant TCO advantage 4

5 Aligning Tiers with Data Value Asset Value Cost of Storage Paying too much Primary Storage High performance Disk Frequency of Access Secondary Storage Tier 2 or 3 Tier Cost Characteristics CAPEX Primary Storage CAPEX Secondary Storage CAPEX Tape OPEX OPEX OPEX 5

6 Is Tape Dead or just the new green archive?

7 Who Is Quantum?

8 Quantum solutions portfolio Data Protection Big Data Management & Archive Protection DXi-Series vmpro Scalar Series StorNext Disk deduplication & replication Data protection for virtual environments Open systems tape automation File sharing & data management 8

9 Quantum StorNext Big Data Technology Disaster Recovery Create/ Edit Disk Tiers Ingest SHARE PRESERVE StorNext File System Distribute Tape and Vault StorNext Storage Manager Data Protection High-performance shared file system Tiered storage management 9

10 StorNext Tiering and Archive LAN CIFS / NFS Storage Area Network (SAN) WIN LAN Clients Gateway Servers LINUX LAN Clients 10

11 StorNext Tiering and Archive DEDUPLICATION Storage Area Network (SAN) SECONDARY TIER TAPE LIBRARY ARCHIVE VAULT REPLICATION 11

12 StorNext Appliance Family Shared File System SAN and LAN Connectivity High Performance Disk Archiving Software Nearline Archives Metadata Appliances M330 Controller Comes with StorNext File System Q-Series Storage QS1200 AEL Archives Both Come with Storage Manager and EDLM G300 Gateways QD6000 G301 G302 QM1200 AEL6000 AEL500 QS

13 StorNext AEL Archives Quantum branded software and hardware AEL TBs (LTO5) AEL TB 7.5PB (LTO5) Automated policy-based storage tiering Automatically move data from suspect tapes to new tapes No additional SW costs when moving to LTO6 13

14 Life Science Customer Examples

15 StorNext in Use We needed to create a storage infrastructure capable of scaling to multiple petabytes and managing hundreds of millions of files, says Roberto Fabbretti, IT Manager at the Vital-IT Center. We wanted to eliminate the need for a separate backup and provide a comprehensive disaster recovery solution. All of this needed to be wrapped within a cost-effective storage environment. Reduced total cost of storage by 50% Improved sequence tag productivity by 20% Provided operational cost savings, including cooling and power Enabled high-speed data sharing with cost-effective content retention Consolidated resources and enabled workflow operations to run faster Eliminated vendor lock-in through StorNext platform independence Ensured all files were easily accessible to all hosts 15

16 StorNext in Use By combining high-speed data sharing and cost-effective content retention in a single solution, StorNext has enabled our researchers to access the data they need quickly and easily and eliminated the significant management overhead we incurred with our legacy system. Geraint Morgan, Director of Information Systems Provided scalable foundation to meet anticipated storage growth of up to 20PB over next 2-3 years Protected prior investments by integrating legacy resources Enabled simultaneous access to significant volumes of data without impacting system users Provided cost-effective content creation through automated data management Allowed centralized management of a heterogeneous environment Mix of venodor genome sequencers, including Life Tech (SOLiD) Sequencing Instruments, Illumina Genome Analyzers and Roche/454Genome Sequencers 16

17 Example Architecture: Baylor HGSC 15 Sequencers 400+ StorNext Distributed LAN Clients used for Sequence analysis Currently have 2.5PB of primary data spread across 7 file systems 700 tapes in active library managed by StorNext tapes in vault 12.5M files already archived

18 Summary

19 Why StorNext for Life Sciences Proven Scalability Multiple customers with more than a PB of data managed by StorNext Single namespace across storage tiers Automated data protection and tiering Long term data storage Flexibility for future architecture changes 19

20 Thank You

21 TCO Comparison: All Disk vs Tiered Storage At Beginning of "All Disk" Architecture Year 1 Year 2 Year 3 3 Year Total Amount of Data in TB, 20-40% annual growth Product Cost (based on List Price) $534,000 $97,000 $328,000 $959,000 Install Cost $18,000 $14,600 $13,000 $45,600 Total CAPEX $552,000 $111,600 $341,000 $1,004,600 3 Year Gold Maintenance $176,220 $21,340 $36,080 $233,640 Power Costs $6,423 $7,707 $11,561 $25,691 Rack Space & Cooling $8,387 $10,065 $15,097 $33,549 Total OPEX $191,030 $39,112 $62,738 $292,880 Total Cost of Ownership $743,030 $150,712 $403,738 $1,297,480 At Beginning of "AEL-Based Tiered Storage Architecture" Year 1 Year 2 Year 3 3 Year Total Data on Tier 1: QD6000 Nearline Disk, in TB Data on Tier 2: StorNext AEL Appliance, in TB Amount of Data in TB, 20-40% annual growth vs All Disk Product Cost (based on List Price) $435,527 $50,836 $113,672 $600,035-37% Install Cost $26,850 $0 $1,600 $28,450-38% Total CAPEX $462,377 $50,836 $115,272 $628,485-37% 3 Year Gold Maintenance $134,130 $5,194 $6,514 $145,838-38% Power Costs $2,199 $2,199 $2,199 $6,597-74% Rack Space & Cooling $10,013 $10,013 $10,013 $30,039-10% Total OPEX $146,342 $17,406 $18,726 $182,475-38% Total Cost of Ownership $608,719 $68,242 $133,998 $810,960-37% Starts at 650 TB, grows to 1.1 PB over three years Key Takeaways 37% ($410K) TCO savings over three years 74% power cost savings over three years Significant CAPEX and OPEX savings 21