NetApp Efektivní diskové úložiště pro moderní datová centra Petr Wünsch Pre-sales Systems Engineer petr@netapp.com 1
The NetApp Company $6B $5B $4B $3B FY2012: 6.23 billion US$ Founded in 1992 as a "Network Appliance, Inc." in Sunnyvale, CA Pure storage and data management company 150+ offices worldwide 12,000+ employees Fortune 500 $2B $1B 03 04 05 06 07 08 09 10 11 12 2
Gartner Magic Quadrant Midrange and High-End Modular Disk Arrays Source: Gartner, Inc., Nov 2011 Roger W. Cox, Pushan Rinnen, Stanley Zaffos, Jimmie Chang Magic Quadrant for Midrange and High- End Modular Disk Arrays This Magic Quadrant was published as part of a larger research note and should be evaluated in the context of the entire report. The report is available upon request from NetApp. The Magic Quadrant is copyrighted Nov 17, 2011 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. 3
Growing Market Share Open Networked Storage Market Revenue Share EMC 32.2% NetApp 16.4% IBM 11.0% HP 9.4% Hitachi 8.5% Dell 7.9% Source: IDC, June 2012; Open Networked Storage equals the combined NAS and SAN markets 4
Market Share presence Including Branded and OEM EMC w/oem 32.4% EMC 32.2% NTAP w/oem 24.0% NetApp 16.4% Based on NetApp estimates June 2012, NetApp revenue increased by IBM, Dell, Oracle N-series and E-series, Teradata, SGI, Quantum OEM estimates, EMC revenue increased by Dell OEM business 5
Data ONTAP: #1 Storage OS Source: NetApp internal estimates, June 2012: VNX, VNXe, Celerra NS can run any of Flare and Dart Operating Systems. Contribution of these products to the OS share has been estimated based on the proportion of NAS and SAN installations in these products (NAS Dart; SAN Flare) 6
Data ONTAP Key Values Data ONTAP The world s most efficient storage operating system Unified Architecture The world s most flexible storage architecture Clustered ONTAP The world s most scalable data infrastructure 7
Data ONTAP Key Values Unified Architecture The world s most flexible storage architecture 8
NetApp Unified Storage Model Industry Approach NetApp FAS and V-Series High-End SAN Low/Midrange SAN NAS Backup Virtualization Disaster Recovery Archive & Compliance Different hardware Different software Different people Different processes Data ONTAP Storage Operating System Same hardware Same software Same people Same processes One platform for all workloads Learn once, deploy everywhere Improve IT and business efficiency 9
NetApp Storage Controller Portfolio Enterprise features on all models One operating system, one interface Investment protection through seamless growth Grow without data migration Full interoperability FAS/V6210 FAS/V6240 FAS/V6280 FAS/V3270 4.320 TB 1.440 disks 16 TB Flash Cache New! FAS2220 180 TB 60 disks FAS2240 432 TB 144 disks FAS/V3210 720 TB 240 disks 512 GB Flash Cache FAS/V3240 1.800 TB 600 disks 1 TB Flash Cache 2.880 TB 960 disks 2 TB Flash Cache 3.600 TB 1.200 disks 3 TB Flash Cache 4.320 TB 1.440 disks 6 TB Flash Cache Data ONTAP + common management software family 10
Unified Model Impact NetApp Competitor FC SAN iscsi SAN CIFS/ NFS NAS FC SAN iscsi SAN CIFS/ NFS NAS Deduplication: Thin Provisioning: Snapshot Copies: Thin Replication: Virtual Clones: Double Parity RAID: NetApp Unified Architecture Same hardware Same software Same people & processes Their unified architecture Different hardware Different software Same people & processes 11
Unified Model Impact: Extends Value to Include Non NetApp Storage NetApp V-Series FC SAN iscsi SAN CIFS/ NFS NAS FC SAN iscsi SAN CIFS/ NFS NAS Deduplication: Thin Provisioning: Snapshot Copies: Thin Replication: Virtual Clones: Double Parity RAID: NetApp Unified Architecture Same hardware Same software Same people & processes 12
V-Series Open Storage Controllers V6200 and V3200 Models V-Series builds on your current storage investment to satisfy unmet needs V3210 720TB V3240 1,800TB V3270 2,880TB V6210 3,600TB V6240 4,320TB V6280 4,320TB Supporting Disk Arrays from Major Storage Vendors 13
Data ONTAP Key Values Data ONTAP The world s most efficient storage operating system 14
NetApp Data ONTAP 8.1 Single operating system for the whole FAS/V-Series product family WAFL Write Anywhere File Layout NVRAM write optimization RAID 4 and RAID-DP data protection Snapshot integrated backup and recovery and more 15
Deduplication Compression Win back up to 95% of the capacity needed for Full Backups, 45 % on average. Snapshot Copies - 95 % - 80 % Zero Performance Impact Capacity savings of up to 80 %. Only changed data needs additional space. Double Parity RAID (RAID-DP ) - 46 % Virtual Clones (FlexClone) - 80 % Savings compared to mirrored data RAID10. Saves up to 80 % with writeable virtual copies. Only changed data needs additional space. Thin Provisioning (FlexVol) - 33 % Thin Replication - 95 % Frees up capacity from 20 % to 33 %. Saves capacity of up to 95 % with Disk-to-Disk data protection. 16
WAFL: Write Anywhere File Layout WAFL is highly data aware and enables the storage system to determine the most efficient data placement on disk Data is intelligently written in batches to available free space in the aggregate without changing existing blocks The aggregate can reclaim free blocks from one flexible volume (FlexVol volume) for allocation to another Data objects can be accessed via NFS, CIFS, FC, FCoE, or iscsi protocol NFS Protocol CIFS Protocol FC/FCoE/iSCSI NFS Semantics CIFS Semantics LUN Semantics Protocol Layer Data ONTAP File Mechanism Directory Mechanism Read and Write FlexVol Volume Aggregate WAFL NetApp RAID RADI-DP 17
NetApp RAID-DP The New Standard for Data Reliability Solution: Greater Availability with RAID-DP Better protection then RAID-10 Same performance and ease of use Business Implications More usable capacity Drive failures won t impact data availability Technical Benefits More secure than RAID-5 More reliable than RAID-10 for double-disk failure 14% parity overhead versus 50% overhead with RAID-10 18
Public SPC-1 Results SPC-1 IOPS Latency in ms List Price in USD $/OP # Disks IOPS/ disk RAID Type # Controllers FAS6240 250 039,67 3,35 1 672 602 6,69 432 579 RAID-DP 6 HDS VSP 269 506,69 5,85 4 934 872 18,31 1 152 234 RAID10 8 Huawei S8100 300 062,04 7,08 2 311 568 7,70 1 152 260 RAID10 16 SVC + V7000 520 043,99 7,39 5 846 630 11,24 1 920 271 RAID10 8x SVC 32x V7000 SVC + DS8000 380 489,30 7,64 13 672 254 35,93 2 048 186 RAID10 6x SVC 4x DS8000 3Par 450 212,66 13,67 5 885 148 13,07 1 920 234 RAID10 8 Optimized for cost performance 19
System Load (IOPS) Without FlexShare FlexShare Prioritization of Workloads ( Quality of Service ) High Priority Volumes Medium Priority Volumes FlexShare enabled Reduces latency for high-priority workload Low Priority Volumes 0 10 20 30 40 50 60 70 80 Latency (msec) With FlexShare Workload 1 (High Priority) Workload 2 (Low Priority) High Priority Volumes Medium Priority Volumes Low Priority Volumes 0 10 20 30 40 50 60 70 80 Latency (msec) Latency (ms) Prioritization at the volume level Five Priority Levels Adjustable on-the-fly No license fees! 20
NetApp Snapshots Traditional NetApp Performance Impact Snapshot Process Significant Impact NetApp Snapshot Minimal Impact Low Performance Overhead Data Protection Snapshot Snapshot Time (2 Hours) Multiple Snapshot Copies Time (2 Hours) Minimal Data Loss Speed and Efficiency Production Tape Backup Tape Snapshot Replication NetApp Production Backup Fast, Efficient Backup and Recovery 17+ Hours Minutes 21
NetApp Snapshot Technology Redirect On Write create 1st snapshot new write operation create 2nd snapshot Virtual copy NetApp FlexClone is a Snapshot with write capability 22
Snapshot Comparison Mnemonic R.O.W. Redirect On Write C.O.W. Copy On Write 23
Snapshot Integration Windows VSS 24
Hidden Snapshot Folder collection of all scheduled & manual snapshots 25
Clones for Development and Testing Time Traditional way Cloning TEST Cloning TEST Using NetApp FlexClones TEST TEST TEST TEST TEST Create FlexClone Copies Speed DB copies made in minutes Quality More copies to more people Time to do more testing 26
Virtual Copies in Virtual Environment App OS Space efficient clones Provision new virtual servers or workstations in minutes Integrated with Vmware vcenter 27
NetApp Deduplication Removes duplicate 4K WAFL blocks Deduplication on primary storage Transparent to applications Supports any interface or protocol Low-priority background process 70% 60% 35% 30% 30% 25% 25% 10% Before After Vmware Hyper-V File Services Sharepoint Email Archival Document Archival Source Code Archival Audio/Video Files 28
Compression and Deduplication InLine Postprocess Raw Data Compressed Data Compressed and Deduped Data Immediate space savings due to "in-line Compression Accumulated space savings after running dedupe NetApp Confidential - Internal Use Only 29
Space Savings by Application Dataset Type Compression Savings Deduplication Savings Combined Savings NetApp Recommends Primary & Secondary Geoseismic Files 40% 3% 40% Compression Software Development 55% 30% 75% Both Virtual Servers 55% 70% 70% Deduplication Home Directories 50% 30% 65% Both Backup/Archive Only Oracle OLTP 65% 0% 65% Compression Exchange 2007 35% 3% 35% Compression Exchange 2010 35% 15% 40% Both* * Exchange 2010: Deduplication for primary; compression for backup/archive 30
Deduplication: Essential for Virtualization App OS App OS App Duplicate App Data OS Is Eliminated OS App OS Traditional NetApp Enterprise FAS System RAID Arrays Savings extend to all copies of the data - Including backup, DR, test clones, and archival copies 31
Virtual Storage Tiering Real Time Serve data when it s hot Efficient Use high-cost media (Flash) efficiently Enable SATA as primary tier Simple Work out of the box with default settings 32
Automated Storage Tiering Compared NetApp Approach Data Driven Real Time Self-Managing Virtual Storage Tier Competition Automated Data Migration Flash FC/SAS Physical Storage SATA Fine grain Dynamic Low overhead Efficient Less granular Time delayed I/O and CPU intensive Less efficient 33
Virtual Storage Tier Offerings Flash Cache Flash Pool Performance Capacity Performance Capacity + PCI-e Cache HDD HDD What is it? Controller-based PCIe card Plug and play FAS3xxx, 6xxx What does it do? Per controller cache: hot volumes on multiple aggrs Caches random reads What is it? Storage-level RAID-protected cache FAS2xxx, 3xxx, 6xxx What does it do? Specific to aggregates Caches random reads and overwrites Cached data persistence through failovers 34
Synergy of Flash Cache and Deduplication Reducing the Duration of Boot Storms in a Virtual Infrastructure ESX Cluster VM VM VM VM VM VM VM VM 1 2 3 4 5 6 7 8 VM 1 Cache VM Deduplicated storage NetApp FAS
Secure Multi-Tenancy The industry s only end-to-end secure multi-tenancy solution vsphere vshield Zones vcenter HR Apps BU Apps Core Apps VMware VMware VMware Securely isolate shared compute, network, and storage resources Consistent QoS at each layer Nexus 1000V Nexus 2000/5000/7000 UCS 10GbE Manage each resource pool independently as a dynamic asset Reduce risk and cost while boosting IT agility MultiStore NetApp Data Motion NFS/iSCSI HR BU APP A Cisco Validated Design Security audited by ICSA Labs PCI compliant 36
Data ONTAP Key Values Clustered ONTAP The world s most scalable data infrastructure 37
Agile Data Infrastructure Clustered Data ONTAP ERP QA Eng HR CRM Sales vfiler vfiler vfiler vfiler vfiler vfiler vfiler Sales Corp IT Clustered Data ONTAP 8 38
Data ONTAP 8 Cluster-Mode System Overview NetApp Storage Single system image for up to 24 nodes FAS and V-Series support Scale to 51PB capacity Scale to multi-gb/sec throughput On-demand resource balancing Third-Party Storage with V-Series Integrated data protection and storage efficiency Multiprotocol access Common software & management Always-on infrastructure Fully integrated solution from NetApp
Data ONTAP 8.1 Cluster-Mode Virtual Server Logical, flexible, secure resource pool for a NAS namespace and LUNs SAN hosts/nas clients All data access is through a Vserver, which supports one or more protocols Includes FlexVol volumes, LUNs, and logical network interfaces (LIFs) Minimum of one Vserver required: can support 100s Logical Interfaces Vserver FlexVol volumes LIF2 HA LIF1 VS1 Integrated Shared Architecture 40
The Power of Nondisruptive Operations Public Cloud Nondisruptive Operations Workloads are rebalanced for performance Server Network Agile Data Infrastructure Time 41
The Power of Nondisruptive Operations Public Cloud Nondisruptive Operations New systems are added for scale Server Network Agile Data Infrastructure Time 42
The Power of Nondisruptive Operations Public Cloud Nondisruptive Operations And systems are upgraded as they become end of life Server Network Agile Data Infrastructure Time 43
The Result of Storage as Infrastructure? Deliver Impact Faster Nondisruptive Operations Grow Business without Limits Agile Data Infrastructure 44
Integrated Data Protection
Integrated Data Protection Single Platform DR Backup Availability Compliance Satisfies broad set of recovery objectives Continuous availability zero RTO Disaster recovery flexible RTO Backup and recover multiple RPOs Archive and compliance Easily and quickly deployed Services are already on board add as needed Configure and make available in minutes Supports multiple environments Physical servers Virtualization IT as a service 46
Risk Mitigation: Faster Protection Snapshot copy Safeguard data up to 98% faster Creates instant point-in-time Snapshot copies Has near-zero impact on performance Enables you to back up when you want, as often as you want to prevent data loss Restore faster, to eliminate risk of downtime Snapshots revert to specific point in time Meets tight recovery time objectives Uses a single command to restore, minimizing downtime Until recently the backup took several hours. With NetApp we have a time saving of at least 18 hours and were able to eliminate the tape backup. Pekka Purontaka, Storage Manager AFA Insurance 47
Snapshot Integration Windows VSS 48
Hidden Snapshot Folder collection of all scheduled & manual snapshots 49
Disaster Recovery: NetApp SnapMirror Primary Data Center Snapshot Copies SnapMirror Satisfy broad set of RPO and distances Up to 92% reduction in RPO Synchronous: Zero RPO, 200km Asynchronous: RPO mins hours, long distance Replicates Snapshot copies for multiple RPOs Meet tighter RTOs Up to 95% reduction in RTO Resume operations in minutes Flexible implementation Many-to-one, one-to-many or cascading based on needs DR Site DR Site It was impressive to see that when we had problems with the fiber or other things, we never did have problems with SnapMirror. It s been pretty bulletproof. City of Sioux Falls 50
SnapMirror: Virtual Environment Primary Data Center DR Site VM1 VM2 VM3 VM1 VM2 VM3 Site Failure SnapMirror Broad support VMware, Microsoft Hyper-V, and Citrix XenServer Tight integration SnapManagers for all major platforms Integrated with VMware SRM for rapid and automated failover Secure Leverages secure multi-tenancy to sequester content Data Data Data Virtual Storage Partition Data Data Data Virtual Storage Partition Should we ever experience a site disaster, in a matter of minutes we can be up and running at the DR facility. And it costs us about 50% less than before. DCI 51
SnapMirror: Easy Strategy Validation Non-disruptive testing Create virtual copies of DR data Point test systems to virtual copy No impact on production or DR process No extra storage units required Virtual copies require near-zero capacity Can be created and removed in minutes Easy and economical to update strategies as environment changes DR Test Systems We can schedule a DR test without interrupting production or IT administrators regular activities. This capability gives us added security and confidence knowing we can recover because we perform the tests more frequently. Anadarko Petroleum Corp. 52
SnapMirror: High Efficiency Primary Data Center Extends benefits of storage efficiency Up to 90% less capacity required DR data stays deduplicated Thin provisioning, RAID-6 leveraged Delivers greater network efficiency Compress Delivers native network compression transferring up to 70% less data Reduces WAN costs and accelerates DR transfers for shorter RPOs DR Site Decompress Using SnapMirror s compression capability, we ve been able to increase existing bandwidth utilization by 66%, saving an estimated $10,000. North American Banking Company 53
SnapMirror: Added Value for Business Low-cost development and test Enable parallel development efforts Reduce capacity needs up to 90% Faster Business Intelligence Perform analytics and mine sales current data to refine go-to-market strategy Improve application performance by reducing load on production systems Virtual clones are ready in minutes not days Data Mining Test and Development With FlexClone, we can have a copy for development, a copy for test, and a copy for load testing, each of which consumes only a small fraction, maybe 5 or 10%, of the original. Transplace 54
SnapVault: Accelerated D2D Backup SnapVault Faster disk-to-disk backup Move Snapshot copies to another system onsite or to a remote location Stores months or years of recovery points Replicates changed blocks, not entire files, enabling backups and restores in minutes Minimizes risk of downtime and data loss Rapid local recovery Rapid remote recovery Enables streamlined processes No intermediary backup servers required Stored in native format to allow end-user restores and data mining 55
SnapLock: Archive and Compliance Nonerasable, nonrewritable magnetic disk storage (WORM) Add-on software license Enabled at a volume level Strict or Flexible immutability Fine-grained management File-level retention policies Reclaim space with file expiration Tamperproof ComplianceClock Open protocol interfaces Data access via CIFS and NFS Easy application integration without closed, proprietary APIs High performance implemented on industry's fastest NAS platforms 56
Application Access data and copy/move to WORM storage SnapLock Example Whatever protocol is appropriate to the application SnapLock-aware application CIFS or NFS primary storage* Whatever protocol is appropriate to the application Create SnapLock (WORM) volume(s) SAS disk possible, but SATA makes more financial sense V-Series supported for best practices Copy/move files to SnapLock volume via CIFS or NFS Logically equivalent to copy-paste Set each file s retention time Or accept the volume s default Can t be less than minimum retention time (SL volume is created with a minimum, default, and maximum retention time set) Can be forever Mark files read only or use auto-commit WORM volumes Dec 12 th 2030 No alterations, overwrites or deletions until file expiration but time can be extended (under supervision of the tamperproof ComplianceClock TM ) *Need not be NetApp primary storage 57
Data Protection Against Any Failure SnapVault VMware HA/FT VMware vcenter Site Recovery Manager MetroCluster SnapMirror Snapshot copies Building 1 Snapshot copies Building 2 Snapshot copies DR Site SnapVault SnapLock Tertiary Snapshot copies Issue User error: Data corruption: System or site failure: Regional disasters: Nearline Backup: Backup archive: NetApp Instant backups; end-user recovery Instantaneous restores Transparent failover Recover in minutes Rapid search and retrieval Tape management; file catalog 58
What About Data Consistency? Database & Business Applications Messaging & Collaboration Consolidation & Virtualization 59
The Challenge Data Management App Admin DBA Server Admin Traditional approach creates bottlenecks Please prepare Wait time Storage Admins Daily tasks have to be met by the storage team Frequently manual processes Long waiting times Unhappiness on all sides Manual Processes Provisioning Restore Configuration Cloning, Snapshot 60
Storage Management Storage Pool Service Layer Integration NetApp Manageability Software Family Integrated data management in all layers SnapManager for Exchange Application Suite SnapManager for SharePoint Server SnapManager for SAP Data ONTAP Data ONTAP SnapManager for SQL Server SnapManager for ESX & Hyper-V Database Suite SnapManager for Oracle Server Suite SnapDrive for Windows, UNIX, Linux OnCommand Software Family SnapCreator for DB2, Domino,... Control System Manager Control My Autosupport Automate OnCommand 5 Automate SnapManager Analyze InsightBalance Analyze InsightAssure Analyze InsightPerform Analyze InsightPlan Access VMWare plug-ins Access Microsoft plug-ins Develope SDK (Java, Perl, C#) 61
General SnapManager Features Integrates with 3rd party software management tools Simplifies and automates backup, recovery and cloning Instantaneous and space-efficient backups using Snapshot Rapid and granular restore & recovery using SnapRestore Auomate creation of dev/test environments using fast and space-efficient clones using FlexClone Policy-driven data protection via integration with Protection Manager (part of OnCommand Unified Manager) Automates replicating backups from Primary to Secondary/DR storage via SnapMirror /SnapVault Option to protect backups to secondary/dr storage Automates restoring backups from Secondary/DR storage Automates cloning of protected backups on Secondary/DR storage Pre and post scripts support for back up, restore and clone operations Role Based Access Control (RBAC) to features Handles SAN and NAS protocols 62
Simple Data Management with NetApp App Admin DBA Server Admin Automated processes Provisioning Recovery Config Cloning Faster solution for a dynamic business More productive employees Daily tasks are performed without a storage admin who creates and maintains the rules Policies Controll Storage Admin creates and maintains the rules 63
Simplified Management with SnapProtect Disk-to-disk-to-tape backup application, built to meet tighter SLAs Up to 98% faster backup and recovery Uses efficient, high speed NetApp Snapshots Application and virtualization aware Lower management cost & complexity One console to create, manage and monitor Snapshot copies, replication and tape Can manage multiple sites Easier search and discovery Catalogs and tracks across disk and tape Indexes contents for granular recovery Allows one-click restore from any tier 64
Syncsort Integration NSB Clients Exchange, SharePoint, SQL, VMware SAN NetApp FAS D2D Backup Target optional NetApp FAS DR Target Any Primary Disk SAN or DAS Instant / Full Virtualization optional Tape Archive Faster Any-to-NetApp backup Application and virtualization aware Writes changed blocks to NetApp for more efficient, high speed backup Lower management cost & complexity Manages NetApp replication and tape Easier search and discovery Catalogs across disk and tape Indexes contents for granular recovery 65
Symantec NetBackup Integration NetBackup Admin Console SnapMirror /SnapVault NAS File Services Replication Director NetApp Plugin NDMP Dump Catalog Up to 98% faster backup and recovery High speed NetApp Snapshots SnapVault for faster D2D backup Files only in initial release Lower management cost and complexity One console to manages Snapshot copies, replication and tape Centralized monitoring and alerting Easier search and discovery Catalogs and tracks across disk and tape Indexes contents for granular recovery Off-box indexing to optimize performance 66
67