Netapp @ 10th TF-Storage Meeting Wojciech Janusz, Netapp Poland Bogusz Błaszkiewicz, Netapp Poland Ljubljana, 2012.02.20
Agenda Data Ontap Cluster-Mode pnfs E-Series NetApp Confidential - Internal Use Only 2
FAS Market Share Trend Revenue EMC 29.4% NetApp 13.8% IBM 12.1% HP 10.7% Dell 8.8% FAS equals the combined NAS and SAN markets Source: IDC, Dec 2010 NetApp Confidential Limited Use
New Entry Systems Added to Line Truly unified FAS/V6280 FAS2040 Most efficient Extremely flexible FAS2240 432TB 144 Drives FAS/V3240 FAS/V3210 720TB 240 Drives 512GB Flash Cache 1,800TB 600 Drives 1TB Flash Cache FAS/V3270 2,880TB 960 Drives 2TB Flash Cache FAS/V6210 3,600TB 1,200 Drives 3TB Flash Cache FAS/V6240 4,320TB 1,440 Drives 6TB Flash Cache 4,320TB 1,440 Drives 8TB Flash Cache 408TB 136 Drives Unified Storage Architecture
Ontap 8.1 Cluster-mode
Data ONTAP 8.1 Cluster-Mode System NAS and SAN Familiar Ethernet and FC infrastructures No special client or host code Multiprotocol Access (NFS/CIFS/FC/iSCSI/FCoE) FAS/V62x0, FAS60x0, FAS/V32x0, FAS31x0 FAS3070, FAS3040, FAS2040* SATA, SAS, FC, and SSD storage Third-party arrays with V- Series Flash Cache SAS Virtualized Storage and Network FC SATA SSD SAS FC or SATA Third-Party Arrays NetApp Storage with V-Series Data ONTAP 8.1 Cluster-Mode System NetApp Confidential Limited Use
Data ONTAP 8 Cluster-Mode Global Namespace Namespace is unchanged as volumes move No client code Easy to manage Easy to change Seamlessly scales to many petabytes Access using a single NFS mount or CIFS share A3 Single NFS mount/cifs share A C A A1 A4 A2 A3 B A4 R B B1 B2 B2 C A2 B1 A1 R NetApp Confidential Limited Use
Data ONTAP 8.1 Cluster-Mode Virtual Server Logical, flexible, secure resource pool for a NAS namespace and LUNs SAN hosts/nas clients All data access is through a Vserver, which supports one or more protocols Includes FlexVol volumes, LUNs, and logical network interfaces (LIFs) Logical Interfaces Vserver FlexVol volumes LIF2 HA LIF1 Minimum of one Vserver required: can support 100s VS1 Integrated Shared Architecture NetApp Confidential Limited Use
Data ONTAP 8.1 Cluster-Mode Multi-Tenancy Vservers enable multiple storage domains sharing a common resource pool SAN hosts/nas clients Maintain logical separation A Vserver defines a domain for volumes, LIFs, and access protocols Secure, delegated administration 100s of Vservers supported LIF4 LIF3 LIF2 LIF2 LIF1 LIF1 HA HA VS2 VS1 Workload Isolation NetApp Confidential Limited Use
Data ONTAP 8.1 Cluster-Mode Cluster Expansion Nondisruptively grow and redistribute resources SAN hosts/nas clients Vserver adjusts as the cluster is seamlessly expanded Mix and match controllers LIF4 HA LIF3 LIF2 HA LIF1 Mix and match drive types SATA, SAS, FC, SSD Third-party arrays with V-Series Hosts 1000s of volumes PB-sized namespace Transparent Operational Flexibility NetApp Confidential Limited Use VS1
Cluster-Mode Transparent Volume Move Continuous data access by clients and hosts NFS / CIFS / iscsi /FC / FCoE Uninterrupted Access Nondisruptively move volumes between ANY aggregates anywhere in the cluster R A B C LUN C1 LUN Uses Snapshot technology to copy data to a new aggregate in the background A1 HA A2 A3 B1 B2 HA Storage space savings, mirror relationships, and Snapshot copies are unchanged A3 A C1 LUN B C LUN B2 A2 C2 LUN B1 R A1 NetApp Confidential Limited Use
Cluster-Mode: On-Demand Flexibility The Challenges Disk full errors Over-provisioning in anticipation of future capacity needs Managing access to new storage The Benefits Nondisruptive volume movement is transparent to clients and hosts Namespace and LUN mapping unchanged Shared storage infrastructure B2 A3 C1 LUN B LUN C1 A1 LUN LUN A2 A A1 A B1 C R LUN The Results Seamlessly add capacity Rebalance resources Rapidly deploy new system NetApp Confidential Limited Use
Cluster-Mode: Operational Efficiency The Challenges Changing workload demands Critical projects need appropriate resources The Benefits Nondisruptive volume movement is transparent to clients and hosts Mix controllers and disk types in the same cluster On-demand mobility for critical projects Adapt resources to meet business demand B2 A3 A2 B1 C1 LUN LUN Higher Performance Storage A1 B A Lower Cost Storage C R LUN The Results Virtualized tiered services Integrated unified system Match business priorities NetApp Confidential Limited Use
Cluster-Mode: Operational Lifecycle The Challenges Upgrade an entire storage system 24x7 operation during move The Execution Identify affected volumes and LUNs Nondisruptively move volumes Perform technology refresh Power up node and rejoin cluster Move volumes back to new node Repeat A1 C1 LUN LUN B2 B B1 A3 A2 A C R LUN The Results ZERO downtime ZERO processing interruptions ZERO client changes Always-On Infrastructure NetApp Confidential Limited Use
Cluster-Mode Networking Overview SAN / NAS HA HA Cluster Interconnect 10GbE Data ONTAP Cluster-Mode Mgmt NetApp Confidential Limited Use
pnfs 16
Massively Scalable NAS Platform A3 C1 One Namespace or Many, Classes of Service B C Projects A B C A1 A2 A3 B1 B2 C1 C2 C3 High-Speed Storage (Highest Performance Across All Workloads) C2 B2 A2 C3 B1 High-Capacity Storage (Lower $/GB) A1 Heterogeneous cluster Mix of controller types in single cluster per workload needs Entry, midrange, and high-end platforms Native and third-party storage (FAS, V-Series) Multiprotocol Tiered storage Match data to disk price/ performance Manage multiple tiers in the same namespace or many Examples Reference data DR mirror destination Scalable archives 17
Comparison of NFSv3, NFSv4 and NFSv4.1 Personality Semantics Authentication Identification Permissions Transport Caching Data Locality NFSv4.1 NFSv3 Stateless Stateful Supports UNIX Only & WINDOWS Weak(AUTH_SYS) Strong (Kerberos) Stringbased 32 bit (xyz@netapp.com) UID/GID More WINDOWS UNIX based friendly UDP TCP & Only TCP Files & Directory Ad-hoc Delegations* No Remote Referrals Access NFSv4 Stateful Supports UNIX & WINDOWS NFSv4.1 Strong (Kerberos) Is a minor release WINDOWS of NFSv4 like access Stringbased (xyz@netapp.com) TCP Only Does not modify any NFSv4 File Delegations features Referrals Is only in DOT8.1 c-mode Bug fixes Supports pnfs Supports sessions and trunking NetApp Confidential - Limited Use 18
pnfs pnfs Protocol Minor version of NFSv4.1 Transparent to applications Storage Access Protocol files (NFSv4.1) blocks (FC, iscsi, FCoE) objects (OSD2) Control Protocol Outside of the pnfs standard pnfs Protocol Client User Applications NFSv4.1 Generic pnfs layout File layout SUN RPC Storage Access Protocol OSD layout SCSI iscs Block layout TCP FCP I RDM A Metadata Server Control Protocol Data Servers NetApp Confidential - Limited Use 8
Regular NFS Vs. pnfs NFS NFS Client Meta-data, Control, Data use the same path pnfs with Data Ontap 8.1 Meta-Data Path Data Path Control Path Single Stack NFS, Meta-Data, Data, Locks pnfs Client pnfs Client pnfs Client N-Blade NFS pnfs N-Blade NFS pnfs D-Blade Meta-Data, Data Locks D-Blade Meta-Data, Data Locks NetApp Confidential - Limited Use 9
Client NFSv4.1 and pnfs in Linux Distributions NFSv4.1 Sessions RHEL 6.0/ RHEL 6.1 SLES 11 SP1 (Untested) Important fixes missing pnfs Files RHEL 6.2 (File support Only) kernel 2.6.40 SLES 11 SP 2* (Files & objects) pnfs Files and Objects Fedora 16 (Linux-3.0) * Internal testing of RHEL Early Access bits under way 21
22 NetApp Sets Record NFS Performance Leading Performance NetApp delivers better performance and efficiency than Isilon 35% more IOPS 40% faster response time 50% less disks 80% fewer controller nodes FAS6240 24-node cluster with Data ONTAP 8.1 SPECsfs2008 NFS benchmark For more information, visit http://www.spec.org/sfs2008/results/. SPEC and SPECsfs2008 are trademarks of the Standard Performance Evaluation Corp.
E-Series 23
Big Data Market Requirements Distributed compute farms with standard software Simpler systems, faster to deploy Optimized balance between compute & storage Reliable data (metadata) Very high streaming bandwidth Dense configurations - GB/s/Rack Unit Large data sets (containers) Simpler system configurations Boundaryless containers (10 s PBs) Simple access to dynamic datasets New access technology(cdmi) with legacy application interfaces Highly efficient, selfmanaging systems NetApp Confidential - Internal Use Only 24
E-Series Controllers 5400 2600 Host/SAN connectivity (4) 40Gb IB (8) 8Gb FC (16) 8Gb FC Drive channels / types / max (2) 6Gb SAS ports SSD/SAS/SED/NL-SAS Up to 384 drives Enclosures (60) drive DE6600 (24) drive DE5600 (12) drive DE1600 Cache 12 / 24 / 48 GB Performance 6,000 MB/s disk reads 3,100 MB/s CME disk writes 900,000 IOPS cache reads 350,000 IOPS SSD reads 150,000 IOPS disk reads Host/SAN connectivity (8) 6Gb SAS (8) 8Gb FC and (4) SAS (8) 1Gb iscsi and (4) SAS (4) 10Gb iscsi and (4) SAS Drive channels / types / max (2) 6Gb SAS ports SSD/SAS/SED/NL-SAS Up to 192 drives Enclosures (60) drive DE6600 (24) drive DE5600 (12) drive DE1600 Cache 2 / 4 GB Performance 4,000 MB/s disk reads 1,200 MB/s CME disk writes 200,000 IOPS cache reads 84,000 IOPS SSD reads 65,000 IOPS disk reads NetApp Confidential Limited Use Dual-controller systems 25
E-series disk shelves DE5600 2U / 24 / 2.5 SAS, SAS SSD drives DE1600 2U / 12 / 3.5 SAS, SAS SSD DE6600 4U / 60 / 3.5 FC, SAS, SATA, SAS SSD NetApp Confidential - Internal Use Only
Creating Storage Systems 5400 + DE6600 5400 + DE5600 2600 + DE1600 5460 5424 2612 Any controller to ANY enclosure Insert 2 E-Series Controller(s) into enclosure to create 1 storage system (RBOD) NetApp Confidential Limited Use 27
E Series Power 1.8PB in 1 rack High density 4U /60 up to 60GB/s reads 400,000 IOPs from disks NetApp Confidential - Internal Use Only
HaDoop NetApp Confidential - Internal Use Only 29
StorageGRID E-Series Building Blocks StorageGRID Software on Generic x86 Servers E2600/5400 + DE6600 120/180TB Array FC attached, 1 adapter per SN E2600 + DE1660 24TB Arrays 2 x Control Nodes 2 x Storage Nodes 2 x Gateway Nodes 2 x Storage Nodes NetApp Confidential - Internal Use Only 30
NetApp and StorNext Designed for NetApp E-Series storage High performance High capacity Highly reliable foundation StorNext File System Heterogeneous data sharing across Fibre Channel SAN clients Mac, Win, Linux, UNIX Simultaneously serve LAN clients with StorNext LAN Gateway & LAN clients StorNext LAN Clients FC LAN StorNext Metadata Controller SAN StorNext SAN Clients FC StorNext Storage Manager (Optional) Intelligent archiving Data always stored on most cost-effective storage tier NetApp E5460 Stack Long-term Archive NetApp Full Motion Video Solution 31
NetApp Auto Support Phone home data representing information about the status NetApp storage controllers Correlate disk latency (hot) with disk type 24 billion records 4 weeks to run query After Hadoop implementation -> 10.5 hours Bug detection through pattern matching 240 billion records Too large to run After Hadoop implementation = 18 hours NetApp Confidential - Limited Use 32
NetApp Confidential - Internal Use Only 33