How To Get A Flash Server For Free On A Microsoft Server (Flash) For A Small Price (For A Long Time) (For Large) (Microsoft) (Flash, Flash) (Power) (Large) (Server) (

Transcription

1 Strategic Storage Solutions and Virtualization Strategy RB Hooks, III CTO, Storage Sun Microsystems Federal

2 Agenda Industry Challenges Storage Management Storage Evolution A New Direction Deployment Considerations High-performance Storage Virtualization Long Term Strategy 2

3 Essential Technology for the Network Industry Challenges 3

4 Storage - Entering a New Era Power costs will exceed product costs by CY11 Datacenter utility costs have nearly doubled in the last 4 years source: Report to Congress on Server and Data Energy Efficiency 08/2007 Management costs are rising faster than $/GB decline Complexity and sheer volume have driven costs up over 25% Y/Y source: IDC 04/2008 Flash technology is driving a new storage eco-system Flash is the best storage technology for performance and power efficiency Open communities are driving storage advancements Open Storage community has introduced over 40 projects 4

5 IT Challenges Have Not Slowed Increasing Demand for Storage Capacity and Performance 2010 New Digital Data (¼ Created, ¾ Replicated) 2006 New Digital Data (Created, Captured, Replicated) 6X Growth Emerging Economies growing 30-40% faster than mature Economies 70% Created by Individuals 95% Unstructured (Non-Database) 161 Exabytes 988 Exabytes Enterprises responsible for 85% of this new data Source: IDC, The Expanding Digital Universe, 2007 (Security, privacy, reliability, compliance) 5

6 Disk Drive Characteristics Capacity TIME 6

7 Disk Drive Characteristics Capacity Performance TIME 7

8 IT Expenses People Costs $x S/W Costs H/W Costs TIME 8

9 IT Expenses People Costs $x S/W Costs H/W Costs TIME 9

10 IT Expenses People Costs $x S/W Costs H/W Costs TIME 10

11 IT Expenses People Costs $x S/W Costs H/W Costs TIME 11

12 Essential Technology for the Network Storage Management 12

13 App Server Storage Management CO N T R O L L E R S 13

14 App Server Storage Management RAID Stripe Size 512k 100GB HDD CO N T R O L L E R S 14

15 App Server Storage Management RAID Stripe Size 512k 100GB HDD CO N T R O L L E R S 15

16 App Server Storage Management RAID Stripe Size 512k 100GB HDD 400 GB Array Group CO N T R O L L E R S 16

17 App Server Storage Management RAID Stripe Size 512k 100GB HDD 400 GB Array Group CO N T R O L L E R S 10 GB 17

18 Data Layout Application Server Application File System Operating System 18

19 Data Layout Application Server Application File File System Operating System 19

20 Data Layout Application Server Application File File System Operating System 20

21 Data Layout Application Server Application File System Operating System 21

22 Data Layout Application Server Application File System Operating System D/R, B/C 40% Utilization 22

23 Essential Technology for the Network Storage Evolution 23

24 Customer Storage Vendor Maintained/Supported Maintained/Supported Storage Evolution DAS SAN NAS Block Network Byte/File Network 24

25 Storage Vendor Maintained/Supported Customer Maintained/Supported Storage Evolution DAS SAN NAS Storage Servers Block Network Byte/File Network 25

26 Why Applications Don t Perform Waiting for DATA SERVER Multi-Core, Multi Socket CPUs 260 Times Slower 15K RPM Disk Drives Today s Multi-Core, MultiSocket application server design are increasingly held back by slow storage High Performance DRAM When requesting data, the server spends most of it s time waiting for storage Application performance remain sluggish regardless of the Server CPU horsepower The traditional remedy of adding more expensive DRAM may no longer suffice as data sets double every 2 years STORAGE 26

27 Cost Effective Performance SSDs are 70X more cost effective Enterprise HDD > > > > 180 Write IOPS 320 Read IOPS 300 GB ~18W $ per IOPS: 2.43 Enterprise SSD > > > > 7,000 Write IOPS 35,000 Read IOPS 32GB ~3W $ per IOPS:

28 Where to Store Data? Optimization Trade-Off Sun Microsystems Internal Use Only

29 ZFS Hybrid Storage Pool Sun X4250 Storage Server Example Configuration B Configuration A 4 Xeon 7350 Processors 32GB FB DDR2 ECC DRAM OpenSolaris with ZFS (1) 80G SSD Cache Device (1) 32G SSD ZIL Device (7) 146GB 10,000 RPM SAS Drives (5) 400GB 4200 RPM SATA Drives 29

30 ZFS Hybrid Pool Example (announced at recent IDF Shanghai) Hybrid Storage Pool (DRAM + Read SSD + Write SSD + 5x 4200 RPM SATA) Traditional Storage Pool (DRAM + 7x 10K RPM 2.5 ) 4.9x 3.2x 4% 2x 11% Read IOPs Write IOPs Cost Storage Power Raw Capacity (Watts) (TB) If NVRAM were used, Hybrid wins on cost, too For large configs (e.g. 48T 750T+) cost is entirely amortized 30

31 Essential Technology for the Network A New Direction 31

32 The Sun Storage 7000 Unified Storage System... Radically SIMPLIFYING the way you manage your storage with breakthrough SPEED, SCALE and COST SAVINGS 32

33 Sun Storage 7000 Unified Systems Converges Compute, Storage and the Network Open Architecture Open data formats, Open protocols Supports industry standard connections CIFS, NFS, HTTP, FTP, iscsi Integrated products, reusable components Storage 20% Technical Innovation Transparent integration of Enterprise SSDs Real-time detailed performance monitoring 57% Game Changing Economics Industry leading - $/GB, $/IOP, $/MB/s Simplistic storage management greatly reducing personnel costs No appliance software fees and license keys Integrated Platform Compute 15% Network 33

34 ENTRY-LEVEL STANDALONE 8 GB memory GB SAS disks HIGH-DENSITY SCALABLE Up to 64GB memory, 142 1TB SATA disks Up to 2 18 GB write-optimized SSDs ENTRY-LEVEL CLUSTER-CAPABLE Up to 64GB memory, 96 1TB SATA disks Up to 6 100GB read/16 18GB write SSDs Active-Active Clustering for H/A STANDARD FEATURES (ALL MODELS) All Data Protocols and Data Services Included (Analytics, Snapshots, Replication, Compression, NFS, CIFS, iscsi ) Built-in 4 1 Gb Ethernet ports Remote Console (Serial or Ethernet) Lights-out Management SCALABLE CLUSTER-CAPABLE Up to 128GB memory, 288 1TB SATA disks Up to 6 100GB read/16 18GB write SSDs Active-Active Clustering for H/A OPTIONAL NETWORKING & CONNECTIVITY (ALL MODELS) 2 10 Gb Ethernet (optical) 4 1 Gb Ethernet (copper) 2 1Gb Ethernet (optical) FC or SCSI HBA for tape backup 34

35 Quick Snapshot System Monitoring 35

36 Real-time Performance Monitoring Drill down to any level to monitor performance events by user, protocol, latency factor, device, etc. 36

37 Storage Management Made Easy Just enter Quota for user and click Apply storage is immediately available its that easy! 37

38 Point & Click Storage Services Click the Power button to turn a service on 38

39 Sun Storage 7000 Unified Systems Real-time graphical business analytics What files are hot right now? What is the distribution of reads and writes? Which clients are hot right now, displayed by protocol? Group analytics into worksheets, can be made persistent Data can be exported for further number crunching, or can be saved on the appliance 39

40 Sun Storage 7000 Unified Storage System ISV Certifications +applications being certified monthly 40

41 Sun Storage 7210 Unified Storage System Content Delivery Networks Scale Higher in Less Datacenter Space Video Players Media Servers Sun Unified Storage 7210 delivered 752 MB/s That's 6,000 Concurrent Streams Randomly accessing 54,000 FLV files 43,775 hours of content, 19.7TB Usable, from 44 TB raw Mirrored Storage for Streaming Contents (SS7210) Streaming Edge Node Figure 1: Streaming Edge Node Architecture NetApp TB drives EMC NS TB drives Power Space Price 1.1x 3.8x 2.4x 1.5x 3.3x 1.8x 41

42 7000 Simulator 42

43 Essential Technology for the Network Deployment Ideas 43

44 Sun Storage 7000 and Database Indexing may go to Solid State Disk Archive Log may be enabled for compression iscsi CIFS NFS NDMP DRAM SSD Backup Server S7410 Tape 44

45 S7000's Benefit for Database Superior performance via ZFS Hybrid Storage Pool technology Larger cache area with DRAM and SSD combined Good for caching indexes Comprehensive Performance Analysis with DTrace Analytics Data Compression for Archive Log space saving End to End Checksum Prevent silent data corruption Highly Optimized Blocksize for DB Rapid Recovery with faster RAID rebuild / snapshot Business Continuity with replication 45

46 7000 Analytics and Oracle >>

47 Sun Storage 7000 and File Server Virus Scanning Server File Server CIFS Web Server NFS iscsi ICAP NDMP Backup Server Application Server Add protocol support without license fees Larger caching area to speed up access Active Directory Server DRAM SSD S7410 Tape 47

48 S7000's Benefit for File Server Best $/GB in the market High Speed file access via Hybrid Storage Pool technology Advanced Storage Management, Performance Tuning and Diagnostics Thin Provisioning - Ideal for Consolidation Built-in Data Compression Fast Recovery with snapshot / cloning Disaster Recovery with replication No license fees 48

49 Sun Storage 7000 and Video Surveillance IP Camera Web Server File Server Video Analytic Server NFS CIFS CIFS CIFS NDMP DRAM SSD Security Office Workstation Backup Server S7410 Tape 49

50 S7000's Benefit for Video Surveillance Best $/GB in the market High performance access Hybrid Storage Pool technology (DRAM, SSD) Advance Storage Management, Performance Tuning and Diagnostics Built-in Data Compression Fast Recovery with snapshot Disaster Recovery with replication 50

51 Sun Storage 7000 and Server Virtualization Virus Scanning Server Virtual Machine1 Virtual Machine2 VMWare ESX NFS VMWare ESX Virtual Machine3 Add protocol support without license fee Larger caching area to speed up access ICAP iscsi NDMP Backup Server Virtual Machine4 DRAM SSD S7410 Active Directory Server Tape 51

52 S7000's Benefit for Server Virtualization Best $/GB in the market High performance access via Hybrid Storage Pool technology (DRAM, SSD) Highly Scalable for multiple VMs deployment Idea for Storage Consolidation Easy to manage with Analytics, right down to the VM disk (vmdk) Comprehensive Data Protection Fast Recovery with snapshot Disaster Recovery with file replication 52

53 7000 and VMware 53

54 Full Compliment of Storage Software Included with the System at No Additional Cost Data Protocols NFS v2, v3 and v4 CIFS ISCSI HTTP HTTPS WebDAV (over SSL too) FTP SFTP FTPS NDMP v4 Data Services Flash Hybrid Storage Pool RAID-Z (5) RAID-Z DP (6) Mirroring Striping Active-active Clustering Remote Replication Antivirus via ICAP Protocol Snapshots and Restores Clones Compression Thin Provisioning End-to-End Data Integrity Multi-Path I/O Fault Management Microsoft VSS Shadow Copy for Shared Folders Management DTrace Analytics Dashboard Role-Based Access Control NIS LDAP & AD Alerts Phone Home SNMP Scripting Upgrade Hardware View Advanced Networking CIFS share-level ACLs Workflow Automation NTP Authentication FTP Analytics CIFS Oplocks 54

55 Sun Storage 7000 Unified Storage Systems vs. the Competition 55

56 S7000 Series Summary October 2009 In the past 9 months: Shipped over 41PB and over 2000 systems (last 3 months shipped the equivalent of the previous 6 months) More than 350 net new customers through June ,165 Unified Storage Simulator downloads externally Continued displacement of competitors : NetApp, EMC, Isilon, BlueArc, etc. I've been covering storage for 10 years and this is the first time that I have become excited about what Sun is doing in storage. Sun's Unified Storage is the first disruptive technology that I've seen in the storage space in 10 years. This is a NAS product that is much better than anything Net App and EMC offer and is a huge opportunity for Sun... - Roger Cox, Gartner Research VP and Distinguished Analyst recently provided his view at a Gartner SAS Forum 56

57 Open Storage Delivers: Freedom from Lock-in and Global Community Efforts of 1000s Breakthrough Economics Simplified Data Management Dynamic Scale for Your Infrastructure 57

58 Essential Technology for the Network Highperformance Storage 58

59 Storage IT Challenges Business Data Growth Driving Storage Infrastructure Challenges Insufficient Performance for database applications and SLA requirements Data Center Cost Power and Cooling Scaling applications against business requirements 59

60 Why Applications Don t Perform Waiting for DATA HDDs can't keep up Today s Multi-Core, MultiSocket application server design are increasingly held back by slow storage When requesting data, the server spends most of its time waiting for storage Application performance remains sluggish regardless of the Server CPU horsepower The traditional remedy of adding more DRAM or shortstroking HDDs is both expensive and inefficient 60

61 Disk to CPU Discontinuity Today s CPU Have Become I/O Starved; HDDs Can't Keep Up Moore s Law (2 x/yr CPUs performance) is out-stripping disk drive rotational speed As a result, storage systems are hopelessly unbalanced between controller capability and storage pool performance 61

62 Enterprise HDD Falling Short Increasing Capacity to Performance Mismatch 62

63 Why SSDs are a BIG DEAL HDDs No Longer the Choice for Performance or Economics A single Solid State Drive equals the IOPS of 100 Hard Disk Drives 30,000 IOPS kWh Drives 1.75kWh A single Solid State Drive consumes less than 1/500th the performance power of Hard Disk Drives* 63

64 Why HDDs are not going away HDDs still holds the lead in Capacity A single Disk Drive holds 33X the capacity of SSDs 1 TByte 33 SSDs 64

65 CPU to Storage Discontinuity The number of HDDs needed to keep up is not cost effective or sustainable 65

66 SSDs Keep Up w/ CPU Moore s Law controls both 66

67 New Server Memory Hierarchy 67

68 Latency Comparison Bridging the DRAM to HDD Gap 1S 100mS 10mS 1mS 100uS TAPE 10uS 1uS HDD FLASH /SSD 100nS 10nS 1nS DRAM CPU 68

69 Sun is the Flash Leader Experience More Performance with Less Power and Space Broadest portfolio of solid-state Flash products Leveraging Flash technology across our entire server and storage portfolios The only company integrating both an operating system and a storage portfolio that is designed for Flash from the ground up Flash enabled ZFS software for automating data management to maximize performance and data integrity while reducing overall costs 69

70 The Sun FlashFire Product Portfolio For accelerating applications and reducing operating costs Performance and Scalability Flash Arrays (External Devices) Flash Cards (Flash/HBA PCIe Cards) SSD (2.5 FF) (In Servers,Storage Syst., S7000) Flash Modules (Embedded In Servers) 70

71 Solid State Drives (SSD) Enterprise advantage from commodity FLASH SSD has three major parts: > A) Controller > B) DRAM > C) FLASH bank Individual FLASH chips are pooled and address space virtualized by the controller Controller also performs > Wear leveling > CRC > Bad block mapping Controller provides the host interface such as SATA, PATA, SAS or FC 71

72 Anatomy of an SSD Similar to HDD Arrays 72

73 Sun Solid State Drive Instant and Efficient Application Performance Acceleration Capacity 32GB User Addressable (SLC enterprise-grade Flash) Form Factor 2.5 Enterprise SFF 3Gb SATA-II Performance A new era in storage performance and efficiency Reliability Dramatically Improved Performance Cost Saving and Eco-Efficiency Simplicity and Ease of Use Improved Reliability Random IOPS: 35,000 IOPS read (4K) 3,300 IOPS write (4K) Random IOPS: 250MB/sec Read (1M) 170MB/sec Write (1M) 2M MTBF hours Power 2.5W Maximum I/O Performance of Over HDDs 73

74 SSDs Why Now? $/GB Crossover in

75 Capacity per SSD vs. HDD Form-factor Crossover in

76 Where to Deploy SSDs? Storage or Server? 76

77 Introducing the Sun Storage F5100 Flash Array The world's fastest solid-state BigFlash Array with unprecedented performance and ecoefficiency STATEMENT 77

78 Delivering World Record Performance More than 1 million IOPS in just 1RU (1.75 Inches!) of Space World's fastest flash array for database acceleration Over 1.2 million read and write IOPS (4K) in 1RU Over 50M IOPS and 80TB in a singe rack Low latency -- Less than 1/15 that of HDD > Reduces I/O service times 10-15X Better IOPS/$ -- Greater than 40X that of disk drives 78

79 Sun Storage F5100 Flash Array Solid State Database Accelerator Over 1M IOPS in 1RU of Space (Over 50M IOPS and 80TB in a rack) Capacity Up to 1.92 TB in 1 RU ( 80TB/ rack) 4 discrete SAS Domains per system Performance 1.6M read IOPS (4K) 1.2M write IOPS (4K) 12.8GB/s sequential read 9.8GB/s sequential write Connectivity 16 x 4-wide3Gb/s SAS Port SAS expander based fabric Direct connect up to 16 hosts Reliability Hot-swap, redundant power and fans Advanced wear-leveling, write endurance Integrated Super CAP backup Redefining Storage Performance and Efficiency World record performance Unprecedented power efficiency Unmatched space efficiency Performance greater than 3,000 HDDs! Power 300 watts Management CAM software 79

80 F5100 Flash Array Database Accelerator Blazing Performance with 3 light bulbs of power and 1.75-inches of space 3 scalable configurations w/upgrades to full: 0.48TB (20 Flash Modules) 0.96TB (40 Flash Modules) 1.92 TB (80 Flash Modules) Accelerate Applications Reduce Power Reduce Cost 80

81 Easy to Deploy: Databases Existing Deployment Attach F5100 Flash Array Rebuild Indexes on F5100 Point to F5100 Indexes and Go! What You Get with the Sun F5100: 2x better response time 2x better throughput 81

82 Flash Modules Capacity (Flash Drives) High write performance and endurance, very compact 24GB User Addressable (SLC enterprise-grade Flash) Form Factor JEDEC MO-258A form factor 68.8 x 30 x 3.8 mm 3Gbps SATA-II Performance NAND NAND FMC NAND NAND Random IOPS: 25,000 IOPS read (4K) 15,000 IOPS write (4K) Sequential IO: 265 MB/sec Read (1M) 118 MB/sec Write (1M) Power * Used in Sun servers, Flash Arrays and released as Open Standard 2.5W Maximum Reliability 2M MTBF hours I/O Performance of HDDs 82

83 Introducing the Sun Flash Accelerator F20 PCIe Card A combination of up to 96GB of Flash memory Big coupled with a SAS disk controller to dramatically increases storage performance STATEMENT 83

84 Sun Flash Accelerator F20 PCIe Card Flash Accelerator Card and disk controller Capacity 96 GB solid state SLC Flash Performance Random IO: 100K IOPS read 87K IOPS write Sequential IO: 1,100 MB/s read 500 MB/s write Form Factor PCIe HBA (low-profile) Disk Controller 2x4-wide 3Gb/s SAS Port Reliability Turbocharge Applications Instantly Enterprise-grade Flash Integrated Super CAP backup Power I/0 Performance of Over 300 HDDs 15 Watts 84

85 Turbo Charges Sun Servers and Their Applications Turbo charges storage pool > Increases I/O performance up to 75X for better application performance > IO performance of 300 HDDs on a PCIe card Controls ENTIRE Hybrid Storage Pool (Flash and Internal HDD) > No extra HBAs needed > No extra PCIe slots being burned > No HDD slots being burned Sun Servers Flash + HBA combo 85

86 Essential Technology for the Network Virtualization 86

87 Evolution of Virtualization Web App Database Multiple user applications each in its own secure, isolated environment Multiple virtual OS environments on a single OS instance (containers) with resource management xvm Multiple virtual CPUs on a single physical CPU VMWare, xvm, and Xen Multiple cores on a die 87

88 Sun xvm Products Virtualization from Desktop to Datacenter Open developer virtualization platform Enterpriseclass hypervisor Only VDI with choice: Windows, Open Solaris and Linux delivered securely Manage heterogeneous datacenters to reduce complexity, provision, monitor 88

89 Different Levels of Virtualization - xvm Hard Partitions App Server Database Identity Server Virtual Machines File Server Web Server Mail Server OS Virtualization Calendar Database Server Web Server Resource Mgmt. SunRay Server Database App Server App OS Server Multiple OSes Single OS Trend to flexibility > Very High RAS > Very Scalable > Mature Technology > Ability to run different OS versions > Ability to live migrate an OS > Ability to run different OS versions and types > De-couples OS and HW versions Trend to isolation > Scalable, low overhead > Single OS to manage > Divides system and app administration > Fine grained resource management > Very scalable and low overhead > Single OS to manage > Fine grained resource management 89

90 Only VDI with Choice: Windows, Open Solaris, and Linux Desktop clients delivered securely to any client on the network PC, Or thin client... xvm or VMware Sun Virtual Desktop Connector Sun Ray Software Sun Secure Global Desktop Software Sun VDI Software Sun Fire x64/x86 Servers Internet 90

91 Essential Technology for the Network Long Term Strategy 91

92 RedShift: Demands Innovation 92

93 Thank You!