Software Defined Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation

Size: px

Start display at page:

Download "Software Defined Storage @ Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation"

Amice Simpson
8 years ago
Views:

1 Software Microsoft PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation

2 Lessons Learned operating large cloud properties

3 Industry trends Cloud scale services influencing design Standard, volume hardware to build high-scale systems at low cost Cloud design points in software Data explosion Device proliferation Modern apps Unstructured data analytics What is Software Defined (SDS)? Cloud scale and cost economics on standard, volume hardware Virtualization Mobility and flexibility within and across sites/clouds More density Scale Out with minimal operational complexity 3

4 Customer choice Private Cloud with partner Private Cloud with Microsoft SDS Hybrid Cloud Public Cloud SAN and NAS Windows SMB3 Scale Out File Server (SoFS) + Spaces StorSimple + Microsoft Azure Microsoft Software Defined (SDS) Breadth offering and unique opportunity Microsoft Azure

5 Private Enterprise and Hosted Clouds with SAN and NAS Private Cloud with partner Private Cloud with Microsoft SDS Hybrid Cloud Public Cloud SAN and NAS Windows SMB3 SoFS + Spaces StorSimple + Microsoft Azure Microsoft Azure

6 Optimizing Windows for SAN/NAS INCITS: T10,T11,T13 (SCSI,FC,AT) IETF: Co chairs for NFS 4.1, STORM (iscsi) Technical work: SMI-S, NVM Programming, XAM SMB 2/3 Plugfest

7 Private Enterprise and Hosted Clouds with Microsoft Defined Private Cloud with partner Private Cloud with Microsoft SDS Hybrid Cloud Public Cloud SAN and NAS Windows SMB3 SoFS + Spaces StorSimple + Microsoft Azure Microsoft Azure

8 Public Cloud lessons applied

9 Software Defined in Windows Server 2012 R2 Hyper-V Clusters Primary application data on cost affective, continuously available, high performance SMB3 file Shares backed by Spaces Shared JBOD SMB3 Network Fabric Scale-Out File Server Clusters Spaces Performance, Scale: SMB3 File network 2. Continuous Availability and Seamless Scale Out with File Server Nodes 3. Elastic, Reliable, Optimized Spaces 4. Standard volume hardware for low cost

10 SoFS + Spaces under the hood SMB3 File network High speed, low latency with SMB Direct SMB Multichannel for path failure resiliency Scale Out File Server Nodes Easy share management Active/Active Scale Out pay as you grow Continuously Available Hyper-V cluster nodes Scale Out File Server cluster nodes SMB3 Network Optimized Placement Virtualized Tiered spaces Physical SSD HDD

11 SoFS - Low latency, high scale with SMBDirect App Buffer SMB Buffer Hyper-V Cluster Scale Out File server (SoFS) Cluster SMB Buffer SMBDirect Microsoft implementation of RDMA on Ethernet, InfiniBand over SMB3 protocol High throughput with low latency Optimized to expose full potential of 10/40Gbps Ethernet and 56Gbps InfiniBand Usage beyond for Server Server Fast Live migration Adapter Buffer Adapter Buffer 32KB random reads from a mirrored space (disk) ~500,000 IOPS ~16.5 GBytes/sec

12 Windows Server System Center Software Defined stack overview Scale with 64-node clusters 8,000 VMs per Hyper- V Cluster Guest Clusters on SMB Hyper-V Replica DPM Dynamic Access control SMB3 in flight data encryption VM Prioritization VM Migration Cluster-Aware Updating with no downtime Windows Azure Backup File provisioning Block provisioning Utilization Trending iscsi Target block NFS 3, 4.1 for *nix clients, VMware SMB3 for Windows clients ReFS local file system for resiliency SMB3 Transparent Failover Fast NTFS chkdsk SMB3 SoFS for Hyper-V, SQL Server SMB3 Direct for low latency Dedup CSV Scale Out SMB3 Multichannel for FT, Perf SAS Array Support Hyper-V Management Thin Provision Alert Monitor SAN based Rapid Provisioning PowerShell Support Thin LUN provisioning Tiered Spaces Pool Classification SM API Integration SMI-S Service

13 Private Cloud Choice - SAN or Microsoft SDS Traditional FC/iSCSI SAN arrays Hyper-V compute nodes Hyper-V compute nodes Microsoft SDS (in Windows Server) Block protocol fabric File protocol fabric Low latency network Low latency with SMB3Direct Management of LUNs Management of Shares tiering tiering (new with R2) Data deduplication Data deduplication RAID resiliency groups Pooling of disks SAN/NAS Scale Out File Server + Spaces Flexible resiliency options Pooling of disks. High availability Persistent write-back cache. Copy offload Snapshots FC/SAS disk shelf FC/SAS disk shelf Shared SAS JBOD Shared SAS JBOD Continuous availability Persistent write-back cache. (new with R2) SMB copy offload Snapshots

14 Customer Quote: NTTX Hosting provider uses industry-standard (Microsoft SoFS + Spaces) to slash costs by 30 % By using Spaces, Hyper-V over SMB, and other new features, I eliminate big, lumpy capital expenditures. I can buy inexpensive and scale. - Philip Moss, Chief Technology Officer, NTTX Select NTTX designed a new datacenter around Windows Server 2012 in order to get new services to market faster and at a lower cost. Benefits: Achieved greater flexibility for meeting customer needs. Got new offerings to market faster. Increased annual revenue opportunities to U.S.$18.6 million. Saved $5.8 million a year.

16 Ecosystem of SMB server/client implementations SMB PlugFest Occurs every year side-by-side with the Developer Conference (SNIA SDC) in September Interaction across operating systems and SMB implementations Participants in the 2013 edition of the SNIA SMB2 / SMB3 Plugfest Santa Clara, CA September 2013

17 Hybrid Cloud StorSimple + Azure Private Cloud with partner Private Cloud with Microsoft SDS Hybrid Cloud Public Cloud SAN and NAS Windows SMB3 SoFS + Spaces StorSimple + Microsoft Azure Microsoft Azure

18 StorSimple Applications & Workloads Target Use Cases CapEx, OpEx of traditional File servers NAS File Share SMB NFS SharePoint Capacity Data grows exponentially (50 60% Annually) Cloud Collaboration Content & records management Archives Business intelligence Most I/O happens to working set data Media Engineering Logs, records EMR/PACS Legal Construction Local VM sprawl VM archives VMs Regional office Time MICROSOFT NDA ONLY

19 Application Servers StorSimple connects Windows, Hyper-V and VMware servers to Azure in minutes with no application modification StorSimple Appliance Most Active Data on SSD Warm data on SAS Local Tier Speed of SSD/SAS + Elasticity of Cloud Azure Inactive Primary Data + Backup + Archive + DR Consolidates primary, archive, backup, DR thru seamless integration with Azure Cloud Snapshots = revolutionary speed, simplicity and reliability for backup and recovery Reduces enterprise TCO by 60 80%

20 Public Cloud Azure Private Cloud with partner Private Cloud with Microsoft SDS Hybrid Cloud Public Cloud SAN and NAS Windows SMB3 SoFS + Spaces StorSimple + Microsoft Azure Microsoft Azure

21 Store, backup, recover your data Highly scalable: 20 trillion objects stored Highly durable: Multiple copies of your data Multiple object support: blobs, tables, drives Easy access: Supports REST APIs Available anywhere: multiple regions

22 Get your data wherever and whenever you need it Microsoft Azure Defend against regional disasters. Geo replication

24 Continue the journey

25 Microsoft Cloud Server Contribution to Open Compute Contributions to Open Compute Project CAD models, Specs, Gerber files, Source code Benefits to traditional servers - 40% cost savings, 15% power efficiency gains

26 Where can I find more information? Microsoft Solution guide Cost effective for Hyper-V Drop by our expo booth

Big data Devices Apps

Trends driving IT pressures Cloud Big data Devices Apps Devices: Info Workers Will Erase Boundary Between enterprise And Consumer Technologies. Forrester Research. August 30, 2012 Apps: Gartner: Predicts