Towards Rack-scale Computing Challenges and Opportunities
|
|
|
- Adelia West
- 8 years ago
- Views:
Transcription
1 Towards Rack-scale Computing Challenges and Opportunities Paolo Costa joint work with Raja Appuswamy, Hitesh Ballani, Sergey Legtchenko, Dushyanth Narayanan, Ant Rowstron
2 Hardware Evolution in Data Centers Goal Increase work done per dollar (CapEx + OpEx) Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 2
3 Hardware Evolution in Data Centers Scale out vs. scale up Many commodity servers rather than few expensive servers Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 3
4 Hardware Evolution in Data Centers Custom layout Remove unnecessary components (e.g., GPGPUs, USB ports) Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 4
5 Hardware Evolution in Data Centers Integrated fabrics Higher density and lower power consumption Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 5
6 Hardware Evolution in Data Centers System-on-Chip (SoC) CPU, IO controllers, NIC/fabric switch on the same die Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 6
7 Hardware Evolution in Data Centers Silicon Photonics High-bandwidth / low-latency interconnect (resource disaggregation) Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 7
8 Hardware Evolution in Data Centers rack unit (RU) 2 Ru 4-10 Ru Rack-scale Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 8
9 Hardware Evolution in Data Centers Rack-scale Computers The rack is the new unit of deployment in data centers Sweet spot between single-server and cluster deployments rack unit (RU) 2 Ru 4-10 Ru Rack-scale Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 9
10 Rack-scale Computer in 2020? Today s traditional rack 2020 Rack-scale Computer #Cores (#servers) ~100s (20-40) ~100,000s (1,000s) Memory ~1 TB ~100s TB Storage ~100 TB (flash + spinning disk) ~100s PB (NVM) Bandwidth / server 10 Gbps 1 Tbps Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 10
11 How far are we from rack-scale computing? Today s rack 2020 Rack-scale Computer 2014 Rack-scale Computer #Cores (#servers) ~100s (20-40) ~100,000s (1,000s) ~1,000s (100s-1000s) Memory ~1 TB ~100s TB ~10 TBs Storage ~100 TB (SSD/HDD) ~100s PB (NVM) ~10s PBs (SSD/HDD) Network 10 Gbps / server 1 Tbps / server ~10s -100s Gbps / server Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 11
12 How far are we from rack-scale computing? #Cores (#servers) Today s rack ~100s (20-40) 2020 Rack-scale Computer ~100,000s (1,000s) 2014 Rack-scale Computer ~1,000s (100s-1000s) Memory ~1 TB ~100s TB ~10 TBs Storage ~100 TB (SSD/HDD) Network 10 Gbps / server ~100s PB (NVM) 1 Tbps / server ~10s PBs (SSD/HDD) ~10s -100s Gbps / server Core count AMD SeaMicro SM cores (64 servers) in 10 RU 2,048 cores (256 servers) at rack scale HP Moonshot Redstone 1,152 cores (288 servers) in 4U 11,520 cores (3,200 servers) at rack scale Boston Viridis 192 cores (48 servers) in 2 RU 7,680 cores (1,920 servers) at rack scale Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 12
13 How far are we from rack-scale computing? #Cores (#servers) Today s rack ~100s (20-40) 2020 Rack-scale Computer ~100,000s (1,000s) 2014 Rack-scale Computer ~1,000s (100s-1000s) Memory ~1 TB ~100s TB ~10 TBs Storage ~100 TB (SSD/HDD) Network 10 Gbps / server ~100s PB (NVM) 1 Tbps / server ~1 PB (SSD/HDD) ~10s -100s Gbps / server Memory AMD SeaMicro SM15000-XE 2 TB RAM (32 GB/server) in 10 RU 8TB RAM at rack scale HP Moonshot Redstone 1.12 TB (4 GB/server) in 4U TB at rack scale Storage AMD SeaMicro FS-5084-L 336 TB storage in 5 RU 2.5 PB at rack scale Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 13
14 How far are we from rack-scale computing? #Cores (#servers) Today s rack ~100s (20-40) 2020 Rack-scale Computer ~100,000s (1,000s) 2014 Rack-scale Computer ~1,000s (100s-1000s) Memory ~1 TB ~100s TB ~10 TBs Storage ~100 TB (SSD/HDD) ~100s PB (NVM) ~1 PB (SSD/HDD) Network AMD SeaMicro SM15000-XE 1.28 Tbps fabric (20 Gbps / server) Mellanox ConnectX-3 Pro 2x 40-Gbps NICs Intel MXC Connector (expected Q3 14) Up to 32 fibers (25 Gbps / fiber) Up to 800 Gbps / server Network 10 Gbps / server 1 Tbps / server ~10s -100s Gbps / server Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 14
15 How far are we from rack-scale computing? #Cores (#servers) Today s rack ~100s (20-40) 2020 Rack-scale Computer ~100,000s (1,000s) 2014 Rack-scale Computer ~1,000s (100s-1000s) Memory ~1 TB ~100s TB ~10 TBs Storage ~100 TB (SSD/HDD) ~100s PB (NVM) ~1 PB (SSD/HDD) Not just quantity 3D stacking Cache-like performance for RAM? NVRAM Fast byte-addressable storage Silicon photonics Low latency (10s-100s ns at rack-scale) Network 10 Gbps / server 1 Tbps / server ~10s -100s Gbps / server Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 15
16 New Hardware, Old Software Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 16
17 New Hardware, Old Software MapReduce Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 17
18 New Hardware, Old Software MapReduce Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 18
19 New Hardware, Old Software MapReduce Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 19
20 New Hardware, Old Software Achieving many of the benefits of Rack-scale Computers requires adequate software support Great opportunity for system researchers to rethink the software stack and hw/sw co-design MapReduce Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 20
21 Research Questions: Architecture What s the best usage of the silicon area? Homogenous vs. heterogeneous cores General-purpose cores vs. accelerators e.g., FPGAs, neural accelerators (NPUs) On-chip vs. off-chip functionality Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 21
22 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 22
23 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 23
24 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 24
25 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 25
26 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 26
27 Research Questions: Networking What is the correct topology? Centralized vs. distributed switch Application-agnostic vs. application specific Where to put memory/storage servers? Converged fabric How to handle memory, storage, IP traffic? Inter-rack connectivity How to extend beyond rack-scale? o over-subscription and protocol bridging Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 27
28 Research Questions: OS / Storage Rethink the cache-hierarchy High-performance (3D stacking) vs. high-capacity tier (NVRAM) What s the correct ratio? Are SSDs / HDDs to be used only for cold data? Impact on existing (and new!) applications? Cache-like RAM and byte-addressable fast storage How to schedule application tasks? Joint scheduling (CPU, memory, network, storage) Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 28
29 Research Questions: Distributed Systems RaSCs are different from many-core setups Separate failure domains, no cache coherency Rack-scale computers are distributed systems (albeit not traditional) How to handle remote resources? Consistency and fault-tolerance What are the right programming abstractions? Shared memory, message passing, MapReduce, Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 29
![Aggregation [NSDI 12] Network Abstractions [HPDC 13]](/docs-images/31/14908072/images/30-0.jpg "Paolo Costa Towards Rack-scale Computing: Challenges and")
30 Rack-scale MSR Cambridge CamCube Vision [WREN 09] Custom Routing [SIGCOMM 10] In-network Aggregation [NSDI 12] Network Abstractions [HPDC 13] Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 30
31 Rack-scale MSR Cambridge Programming abstractions Storage Rack-scale design Network Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 31
32 Rack-scale MSR Cambridge Programming abstractions Storage Rack-scale design Network FaRM [NSDI 14] RDMA-based distributed platform Transaction support Lock-free reads Support for object colocation Hardware alone is not enough Software stack customization is needed High performance 167 M key lookups (31 us latency) on a 20-server testbed Aleksandar Dragojević, Dushyanth Narayanan, Orion Hodson, Miguel Castro Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 32
33 Rack-scale MSR Cambridge Programming abstractions Storage Rack-scale design Network Pelican Rack-scale storage appliance for cold data Hardware and software co-design High storage density Low cost Low power consumption Fault tolerant Austin Donnelly, Richard Black, Sergey Legtchenko, Ant Rowstron, Dave Harper, Shobana Balakrishnan, Eric Peterson, Adam Glass Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 33
34 Rack-scale MSR Cambridge Programming abstractions Storage Network Rack-scale design RaSC-Net [HotCloud 14] How to design a network stack for Rack-scale computers? Routing and congestion control Support for: Multiple paths Low latency Consolidated workloads Paolo Costa, Hitesh Ballani, Dushyanth Narayan Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 34
35 Rack-scale MSR Cambridge Programming abstractions Storage Network Rack-scale design DRackAr How to master the design space? Topology, resources provisioning, Input: Hardware components Constraints (e.g., max power budget) Target workload Utility function Output: Rack configuration Sergey Legtchenko, Ant Rowstron Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 35
36 Summary Rack-scale computing: 1,000s of cores TBs of RAM and PBs of storage Intra-rack high bandwidth / low latency connectivity This can improve the performance of existing apps graph processing, machine learning jobs, in-memory DBs, but also enable new ones! Call to action Hardware has been changing a lot now it s up to us to change the software too! Paolo Costa Towards Rack-scale Computing: Challenges and Opportunities 36
Paolo Costa costa@imperial.ac.uk
joint work with Ant Rowstron, Austin Donnelly, and Greg O Shea (MSR Cambridge) Hussam Abu-Libdeh, Simon Schubert (Interns) Paolo Costa costa@imperial.ac.uk Paolo Costa CamCube - Rethinking the Data Center
Pelican: A Building Block for Exascale Cold Data Storage
Pelican: A Building Block for Exascale Cold Data Storage Austin Donnelly Microsoft Research and: Shobana Balakrishnan, Richard Black, Adam Glass, Dave Harper, Sergey Legtchenko, Aaron Ogus, Eric Peterson,
Solving I/O Bottlenecks to Enable Superior Cloud Efficiency
WHITE PAPER Solving I/O Bottlenecks to Enable Superior Cloud Efficiency Overview...1 Mellanox I/O Virtualization Features and Benefits...2 Summary...6 Overview We already have 8 or even 16 cores on one
Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks
WHITE PAPER July 2014 Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks Contents Executive Summary...2 Background...3 InfiniteGraph...3 High Performance
Ant Rowstron. Joint work with Paolo Costa, Austin Donnelly and Greg O Shea Microsoft Research Cambridge. Hussam Abu-Libdeh, Simon Schubert Interns
Ant Rowstron Joint work with Paolo Costa, Austin Donnelly and Greg O Shea Microsoft Research Cambridge Hussam Abu-Libdeh, Simon Schubert Interns Thinking of large-scale data centers Microsoft, Google,
Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014
Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet Anand Rangaswamy September 2014 Storage Developer Conference Mellanox Overview Ticker: MLNX Leading provider of high-throughput,
SMB Direct for SQL Server and Private Cloud
SMB Direct for SQL Server and Private Cloud Increased Performance, Higher Scalability and Extreme Resiliency June, 2014 Mellanox Overview Ticker: MLNX Leading provider of high-throughput, low-latency server
Deploying Ceph with High Performance Networks, Architectures and benchmarks for Block Storage Solutions
WHITE PAPER May 2014 Deploying Ceph with High Performance Networks, Architectures and benchmarks for Block Storage Solutions Contents Executive Summary...2 Background...2 Network Configuration...3 Test
Network Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics. Qin Yin Fall Semester 2013
Network Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics Qin Yin Fall Semester 2013 1 Walmart s Data Center 2 Amadeus Data Center 3 Google s Data Center 4 Data Center
Hadoop: Embracing future hardware
Hadoop: Embracing future hardware Suresh Srinivas @suresh_m_s Page 1 About Me Architect & Founder at Hortonworks Long time Apache Hadoop committer and PMC member Designed and developed many key Hadoop
How To Build A Cisco Ukcsob420 M3 Blade Server
Data Sheet Cisco UCS B420 M3 Blade Server Product Overview The Cisco Unified Computing System (Cisco UCS ) combines Cisco UCS B-Series Blade Servers and C-Series Rack Servers with networking and storage
AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013
AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013 OpenStack What is OpenStack? OpenStack is a cloud operaeng system that controls large pools of compute, storage, and networking resources
UCS M-Series Modular Servers
UCS M-Series Modular Servers The Next Wave of UCS Innovation Marian Klas Cisco Systems June 2015 Cisco UCS - Powering Applications at Every Scale Edge-Scale Computing Cloud-Scale Computing Seamlessly Extend
Mellanox Academy Online Training (E-learning)
Mellanox Academy Online Training (E-learning) 2013-2014 30 P age Mellanox offers a variety of training methods and learning solutions for instructor-led training classes and remote online learning (e-learning),
SeaMicro SM10000-64 Server
SeaMicro SM10000-64 Server Building Datacenter Servers Using Cell Phone Chips Ashutosh Dhodapkar, Gary Lauterbach, Sean Lie, Ashutosh Dhodapkar, Gary Lauterbach, Sean Lie, Dhiraj Mallick, Jim Bauman, Sundar
Enabling the Use of Data
Enabling the Use of Data Michael Kagan, CTO June 1, 2015 - Technion Computer Engineering Conference Safe Harbor Statement These slides and the accompanying oral presentation contain forward-looking statements
Achieving a High-Performance Virtual Network Infrastructure with PLUMgrid IO Visor & Mellanox ConnectX -3 Pro
Achieving a High-Performance Virtual Network Infrastructure with PLUMgrid IO Visor & Mellanox ConnectX -3 Pro Whitepaper What s wrong with today s clouds? Compute and storage virtualization has enabled
Optimizing Data Center Networks for Cloud Computing
PRAMAK 1 Optimizing Data Center Networks for Cloud Computing Data Center networks have evolved over time as the nature of computing changed. They evolved to handle the computing models based on main-frames,
Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA
WHITE PAPER April 2014 Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA Executive Summary...1 Background...2 File Systems Architecture...2 Network Architecture...3 IBM BigInsights...5
Mellanox Accelerated Storage Solutions
Mellanox Accelerated Storage Solutions Moving Data Efficiently In an era of exponential data growth, storage infrastructures are being pushed to the limits of their capacity and data delivery capabilities.
Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions
Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions 64% of organizations were investing or planning to invest on Big Data technology
Hyperscale Use Cases for Scaling Out with Flash. David Olszewski
Hyperscale Use Cases for Scaling Out with Flash David Olszewski Business challenges Performanc e Requireme nts Storage Budget Balance the IT requirements How can you get the best of both worlds? SLA Optimized
Mit Soft- & Hardware zum Erfolg. Giuseppe Paletta
Mit Soft- & Hardware zum Erfolg IT-Transformation VCE Converged and Hyperconverged Infrastructure VCE VxRack EMC VSPEX Blue IT-Transformation IT has changed dramatically in last past years The requirements
Panel: Cloud/SDN/NFV 黃 仁 竑 教 授 國 立 中 正 大 學 資 工 系 2015/12/26
Panel: Cloud/SDN/NFV 黃 仁 竑 教 授 國 立 中 正 大 學 資 工 系 2015/12/26 1 Outline Cloud data center (CDC) Software Defined Network (SDN) Network Function Virtualization (NFV) Conclusion 2 Cloud Computing Cloud computing
High Performance MySQL Cluster Cloud Reference Architecture using 16 Gbps Fibre Channel and Solid State Storage Technology
High Performance MySQL Cluster Cloud Reference Architecture using 16 Gbps Fibre Channel and Solid State Storage Technology Evaluation report prepared under contract with Brocade Executive Summary As CIOs
Platfora Big Data Analytics
Platfora Big Data Analytics ISV Partner Solution Case Study and Cisco Unified Computing System Platfora, the leading enterprise big data analytics platform built natively on Hadoop and Spark, delivers
Walmart s Data Center. Amadeus Data Center. Google s Data Center. Data Center Evolution 1.0. Data Center Evolution 2.0
Walmart s Data Center Network Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics Qin Yin Fall emester 2013 1 2 Amadeus Data Center Google s Data Center 3 4 Data Center
Scalable. Reliable. Flexible. High Performance Architecture. Fault Tolerant System Design. Expansion Options for Unique Business Needs
Protecting the Data That Drives Business SecureSphere Appliances Scalable. Reliable. Flexible. Imperva SecureSphere appliances provide superior performance and resiliency for demanding network environments.
Cut I/O Power and Cost while Boosting Blade Server Performance
April 2009 Cut I/O Power and Cost while Boosting Blade Server Performance 1.0 Shifting Data Center Cost Structures... 1 1.1 The Need for More I/O Capacity... 1 1.2 Power Consumption-the Number 1 Problem...
RAMCloud and the Low- Latency Datacenter. John Ousterhout Stanford University
RAMCloud and the Low- Latency Datacenter John Ousterhout Stanford University Most important driver for innovation in computer systems: Rise of the datacenter Phase 1: large scale Phase 2: low latency Introduction
Router Architectures
Router Architectures An overview of router architectures. Introduction What is a Packet Switch? Basic Architectural Components Some Example Packet Switches The Evolution of IP Routers 2 1 Router Components
Scalable. Reliable. Flexible. High Performance Architecture. Fault Tolerant System Design. Expansion Options for Unique Business Needs
Protecting the Data That Drives Business SecureSphere Appliances Scalable. Reliable. Flexible. Imperva SecureSphere appliances provide superior performance and resiliency for demanding network environments.
VxRACK : L HYPER-CONVERGENCE AVEC L EXPERIENCE VCE JEUDI 19 NOVEMBRE 2015. Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist
VxRACK : L HYPER-CONVERGENCE AVEC L EXPERIENCE VCE JEUDI 19 NOVEMBRE 2015 Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist Who is VCE Today? #1 Market Share & Gartner MQ position 96% Customer
MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products
MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with
State of the Art Cloud Infrastructure
State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014 Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks
The Future of Computing Cisco Unified Computing System. Markus Kunstmann Channels Systems Engineer
The Future of Computing Cisco Unified Computing System Markus Kunstmann Channels Systems Engineer 2009 Cisco Systems, Inc. All rights reserved. Data Centers Are under Increasing Pressure Collaboration
The Software Defined Hybrid Packet Optical Datacenter Network SDN AT LIGHT SPEED TM. 2012-13 CALIENT Technologies www.calient.
The Software Defined Hybrid Packet Optical Datacenter Network SDN AT LIGHT SPEED TM 2012-13 CALIENT Technologies www.calient.net 1 INTRODUCTION In datacenter networks, video, mobile data, and big data
Getting More Performance and Efficiency in the Application Delivery Network
SOLUTION BRIEF Intel Xeon Processor E5-2600 v2 Product Family Intel Solid-State Drives (Intel SSD) F5* Networks Delivery Controllers (ADCs) Networking and Communications Getting More Performance and Efficiency
All-Flash Arrays Weren t Built for Dynamic Environments. Here s Why... This whitepaper is based on content originally posted at www.frankdenneman.
WHITE PAPER All-Flash Arrays Weren t Built for Dynamic Environments. Here s Why... This whitepaper is based on content originally posted at www.frankdenneman.nl 1 Monolithic shared storage architectures
Unified Computing Systems
Unified Computing Systems Cisco Unified Computing Systems simplify your data center architecture; reduce the number of devices to purchase, deploy, and maintain; and improve speed and agility. Cisco Unified
Rackscale- the things that matter GUSTAVO ALONSO SYSTEMS GROUP DEPT. OF COMPUTER SCIENCE ETH ZURICH
Rackscale- the things that matter GUSTAVO ALONSO SYSTEMS GROUP DEPT. OF COMPUTER SCIENCE ETH ZURICH HTDC 2014 Systems Group = www.systems.ethz.ch Enterprise Computing Center = www.ecc.ethz.ch On the way
Boost Database Performance with the Cisco UCS Storage Accelerator
Boost Database Performance with the Cisco UCS Storage Accelerator Performance Brief February 213 Highlights Industry-leading Performance and Scalability Offloading full or partial database structures to
Towards Predictable Datacenter Networks
Towards Predictable Datacenter Networks Hitesh Ballani, Paolo Costa, Thomas Karagiannis and Ant Rowstron Microsoft Research, Cambridge This talk is about Guaranteeing network performance for tenants in
Fabrics that Fit Matching the Network to Today s Data Center Traffic Conditions
Sponsored by Fabrics that Fit Matching the Network to Today s Data Center Traffic Conditions In This Paper Traditional network infrastructures are often costly and hard to administer Today s workloads
The Future of Cloud Networking. Idris T. Vasi
The Future of Cloud Networking Idris T. Vasi Cloud Computing and Cloud Networking What is Cloud Computing? An emerging computing paradigm where data and services reside in massively scalable data centers
Michael Kagan. michael@mellanox.com
Virtualization in Data Center The Network Perspective Michael Kagan CTO, Mellanox Technologies michael@mellanox.com Outline Data Center Transition Servers S as a Service Network as a Service IO as a Service
How To Build A Cloud Server For A Large Company
MASSIVELY SCALED INFRASTRUCTURE FOR VERIZON CLOUD COMPUTE AND STORAGE Challenge Create the world s highest performance enterprise class public cloud Provide granular, customized configurations defined
Introduction to Cloud Design Four Design Principals For IaaS
WHITE PAPER Introduction to Cloud Design Four Design Principals For IaaS What is a Cloud...1 Why Mellanox for the Cloud...2 Design Considerations in Building an IaaS Cloud...2 Summary...4 What is a Cloud
Intel s Disaggregated Server Rack
Intel s Disaggregated Server Rack Does Disaggregation Really Mean Anything? There s been a lot of discussion about disaggregated servers, racks, and datacenters since Facebook and Intel promoted their
Scaling from Datacenter to Client
Scaling from Datacenter to Client KeunSoo Jo Sr. Manager Memory Product Planning Samsung Semiconductor Audio-Visual Sponsor Outline SSD Market Overview & Trends - Enterprise What brought us to NVMe Technology
Hyper-V over SMB Remote File Storage support in Windows Server 8 Hyper-V. Jose Barreto Principal Program Manager Microsoft Corporation
Hyper-V over SMB Remote File Storage support in Windows Server 8 Hyper-V Jose Barreto Principal Program Manager Microsoft Corporation Agenda Hyper-V over SMB - Overview How to set it up Configuration Options
Optimizing Web Infrastructure on Intel Architecture
White Paper Intel Processors for Web Architectures Optimizing Web Infrastructure on Intel Architecture Executive Summary and Purpose of this Paper Today s data center infrastructures must adapt to mobile
Implementing a unified Datacenter architecture for service providers
Implementing a unified Datacenter architecture for service providers IT, commercial & network Tomas Fredberg, Ericsson HDS 8000 Chief Architect Content Introduction Ericsson HDS 8000 Hardware components
Switching Solution Creating the foundation for the next-generation data center
Alcatel-Lucent Enterprise Data Center Switching Solution Creating the foundation for the next-generation data center a new network paradigm What do the following trends have in common? Virtualization Real-time
Doubling the I/O Performance of VMware vsphere 4.1
White Paper Doubling the I/O Performance of VMware vsphere 4.1 with Broadcom 10GbE iscsi HBA Technology This document describes the doubling of the I/O performance of vsphere 4.1 by using Broadcom 10GbE
Evaluation Report: HP Blade Server and HP MSA 16GFC Storage Evaluation
Evaluation Report: HP Blade Server and HP MSA 16GFC Storage Evaluation Evaluation report prepared under contract with HP Executive Summary The computing industry is experiencing an increasing demand for
VMware Virtual SAN 6.2 Network Design Guide
VMware Virtual SAN 6.2 Network Design Guide TECHNICAL WHITE PAPER APRIL 2016 Contents Intended Audience... 2 Overview... 2 Virtual SAN Network... 2 Physical network infrastructure... 3 Data center network...
Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack
Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack HIGHLIGHTS Real-Time Results Elasticsearch on Cisco UCS enables a deeper
Data Center and Cloud Computing Market Landscape and Challenges
Data Center and Cloud Computing Market Landscape and Challenges Manoj Roge, Director Wired & Data Center Solutions Xilinx Inc. #OpenPOWERSummit 1 Outline Data Center Trends Technology Challenges Solution
Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200
Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200 Most organizations routinely utilize a server virtualization infrastructure to benefit
PSAM, NEC PCIe SSD Appliance for Microsoft SQL Server (Reference Architecture) September 11 th, 2014 NEC Corporation
PSAM, NEC PCIe SSD Appliance for Microsoft SQL Server (Reference Architecture) September 11 th, 2014 NEC Corporation 1. Overview of NEC PCIe SSD Appliance for Microsoft SQL Server Page 2 NEC Corporation
Cisco s Massively Scalable Data Center. Network Fabric for Warehouse Scale Computer
Network Fabric for Warehouse Scale Computer Cisco Massively Scalable Data Center Reference Architecture The data center network is arguably the most challenging design problem for a network architect.
Diablo and VMware TM powering SQL Server TM in Virtual SAN TM. A Diablo Technologies Whitepaper. May 2015
A Diablo Technologies Whitepaper Diablo and VMware TM powering SQL Server TM in Virtual SAN TM May 2015 Ricky Trigalo, Director for Virtualization Solutions Architecture, Diablo Technologies Daniel Beveridge,
FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures
Technology Insight Paper FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures By Leah Schoeb January 16, 2013 FlashSoft Software from SanDisk: Accelerating Virtual Infrastructures 1 FlashSoft
Business Case for BTI Intelligent Cloud Connect for Content, Co-lo and Network Providers
Business Case for BTI Intelligent Cloud Connect for Content, Co-lo and Network Providers s Executive Summary Cloud computing, video streaming, and social media are contributing to a dramatic rise in metro
Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers
Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers White Paper rev. 2015-11-27 2015 FlashGrid Inc. 1 www.flashgrid.io Abstract Oracle Real Application Clusters (RAC)
Broadcom Ethernet Network Controller Enhanced Virtualization Functionality
White Paper Broadcom Ethernet Network Controller Enhanced Virtualization Functionality Advancements in VMware virtualization technology coupled with the increasing processing capability of hardware platforms
A1 and FARM scalable graph database on top of a transactional memory layer
A1 and FARM scalable graph database on top of a transactional memory layer Miguel Castro, Aleksandar Dragojević, Dushyanth Narayanan, Ed Nightingale, Alex Shamis Richie Khanna, Matt Renzelmann Chiranjeeb
Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software
WHITEPAPER Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software SanDisk ZetaScale software unlocks the full benefits of flash for In-Memory Compute and NoSQL applications
Block based, file-based, combination. Component based, solution based
The Wide Spread Role of 10-Gigabit Ethernet in Storage This paper provides an overview of SAN and NAS storage solutions, highlights the ubiquitous role of 10 Gigabit Ethernet in these solutions, and illustrates
Juniper Networks QFabric: Scaling for the Modern Data Center
Juniper Networks QFabric: Scaling for the Modern Data Center Executive Summary The modern data center has undergone a series of changes that have significantly impacted business operations. Applications
Storing Big Data The Rise of the Storage Cloud
Storing Big Data The Rise of the Cloud Young-Sae Song, December 2012 www.seamicro.com Whereas even a few years ago a terabyte was seen as a large amount of data, today individual applications can generate
Netflix Open Connect. 2 Terabits from 6 racks
Netflix Open Connect 2 Terabits from 6 racks 1 Who am I? Ryan Woolley Network Architect for Netflix rwoolley@netflix.com 2 What is Netflix? Unlimited, flat-fee streaming to hundreds of devices Movies,
Pelican: A Building Block for Exascale Cold Data Storage
Pelican: A Building Block for Exascale Cold Data Storage Shobana Balakrishnan, Richard Black, Austin Donnelly, Paul England, Adam Glass, Dave Harper, and Sergey Legtchenko, ; Aaron Ogus, Microsoft; Eric
How To Speed Up A Flash Flash Storage System With The Hyperq Memory Router
HyperQ Hybrid Flash Storage Made Easy White Paper Parsec Labs, LLC. 7101 Northland Circle North, Suite 105 Brooklyn Park, MN 55428 USA 1-763-219-8811 www.parseclabs.com info@parseclabs.com sales@parseclabs.com
Cisco Nexus 5000 Series Switches: Decrease Data Center Costs with Consolidated I/O
Cisco Nexus 5000 Series Switches: Decrease Data Center Costs with Consolidated I/O Introduction Data centers are growing at an unprecedented rate, creating challenges for enterprises. Enterprise-level
Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen
Accelerating Real Time Big Data Applications PRESENTATION TITLE GOES HERE Bob Hansen Apeiron Data Systems Apeiron is developing a VERY high performance Flash storage system that alters the economics of
Vblock Infrastructure Platforms 2010 Vblock Platforms Architecture Overview
www.vce.com Vblock Infrastructure Platforms 2010 Vblock Platforms Version 1.3 November 2011 2011 VE ompany, LL. All Rights Reserved. Revision history Revision history Date Version Author Description of
White Paper Solarflare High-Performance Computing (HPC) Applications
Solarflare High-Performance Computing (HPC) Applications 10G Ethernet: Now Ready for Low-Latency HPC Applications Solarflare extends the benefits of its low-latency, high-bandwidth 10GbE server adapters
Brocade and EMC Solution for Microsoft Hyper-V and SharePoint Clusters
Brocade and EMC Solution for Microsoft Hyper-V and SharePoint Clusters Highlights a Brocade-EMC solution with EMC CLARiiON, EMC Atmos, Brocade Fibre Channel (FC) switches, Brocade FC HBAs, and Brocade
Next Gen Data Center. KwaiSeng Consulting Systems Engineer kslai@cisco.com
Next Gen Data Center KwaiSeng Consulting Systems Engineer kslai@cisco.com Taiwan Update Feb 08, kslai 2006 Cisco 2006 Systems, Cisco Inc. Systems, All rights Inc. reserved. All rights reserved. 1 Agenda
Zadara Storage Cloud A whitepaper. @ZadaraStorage
Zadara Storage Cloud A whitepaper @ZadaraStorage Zadara delivers two solutions to its customers: On- premises storage arrays Storage as a service from 31 locations globally (and counting) Some Zadara customers
A Close Look at PCI Express SSDs. Shirish Jamthe Director of System Engineering Virident Systems, Inc. August 2011
A Close Look at PCI Express SSDs Shirish Jamthe Director of System Engineering Virident Systems, Inc. August 2011 Macro Datacenter Trends Key driver: Information Processing Data Footprint (PB) CAGR: 100%
Radware ADC-VX Solution. The Agility of Virtual; The Predictability of Physical
Radware ADC-VX Solution The Agility of Virtual; The Predictability of Physical Table of Contents General... 3 Virtualization and consolidation trends in the data centers... 3 How virtualization and consolidation
Traditional v/s CONVRGD
Traditional v/s CONVRGD Traditional Virtualization Stack Converged Virtualization Infrastructure with HCE/HSE Data protection software applications PDU Backup Servers + Virtualization Storage Switch HA
Cisco UCS B440 M2 High-Performance Blade Server
Data Sheet Cisco UCS B440 M2 High-Performance Blade Server Product Overview The Cisco UCS B440 M2 High-Performance Blade Server delivers the performance, scalability and reliability to power computation-intensive,
Advanced Computer Networks. Datacenter Network Fabric
Advanced Computer Networks 263 3501 00 Datacenter Network Fabric Patrick Stuedi Spring Semester 2014 Oriana Riva, Department of Computer Science ETH Zürich 1 Outline Last week Today Supercomputer networking
Blade Switches Don t Cut It in a 10 Gig Data Center
Blade Switches Don t Cut It in a 10 Gig Data Center Zeus Kerravala, Senior Vice President and Distinguished Research Fellow, zkerravala@yankeegroup.com Introduction: Virtualization Drives Data Center Evolution
EMC XTREMIO EXECUTIVE OVERVIEW
EMC XTREMIO EXECUTIVE OVERVIEW COMPANY BACKGROUND XtremIO develops enterprise data storage systems based completely on random access media such as flash solid-state drives (SSDs). By leveraging the underlying
SMB Advanced Networking for Fault Tolerance and Performance. Jose Barreto Principal Program Managers Microsoft Corporation
SMB Advanced Networking for Fault Tolerance and Performance Jose Barreto Principal Program Managers Microsoft Corporation Agenda SMB Remote File Storage for Server Apps SMB Direct (SMB over RDMA) SMB Multichannel
Introduction to VMware EVO: RAIL. White Paper
Introduction to VMware EVO: RAIL White Paper Table of Contents Introducing VMware EVO: RAIL.... 3 Hardware.................................................................... 4 Appliance...............................................................
The HP IT Transformation Story
The HP IT Transformation Story Continued consolidation and infrastructure transformation impacts to the physical data center Dave Rotheroe, October, 2015 Why do data centers exist? Business Problem Application
Designing and Experimenting with Data Center Architectures. Aditya Akella UW-Madison
Designing and Experimenting with Data Center Architectures Aditya Akella UW-Madison http://www.infotechlead.com/2013/03/28/gartner-data-center-spending-to-grow-3-7-to-146-billion-in-2013-8707 Charles E.
Software-defined Storage Architecture for Analytics Computing
Software-defined Storage Architecture for Analytics Computing Arati Joshi Performance Engineering Colin Eldridge File System Engineering Carlos Carrero Product Management June 2015 Reference Architecture
Cloud Data Center Acceleration 2015
Cloud Data Center Acceleration 2015 Agenda! Computer & Storage Trends! Server and Storage System - Memory and Homogenous Architecture - Direct Attachment! Memory Trends! Acceleration Introduction! FPGA
Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15
Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15 Table of Contents Fully Integrated Hardware and Software
Cisco for SAP HANA Scale-Out Solution on Cisco UCS with NetApp Storage
Cisco for SAP HANA Scale-Out Solution Solution Brief December 2014 With Intelligent Intel Xeon Processors Highlights Scale SAP HANA on Demand Scale-out capabilities, combined with high-performance NetApp
I3: Maximizing Packet Capture Performance. Andrew Brown
I3: Maximizing Packet Capture Performance Andrew Brown Agenda Why do captures drop packets, how can you tell? Software considerations Hardware considerations Potential hardware improvements Test configurations/parameters
From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller
White Paper From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller The focus of this paper is on the emergence of the converged network interface controller