Intel DPDK Boosts Server Appliance Performance White Paper



Similar documents
Performance of Software Switching

Network Function Virtualization Using Data Plane Developer s Kit

Intel Network Builders: Lanner and Intel Building the Best Network Security Platforms

Network Virtualization Technologies and their Effect on Performance

White Paper. Innovate Telecom Services with NFV and SDN

The Lagopus SDN Software Switch. 3.1 SDN and OpenFlow. 3. Cloud Computing Technology

The Role of Virtual Routers In Carrier Networks

Achieving Nanosecond Latency Between Applications with IPC Shared Memory Messaging

High-performance vswitch of the user, by the user, for the user

I/O Virtualization Using Mellanox InfiniBand And Channel I/O Virtualization (CIOV) Technology

Intel Data Direct I/O Technology (Intel DDIO): A Primer >

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM?

High-Density Network Flow Monitoring

Assessing the Performance of Virtualization Technologies for NFV: a Preliminary Benchmarking

Enhance Service Delivery and Accelerate Financial Applications with Consolidated Market Data

The virtualization of SAP environments to accommodate standardization and easier management is gaining momentum in data centers.

Accelerating High-Speed Networking with Intel I/O Acceleration Technology

10G Ethernet: The Foundation for Low-Latency, Real-Time Financial Services Applications and Other, Future Cloud Applications

Achieving Mainframe-Class Performance on Intel Servers Using InfiniBand Building Blocks. An Oracle White Paper April 2003

Router Architectures

Solving the Hypervisor Network I/O Bottleneck Solarflare Virtualization Acceleration

Broadcom Ethernet Network Controller Enhanced Virtualization Functionality

Network Services in the SDN Data Center

Big Data Technologies for Ultra-High-Speed Data Transfer and Processing

An Oracle Technical White Paper November Oracle Solaris 11 Network Virtualization and Network Resource Management

DPDK Summit 2014 DPDK in a Virtual World

WHITE PAPER Guide to 50% Faster VMs No Hardware Required

LOAD BALANCING IN THE MODERN DATA CENTER WITH BARRACUDA LOAD BALANCER FDC T740

Performance Evaluation of VMXNET3 Virtual Network Device VMware vsphere 4 build

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

Full and Para Virtualization

Developing High-Performance, Flexible SDN & NFV Solutions with Intel Open Network Platform Server Reference Architecture

Sockets vs. RDMA Interface over 10-Gigabit Networks: An In-depth Analysis of the Memory Traffic Bottleneck

Why Computers Are Getting Slower (and what we can do about it) Rik van Riel Sr. Software Engineer, Red Hat

Why EMC for SAP HANA. EMC is the #1 Storage Vendor for SAP (IDC Storage User Demand Study, Fall 2011)

Intel Ethernet Switch Load Balancing System Design Using Advanced Features in Intel Ethernet Switch Family

TCP Servers: Offloading TCP Processing in Internet Servers. Design, Implementation, and Performance

Broadcom 10GbE High-Performance Adapters for Dell PowerEdge 12th Generation Servers

High-performance vnic framework for hypervisor-based NFV with userspace vswitch Yoshihiro Nakajima, Hitoshi Masutani, Hirokazu Takahashi NTT Labs.

IO Visor: Programmable and Flexible Data Plane for Datacenter s I/O

Software-Defined Networking for Wi-Fi White Paper

Challenges in high speed packet processing

Network Function Virtualization

Virtual Machine in Data Center Switches Huawei Virtual System

Optimizing TCP Forwarding

How Solace Message Routers Reduce the Cost of IT Infrastructure

Solid State Storage in Massive Data Environments Erik Eyberg

Securing the Intelligent Network

From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller

Data and Control Plane Interconnect solutions for SDN & NFV Networks Raghu Kondapalli August 2014

Datacenter Operating Systems

Performance Beyond PCI Express: Moving Storage to The Memory Bus A Technical Whitepaper

Scaling Networking Applications to Multiple Cores

Microsoft Private Cloud Fast Track

How Linux kernel enables MidoNet s overlay networks for virtualized environments. LinuxTag Berlin, May 2014

Infrastructure Matters: POWER8 vs. Xeon x86

NEC * Virtualized EPC Innovation Powered by Multi Core Intel Architecture Processors

PCI Express High Speed Networks. Complete Solution for High Speed Networking

新 一 代 軟 體 定 義 的 網 路 架 構 Software Defined Networking (SDN) and Network Function Virtualization (NFV)

Intel Open Network Platform Release 2.1: Driving Network Transformation

NV-DIMM: Fastest Tier in Your Storage Strategy

Oracle Database Scalability in VMware ESX VMware ESX 3.5

Wire-speed Packet Capture and Transmission

Network Function Virtualization: Virtualized BRAS with Linux* and Intel Architecture

Radware s AppDirector and AppXcel An Application Delivery solution for applications developed over BEA s Weblogic

SDN and NFV Open Source Initiatives. Systematic SDN and NFV Workshop Challenges, Opportunities and Potential Impact

Windows Server 2008 R2 Hyper V. Public FAQ

VNF & Performance: A practical approach

Whitepaper. Implementing High-Throughput and Low-Latency 10 Gb Ethernet for Virtualized Data Centers

ADVANCED PROCESSOR ARCHITECTURES AND MEMORY ORGANISATION Lesson-12: ARM

Boosting Data Transfer with TCP Offload Engine Technology

D1.2 Network Load Balancing

Server Virtualization: Avoiding the I/O Trap

VMWARE WHITE PAPER 1

Network Functions Virtualization Using Intel Ethernet Multi-host Controller FM10000 Family

Getting More Performance and Efficiency in the Application Delivery Network

iscsi: Accelerating the Transition to Network Storage

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

Microsoft Windows Server in a Flash

Welcome to the Dawn of Open-Source Networking. Linux IP Routers Bob Gilligan

Application Compatibility Best Practices for Remote Desktop Services

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance

A Platform Built for Server Virtualization: Cisco Unified Computing System

Telecom - The technology behind

A Comparative Study on Vega-HTTP & Popular Open-source Web-servers

AppDirector Load balancing IBM Websphere and AppXcel

Foundation for High-Performance, Open and Flexible Software and Services in the Carrier Network. Sandeep Shah Director, Systems Architecture EZchip

High-Performance IP Service Node with Layer 4 to 7 Packet Processing Features

Accelerating the Data Plane With the TILE-Mx Manycore Processor

ioscale: The Holy Grail for Hyperscale

ON THE IMPLEMENTATION OF ADAPTIVE FLOW MEASUREMENT IN THE SDN-ENABLED NETWORK: A PROTOTYPE

HyperQ Storage Tiering White Paper

Chapter 1 Reading Organizer

1. Computer System Structure and Components

10Gb Ethernet: The Foundation for Low-Latency, Real-Time Financial Services Applications and Other, Latency-Sensitive Applications

Transcription:

Intel DPDK Boosts Server Appliance Performance

Intel DPDK Boosts Server Appliance Performance Introduction As network speeds increase to 40G and above, both in the enterprise and data center, the bottlenecks within critical network devices has become a more pressing problem. Essentially, devices have to move network packets from ingress LAN ports to system memory and then to egress ports as fast as possible. This fundamental data plane packet processing determines the basic throughput on any device platform. To help alleviate the data plane bottleneck, Intel developed the Data Plane Development Kit (DPDK) for software applications that run on standard Intel x86 CPU hardware platforms. This paper examines the main building blocks of Intel s DPDK and how it significantly boosts data plane throughput on Intel x86 based hardware. In particular, how the DPDK reduces overheads in a standard Linux operating system environment, the preferred developers choice for application software that runs on openplatform appliances. Additionally, how the tremendous DPDK performance enhancement enables the deployment of consolidated open platform server appliances for next generation networks. Inside Intel s DPDK Intel s DPDK is basically a set of software development libraries that can be used to build highperformance applications to run on Intel based network appliance platforms. The DPDK components leverage Intel CPU multi core and multi processor architecture for optimized data plane throughput. The main components of the Intel DPDK libraries can be summarized as follows: Memory Manager: Allocates memory for pools of objects. Each pool implements a ring to store free objects and the manager ensures that objects are spread equally on all DRAM channels. Buffer Manager: Pre allocates fixed size buffers stored in memory pools. Saves significant amounts of time that an operating system uses to allocate and de allocate buffers. 1

Queue Manager: Avoids unnecessary wait times by providing fixed size lockless queues for software components to process packets. Flow Classification: Implements an efficient mechanism for placing packets in flows for fast processing to boost throughput. Poll Mode Drivers: These are drivers for 1 and 10 Gigabit Ethernet controllers that work without interrupt based signaling to speed up the packet pipeline. The Intel DPDK libraries run on open source Linux systems in the user space, just as any other Linux utilities. This means that when building software applications, the DPDK libraries allow direct access to the hardware without using the Linux kernel. The data plane processing is handled by the DPDK libraries that pass network packets directly to the application network stack without any Linux kernel overhead. Application Acceleration Typical network infrastructure packet sizes are small (64 bytes), but arrive at network interfaces at a very high rate, placing a major stress on data plane processing. Server packet sizes are typically large (1024 bytes) and therefore only arrive at interfaces at slower rates. For Gigabit interfaces on a system using interrupt driven network drivers, the number of interrupts for received packets rapidly overwhelms the system. Implementing DPDK applications that use polled mode network drivers provides a significant throughput improvement. The DPDK libraries enable software tasks to be bound to a specific CPU core. This one to one mapping of software threads to hardware threads completely avoids the problem of excessive overhead for the Linux scheduler to switch tasks. 2

When system access to memory or PCIe is slowing CPU operation, the DPDK libraries can release bandwidth by processing four packets at a time and reduce multiple memory reads to a single read. The DPDK libraries can also be used to streamline memory access by aligning data structures to cache sizes and minimizing access to external memory. This means data can be pre fetched before it is needed and the CPU does not have to wait. Often an application requires access to shared data structures, which can result in a serious bottleneck. With DPDK libraries, you can implement optimized schemes and lockless queues that reduce the amount of data sharing. Altogether, Intel DPDK delivers a powerful software model for application development that dramatically increases small packet throughput by three to four times. In fact, systems based on Intel s highend processors have achieved Layer 3 forwarding rates of over 80 million packets per second (Mpps) for 64 byte packets. Benefits for Server Appliances The impressive data plane throughput of Intel s DPDK on standard Intel architecture means it is perfectly suited for building a wide range of high performing network appliances. Accton s open platform server appliances support DPDK for leading edge firewall, routing, VPN, or many other services. The flexible platforms are truly open and can scale in capacity to meet any number of data network functions. Furthermore, Accton s open platforms offer a highly adaptable alternative to fixed function devices. The high performance of DPDK enables a number of mixed vendor devices to be consolidated into one open device that not only reduces complexity, but saves significant costs and resources. 3

Conclusion The implementation of Intel s DPDK has set new standards for data plane throughput on standard Intel x86 CPU hardware platforms. As Intel CPU development surges forward, the dramatic improvements in packet processing performance will only increase, allowing more data workloads to be consolidated on one unified open device. This is an expected trend as enterprise and data center networks move towards agile systems based on open hardware and software. Accton s server appliances, such as the SAF4121I, are designed as open high performance platforms based on standard Intel x86 communications hardware. These platforms enable any available operating system and software applications to be installed, creating customized flexible devices that are a solid futureproof investment for any next generation network. 4

Accton Technology Corporation No. 1, Creation Rd. III,Hsinchu Science Park, Hsinchu 300,Taiwan, R.O.C. www.accton.com E052014-CS-R01