Xilinx SDAccel. A Unified Development Environment for Tomorrow s Data Center. By Loring Wirbel Senior Analyst. November
|
|
- Bathsheba Charles
- 2 years ago
- Views:
Transcription
1 Xilinx SDAccel A Unified Development Environment for Tomorrow s Data Center By Loring Wirbel Senior Analyst November Copyright 2014 The Linley Group, Inc.
2 This paper examines Xilinx s SDAccel, a software development environment for OpenCL, C and C++, which is part of the Xilinx SDx family. The paper will examine the role of SDAccel in creating more poweroptimized compute environments for the data center, and in bringing together CPU/GPU optimized compilation and dynamically reconfigurable accelerators under a common development environment. The Severe Power Limitations of Tomorrow s Data Center The most aggressive efforts of microprocessor vendors to shrink feature sizes, move to new FinFET processes, and add special power-saving states to CPUs, have not been enough to solve the power crises of data centers packed with ever denser servers. Even a mega-data center handling standard Internet traffic has struggled to keep power budgets in line with utility company capabilities. When the special demands of high-resolution video, image recognition, deep packet inspection, and parallel algorithm processing are added, it becomes a challenge for a PCI Express board with a standard CPU or GPU to keep within a 25W power budget. The advent of 28nm and 20nm high-integration FPGA families, such as Xilinx 7 series and UltraScale, have changed the dynamics for integration of FPGAs into host cards and line cards in data center servers. Performance per watt can easily exceed 20x that of an equivalent CPU or GPU, while offering up to 50-75x latency improvements in some applications than traditional processors. FPGAs also offer well-characterized IP cores for high-speed interfaces such as PCI Express, DDR4 SDRAM, 10G Ethernet, and 25/28Gbps serdes, the future building block of 50G and 100G Ethernet. Baidu, China s largest search-engine specialist, has turned to deep neural-network (DNN) processing to solve problems in speech recognition, image search, and natural language processing. The company quickly determined that when neural back-propagation algorithms are used in online prediction, FPGA solutions scale far easier than CPUs and GPUs. The 400Gflop Software Defined Accelerator developed by Baidu is based on a Xilinx Kintex t-2l PCI Express FPGA board that could be plugged into any type of 1U or 2U server. Under various workloads, Baidu found that the Kintex-7 FPGA boards gave 4x higher performance than GPUs and 9x higher performance than CPUs while consuming 10-20W in real production systems. One limitation of FPGA solutions cited by Baidu, long development times, is a problem which Baidu itself suggests can be solved by just the sort of software tools offered under SDAccel. Convey Computer, a board-level supercomputer specialist combining x86 CPUs with Xilinx FPGAs, designed a Wolverine accelerator card that could aid content caching for data center servers. Convey has partnered with Dell s data center solutions (DCS) division to offer image resizing solutions (heavily demanded in social media and photostorage networks) utilizing a dual Virtex -7 board to speed resizing tasks by 35 to 40 times over an equivalent system using CPUs alone. Again, the key to wider use of the 2014 The Linley Group - 1 -
3 Convey-Dell solution comes from the ability to customize the FPGA accelerators in higher-level languages. One owner of large data centers that needs little convincing of FPGA utility is Microsoft, which began an initiative in early 2014 to accelerate Bing search ranking using FPGAs. In a recent keynote speech at the Linley Processor Conference, vice president of Microsoft s server engineering Kushadra Vaid showed results from a production pilot using 1,632 servers with PCIe-based FPGA cards. Relative to unaccelerated servers, Microsoft s implementation resulted in 2x throughput, 29% lower latency, and a 30% cost reduction. Although Vaid showed that ASICs could deliver ultimate efficiency, he stated they simply cannot keep up with rapidly changing requirements. What has been inhibiting broader FPGA use in such data center applications has been the lack of an efficient optimizing compiler and related development environment to match the decades of work on compilers for common CPU and GPU architectures. Microsoft s focus on Bing search acceleration spotlights the degree to which heterogeneous computing, in which coprocessors are assigned such tasks as document ranking, has risen in importance in the data center to equal that of homogeneous multicore multiprocessing. Developers of compilers originally intended for integer CPUs can add support for coprocessing in a piecemeal fashion, though the heterogeneous elements rarely are as tightly coupled as kernels and CPUs in a unified FPGA architecture. Nvidia s recent move to add OpenCL to its existing parallel CUDA environment indicates that those processor companies who launch compilation tasks with a processor other than a central integer CPU (in Nvidia s case, a GPU) often show more foresight in turning to parallelized languages than those working on either a single-core CPU or multicore CPU design. Compilers for x86 and other architectures have been tasked with several new parameters for optimization of performance, with power taking precedence over code density in recent years. Intel s C++ compilers (particularly its work with Xeon Phi) and Nvidia s CUDA compilers have attempted to optimize for parallel threads, though neither company has achieved great success in adding coprocessing elements to primary CPUs. Demands on compilers have increased even as processor architectures have grown more complex, with multicore, heavier pipelining, and additional co-processors, both on- and off-chip, among the advanced capabilities compilers are expected to handle. Xilinx has worked for nearly a decade on the development of domain-specific specification environments. Concerns from both data-center managers and server/switch OEMs on data-center performance helped drive one such vertical development toward a unified environment for design optimization in data-center applications. The result is SDAccel, the Software-Defined Development Environment for Acceleration. SDAccel s compiler technology is built on the high-level synthesis (HLS) technology Xilinx acquired in early 2011 when it bought AutoESL. Xilinx has spent the last 3+ years further developing the technology and shipping it as product to over 1,000 FPGA customers. In parallel, it has also been expanding this technology from C and C++ to now optimizing the compilation of native OpenCL code The Linley Group - 2 -
4 This compiler accomplishes the basics a user would expect of any native OpenCL compiler, such as loop merging, flattening, and unrolling, but also does more advanced optimization of memory usage, dataflows, and loop pipelining options. These optimizations allow customers to rely on the compiler to efficiently take C, C++, or OpenCL directly to FPGA hardware. Xilinx benchmarks show that the compiler can reliably get within 5% of optimized RTL with regards to size and Xilinx states that it has seen some instances where it gets over 20% QoR (Quality of Results) improvement vs. RTL. This allows customers to design and optimize their applications on the x86 processor at an architectural level before synthesizing and debugging on the native FPGA hardware with embedded debug capabilities. Beyond an Effective Compiler: A GPU-Like Development Environment While many modern C, C++, and OpenCL compilers are elements of broader development suites, many SDKs are comprised of little more than a set of loosely-linked linear tools, some of which remain centered on ancient command-line interfaces. From its inception, the SDAccel environment was designed to be an interactive, dynamic development environment for analyzing applications, parsing them into CPU and kernel elements while using a target x86 card as a platform for emulating the elements for later implementation in FPGAs. Figure 1 shows a typical design flow in the SDAccel environment. Figure 1: The executable image created through SDAccel compilation can be implemented in Xilinx FPGAs. The experienced software developer with a minimal experience in FPGA instantiation will find plenty of familiar elements in SDAccel. The goal in allowing for C, C++, and OpenCL inputs was to make the programming environment familiar to those from the standalone CPU world, while insuring that the full unique feature set of FPGAs could be accessed. SDAccel supports full emulation on a CPU, and the programmer can compare parallelized and pipelined elements, and perform such optimization as loop, on-chip 2014 The Linley Group - 3 -
5 memory, and dataflow operations, all prior to initial compilation for a specific FPGA architecture. Three levels of compilation allow for easy design iterations to be undertaken for application programming and deployment for the FPGA. First, C, C++ or OpenCL kernel compilation and emulation on the x86 allows design validation and functional debug. Then, the kernel is compiled and simulated using a System C model on the x86 CPU. The final compilation step is for execution on the FPGA device, though SDAccel allows debugging visibility during all three stages. One software workflow is used across a CPU emulation target and the FPGA implementation target. Acceleration units can be loaded on demand as heterogeneous FPGA elements, and the compiled accelerators can be profiled across the host and kernels. Co-simulations of multiple kernels in one workflow can be iterated several times before committing the design to a chosen FPGA architecture. The advantage of multiple iterations is discussed below, where accelerators for encryption and for image filtering and scaling are able to achieve efficiencies close to hand-coded designs. The use of the accelerator kernels is simplified by the fact that common interfaces used in the FPGA, such as PCI Express and Gigabit Ethernet, are always on for reconfiguring the accelerators. The ability to work in C, C++ and OpenCL offers a unique benefit to the developers since this allows for the best of both worlds with regards to using existing code base and leveraging the new OpenCL environment. Although OpenCL offers some distinct advantages with portability and segmentation of code between hosts and compute units to run kernels, the majority of libraries and existing code base that exists is in either C or C++. SDAccel gives customers the ability to continue to develop in C and C++ when appropriate and concurrently leverage OpenCL portability. SDAccel includes OpenCL built-in, DSP, video, and linear algebra libraries. SDAccel also integrates third party libraries such as OpenCV and BLAS into its software environment. When designs utilize complex coprocessing blocks such as compression or encryption, the result when using the SDAccel development environment can be a design that is on par or even exceeds hand coding in performance and size. Achieving the Full Advantages of OpenCL In assessing the competitive landscape for SDAccel, it is important to recognize that the programmable logic industry still dwells primarily in a world of RTL flows. Significant advances in device design can be made within such an environment, of course. Tabula, for example, augmented its existing Stylus RTL compiler with a tool called DesignInsight. This software environment aids in accelerator verification and debug steps through the insertion of embedded points that allow better visibility of an existing design. But without the front-end application of optimizing compilers, DesignInsight works from a first-pass design that has not tightly linked the CPU and accelerator elements under a common compiler scheme The Linley Group - 4 -
6 Open Computing Language, or OpenCL, was developed by Apple Inc. and promoted by Khronos Group precisely to aid the integration of CPUs, GPUs, and DSP blocks in heterogeneous designs. In order to enhance its use in parallel implementation of designs, leading CPU and GPU vendors including Intel, Nvidia, Qualcomm, AMD, Imagination Technologies, and ARM Holdings contributed to development of both the language and its APIs. OpenCL supports both task-based and data-based parallelism. Xilinx and Altera have committed to its use in new designs, though Xilinx also supports C and C++ kernel inputs for compiled designs. Critical to FPGA library elements is OpenCL s definition of task-specific accelerators as kernels that run on OpenCL devices, a key element enabling the joint compilation environment within SDAccel. These kernels are written in standard C, but annotated with constructs to identify memory hierarchy and parallelism. While Intel and Nvidia both were contributors to Khronos Group, the two companies are still in early stages of offering OpenCL for their own processor architectures, and have done little to open them to partners with co-processing suites. Nvidia has invested much time and effort in CUDA, and understandably has been approaching compiler efforts for OpenCL slowly. Intel has offered Xeon Phi tools, as well as optimization guides for such architectures as Celeron, Xeon, Ivy Bridge, and Sandy Bridge, but looks to third parties for the most part to develop tools that integrate accelerators. It is interesting to note that two of Intel s FPGA partners, Tabula and Achronix, have yet to indicate interest in OpenCL. Other CPU and GPU supporters of Khronos, including AMD, ARM, and Imagination (MIPS), joined forces with MediaTek and Texas Instruments in 2012 to form the Heterogeneous System Architecture (HSA) consortium, with an explicit purpose of supporting OpenCL as one means of linking CPUs, GPUs, and accelerators. The HSA group has made significant advances in linking OpenCL to existing compiler environments for example, with the HSAIL language introduced in 2013, and more recent reference work with AMD on HadoopCL, which offloads Hadoop queries to a GPU through the use of OpenCL. Similarly, universities such as Imperial College of London, Saarland, UCLA, Ohio State University, and many other institutions with leading engineering schools, have initiated projects to parallelize tasks such as scalar graphics, or implementation of scratchpad memory in FPGAs. In almost all cases, however, published papers cover C and C++ efforts in a pre-opencl environment. This reflects the fact that more advanced OpenCL functions such as shared virtual memory and pipes, were only publicized at the end of 2013 with the release of OpenCL 2.0. While Altera has promoted the extension of OpenCL to data plane elements through its use of the OpenCL pipes feature, its own OpenCL compiler continues to treat accelerator code and kernel development as two distinct tasks. Code is developed on an x86 target with an optimization report sent to the designer, while accelerator kernels are designed and prototyped on a virtual FPGA fabric The Linley Group - 5 -
7 The difference in optimizing accelerator kernels can be seen in the comparison of devices for an example compression and streaming encryption benchmarks, shown in Table 1 & 2. SDAccel offers a tripling of throughput in compression benchmark over competitive standard OpenCL compilation for FPGAs, while offering a 4x smaller size for the encryption benchmark at one-third the power. In Table 2, SDAccel shows sevenfold power advantages in HD filtering and image downscaling over an equivalent Nvidia GPU solution. These advantages are achieved by using specific developer optimizations and iterating the design through emulation and simulation steps prior to the final FPGA compilation. This not only minimizes back-end tasks such as place and route, but allows for a coding efficiency matching that of hand-coding. Application Metrics Hand Coded RTL SDAccel Compilation for FPGAs Other FPGA Compiler Technology Compression Benchmark Streaming Encryption Benchmark Throughput 1x 1x 0.3x Area 1x 0.9x 3x Throughput 1x 1.2x 1x Area 1x 1.25x 5x Application Goal SDAccel Compilation for FPGAs Other FPGA Compiler Technology SDAccel Advantage SDAccel Developer Options HD Sobel Filter Highest frames/second 650fps 130fps 5x faster C-based FPGA optimized libraries HD Image Downscaling Highest frames/second 465fps 110fps 4x faster C-based FPGA optimized libraries *Data in above table provided by Auviz Systems Application Metric SDAccel Compilation for FPGAs Nvidia K20 SDAccel Advantage HD Sobel Filter Frames/watt x HD Image Downscaling Frames/watt x *Data in above table provided by Auviz Systems Tables 1, 2 and 3. Comparison of application performance of SDAccel against other FPGA compiler technology for FPGAs (top) and compilation for Nvidia K20 (bottom). SDAccel s Role in Transcending Data-Center Power Limits The growing acceptance of OpenCL by CPU/GPU vendors, server OEMs, and datacenter managers alike is an indication that all parties recognize that C-based optimizing 2014 The Linley Group - 6 -
8 compilers for single processor architectures can only offer small reductions in overall power dissipation within the server rack, even as processors turn to sub-20nm process technologies and special power-saving states. This has been evident for some time in applications that make heavy use of DSP and graphics, such as data mining and intelligence, 3D visualization, and parallel algorithm exploitation in microbiology, financial trading, and similar vertical markets. The broad-based server OEM effort to make heavier use of FPGAs in data centers, however, is an indication that the need for higher integration and lower power in heterogeneous computing is extending to more general-purpose applications such as search-engine queries and Hadoop queries. Efforts to create unified heterogeneous system specifications, such as those of the HSA consortium, are useful, as are such projects as Tabula s RTL compilation and post-design validation/verification, or Altera s use of OpenCL pipes capability in the data plane. Nothing to date in private industry or academia brings the power of OpenCL to unified FPGA design. The SDAccel Development Environment allows efficient iterations of compilation, emulation with autogenerated cycle accurate kernel models, cosimulation and verification to take place on x86 target boards. The optimized design can then be compiled for the FPGA architecture. FPGA enabling of the low-power data center will not happen overnight. Promotion of new design methods by Baidu, Dell, Microsoft, and others will help raise awareness of new heterogeneous server design, and the HSA consortium will play a similar role in standardizing the use of OpenCL, perhaps making the parallel language a standard within a few short years. Getting the most out of an OpenCL FPGA, however, will require more than the point compilation tools offered to date. SDAccel not only brings acceleration kernels closer to traditional CPUs and GPUs than they have been in the past, it also simplifies the task of developing FPGAs for the heterogeneous, low-power data center of the future. About the Author Loring Wirbel is a senior analyst at The Linley Group. The Linley Group offers the most comprehensive analysis of the networking-silicon industry. We analyze not only the business strategy but also the technology inside all the announced products. Our weekly publications and in-depth reports cover topics including Ethernet chips, network processors, multicore embedded processors, and wireless base-station processors. For more information, see our web site at Trademark names are used throughout this paper in an editorial fashion and are not denoted with a trademark symbol. These trademarks are the property of their respective owners. This paper is sponsored by Xilinx, but all opinions and analysis are those of the author The Linley Group - 7 -
Data Center and Cloud Computing Market Landscape and Challenges
Data Center and Cloud Computing Market Landscape and Challenges Manoj Roge, Director Wired & Data Center Solutions Xilinx Inc. #OpenPOWERSummit 1 Outline Data Center Trends Technology Challenges Solution
Moving Beyond CPUs in the Cloud: Will FPGAs Sink or Swim?
Moving Beyond CPUs in the Cloud: Will FPGAs Sink or Swim? Successful FPGA datacenter usage at scale will require differentiated capability, programming ease, and scalable implementation models Executive
Seeking Opportunities for Hardware Acceleration in Big Data Analytics
Seeking Opportunities for Hardware Acceleration in Big Data Analytics Paul Chow High-Performance Reconfigurable Computing Group Department of Electrical and Computer Engineering University of Toronto Who
Xeon+FPGA Platform for the Data Center
Xeon+FPGA Platform for the Data Center ISCA/CARL 2015 PK Gupta, Director of Cloud Platform Technology, DCG/CPG Overview Data Center and Workloads Xeon+FPGA Accelerator Platform Applications and Eco-system
FPGA Acceleration using OpenCL & PCIe Accelerators MEW 25
FPGA Acceleration using OpenCL & PCIe Accelerators MEW 25 December 2014 FPGAs in the news» Catapult» Accelerate BING» 2x search acceleration:» ½ the number of servers»
Extending the Power of FPGAs. Salil Raje, Xilinx
Extending the Power of FPGAs Salil Raje, Xilinx Extending the Power of FPGAs The Journey has Begun Salil Raje Xilinx Corporate Vice President Software and IP Products Development Agenda The Evolution of
Embedded Systems: map to FPGA, GPU, CPU?
Embedded Systems: map to FPGA, GPU, CPU? Jos van Eijndhoven jos@vectorfabrics.com Bits&Chips Embedded systems Nov 7, 2013 # of transistors Moore s law versus Amdahl s law Computational Capacity Hardware
Next Generation GPU Architecture Code-named Fermi
Next Generation GPU Architecture Code-named Fermi The Soul of a Supercomputer in the Body of a GPU Why is NVIDIA at Super Computing? Graphics is a throughput problem paint every pixel within frame time
GPU System Architecture. Alan Gray EPCC The University of Edinburgh
GPU System Architecture EPCC The University of Edinburgh Outline Why do we want/need accelerators such as GPUs? GPU-CPU comparison Architectural reasons for GPU performance advantages GPU accelerated systems
Intel Xeon +FPGA Platform for the Data Center
Intel Xeon +FPGA Platform for the Data Center FPL 15 Workshop on Reconfigurable Computing for the Masses PK Gupta, Director of Cloud Platform Technology, DCG/CPG Overview Data Center and Workloads Xeon+FPGA
GPUs: Doing More Than Just Games. Mark Gahagan CSE 141 November 29, 2012
GPUs: Doing More Than Just Games Mark Gahagan CSE 141 November 29, 2012 Outline Introduction: Why multicore at all? Background: What is a GPU? Quick Look: Warps and Threads (SIMD) NVIDIA Tesla: The First
Programming models for heterogeneous computing. Manuel Ujaldón Nvidia CUDA Fellow and A/Prof. Computer Architecture Department University of Malaga
Programming models for heterogeneous computing Manuel Ujaldón Nvidia CUDA Fellow and A/Prof. Computer Architecture Department University of Malaga Talk outline [30 slides] 1. Introduction [5 slides] 2.
Beyond the Data Center: How Network-Function Virtualization Enables New Customer-Premise Services
Beyond the Data Center: How Network-Function Virtualization Enables New Customer-Premise Services By Tom R. Halfhill Senior Analyst February 2016 www.linleygroup.com Beyond the Data Center: How Network-Function
MPSoC Designs: Driving Memory and Storage Management IP to Critical Importance
MPSoC Designs: Driving Storage Management IP to Critical Importance Design IP has become an essential part of SoC realization it is a powerful resource multiplier that allows SoC design teams to focus
Graphics Cards and Graphics Processing Units. Ben Johnstone Russ Martin November 15, 2011
Graphics Cards and Graphics Processing Units Ben Johnstone Russ Martin November 15, 2011 Contents Graphics Processing Units (GPUs) Graphics Pipeline Architectures 8800-GTX200 Fermi Cayman Performance Analysis
7a. System-on-chip design and prototyping platforms
7a. System-on-chip design and prototyping platforms Labros Bisdounis, Ph.D. Department of Computer and Communication Engineering 1 What is System-on-Chip (SoC)? System-on-chip is an integrated circuit
Better Digital Signal Processing Performance; Lower Costs With Innovative IntervalZero RTX Real-time Platform
White Paper Better Digital Signal Performance; Lower Costs With Innovative IntervalZero RTX Real-time Platform I. Overview Digital Signal Processors (s) have specialized architectures that are optimized
High Performance GPGPU Computer for Embedded Systems
High Performance GPGPU Computer for Embedded Systems Author: Dan Mor, Aitech Product Manager September 2015 Contents 1. Introduction... 3 2. Existing Challenges in Modern Embedded Systems... 3 2.1. Not
FPGA Accelerator Virtualization in an OpenPOWER cloud. Fei Chen, Yonghua Lin IBM China Research Lab
FPGA Accelerator Virtualization in an OpenPOWER cloud Fei Chen, Yonghua Lin IBM China Research Lab Trend of Acceleration Technology Acceleration in Cloud is Taking Off Used FPGA to accelerate Bing search
Making Multicore Work and Measuring its Benefits. Markus Levy, president EEMBC and Multicore Association
Making Multicore Work and Measuring its Benefits Markus Levy, president EEMBC and Multicore Association Agenda Why Multicore? Standards and issues in the multicore community What is Multicore Association?
White Paper COMPUTE CORES
White Paper COMPUTE CORES TABLE OF CONTENTS A NEW ERA OF COMPUTING 3 3 HISTORY OF PROCESSORS 3 3 THE COMPUTE CORE NOMENCLATURE 5 3 AMD S HETEROGENEOUS PLATFORM 5 3 SUMMARY 6 4 WHITE PAPER: COMPUTE CORES
Spectra-Q Engine BACKGROUNDER
BACKGROUNDER Spectra-Q Engine 2010 s 2000 s 1990 s >50K >500K >5M FPGAs and SoCs have taken huge leaps with next-generation capabilities. These include multi-million logic elements, complex interface protocols,
HARNESS project: Managing Heterogeneous Compute Resources for a Cloud Platform
HARNESS project: Managing Heterogeneous Compute Resources for a Cloud Platform J. G. F. Coutinho 1, O. Pell 2, E. O Neill 3, P. Sanders 2, J. McGlone 3, P. Grigoras 1, W. Luk 1, and C. Ragusa 2 1 Imperial
Networking Virtualization Using FPGAs
Networking Virtualization Using FPGAs Russell Tessier, Deepak Unnikrishnan, Dong Yin, and Lixin Gao Reconfigurable Computing Group Department of Electrical and Computer Engineering University of Massachusetts,
Deep Learning Meets Heterogeneous Computing. Dr. Ren Wu Distinguished Scientist, IDL, Baidu wuren@baidu.com
Deep Learning Meets Heterogeneous Computing Dr. Ren Wu Distinguished Scientist, IDL, Baidu wuren@baidu.com Baidu Everyday 5b+ queries 500m+ users 100m+ mobile users 100m+ photos Big Data Storage Processing
Key-Value Store Acceleration with OpenPower
Key-Value Store Acceleration with OpenPower Michaela Blott, Principal Engineer Xilinx Research #OpenPOWERSummit Join the conversation at #OpenPOWERSummit 1 Agenda Background Acceleration of KVS with FPGAs
FPGA-based MapReduce Framework for Machine Learning
FPGA-based MapReduce Framework for Machine Learning Bo WANG 1, Yi SHAN 1, Jing YAN 2, Yu WANG 1, Ningyi XU 2, Huangzhong YANG 1 1 Department of Electronic Engineering Tsinghua University, Beijing, China
CFD Implementation with In-Socket FPGA Accelerators
CFD Implementation with In-Socket FPGA Accelerators Ivan Gonzalez UAM Team at DOVRES FuSim-E Programme Symposium: CFD on Future Architectures C 2 A 2 S 2 E DLR Braunschweig 14 th -15 th October 2009 Outline
White Paper Selecting the Ideal FPGA Vendor for Military Programs
White Paper Introduction As digital processing technologies such as digital signal processors, FPGAs, and CPUs become more complex and powerful, product and feature differentiation among vendors has significantly
High-Level Synthesis for FPGA Designs
High-Level Synthesis for FPGA Designs BRINGING BRINGING YOU YOU THE THE NEXT NEXT LEVEL LEVEL IN IN EMBEDDED EMBEDDED DEVELOPMENT DEVELOPMENT Frank de Bont Trainer consultant Cereslaan 10b 5384 VT Heesch
Processor to Usher in a New Era of Computing
Project Denver Processor to Usher in a New Era of Computing Bill Dally January 5, 2011 http://blogs.nvidia.com/2011/01/project-denver-processor-to-usher-in-new-era-of-computing/ Project Denver Announced
Graphical Processing Units to Accelerate Orthorectification, Atmospheric Correction and Transformations for Big Data
Graphical Processing Units to Accelerate Orthorectification, Atmospheric Correction and Transformations for Big Data Amanda O Connor, Bryan Justice, and A. Thomas Harris IN52A. Big Data in the Geosciences:
XILINX RECONFIGURABLE ACCELERATION STACK TARGETS MACHINE LEARNING, DATA ANALYTICS, & VIDEO STREAMING
XILINX RECONFIGURABLE ACCELERATION STACK TARGETS MACHINE LEARNING, DATA ANALYTICS, & VIDEO STREAMING FPGA REPROGRAMMABILITY DELIVERS PERFORMANCE & FLEXIBILITY WHILE SPEEDING TIME-TO- INNOVATION FOR HYPERSCALE
Infrastructure Matters: POWER8 vs. Xeon x86
Advisory Infrastructure Matters: POWER8 vs. Xeon x86 Executive Summary This report compares IBM s new POWER8-based scale-out Power System to Intel E5 v2 x86- based scale-out systems. A follow-on report
HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK
HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK Steve Oberlin CTO, Accelerated Computing US to Build Two Flagship Supercomputers SUMMIT SIERRA Partnership for Science 100-300 PFLOPS Peak Performance
Analysis of GPU Parallel Computing based on Matlab
Analysis of GPU Parallel Computing based on Matlab Mingzhe Wang, Bo Wang, Qiu He, Xiuxiu Liu, Kunshuai Zhu (School of Computer and Control Engineering, University of Chinese Academy of Sciences, Huairou,
Introduction to GP-GPUs. Advanced Computer Architectures, Cristina Silvano, Politecnico di Milano 1
Introduction to GP-GPUs Advanced Computer Architectures, Cristina Silvano, Politecnico di Milano 1 GPU Architectures: How do we reach here? NVIDIA Fermi, 512 Processing Elements (PEs) 2 What Can It Do?
Overview on Modern Accelerators and Programming Paradigms Ivan Giro7o igiro7o@ictp.it
Overview on Modern Accelerators and Programming Paradigms Ivan Giro7o igiro7o@ictp.it Informa(on & Communica(on Technology Sec(on (ICTS) Interna(onal Centre for Theore(cal Physics (ICTP) Mul(ple Socket
Cloud Data Center Acceleration 2015
Cloud Data Center Acceleration 2015 Agenda! Computer & Storage Trends! Server and Storage System - Memory and Homogenous Architecture - Direct Attachment! Memory Trends! Acceleration Introduction! FPGA
Data Processing in Modern Hardware. Gustavo Alonso Systems Group Department of Computer Science ETH Zurich, Switzerland
Data Processing in Modern Hardware Gustavo Alonso Systems Group Department of Computer Science ETH Zurich, Switzerland EDBT/ICDT 2016 ETH Systems Group www.systems.ethz.ch Take home message Slide courtesy
Bricata Next Generation Intrusion Prevention System A New, Evolved Breed of Threat Mitigation
Bricata Next Generation Intrusion Prevention System A New, Evolved Breed of Threat Mitigation Iain Davison Chief Technology Officer Bricata, LLC WWW.BRICATA.COM The Need for Multi-Threaded, Multi-Core
Performance Evaluation of NAS Parallel Benchmarks on Intel Xeon Phi
Performance Evaluation of NAS Parallel Benchmarks on Intel Xeon Phi ICPP 6 th International Workshop on Parallel Programming Models and Systems Software for High-End Computing October 1, 2013 Lyon, France
Stream Processing on GPUs Using Distributed Multimedia Middleware
Stream Processing on GPUs Using Distributed Multimedia Middleware Michael Repplinger 1,2, and Philipp Slusallek 1,2 1 Computer Graphics Lab, Saarland University, Saarbrücken, Germany 2 German Research
Introducing PgOpenCL A New PostgreSQL Procedural Language Unlocking the Power of the GPU! By Tim Child
Introducing A New PostgreSQL Procedural Language Unlocking the Power of the GPU! By Tim Child Bio Tim Child 35 years experience of software development Formerly VP Oracle Corporation VP BEA Systems Inc.
Choosing a Computer for Running SLX, P3D, and P5
Choosing a Computer for Running SLX, P3D, and P5 This paper is based on my experience purchasing a new laptop in January, 2010. I ll lead you through my selection criteria and point you to some on-line
OpenPOWER Outlook AXEL KOEHLER SR. SOLUTION ARCHITECT HPC
OpenPOWER Outlook AXEL KOEHLER SR. SOLUTION ARCHITECT HPC Driving industry innovation The goal of the OpenPOWER Foundation is to create an open ecosystem, using the POWER Architecture to share expertise,
Evaluation of CUDA Fortran for the CFD code Strukti
Evaluation of CUDA Fortran for the CFD code Strukti Practical term report from Stephan Soller High performance computing center Stuttgart 1 Stuttgart Media University 2 High performance computing center
Kalray MPPA Massively Parallel Processing Array
Kalray MPPA Massively Parallel Processing Array Next-Generation Accelerated Computing February 2015 2015 Kalray, Inc. All Rights Reserved February 2015 1 Accelerated Computing 2015 Kalray, Inc. All Rights
Amazon EC2 Product Details Page 1 of 5
Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of
Lecture 11: Multi-Core and GPU. Multithreading. Integration of multiple processor cores on a single chip.
Lecture 11: Multi-Core and GPU Multi-core computers Multithreading GPUs General Purpose GPUs Zebo Peng, IDA, LiTH 1 Multi-Core System Integration of multiple processor cores on a single chip. To provide
From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller
White Paper From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller The focus of this paper is on the emergence of the converged network interface controller
Parallel Computing with MATLAB
Parallel Computing with MATLAB Scott Benway Senior Account Manager Jiro Doke, Ph.D. Senior Application Engineer 2013 The MathWorks, Inc. 1 Acceleration Strategies Applied in MATLAB Approach Options Best
The search engine you can see. Connects people to information and services
The search engine you can see Connects people to information and services The search engine you cannot see Total data: ~1EB Processing data : ~100PB/day Total web pages: ~1000 Billion Web pages updated:
FPGAs in Next Generation Wireless Networks
FPGAs in Next Generation Wireless Networks March 2010 Lattice Semiconductor 5555 Northeast Moore Ct. Hillsboro, Oregon 97124 USA Telephone: (503) 268-8000 www.latticesemi.com 1 FPGAs in Next Generation
Xilinx SDNet: A New Way to Specify Network Hardware
Xilinx SDNet: A New Way to Specify Network Hardware By Loring Wirbel Senior Analyst March 2014 www.linleygroup.com Copyright 2014 The Linley Group, Inc. This paper examines Xilinx s SDNet specification
ACCELERATING SELECT WHERE AND SELECT JOIN QUERIES ON A GPU
Computer Science 14 (2) 2013 http://dx.doi.org/10.7494/csci.2013.14.2.243 Marcin Pietroń Pawe l Russek Kazimierz Wiatr ACCELERATING SELECT WHERE AND SELECT JOIN QUERIES ON A GPU Abstract This paper presents
Fractal Video Compression in OpenCL: An Evaluation of CPUs, GPUs, and FPGAs as Acceleration Platforms. Doris Chen, Deshanand Singh Jan 24 th, 2013
Fractal Video Compression in OpenCL: An Evaluation of CPUs, GPUs, and FPGAs as Acceleration Platforms Doris Chen, Deshanand Singh Jan 24 th, 2013 Platform Evaluation Challenges Conducting a fair platform
Shattering the 1U Server Performance Record. Figure 1: Supermicro Product and Market Opportunity Growth
Shattering the 1U Server Performance Record Supermicro and NVIDIA recently announced a new class of servers that combines massively parallel GPUs with multi-core CPUs in a single server system. This unique
GEDAE TM - A Graphical Programming and Autocode Generation Tool for Signal Processor Applications
GEDAE TM - A Graphical Programming and Autocode Generation Tool for Signal Processor Applications Harris Z. Zebrowitz Lockheed Martin Advanced Technology Laboratories 1 Federal Street Camden, NJ 08102
NVIDIA CUDA Software and GPU Parallel Computing Architecture. David B. Kirk, Chief Scientist
NVIDIA CUDA Software and GPU Parallel Computing Architecture David B. Kirk, Chief Scientist Outline Applications of GPU Computing CUDA Programming Model Overview Programming in CUDA The Basics How to Get
Full and Para Virtualization
Full and Para Virtualization Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF x86 Hardware Virtualization The x86 architecture offers four levels
Model-based system-on-chip design on Altera and Xilinx platforms
CO-DEVELOPMENT MANUFACTURING INNOVATION & SUPPORT Model-based system-on-chip design on Altera and Xilinx platforms Ronald Grootelaar, System Architect RJA.Grootelaar@3t.nl Agenda 3T Company profile Technology
Accelerate Cloud Computing with the Xilinx Zynq SoC
X C E L L E N C E I N N E W A P P L I C AT I O N S Accelerate Cloud Computing with the Xilinx Zynq SoC A novel reconfigurable hardware accelerator speeds the processing of applications based on the MapReduce
Introduction to GPU Programming Languages
CSC 391/691: GPU Programming Fall 2011 Introduction to GPU Programming Languages Copyright 2011 Samuel S. Cho http://www.umiacs.umd.edu/ research/gpu/facilities.html Maryland CPU/GPU Cluster Infrastructure
1-Gigabit TCP Offload Engine
White Paper 1-Gigabit TCP Offload Engine Achieving greater data center efficiencies by providing Green conscious and cost-effective reductions in power consumption. June 2009 Background Broadcom is a recognized
Introducing the Singlechip Cloud Computer
Introducing the Singlechip Cloud Computer Exploring the Future of Many-core Processors White Paper Intel Labs Jim Held Intel Fellow, Intel Labs Director, Tera-scale Computing Research Sean Koehl Technology
Parallel Computing: Strategies and Implications. Dori Exterman CTO IncrediBuild.
Parallel Computing: Strategies and Implications Dori Exterman CTO IncrediBuild. In this session we will discuss Multi-threaded vs. Multi-Process Choosing between Multi-Core or Multi- Threaded development
Direct GPU/FPGA Communication Via PCI Express
Direct GPU/FPGA Communication Via PCI Express Ray Bittner, Erik Ruf Microsoft Research Redmond, USA {raybit,erikruf}@microsoft.com Abstract Parallel processing has hit mainstream computing in the form
Reconfigurable Architecture Requirements for Co-Designed Virtual Machines
Reconfigurable Architecture Requirements for Co-Designed Virtual Machines Kenneth B. Kent University of New Brunswick Faculty of Computer Science Fredericton, New Brunswick, Canada ken@unb.ca Micaela Serra
high-performance computing so you can move your enterprise forward
Whether targeted to HPC or embedded applications, Pico Computing s modular and highly-scalable architecture, based on Field Programmable Gate Array (FPGA) technologies, brings orders-of-magnitude performance
Parallel Firewalls on General-Purpose Graphics Processing Units
Parallel Firewalls on General-Purpose Graphics Processing Units Manoj Singh Gaur and Vijay Laxmi Kamal Chandra Reddy, Ankit Tharwani, Ch.Vamshi Krishna, Lakshminarayanan.V Department of Computer Engineering
GPU programming using C++ AMP
GPU programming using C++ AMP Petrika Manika petrika.manika@fshn.edu.al Elda Xhumari elda.xhumari@fshn.edu.al Julian Fejzaj julian.fejzaj@fshn.edu.al Abstract Nowadays, a challenge for programmers is to
AMD WHITE PAPER GETTING STARTED WITH SEQUENCEL. AMD Embedded Solutions 1
AMD WHITE PAPER GETTING STARTED WITH SEQUENCEL AMD Embedded Solutions 1 Optimizing Parallel Processing Performance and Coding Efficiency with AMD APUs and Texas Multicore Technologies SequenceL Auto-parallelizing
CARMA CUDA on ARM Architecture. Developing Accelerated Applications on ARM
CARMA CUDA on ARM Architecture Developing Accelerated Applications on ARM CARMA is an architectural prototype for high performance, energy efficient hybrid computing Schedule Motivation System Overview
Architectures and Platforms
Hardware/Software Codesign Arch&Platf. - 1 Architectures and Platforms 1. Architecture Selection: The Basic Trade-Offs 2. General Purpose vs. Application-Specific Processors 3. Processor Specialisation
Intel Network Builders: Lanner and Intel Building the Best Network Security Platforms
Solution Brief Intel Xeon Processors Lanner Intel Network Builders: Lanner and Intel Building the Best Network Security Platforms Internet usage continues to rapidly expand and evolve, and with it network
Load Balanced Performance
Load Balanced Performance A KEY INGREDIENT FOR FAST, RELIABLE APPLICATIONS Key Attributes Applications have become the center of the business world. We rely on them to reach customers, build products,
Computer Graphics Hardware An Overview
Computer Graphics Hardware An Overview Graphics System Monitor Input devices CPU/Memory GPU Raster Graphics System Raster: An array of picture elements Based on raster-scan TV technology The screen (and
FPGA-based Multithreading for In-Memory Hash Joins
FPGA-based Multithreading for In-Memory Hash Joins Robert J. Halstead, Ildar Absalyamov, Walid A. Najjar, Vassilis J. Tsotras University of California, Riverside Outline Background What are FPGAs Multithreaded
Making Full use of Emerging ARM-based Heterogeneous Multicore SoCs
Making Full use of Emerging ARM-based Heterogeneous Multicore SoCs Felix Baum Embedded Systems Division Mentor Graphics Corporation Fremont, California USA felix_baum@mentor.com Arvind Raghuraman Embedded
Lesson 7: SYSTEM-ON. SoC) AND USE OF VLSI CIRCUIT DESIGN TECHNOLOGY. Chapter-1L07: "Embedded Systems - ", Raj Kamal, Publs.: McGraw-Hill Education
Lesson 7: SYSTEM-ON ON-CHIP (SoC( SoC) AND USE OF VLSI CIRCUIT DESIGN TECHNOLOGY 1 VLSI chip Integration of high-level components Possess gate-level sophistication in circuits above that of the counter,
NVIDIA CUDA GETTING STARTED GUIDE FOR MICROSOFT WINDOWS
NVIDIA CUDA GETTING STARTED GUIDE FOR MICROSOFT WINDOWS DU-05349-001_v6.0 February 2014 Installation and Verification on TABLE OF CONTENTS Chapter 1. Introduction...1 1.1. System Requirements... 1 1.2.
:Introducing Star-P. The Open Platform for Parallel Application Development. Yoel Jacobsen E&M Computing LTD yoel@emet.co.il
:Introducing Star-P The Open Platform for Parallel Application Development Yoel Jacobsen E&M Computing LTD yoel@emet.co.il The case for VHLLs Functional / applicative / very high-level languages allow
HP Moonshot: An Accelerator for Hyperscale Workloads
HP Moonshot: An Accelerator for Hyperscale Workloads Sponsored by HP, see HP Moonshot for more information www.hp.com/go/moonshot Executive Summary Hyperscale data center customers have specialized workloads,
GPU File System Encryption Kartik Kulkarni and Eugene Linkov
GPU File System Encryption Kartik Kulkarni and Eugene Linkov 5/10/2012 SUMMARY. We implemented a file system that encrypts and decrypts files. The implementation uses the AES algorithm computed through
Writing Applications for the GPU Using the RapidMind Development Platform
Writing Applications for the GPU Using the RapidMind Development Platform Contents Introduction... 1 Graphics Processing Units... 1 RapidMind Development Platform... 2 Writing RapidMind Enabled Applications...
Algorithm and Programming Considerations for Embedded Reconfigurable Computers
Algorithm and Programming Considerations for Embedded Reconfigurable Computers Russell Duren, Associate Professor Engineering And Computer Science Baylor University Waco, Texas Douglas Fouts, Professor
RAPID PROTOTYPING PLATFORM FOR RECONFIGURABLE IMAGE PROCESSING
RAPID PROTOTYPING PLATFORM FOR RECONFIGURABLE IMAGE PROCESSING B.Kovář 1, J. Kloub 1, J. Schier 1, A. Heřmánek 1, P. Zemčík 2, A. Herout 2 (1) Institute of Information Theory and Automation Academy of
HPC with Multicore and GPUs
HPC with Multicore and GPUs Stan Tomov Electrical Engineering and Computer Science Department University of Tennessee, Knoxville CS 594 Lecture Notes March 4, 2015 1/18 Outline! Introduction - Hardware
Applications to Computational Financial and GPU Computing. May 16th. Dr. Daniel Egloff +41 44 520 01 17 +41 79 430 03 61
F# Applications to Computational Financial and GPU Computing May 16th Dr. Daniel Egloff +41 44 520 01 17 +41 79 430 03 61 Today! Why care about F#? Just another fashion?! Three success stories! How Alea.cuBase
White Paper OpenCL : The Future of Accelerated Application Performance Is Now. Table of Contents
White Paper OpenCL : The Future of Accelerated Application Performance Is Now Table of Contents INTRODUCTION... 2 What Is OpenCL?... 2 Changing the Game... 2 GPUs: Not Just for Graphics Anymore... 2 THE
Overview of HPC Resources at Vanderbilt
Overview of HPC Resources at Vanderbilt Will French Senior Application Developer and Research Computing Liaison Advanced Computing Center for Research and Education June 10, 2015 2 Computing Resources
supercomputing. simplified.
supercomputing. simplified. INTRODUCING WINDOWS HPC SERVER 2008 R2 SUITE Windows HPC Server 2008 R2, Microsoft s third-generation HPC solution, provides a comprehensive and costeffective solution for harnessing
Custom design services
Custom design services Your partner for electronic design services and solutions Barco Silex, Barco s center of competence for micro-electronic design, has established a solid reputation in the development
Digitale Signalverarbeitung mit FPGA (DSF) Soft Core Prozessor NIOS II Stand Mai 2007. Jens Onno Krah
(DSF) Soft Core Prozessor NIOS II Stand Mai 2007 Jens Onno Krah Cologne University of Applied Sciences www.fh-koeln.de jens_onno.krah@fh-koeln.de NIOS II 1 1 What is Nios II? Altera s Second Generation
Graphical Processing Units to Accelerate Orthorectification, Atmospheric Correction and Transformations for Big Data
Graphical Processing Units to Accelerate Orthorectification, Atmospheric Correction and Transformations for Big Data Amanda O Connor, Bryan Justice, and A. Thomas Harris IN52A. Big Data in the Geosciences:
Impact of Big Data growth On Transparent Computing
Impact of Big Data growth On Transparent Computing Michael A. Greene Intel Vice President, Software and Services Group, General Manager, System Technologies and Optimization 1 Transparent Computing (TC)
Virtual Platforms Addressing challenges in telecom product development
white paper Virtual Platforms Addressing challenges in telecom product development This page is intentionally left blank. EXECUTIVE SUMMARY Telecom Equipment Manufacturers (TEMs) are currently facing numerous
Trends in High-Performance Computing for Power Grid Applications
Trends in High-Performance Computing for Power Grid Applications Franz Franchetti ECE, Carnegie Mellon University www.spiral.net Co-Founder, SpiralGen www.spiralgen.com This talk presents my personal views