The GPU Accelerated Data Center. Marc Hamilton, August 27, 2015

Transcription

1 The GPU Accelerated Data Center Marc Hamilton, August 27, 2015

2 THE GPU-ACCELERATED DATA CENTER HPC DEEP LEARNING PC VIRTUALIZATION CLOUD GAMING RENDERING 2

3 Product design FROM ADVANCED RENDERING TO VIRTUAL PCS Visualization of products, architecture and science AEC You listen to music on Spotify. You Advanced watch movies rendering on Netflix. enables GeForce Now lets you play games the same way. new levels of virtual product design Instantly Data center stream provides the latest elastic titles from our powerful cloud-gaming scalability, mobility, security supercomputers. Think of it as your game for virtual console PCs in the sky. In-situ visualization adds unique value to HPC data centers Gaming is now easy and instant. In-situ visualization 3

4 Typical CAD Model Today 4

5 Typical CAD Model vs Real Photo 5

6 Real or Rendered With NVIDIA DesignWorks 6

7 Building-Scale Rendering With NVIDIA DesignWorks 7

8 Drone Shots July 2 August 25 8

9 GPU-POWERED DEEP LEARNING FOR CLOUD SERVICES We love GPUs, we just use a lot of them, Jeff Dean, Google 50% of searches will be voice or image, Andrew Ng, Baidu

10 Trends Driving HPC & Big Data Advances Algorithms Large Datasets Powerful Accelerators 10

11 The hardware needed to emulate the human brain may be ready even sooner than he predicted in around 2020 using technologies such as graphics processing units (GPUs), which are ideal for brain-software algorithms. Interview with Ray Kurzweil, Director of Engineering at Google & Renowned Futurist Washington Post, April 23,

12 12

13 13

14 14

15 15

16 ??? 16

17 Singapore Tech Center NVIDIA & EDB Joining Forces Building a new world class technology center in Singapore Focus on Deep Learning software, ecosystem development, and training Smart Nation, IVA, ADAS, and other DL applications Led by NVIDIA s Dr. Simon See Now hiring! NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE. 17

18 The Possibilities Are Endless NVIDIA Singapore Tech Center to Support Smart Nation R&D NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE. 18

19 GPUS POWERING WORLD S FASTEST SUPERCOMPUTERS Oak Ridge Titan 18,000 GPUs, U.S. Mission: DoE Open Science CSCS 5,200 GPUs, Europe Mission: Weather TSUBAME 4,000 GPUs, Japan Mission: Industry

20 Continued leadership in HPC CORAL Deployment in PFLOPS Peak 10x in Scientific App Performance IBM POWER9 CPU + NVIDIA Volta GPU NVLink High-speed Interconnect 40,000 Volta GPUs National Strategic Computing Initiative Executive order to build U.S. exascale supercomputer by 2023 A viable path forward for the post-moore s Law era 30x faster than current supercomputers GPUs to power pre- and exascale machines R&D budget $500M ( )

21 Japan s View On The Accelerated Data Center July 2015, ISC Keynote TSUBAME3.0 in 2016 will not only run HPC workloads, but also will have Big Data and Cloud Computing features Satoshi Matsuoka, Tokyo Tech & ISC 16 Chair 21

22 A*STAR Computational Resource Center NVIDIA & A*STAR Joining Forces Singapore s National Supercomputing Resource Equipped with NVIDIA Tesla GPUs, CUDA and cudnn Deep Learning software Bringing accelerated computing and big data analytics to Singapore s top researchers NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE. 22

23 Vision: Mainstream Parallel Programming Enable more programmers to write portable parallel software in their language of choice Embrace and evolve standards in key languages CUDA continues to evolve as the target low-level platform for GPU acceleration C 23

24 Tesla Accelerated Computing Platform Data Center Infrastructure Development System Solutions Communication Infrastructure Management Programming Languages Development Tools Software Solutions / GPU Accelerators GPU Boost Interconnect System Management Compiler Solutions GPU Direct NVLink NVML LLVM Profile and Debug CUPTI Accelerated Libraries cublas Enterprise Services Support & Maintenance 24

25 Deep Learning Performance Doubles for Data Scientists and Researchers Train Models up to 2x Faster with Automatic Multi-GPU Scaling 2x Faster Single GPU Training Support for Larger Models 2x Larger Datasets Instruction-level Profiling DIGITS 2 cudnn 3 CUDA

26 TESLA Accelerated Data Center PLATFORM QUADRO Rendering Iray DESIGNWORKS GRID Virtualized PC & Workstation vgpu HPC OpenACC CUDA Deep Learning cudnn Tesla System Management and Communication Middleware TESLA Datacenter Servers/Racks 26

27 After You Leave GTC Singapore Free Deep Learning Courses GPU Computing Labs See The Future of Enterprise Desktop 5-course series led by NVIDIA experts Hands-on labs run completely on GPUs in the Cloud, no local GPU needed developer.nvidia.com/deeplearning-courses All courses with cloud based hands-on labs No charge for intro courses Contact your NVIDIA representative to get free tokens for advanced labs nvidia.qwiklab.com Experience virtualized graphics from NVIDIA GRID Cloud data center in Asia Free on-line test-drive with 3D apps including AutoCAD, ArcGIS Pro, Dassault SOLIDWORKS Contact your NVIDIA rep for an on-site trial 27

28