CUDA Debugging and Profiling Tools Mark Harris, NVIDIA

Size: px

Start display at page:

Download "CUDA Debugging and Profiling Tools Mark Harris, NVIDIA"

Kelly Bridges
7 years ago
Views:

1 CUDA Debugging and Profiling Tools Mark Harris, NVIDIA

2 CUDA-GDB Debugger Extended version of GDB with support for CUDA C Supported on Linux 32bit / 64bit systems Seamlessly debug both the host CPU and device GPU code Set breakpoints on any source line or symbol name Single step executes only one warp except on syncthreads() Access and print all CUDA memory allocations, local, global, constant and shared vars. 2

3 Linux GDB Integration with EMACS 3

4 Linux GDB Integration with DDD 4

5 CUDA-MemCheck Detects/tracks memory errors Out of bounds accesses Misaligned accesses (types must be aligned on their size) Linux and WinXP (included with CUDA Toolkit) Integrated into CUDA-GDB on Linux Also standalone command-line tool on Linux and Windows Win7 and Vista support coming 5

6 CUDA Driver Command-line Profiling 1. Set environment variables export CUDA_PROFILE=1 export CUDA_PROFILE_CSV=1 export CUDA_PROFILE_CONFIG=config.txt export CUDA_PROFILE_LOG=profile.csv 2. Set configuration file FILE "config.txt": gpustarttimestamp instructions 3. Run application matrixmul 4. View profiler output FILE "profile.csv": # CUDA_PROFILE_LOG_VERSION 1.5 # CUDA_DEVICE 0 GeForce 8800 GT # CUDA_PROFILE_CSV 1 # TIMESTAMPFACTOR fa292bb1ea2c12c gpustarttimestamp,method,gputime,cputime,occupancy,instructions 115f4eaa10e3b220,memcpyHtoD,7.328, f4eaa10e5dac0,memcpyHtoD,5.664, f4eaa10e95ce0,memcpyHtoD,7.328, f4eaa10f2ea60,_Z10dmatrixmulPfiiS_iiS_,19.296,40.000,0.333, f4eaa10f443a0,memcpyDtoH,7.776,

7 CUDA Visual Profiler Performance analysis for CUDA apps Linux,Windows,Mac Execute app and collect profiling data Hardware performance counters Profile all kernels and memory xfers Profiling data analysis 7

8 CUDA Visual Profiler kernel data 9

9 CUDA Visual Profiler computed kernel data Instruction throughput (achieved instruction rate) / (peak single-issue instruction rate) Global memory read throughput (GB/s) Global memory write throughput (GB/s) Overall global memory access throughput (GB/s) Global memory load efficiency Global memory store efficiency 10

10 CUDA Visual Profiler memory transfer data Memory transfer type and direction (D=Device, H=Host, A=cuArray) e.g. H to D: Host to Device Synchronous / Asynchronous Memory transfer size (bytes) Stream ID 11

11 CUDA Visual Profiler data analysis views Views: Summary table Kernel table Memcpy table Summary plot GPU Time Height plot GPU Time Width plot Profiler counter plot Profiler table column plot Multi-device plot Multi-stream plot Analyze profiler counters Analyze kernel occupancy 12

12 CUDA Visual Profiler Misc. Multiple sessions Compare views for different sessions Comparison Summary plot Profiler projects save & load Import/Export profiler data (.CSV format) 13

13 NVIDIA Parallel Nsight The industry s 1st Development Environment for massively parallel applications Accelerates GPU + CPU application development Complete Visual Studio-integrated development environment 14

14 Parallel Nsight 1.0 Nsight Parallel Debugger GPU source code debugging Variable & memory inspection Nsight Analyzer Platform-level Analysis For the CPU and GPU Nsight Graphics Inspector Visualize and debug graphics content 15

15 Source Debugging Supports CUDA C and HLSL (Direct3D Shading Language) Hardware breakpoints GPU memory and variable views Nsight menu and toolbars 16

16 Parallel Nsight IDE - Debugging 17

17 Analysis View a correlated trace timeline with both CPU and GPU events. 18

18 Analysis Detailed tooltips are available for every event on the timeline. 19

19 Parallel Nsight 1.0 System Requirements Hardware GeForce 9 series or higher Tesla C1060/S1070 or higher Quadro (G9x or higher) Operating System Windows Server 2008 R2 Windows 7 / Vista 32 or 64-bit Visual Studio Visual Studio 2008 SP1 20

20 Supported System Configurations #1: Single machine, Single GPU Analyzer Graphics Inspector #2: Two machines connected over the network TCP/IP #3: Single machine, dual GPUs Debugger Analyzer Graphics Inspector Debugger Analyzer Graphics Inspector 21

21 Parallel Nsight 1.0 Versions Standard (free) GPU Source Debugger Graphics Inspector Professional ($349) Analyzer Data Breakpoints Premium ticket-based support Volume and Site Licensing available 22

Optimizing Application Performance with CUDA Profiling Tools

Optimizing Application Performance with CUDA Profiling Tools Why Profile? Application Code GPU Compute-Intensive Functions Rest of Sequential CPU Code CPU 100 s of cores 10,000 s of threads Great memory