Mitglied der Helmholtz-Gemeinschaft. Remote Visualization. November 27, 2015 Dr. Herwig Zilken

Transcription

1 Mitglied der Helmholtz-Gemeinschaft Remote Visualization November 27, 2015 Dr. Herwig Zilken

2 Visualization on JURECA This talk is about remote data visualization is stored on central GPFS Visualization app is running on a server (JURECA) Output is shown on your local desktop by means of Redirection of X- and OpenGL- commands to your local X-server Running a virtual desktop (VNC-server) on the server, sending the image of this desktop to your local viewer Using the server components of remote aware visualization apps (ParaView, VisIt) on JURECA and their client components on your local machine May 19, 2015 Folie 2

3 Remote Rendering with VNC/VirtualGL Remote rendering with VNC (virtual network client) together with VirtualGL VNC/VirtualGL is a good solution for many common OpenGL applications, e.g. IDL, PyMol Needs X-Server to be installed on the application server will be available on the Vis-Nodes of JURECA only May 19, 2015 Folie 3

4 JURECA Visualization-Nodes: Technical 12 Visualization-Nodes 2 x Intel Xeon CPUs (Haswell), 2.5 GHz 12 cores/cpu, 24 cores/node, 2 way SMT/Hyper Threading, 48 logical cores 2 GPUs Nvidia Tesla K40 per node, 12 GB RAM on each card 10 nodes with 512 GB RAM ( jrc[ ] ) 2 nodes with 1024 GB RAM ( jrc139[3,4] ) Special partition named vis connection to vis-nodes via login-nodes and ssh tunnels (for security reasons) BUT! Visualization with ParaView and VisIt in principle is possible on EVERY node of JURECA (via software rendering) JURECA can be used as a big render cluster May 19, 2015 Folie 4

5 Installed Vis-Software on JURECA (so far) Notice: we are just starting to install vis apps on JURECA! Please be patient for a few weeks. ParaView (installed with software rendering so far) VisIt (only test installation, with software rendering so far) (VisIt is also installed on JUQUEEN, mainly for in-situ visualization) Interactive Language IDL Maybe later (on demand): PyMol Molecular Viewer Visual Molecular Dynamics VMD Vapor.. May 19, 2015 Folie 5

6 Parallel ParaView ParaView has three main components: Client Server Render Server Server Client create control destroy control image Source Filter Server Render Server Object Source Object Filter Filter Object Mapper/ Actor Render Object Object May 19, 2015 Folie 6

7 Parallel ParaView (continued) ParaView can be started in non parallel (standalone) mode: All three components in one single process command: paraview ParaView can be started in distributed/parallel mode: 1. Local client and parallel server (data server and render server in one process) used on JURECA! command on local client: paraview command on remote cluster: mpiexec x n <num_processes> pvserver May 19, 2015 Folie 7

8 Parallel Paraview (continued) 2. Local client and parallel data and render server (data server and render server may run on different machines) command on local client: paraview command on data processing server: mpiexec n <num_dataserver> pvdataserver m=machines.pvx command on render server: mpiexec n <num_renderserver> pvrenderserver m=machines.pvx (num_dataserver >= num_renderserver) May 19, 2015 Folie 8

9 Remote Rendering Setup ParaView or VisIt server running on JURECA (either on login node or on a couple of compute nodes) ParaView or VisIt client on local workstation Server side rendering and client side rendering possible server side rendering: images are send to client on GPFS client side rendering: graphical primitives are send to the client Client 1 JURECA All connections must use ssh tunnels! Client 2 May 19, 2015 Folie 9

10 Starting Remote ParaView on JURECA 1. login to JURECA and start the ParaView server in a batch job: ssh jureca.zam.kfa-juelich.de load necessary modules (a stage, intel-para, paraview) allocate node(s): salloc --partition=batch --nodes=1 --time=00:20:00 run pvserver: srun --nodes=1 --ntasks=12 pvserver check on which node the server runs: squeue u yourname lets say pvserver runs on jrc create a tunnel from your local client to this node: ssh L 11111:jrc0345:11111 jureca.zam.kfa-juelich.de 3. start your local ParaView client, create a server configuration as follows: server type: Client/Server, Host: localhost, Port: connect your local client to the ParaView server running on JURECA May 19, 2015 Folie 10

11 Starting Remote VisIt on JURECA You do NOT need to login to JURECA manually, as the login process is integrated in the VisIt client. 1. Start your local VisIt client, create a host profile named JURECA as follows: remote hostname: jureca.zam.kfa-juelich.de enable Tunnel data connection through SSH set Username and Path to VisIt installation 2. Create two launch profiles: I. serial: no special parameters II. parallel: enable Launch parallel engine set launch method to sbatch/aprun set Partition to batch (or vis) 3. Open a File, select JURECA as host. When the connection is successful, you can open a file stored on GPFS 4. Select launch profile: serial: launches the VisIt engine on the login node parallel: creates a batch job which launches the parallel VisIt engine May 19, 2015 Folie 11