VisIt: A Tool for Visualizing and Analyzing Very Large Data. Hank Childs, Lawrence Berkeley National Laboratory December 13, 2010

Size: px

Start display at page:

Download "VisIt: A Tool for Visualizing and Analyzing Very Large Data. Hank Childs, Lawrence Berkeley National Laboratory December 13, 2010"

Homer Hunter
8 years ago
Views:

1 VisIt: A Tool for Visualizing and Analyzing Very Large Data Hank Childs, Lawrence Berkeley National Laboratory December 13, 2010

2 VisIt is an open source, richly featured, turn-key application for large data. Used by: 1 billion grid points / time slice Visualization experts Simulation code developers Simulation code consumers Popular R&D 100 award in 2005 Used on many of the Top500 >>>100K downloads 217 pin reactor cooling simulation Run on ¼ of Argonne BG/P Image credit: Paul Fischer, ANL

developers Simulation code consumers Popular R&D 100 award in 2005 Used on many of the

3 VisIt is used to look at lots of types of simulated and experimental data. Fusion, Sanderson, UUtah Astrophysics, Childs Nuclear Reactors, Childs Particle accelerators, Ruebel, LLNL

4 AGU examples: environmental management Image credit: Horsman & Bethel, LBL

5 AGU example: earthquakes Image credits: Boyle, LBL

6 AGU example: climate Image credit: Prabhat, LBL

7 Terribly Named!!! intended for much more than just visualization Analysis Visual Debugging Data Exploration Presentations

8 What sort of analysis is appropriate for VisIt? General analysis techniques (e.g. integration, volumes, surface areas, etc.) Specialized analysis (e.g. hohlraum flux at AGEX) Detector at AGEX Detector provided by VisIt (synthetic diagnostic)

9 VisIt has a rich feature set. Meshes: rectilinear, curvilinear, unstructured, point, AMR Data: scalar, vector, tensor, material, species Dimension: 1D, 2D, 3D, time varying Rendering (~15): pseudocolor, volume rendering, hedgehogs, glyphs, mesh lines, etc Data manipulation (~40): slicing, contouring, clipping, thresholding, restrict to box, reflect, project, revolve, File formats (~110) Derived quantities: >100 interoperable building blocks +,-,*,/, gradient, mesh quality, if-then-else, and, or, not Many general features: position lights, make movie, etc Queries (~50): ways to pull out quantitative information, debugging, comparative analysis

pseudocolor, volume rendering, hedgehogs, glyphs, mesh lines, etc Data manipulation (~40): slicing, contouring, clipping, thresholding, restrict to box, reflect,

10 VisIt employs a parallelized clientserver architecture. localhost Linux, Windows, Mac remote machine Client-server observations: Good for remote visualization Leverages available resources Scales well Graphics Hardware Parallel vis resources Additional design considerations: Plugins User data Multiple UIs: GUI (Qt), CLI (Python), more No need to move data

visualization Leverages available resources Scales well Graphics Hardware Parallel vis

11 VisIt recently demonstrated good performance at unprecedented scale. Weak scaling study: ~62.5M cells/core Machine Model Problem Size #cores Franklin Cray XT4 1T, 2T 16K, 32K Dawn BG/P 4T 64K JaguarPF Cray XT5 2T 32K Juno X86_64 1T 16K Purple IBM P5 0.5T 8K Ranger Sun 1T 16K Two trillion cell data set, rendered in VisIt by David Pugmire on ORNL Jaguar machine 11

5M cells/core Machine Model Problem Size #cores Franklin Cray XT4 1T, 2T 16K, 32K Dawn

12 The VisIt team focuses on making a robust, usable product for end users. Manuals 300 page user manual 200 page command line interface manual Getting your data into VisIt manual Wiki for users (and developers) Revision control, nightly regression testing, etc Executables for all major platforms Day long class, complete with exercises Slides from the VisIt class

VisIt manual Wiki for users (and developers) Revision control, nightly regression testing,

13 VisIt is a vibrant project with many participants. Over 75 person-years of effort Over 1.5 million lines of code Partnership between: Department of Energy s Office of Science, National Nuclear Security Agency, and Office of Nuclear Energy, the National Science Foundation XD centers (Longhorn XD and RDAV), and more. Project started 2005 R&D100 VACET is funded GNEP funds LLNL to support GNEP codes at Argonne Developers from AWE enters repo LLNL, LBL, & ORNL Start dev in repo Institutional support leverages effort from many labs LLNL user community transitioned to VisIt User community grows, including AWE & ASC Alliance schools SciDAC Outreach Center enables Public SW repo Saudi Aramco funds LLNL to support VisIt UC Davis & UUtah research done in VisIt repo Partnership with CEA is developed More developers Entering repo all the time Fall Spring Summer Spring

14 VisIt: What s the Big Deal? Everything works at scale Robust, usable tool Features that span the power of visualization : Data exploration Confirmation Communication Features for different kinds of users: Vis experts Code developers Code consumers Healthy future: vibrant developer and user communities

of visualization : Data exploration Confirmation Communication Features for

15 How to make VisIt work after you get home How to get VisIt running on your machine Downloading and installing VisIt Building VisIt from scratch How to get VisIt to read your data Support for shapefiles, NetCDF, HDF5, and 100+ more How to get help when you run into trouble See title=sc10_tutorial

read your data Support for shapefiles, NetCDF, HDF5, and 100+ more How to get help

16 Anatomy of a picture Lots of elbow grease to make this picture. Satellite image externally obtained and manually registered to simulation space and elevated using height information obtained from yet another external source. Image credit: Horsman & Bethel, LBL Contour of scalar field from simulation Custom reader to read well bore data

elevated using height information obtained from yet another external source.

17 AGU example: climate Image credit: Prabhat, LBL This is basically the out of box picture, modulo changes in color table and annotations.

18 Summary VisIt is a richly featured visualization tool that is capable of visualizing data from many different application areas. Truth in advertising: a general interface & it sometimes takes a lot of effort to get the visualization you want. VisIt has excellent built in support for large data sets. User resources: Main website: Wiki: Tutorial: Contacts: Hank Childs, hchilds@lbl.gov General VisIt user list: visitusers@ornl.gov

VisIt has excellent built in support for large data sets. User resources: Main website: http://www.llnl.gov/visit Wiki: http://www.

The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): A Vision for Large-Scale Climate Data

The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): A Vision for Large-Scale Climate Data Lawrence Livermore National Laboratory? Hank Childs (LBNL) and Charles Doutriaux (LLNL) September