A Critical Review of Scientific Visualization in Astronomy

Size: px
Start display at page:

Download "A Critical Review of Scientific Visualization in Astronomy"

Transcription

1 A Critical Review of Scientific Visualization in Astronomy Christopher Fluke & Amr Hassan Those not properly initiated into the mysteries of visualization research often seek to understand the images rather than appreciate their beauty. Globus & Raible (1994) CRICOS provider 00111D

2 Astronomy Data Astronomy is a data intensive science By 2010, 3 Petabytes of data (Brunner et al. 2002) Doubles every 1.5 years (Szalay & Gray 2001) Knowledge is not growing at same rate (Djorgovski 2005) Observation: Optical: LSST, SkyMapper, Radio: ALMA, ASKAP, MeerKat, SKA Simulation: Cosmology: N > particles CSIRO Springel et al.

3 Petascale Astronomy Era Analysis, storage, access? escience paradigm Automated data mining will be essential HOWEVER Still need to look at data Understanding Interpretation Verification (of automated results)

4 Human Visual System: Ultimate Pattern Matcher!

5 Visuals in Astronomy: A Long History Credits: Rappenglück (1999); Wikimedia Commons; Linda Hill Library of Science, Engineering & Technology; NASA; C Fluke

6 Much of astronomy is making (pretty) images and graphs Images from the Hubble Space Telescope

7 The Role of Visualization in Astronomy Planning Observation/monitoring Quality control Knowledge discovery Analysis Publication Formal Education Informal outreach Data V isualization System Knowledge discovery Much of the data is >3D Science

8 Scientific Visualization = SciVis SciVis is the process of turning N > 3D data into images Inherent geometric structure Interactive examination Understanding not just presentation Fundamental enabling technology for knowledge discovery McCormick, De Fanti & Brown (1987) Multidisciplinary

9 unc.renci.org Application Areas Architecture Engineering Molecular modelling Medical imaging

10 SciVis Research Techniques for displaying data Surface Rendering Volume Rendering Streamlines Efficient, scalable implementations Effective HPC use Parallel rendering Computational steering

11 Review: What we hope to achieve Identified papers addressing SciVis issues in astronomy Not an account of projects that have used SciVis No similar review exists c.f. Palomino (2003); Leech & Jenness (2005); Dubinski (2008); Kapferer & Riser (2008); Li et al. (2008) Hassan (PhD thesis) and Fluke & Hassan (in prep) Open questions How has SciVis advanced in astronomy? Are there areas for improvement? What future work is required? (Petascale Astronomy Era)

12 A Bit of Perspective Astronomical SciVis Medical SciVis Number of active researchers < 50 Number of active researchers > 1000 Beneficiaries O(10 4 ) astronomers Beneficiaries O(10 9 ) people!! However O(billion dollar) investments in astronomy data production hardware in next decade probably warrants some additional effort

13 Literature: Breakdown Large-N particle Simulations AMR Simulation Data Other Simulation Data Custom Visualization Software Multi-wavelength/ Spectral data Distributed/Remote Visualization Collaborative Visualization General Visualization Software Public Outreach Outcomes Will talk about Won t talk about

14 Case Study: Large-Scale Visualization Numerical simulations N-body gravity N > 10 9 Outputs (x,y,z) positions (v x,v y,v z ) velocity Temperature, density, particle type, Multiple time steps Custom file formats Scattered Points

15 Brodbeck et al. (1998) Comparative visualization competing Dark Matter models Provided animations on videotape

16 Navratil et al. (2007) Comparison between techniques Consider impact of visualization on understanding Direct visualization (Partiview) Direct visualization (ParaView) Isosurfaces (ParaView) Spatial relationships and extent of structures visible

17 Dubinski (2008) Spiral Metamorphosis MYRIAD library Visualization outputs as simulation proceeds Ability to map to different display formats Andromeda and Milky Way Δt = 170 million years

18 Szalay et al. (2008) particles? Brute force approach does not scale Hierarchical structure (spatial octree) GPU = 10 fps on TB of data Selecting points of interest

19 Case Study: Adaptive Mesh Refinement simulations Hydrodynamical technique Berger & Colella (1989) Multi-scale hierarchy Resolution where required Reduce memory CPU overhead lowered Astronomy use Cosmology Structure formation Gas dynamics First stars

20 Norman et al. (1999) Lack of suitable tools Not first class data type Re-sampled to structured grid Not scalable Custom VTK software

21 Kähler et al. (2003; 2006) Volume rendering the first stars Large range of length-scales 1000 light years to a fraction of an AU (10 19 to m) Use GPU for real-time interaction

22 Kähler et al. (2006) Comparison of volume rendering techniques Refinements Texturebased rendering GPU assisted ray-casting

23 Astronomy data challenges Observation Data volume (Petabytes ) (Low) Signal-to-noise (High) Dynamic range Incomplete or sparse sampling Astronomy-specific coordinate systems (RA, Dec, z) Simulation Number of particles Mesh resolution Range of length scales (solar to cosmological) Data formats!! (FITS, VOTable, Gadget-2, HDF5, ASCII )

24 SciVis Software Options Commercial SciVis software IDL VisIt TecPlot Amira Free SciVis software Drishti ParaView Write your own code VTK, OpenGL S2PLOT

25 SciVis Software Options Adapt from another discipline Astronomical Medicine Project (IIC/Harvard) Osirix 3D Slicer

26 SciVis Software Options Custom astronomy code AstroMD (Becciani et al. 2003) DVR (Beeson et al. 2003) Glnemo (Lambert) Hubble in a Bottle (Kuehne 2005) IFRIT (Gnedin) Karma (Gooch 1996) Partiview (Levy) SPLASH (Price 2007) StarSplatter (Welling) Tipsy (Katz & Quinn) TOPCAT (Taylor) VisIVO (Comparato et al. 2007) VOPlot3D (VO-India)

27 Why do Astronomers need their own SciVis software? General visualization software can be challenging to use Steep learning curve? Too much functionality? Not quite right functionality? (e.g. quantitative analysis) Lack of native data format support Costly file conversion Inflated file sizes Units! RA, Dec, z (x, y, z) Does not integrate directly with work process Need to convert data to another format

28 Preliminary Findings Visualization is not Science for astronomers Too many short-term projects (situation improving ) Funding sources? Visualization does not do the Science Interpretation of results Adding meaning is still a task Qualitative vs. Quantitative Emphasis still on pretty pictures /public outreach? Few packages give astronomers statistical tools they need

29 Preliminary Findings Usability and Interoperability Applications with focused functionality had wider use Being cross platform is very important Lifetime of software? Documentation? Support? Adjustable parameters and configurations Deep understanding required for both visualization and data Only a small portion of work targeted general data

30 Preliminary Findings Publication and citation Does astronomy software receive enough credit? E.g. Weiner et al Hard to track number of software users Where to publish astronomy SciVis papers? MNRAS, A&A, ApJ, PASA, New Astronomy key words: Methods: data analysis Methods: numerical Techniques: image processing What about Methods: visualization or Software:??? Not all astronomy SciVis papers are in ADS

31 Opportunities Increased use of GPU For graphics and computation [Hassan talk Wed] Comparison between observation and models Enhanced comprehension and cognition Colour maps Shaders/Transfer functions Alternative interaction devices Spaceball Gooch (1996) Programmable handheld devices; Game controllers Software development Modular craftsmanship (Goodman 2009) [Fluke talk Wed]

32 Collaborative Environments Nakasone et al. (2009) Second Life Djorgovski et al. (2009) Google Wave

33 Conclusion Pretty pictures are important BUT Aim to maximize scientific return from data through advances in scientific visualization Many current astronomy visualization approaches will be seriously challenged by, or completely incompatible with, the Petascale Data Era The time for new advancements in SciVis for astronomy is now!

34

35 Types of Astronomical Data Brunner et al. (2002): Imaging data: 2D, narrow Δλ, fixed epoch Catalogs: secondary parameters determined from processing (coordinates, fluxes, sizes, etc). Spectroscopic data and products (e.g. redshifts, chemical composition, etc). Studies in the time domain: moving objects, variable and transient sources Numerical simulations

36 Common Data Formats Structured Grid Unstructured Grid Scattered Points Adaptive Mesh Refinement Points + Connectivity Points Only

37 Palomino (2003)

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,

More information

Visualization and Astronomy

Visualization and Astronomy Visualization and Astronomy Prof.dr. Jos Roerdink Institute for Mathematics and Computing Science University of Groningen URL: www.cs.rug.nl/svcg/ Scientific Visualization & Computer Graphics Group Institute

More information

VisIVO: data exploration of complex data

VisIVO: data exploration of complex data Mem. S.A.It. Vol. 80, 441 c SAIt 2009 Memorie della VisIVO: data exploration of complex data G. Caniglia 1,4, U. Becciani 1, M. Comparato 1, A. Costa 1, C. Gheller 2, A. Grillo 1, M. Krokos 3, and F. Vitello

More information

Science Drivers for Big Data Joseph Lazio SKA Program Development Office & Jet Propulsion Laboratory, California Institute of Technology

Science Drivers for Big Data Joseph Lazio SKA Program Development Office & Jet Propulsion Laboratory, California Institute of Technology Science Drivers for Big Data Joseph Lazio SKA Program Development Office & Jet Propulsion Laboratory, California Institute of Technology 2010 California Institute of Technology. Government sponsorship

More information

VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis: Overview and Demo

VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis: Overview and Demo Claudio Gheller (CINECA), Marco Comparato (OACt), Ugo Becciani (OACt) VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis: Overview and Demo VisIVO: Visualization Interface for the

More information

An ArrayLibraryforMS SQL Server

An ArrayLibraryforMS SQL Server An ArrayLibraryforMS SQL Server Scientific requirements and an implementation László Dobos 1,2 --dobos@complex.elte.hu Alex Szalay 2, José Blakeley 3, Tamás Budavári 2, István Csabai 1,2, Dragan Tomic

More information

Data Centric Systems (DCS)

Data Centric Systems (DCS) Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems

More information

VisIVO, an open source, interoperable visualization tool for the Virtual Observatory

VisIVO, an open source, interoperable visualization tool for the Virtual Observatory Claudio Gheller (CINECA) 1, Ugo Becciani (OACt) 2, Marco Comparato (OACt) 3 Alessandro Costa (OACt) 4 VisIVO, an open source, interoperable visualization tool for the Virtual Observatory 1: c.gheller@cineca.it

More information

Visualization of Large Multi-Dimensional Datasets

Visualization of Large Multi-Dimensional Datasets ***TITLE*** ASP Conference Series, Vol. ***VOLUME***, ***PUBLICATION YEAR*** ***EDITORS*** Visualization of Large Multi-Dimensional Datasets Joel Welling Department of Statistics, Carnegie Mellon University,

More information

How To Teach Data Science

How To Teach Data Science The Past, Present, and Future of Data Science Education Kirk Borne @KirkDBorne http://kirkborne.net George Mason University School of Physics, Astronomy, & Computational Sciences Outline Research and Application

More information

MEng, BSc Applied Computer Science

MEng, BSc Applied Computer Science School of Computing FACULTY OF ENGINEERING MEng, BSc Applied Computer Science Year 1 COMP1212 Computer Processor Effective programming depends on understanding not only how to give a machine instructions

More information

Parallel Large-Scale Visualization

Parallel Large-Scale Visualization Parallel Large-Scale Visualization Aaron Birkland Cornell Center for Advanced Computing Data Analysis on Ranger January 2012 Parallel Visualization Why? Performance Processing may be too slow on one CPU

More information

Visualizing and Analyzing Massive Astronomical Datasets with Partiview

Visualizing and Analyzing Massive Astronomical Datasets with Partiview Visualizing and Analyzing Massive Astronomical Datasets with Partiview Brian P. Abbott 1, Carter B. Emmart 1, Stuart Levy 2, and Charles T. Liu 1 1 American Museum of Natural History & Hayden Planetarium,

More information

MEng, BSc Computer Science with Artificial Intelligence

MEng, BSc Computer Science with Artificial Intelligence School of Computing FACULTY OF ENGINEERING MEng, BSc Computer Science with Artificial Intelligence Year 1 COMP1212 Computer Processor Effective programming depends on understanding not only how to give

More information

MANAGING AND MINING THE LSST DATA SETS

MANAGING AND MINING THE LSST DATA SETS MANAGING AND MINING THE LSST DATA SETS Astronomy is undergoing an exciting revolution -- a revolution in the way we probe the universe and the way we answer fundamental questions. New technology enables

More information

A Steering Environment for Online Parallel Visualization of Legacy Parallel Simulations

A Steering Environment for Online Parallel Visualization of Legacy Parallel Simulations A Steering Environment for Online Parallel Visualization of Legacy Parallel Simulations Aurélien Esnard, Nicolas Richart and Olivier Coulaud ACI GRID (French Ministry of Research Initiative) ScAlApplix

More information

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio

More information

Collaborations between Official Statistics and Academia in the Era of Big Data

Collaborations between Official Statistics and Academia in the Era of Big Data Collaborations between Official Statistics and Academia in the Era of Big Data World Statistics Day October 20-21, 2015 Budapest Vijay Nair University of Michigan Past-President of ISI vnn@umich.edu What

More information

A New Data Visualization and Analysis Tool

A New Data Visualization and Analysis Tool Title: A New Data Visualization and Analysis Tool Author: Kern Date: 22 February 2013 NRAO Doc. #: Version: 1.0 A New Data Visualization and Analysis Tool PREPARED BY ORGANIZATION DATE Jeff Kern NRAO 22

More information

Learning from Big Data in

Learning from Big Data in Learning from Big Data in Astronomy an overview Kirk Borne George Mason University School of Physics, Astronomy, & Computational Sciences http://spacs.gmu.edu/ From traditional astronomy 2 to Big Data

More information

Cosmic Structure Formation and Dynamics: Cosmological N-body Simulations of Galaxy Formation and Magnetohydrodynamic Simulations of Solar Atmosphere

Cosmic Structure Formation and Dynamics: Cosmological N-body Simulations of Galaxy Formation and Magnetohydrodynamic Simulations of Solar Atmosphere Chapter 3 Epoch Making Simulation Cosmic Structure Formation and Dynamics: Cosmological N-body Simulations of Galaxy Formation and Magnetohydrodynamic Simulations of Solar Atmosphere Project Representative

More information

Data Mining Challenges and Opportunities in Astronomy

Data Mining Challenges and Opportunities in Astronomy Data Mining Challenges and Opportunities in Astronomy S. G. Djorgovski (Caltech) With special thanks to R. Brunner, A. Szalay, A. Mahabal, et al. The Punchline: Astronomy has become an immensely datarich

More information

Software challenges in the implementation of large surveys: the case of J-PAS

Software challenges in the implementation of large surveys: the case of J-PAS Software challenges in the implementation of large surveys: the case of J-PAS 1/21 Paulo Penteado - IAG/USP pp.penteado@gmail.com http://www.ppenteado.net/ast/pp_lsst_201204.pdf (K. Taylor) (A. Fernández-Soto)

More information

DATA VISUALIZATION. Lecture 1 Introduction. Lin Lu http://vr.sdu.edu.cn/~lulin/ llu@sdu.edu.cn

DATA VISUALIZATION. Lecture 1 Introduction. Lin Lu http://vr.sdu.edu.cn/~lulin/ llu@sdu.edu.cn DATA VISUALIZATION Lecture 1 Introduction Lin Lu http://vr.sdu.edu.cn/~lulin/ llu@sdu.edu.cn Visualization 可 视 化 Visualization now seen as key part of modern computing High performance computing generates

More information

Data Requirements from NERSC Requirements Reviews

Data Requirements from NERSC Requirements Reviews Data Requirements from NERSC Requirements Reviews Richard Gerber and Katherine Yelick Lawrence Berkeley National Laboratory Summary Department of Energy Scientists represented by the NERSC user community

More information

Data Visualization - A Very Rough Guide

Data Visualization - A Very Rough Guide Data Visualization - A Very Rough Guide Ken Brodlie University of Leeds 1 What is This Thing Called Visualization? Visualization Use of computersupported, interactive, visual representations of data to

More information

A Preliminary Summary of The VLA Sky Survey

A Preliminary Summary of The VLA Sky Survey A Preliminary Summary of The VLA Sky Survey Eric J. Murphy and Stefi Baum (On behalf of the entire Science Survey Group) 1 Executive Summary After months of critical deliberation, the Survey Science Group

More information

Data Mining with Hadoop at TACC

Data Mining with Hadoop at TACC Data Mining with Hadoop at TACC Weijia Xu Data Mining & Statistics Data Mining & Statistics Group Main activities Research and Development Developing new data mining and analysis solutions for practical

More information

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010 Virtual Observatories Virtual Observatories 1%%&'&$#-&6!&9:#,*3),!#,6!6#$C!&,&$D2 *:#%&+-3;& D&);&-$2!!"! "!" &,&$D2 %),-&,-!"#$%&'&#()*! $#%&!(!!! $ '!%&$ $! (% %)'6!6#$C!;#--&$G $! '!!! $#63#-3),G $!

More information

HPC & Visualization. Visualization and High-Performance Computing

HPC & Visualization. Visualization and High-Performance Computing HPC & Visualization Visualization and High-Performance Computing Visualization is a critical step in gaining in-depth insight into research problems, empowering understanding that is not possible with

More information

PERFORMANCE ANALYSIS AND OPTIMIZATION OF LARGE-SCALE SCIENTIFIC APPLICATIONS JINGJIN WU

PERFORMANCE ANALYSIS AND OPTIMIZATION OF LARGE-SCALE SCIENTIFIC APPLICATIONS JINGJIN WU PERFORMANCE ANALYSIS AND OPTIMIZATION OF LARGE-SCALE SCIENTIFIC APPLICATIONS BY JINGJIN WU Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science

More information

Analytics-as-a-Service: From Science to Marketing

Analytics-as-a-Service: From Science to Marketing Analytics-as-a-Service: From Science to Marketing Data Information Knowledge Insights (Discovery & Decisions) Kirk Borne George Mason University, Fairfax, VA www.kirkborne.net @KirkDBorne Big Data: What

More information

Large-Data Software Defined Visualization on CPUs

Large-Data Software Defined Visualization on CPUs Large-Data Software Defined Visualization on CPUs Greg P. Johnson, Bruce Cherniak 2015 Rice Oil & Gas HPC Workshop Trend: Increasing Data Size Measuring / modeling increasingly complex phenomena Rendering

More information

Sanjeev Kumar. contribute

Sanjeev Kumar. contribute RESEARCH ISSUES IN DATAA MINING Sanjeev Kumar I.A.S.R.I., Library Avenue, Pusa, New Delhi-110012 sanjeevk@iasri.res.in 1. Introduction The field of data mining and knowledgee discovery is emerging as a

More information

DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID

DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID DAME Astrophysical DAta Mining & Exploration on GRID M. Brescia S. G. Djorgovski G. Longo & DAME Working Group Istituto Nazionale di Astrofisica Astronomical Observatory of Capodimonte, Napoli Department

More information

VAPOR: A tool for interactive visualization of massive earth-science datasets

VAPOR: A tool for interactive visualization of massive earth-science datasets VAPOR: A tool for interactive visualization of massive earth-science datasets Alan Norton and John Clyne National Center for Atmospheric Research Boulder, CO USA Presentation at AGU Dec. 13, 2010 This

More information

The Tonnabytes Big Data Challenge: Transforming Science and Education. Kirk Borne George Mason University

The Tonnabytes Big Data Challenge: Transforming Science and Education. Kirk Borne George Mason University The Tonnabytes Big Data Challenge: Transforming Science and Education Kirk Borne George Mason University Ever since we first began to explore our world humans have asked questions and have collected evidence

More information

Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science)

Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science) Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science) Kirk Borne George Mason University, Fairfax, VA www.kirkborne.net

More information

Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery

Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery Center for Information Services and High Performance Computing (ZIH) Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery Richard Grunzke*, Jens Krüger, Sandra Gesing, Sonja

More information

The Challenge of Data in an Era of Petabyte Surveys Andrew Connolly University of Washington

The Challenge of Data in an Era of Petabyte Surveys Andrew Connolly University of Washington The Challenge of Data in an Era of Petabyte Surveys Andrew Connolly University of Washington We acknowledge support from NSF IIS-0844580 and NASA 08-AISR08-0081 The science of big data sets Big Questions

More information

Information Visualization WS 2013/14 11 Visual Analytics

Information Visualization WS 2013/14 11 Visual Analytics 1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and

More information

Lecture Notes, CEng 477

Lecture Notes, CEng 477 Computer Graphics Hardware and Software Lecture Notes, CEng 477 What is Computer Graphics? Different things in different contexts: pictures, scenes that are generated by a computer. tools used to make

More information

and the VO-Science Francisco Jiménez Esteban Suffolk University

and the VO-Science Francisco Jiménez Esteban Suffolk University The Spanish-VO and the VO-Science Francisco Jiménez Esteban CAB / SVO (INTA-CSIC) Suffolk University The Spanish-VO (SVO) IVOA was created in June 2002 with the mission to facilitate the international

More information

ENABLING TOOLS AND TECHNIQUES FOR THE OPTIMIZATION OF THE HERACLES SIMULATION PROGRAM

ENABLING TOOLS AND TECHNIQUES FOR THE OPTIMIZATION OF THE HERACLES SIMULATION PROGRAM ENABLING TOOLS AND TECHNIQUES FOR THE OPTIMIZATION OF THE HERACLES SIMULATION PROGRAM Edouard Audit, Valérie Gautard, Daniel Pomarède, Bruno Thooris CEA/DAPNIA/Saclay, 91191 Gif/Yvette, France Valerie.Gautard@cea.fr

More information

Visualization of Adaptive Mesh Refinement Data with VisIt

Visualization of Adaptive Mesh Refinement Data with VisIt Visualization of Adaptive Mesh Refinement Data with VisIt Gunther H. Weber Lawrence Berkeley National Laboratory VisIt Richly featured visualization and analysis tool for large data sets Built for five

More information

The Visualization Pipeline

The Visualization Pipeline The Visualization Pipeline Conceptual perspective Implementation considerations Algorithms used in the visualization Structure of the visualization applications Contents The focus is on presenting the

More information

arxiv:1007.4101v1 [astro-ph.co] 23 Jul 2010

arxiv:1007.4101v1 [astro-ph.co] 23 Jul 2010 arxiv:1007.4101v1 [astro-ph.co] 23 Jul 2010 Trumpeting the Vuvuzela: UltraDeep HI observations with MeerKAT Benne Willem Holwerda Astrophysics, Cosmology and Gravity Centre (ACGC), Astronomy Department,

More information

PyFR: Bringing Next Generation Computational Fluid Dynamics to GPU Platforms

PyFR: Bringing Next Generation Computational Fluid Dynamics to GPU Platforms PyFR: Bringing Next Generation Computational Fluid Dynamics to GPU Platforms P. E. Vincent! Department of Aeronautics Imperial College London! 25 th March 2014 Overview Motivation Flux Reconstruction Many-Core

More information

What is the Sloan Digital Sky Survey?

What is the Sloan Digital Sky Survey? What is the Sloan Digital Sky Survey? Simply put, the Sloan Digital Sky Survey is the most ambitious astronomical survey ever undertaken. The survey will map one-quarter of the entire sky in detail, determining

More information

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com

More information

NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect

NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect SIGGRAPH 2013 Shaping the Future of Visual Computing NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect NVIDIA

More information

CAD and Creativity. Contents

CAD and Creativity. Contents CAD and Creativity K C Hui Department of Automation and Computer- Aided Engineering Contents Various aspects of CAD CAD training in the university and the industry Conveying fundamental concepts in CAD

More information

Data Visualization. Principles and Practice. Second Edition. Alexandru Telea

Data Visualization. Principles and Practice. Second Edition. Alexandru Telea Data Visualization Principles and Practice Second Edition Alexandru Telea First edition published in 2007 by A K Peters, Ltd. Cover image: The cover shows the combination of scientific visualization and

More information

Data-intensive HPC: opportunities and challenges. Patrick Valduriez

Data-intensive HPC: opportunities and challenges. Patrick Valduriez Data-intensive HPC: opportunities and challenges Patrick Valduriez Big Data Landscape Multi-$billion market! Big data = Hadoop = MapReduce? No one-size-fits-all solution: SQL, NoSQL, MapReduce, No standard,

More information

Undergraduate Studies Department of Astronomy

Undergraduate Studies Department of Astronomy WIYN 3.5-meter Telescope at Kitt Peak near Tucson, AZ Undergraduate Studies Department of Astronomy January 2014 Astronomy at Indiana University General Information The Astronomy Department at Indiana

More information

How To Create A Data Visualization

How To Create A Data Visualization CSCI 552 Data Visualization Shiaofen Fang What Is Visualization? We observe and draw conclusions A picture says more than a thousand words/numbers Seeing is believing, seeing is understanding Beware of

More information

Mesh Generation and Load Balancing

Mesh Generation and Load Balancing Mesh Generation and Load Balancing Stan Tomov Innovative Computing Laboratory Computer Science Department The University of Tennessee April 04, 2012 CS 594 04/04/2012 Slide 1 / 19 Outline Motivation Reliable

More information

Parallel Simplification of Large Meshes on PC Clusters

Parallel Simplification of Large Meshes on PC Clusters Parallel Simplification of Large Meshes on PC Clusters Hua Xiong, Xiaohong Jiang, Yaping Zhang, Jiaoying Shi State Key Lab of CAD&CG, College of Computer Science Zhejiang University Hangzhou, China April

More information

Lecture 14. Introduction to the Sun

Lecture 14. Introduction to the Sun Lecture 14 Introduction to the Sun ALMA discovers planets forming in a protoplanetary disc. Open Q: what physics do we learn about the Sun? 1. Energy - nuclear energy - magnetic energy 2. Radiation - continuum

More information

Computer Graphics AACHEN AACHEN AACHEN AACHEN. Public Perception of CG. Computer Graphics Research. Methodological Approaches - - - - - - - - - -

Computer Graphics AACHEN AACHEN AACHEN AACHEN. Public Perception of CG. Computer Graphics Research. Methodological Approaches - - - - - - - - - - Public Perception of CG Games Computer Graphics Movies Computer Graphics Research algorithms & data structures fundamental continuous & discrete mathematics optimization schemes 3D reconstruction global

More information

Visualization Tools for Adaptive Mesh Refinement Data

Visualization Tools for Adaptive Mesh Refinement Data Visualization Tools for Adaptive Mesh Refinement Data Gunther H. Weber 1 and Vincent E. Beckner 1 and Hank Childs 2 and Terry J. Ligocki 1 and Mark C. Miller 2 and Brian Van Straalen 1 and E. Wes Bethel

More information

Visualization and Exploration of huge data volumes

Visualization and Exploration of huge data volumes Visualization and Exploration of huge data volumes Claudio Gheller (CINECA), c.gheller@cineca.it CINECA (http://www.cineca.it) CINECA is a non profit Consortium, made up of 36 Italian universities, The

More information

MayaVi: A free tool for CFD data visualization

MayaVi: A free tool for CFD data visualization MayaVi: A free tool for CFD data visualization Prabhu Ramachandran Graduate Student, Dept. Aerospace Engg. IIT Madras, Chennai, 600 036. e mail: prabhu@aero.iitm.ernet.in Keywords: Visualization, CFD data,

More information

SGI HPC Systems Help Fuel Manufacturing Rebirth

SGI HPC Systems Help Fuel Manufacturing Rebirth SGI HPC Systems Help Fuel Manufacturing Rebirth Created by T A B L E O F C O N T E N T S 1.0 Introduction 1 2.0 Ongoing Challenges 1 3.0 Meeting the Challenge 2 4.0 SGI Solution Environment and CAE Applications

More information

CLUSTER ANALYSIS WITH R

CLUSTER ANALYSIS WITH R CLUSTER ANALYSIS WITH R [cluster analysis divides data into groups that are meaningful, useful, or both] LEARNING STAGE ADVANCED DURATION 3 DAY WHAT IS CLUSTER ANALYSIS? Cluster Analysis or Clustering

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

IDL. Get the answers you need from your data. IDL

IDL. Get the answers you need from your data. IDL Get the answers you need from your data. IDL is the preferred computing environment for understanding complex data through interactive visualization and analysis. IDL Powerful visualization. Interactive

More information

UCLA Graduate School of Education and Information Studies UCLA

UCLA Graduate School of Education and Information Studies UCLA UCLA Graduate School of Education and Information Studies UCLA Peer Reviewed Title: Slides for When use cases are not useful: Data practices, astronomy, and digital libraries Author: Wynholds, Laura, University

More information

ParaVision 6. Innovation with Integrity. The Next Generation of MR Acquisition and Processing for Preclinical and Material Research.

ParaVision 6. Innovation with Integrity. The Next Generation of MR Acquisition and Processing for Preclinical and Material Research. ParaVision 6 The Next Generation of MR Acquisition and Processing for Preclinical and Material Research Innovation with Integrity Preclinical MRI A new standard in Preclinical Imaging ParaVision sets a

More information

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,

More information

Remote Graphical Visualization of Large Interactive Spatial Data

Remote Graphical Visualization of Large Interactive Spatial Data Remote Graphical Visualization of Large Interactive Spatial Data ComplexHPC Spring School 2011 International ComplexHPC Challenge Cristinel Mihai Mocan Computer Science Department Technical University

More information

Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED

Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory 21 st Century Research Continuum Theory Theory embodied in computation Hypotheses tested through experiment SCIENTIFIC METHODS

More information

D7.7 Data Management Plan (a)

D7.7 Data Management Plan (a) H2020 FETHPC-1-2014 An Exascale Programming, Multi-objective Optimisation and Resilience Management Environment Based on Nested Recursive Parallelism Project Number 671603 D7.7 Data Management Plan (a)

More information

Multidimensional Data in the Virtual Observatory

Multidimensional Data in the Virtual Observatory IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC Contextual

More information

(Toward) Radiative transfer on AMR with GPUs. Dominique Aubert Université de Strasbourg Austin, TX, 14.12.12

(Toward) Radiative transfer on AMR with GPUs. Dominique Aubert Université de Strasbourg Austin, TX, 14.12.12 (Toward) Radiative transfer on AMR with GPUs Dominique Aubert Université de Strasbourg Austin, TX, 14.12.12 A few words about GPUs Cache and control replaced by calculation units Large number of Multiprocessors

More information

CHAPTER FIVE RESULT ANALYSIS

CHAPTER FIVE RESULT ANALYSIS CHAPTER FIVE RESULT ANALYSIS 5.1 Chapter Introduction 5.2 Discussion of Results 5.3 Performance Comparisons 5.4 Chapter Summary 61 5.1 Chapter Introduction This chapter outlines the results obtained from

More information

The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory

The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory Astronomy in the XXI century The Internet revolution (the dot com boom ) has transformed

More information

Overview Motivation and applications Challenges. Dynamic Volume Computation and Visualization on the GPU. GPU feature requests Conclusions

Overview Motivation and applications Challenges. Dynamic Volume Computation and Visualization on the GPU. GPU feature requests Conclusions Module 4: Beyond Static Scalar Fields Dynamic Volume Computation and Visualization on the GPU Visualization and Computer Graphics Group University of California, Davis Overview Motivation and applications

More information

Cross-Matching Very Large Datasets

Cross-Matching Very Large Datasets 1 Cross-Matching Very Large Datasets María A. Nieto-Santisteban, Aniruddha R. Thakar, and Alexander S. Szalay Johns Hopkins University Abstract The primary mission of the National Virtual Observatory (NVO)

More information

Petascale Visualization: Approaches and Initial Results

Petascale Visualization: Approaches and Initial Results Petascale Visualization: Approaches and Initial Results James Ahrens Li-Ta Lo, Boonthanome Nouanesengsy, John Patchett, Allen McPherson Los Alamos National Laboratory LA-UR- 08-07337 Operated by Los Alamos

More information

HPC Wales Skills Academy Course Catalogue 2015

HPC Wales Skills Academy Course Catalogue 2015 HPC Wales Skills Academy Course Catalogue 2015 Overview The HPC Wales Skills Academy provides a variety of courses and workshops aimed at building skills in High Performance Computing (HPC). Our courses

More information

Using D2K Data Mining Platform for Understanding the Dynamic Evolution of Land-Surface Variables

Using D2K Data Mining Platform for Understanding the Dynamic Evolution of Land-Surface Variables Using D2K Data Mining Platform for Understanding the Dynamic Evolution of Land-Surface Variables Praveen Kumar 1, Peter Bajcsy 2, David Tcheng 2, David Clutter 2, Vikas Mehra 1, Wei-Wen Feng 2, Pratyush

More information

LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist

LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist DERCAP Sydney, Australia, 2009 Overview of Presentation LSST - a large-scale Southern hemisphere optical survey

More information

Multiphase Flow - Appendices

Multiphase Flow - Appendices Discovery Laboratory Multiphase Flow - Appendices 1. Creating a Mesh 1.1. What is a geometry? The geometry used in a CFD simulation defines the problem domain and boundaries; it is the area (2D) or volume

More information

How is EnSight Uniquely Suited to FLOW-3D Data?

How is EnSight Uniquely Suited to FLOW-3D Data? How is EnSight Uniquely Suited to FLOW-3D Data? July 5, 2011 figure 1. FLOW-3D model of Dam visualized with EnSight If you would like to know how CEI s EnSight offers you more power than other postprocessors

More information

Using the Parkes Pulsar Data Archive

Using the Parkes Pulsar Data Archive JART http://www.jart.ac.cn Using the Parkes Pulsar Data Archive J. Khoo 1, G. Hobbs 1, R. N. Manchester 1, D. Miller 2, J. Dempsey 2 1 CSIRO Astronomy and Space Science, Australia Telescope National Facility,

More information

Information Management course

Information Management course Università degli Studi di Milano Master Degree in Computer Science Information Management course Teacher: Alberto Ceselli Lecture 01 : 06/10/2015 Practical informations: Teacher: Alberto Ceselli (alberto.ceselli@unimi.it)

More information

Data analysis of L2-L3 products

Data analysis of L2-L3 products Data analysis of L2-L3 products Emmanuel Gangler UBP Clermont-Ferrand (France) Emmanuel Gangler BIDS 14 1/13 Data management is a pillar of the project : L3 Telescope Caméra Data Management Outreach L1

More information

Multivariate Data Visualization

Multivariate Data Visualization Multivariate Data Visualization VOTech/Universities of Leeds & Edinburgh Richard Holbrey Outline Focus on data exploration Joined VOTech in June, so...... informal introduction Examine some definitions

More information

Origins of the Cosmos Summer 2016. Pre-course assessment

Origins of the Cosmos Summer 2016. Pre-course assessment Origins of the Cosmos Summer 2016 Pre-course assessment In order to grant two graduate credits for the workshop, we do require you to spend some hours before arriving at Penn State. We encourage all of

More information

Introduction to LSST Data Management. Jeffrey Kantor Data Management Project Manager

Introduction to LSST Data Management. Jeffrey Kantor Data Management Project Manager Introduction to LSST Data Management Jeffrey Kantor Data Management Project Manager LSST Data Management Principal Responsibilities Archive Raw Data: Receive the incoming stream of images that the Camera

More information

Ionospheric Research with the LOFAR Telescope

Ionospheric Research with the LOFAR Telescope Ionospheric Research with the LOFAR Telescope Leszek P. Błaszkiewicz Faculty of Mathematics and Computer Science, UWM Olsztyn LOFAR - The LOw Frequency ARray The LOFAR interferometer consist of a large

More information

Taming the Internet of Things: The Lord of the Things

Taming the Internet of Things: The Lord of the Things Taming the Internet of Things: The Lord of the Things Kirk Borne @KirkDBorne School of Physics, Astronomy, & Computational Sciences College of Science, George Mason University, Fairfax, VA Taming the Internet

More information

165 points. Name Date Period. Column B a. Cepheid variables b. luminosity c. RR Lyrae variables d. Sagittarius e. variable stars

165 points. Name Date Period. Column B a. Cepheid variables b. luminosity c. RR Lyrae variables d. Sagittarius e. variable stars Name Date Period 30 GALAXIES AND THE UNIVERSE SECTION 30.1 The Milky Way Galaxy In your textbook, read about discovering the Milky Way. (20 points) For each item in Column A, write the letter of the matching

More information

Astro 301/ Fall 2005 (48310) Introduction to Astronomy

Astro 301/ Fall 2005 (48310) Introduction to Astronomy Astro 301/ Fall 2005 (48310) Introduction to Astronomy Instructor: Professor Shardha Jogee TAs: David Fisher, Donghui Jeong, and Miranda Nordhaus Lecture 22 = Tu Nov 15 Lecture 23 = Th Nov 17 http://www.as.utexas.edu/~sj/a301-fa05/

More information

Big Data Visualization on the MIC

Big Data Visualization on the MIC Big Data Visualization on the MIC Tim Dykes School of Creative Technologies University of Portsmouth timothy.dykes@port.ac.uk Many-Core Seminar Series 26/02/14 Splotch Team Tim Dykes, University of Portsmouth

More information

Using GPUs in the Cloud for Scalable HPC in Engineering and Manufacturing March 26, 2014

Using GPUs in the Cloud for Scalable HPC in Engineering and Manufacturing March 26, 2014 Using GPUs in the Cloud for Scalable HPC in Engineering and Manufacturing March 26, 2014 David Pellerin, Business Development Principal Amazon Web Services David Hinz, Director Cloud and HPC Solutions

More information

Visualization à la Unix TM

Visualization à la Unix TM Visualization à la Unix TM Hans-Peter Bischof (hpb [at] cs.rit.edu) Department of Computer Science Golisano College of Computing and Information Sciences Rochester Institute of Technology One Lomb Memorial

More information

Collaborative modelling and concurrent scientific data analysis:

Collaborative modelling and concurrent scientific data analysis: Collaborative modelling and concurrent scientific data analysis: Application case in space plasma environment with the Keridwen/SPIS- GEO Integrated Modelling Environment B. Thiebault 1, J. Forest 2, B.

More information

COMPLEX DATA VISUALIZATION. 15/01/2015 CEA DSM Irfu - Daniel Pomarède - COMPLEX DATA VISUALIZATION

COMPLEX DATA VISUALIZATION. 15/01/2015 CEA DSM Irfu - Daniel Pomarède - COMPLEX DATA VISUALIZATION COMPLEX DATA VISUALIZATION 15/01/2015 CEA DSM Irfu - Daniel Pomarède - COMPLEX DATA VISUALIZATION 1 COMPLEX DATA VISUALIZATION a software project established in the context of the COAST «Computational

More information