Advanced 3D Visualization with Avizo Using LabVIEW Data

Transcription

1 Advanced 3D Visualization with Avizo Using LabVIEW Data Shawn Zhang & Patrick Barthelemy VSG - Visualization Sciences Group August 3,

2 Agenda 3D Visualization Needs from LabVIEW Users Avizo Values Case Studies and Demos 3D medical imaging Using LabVIEW-Avizo integration bridge (prototype) 3D bridge structure analysis 4D reservoir thermo analysis Concluding Remarks 2

3 3D Visualization Needs from LabVIEW Users: Continuing explosion of data size due to enhanced data acquisition capabilities Growing needs on comparing and fusing data from difference sources Increasing appetite on interactivity and performance 3

4 Sample LabVIEW customer requests: Texture mapping (Obastat solved in 8.2) Edge visibility when lighting is on. Need to overlap solid and line (nilak) Rotating performance of points as an elevated surface (Chilly Charly) Source: LabVIEW Discussion Forum 4

5 Avizo Application Framework aviso noun, a boat used esp. for carrying dispatches; dispatch boat. [Origin: ; < Sp, n. deriv. of avisar to advise ] Dictionary.com Unabridged (v 1.1) Based on the Random House Unabridged Dictionary, Random House, Inc Aviso \A*vi"so\, n. [Sp.] 1. Information; advice. 2. An advice boat, or dispatch boat. Webster's Revised Unabridged Dictionary, 1996, 1998 MICRA, Inc. 5

6 Avizo Key Values Advanced framework for 3D data visualization & analysis Perfect fit for researchers, engineers Quick data inspection and analysis with ease-of-use GUI State of the art rendering techniques (based on Open Inventor) Combine multiple data sources, very flexible 3D data analysis workflow: 3D data fusion, registration, quantification, geometry segmentation and reconstruction, simulation data post-processing Powerful presentation and collaboration support Ready-for-use from laptop, desktop to VR system Application framework: customizable and extensible Geobench, INRIA/I3D, data courtesy of CEA 6

7 Avizo: One-stop visualization 3D imaging CT scan, MRI, PET, microscopy, FIB/SEM, ultrasound Seismics, GPR, EMR 3D models/scenes Hierarchical CAD models, NURBS, textures, bump, shaders, advanced transparency 3D point sets Laser surface scanners, CMMs 3D simulation FEA, CFD, MHD, multi-physics, molecular dynamics Transient 3D animations videos, sounds 7

8 Avizo in materials science and NDT Electronics/semiconductors, composite materials, metallic foams, metallurgy, nanotechnology, powders, films, fibers, food and seeds, building materials, rocks, material characterization, performance/process, nanometric measurements, surface analysis, corrosion, fatigue, QC, non destructive testing, industrial CT, tomography Image: B. Connolly - U. Birmingham Risø Image: Prof. D. Bernard - ICMCB Bordeaux D. Bernard - ICMCB 8

9 Avizo in Computer Aided Engineering Image to simulation, structural analysis, aerodynamics analysis, crash analysis, engineering design review, reverse engineering 9

10 Avizo in oil & gas, and geosciences Seismics/geophysics, petrography/geology, core sample, borehole, GPR, EM resistivity Vista Centre Birmingham Data courtesy: PGS Courtesy: U. Minnesota 10

11 Avizo in other social and physical sciences Earth Sciences, climatology, oceanography, environment, chemistry / molecular dynamics, archaeology, heritage, paleontology, geophysics, geology, astrophysics, science museums Courtesy: Albert Einstein Institute 11

12 Avizo: graphical programming 12

13 Case Study 1: 3D imaging 256x256x100 mouse tendon imaging data Source: LabVIEW Discussion Forum User AntLee29, 13

14 Open challenges for 3D image data Noise 3D rendering efficiency and interactivity Forum user Ben : With the FP open it took about 38 minutes on a 2GHz laptop with 1G memory. With the FP closed, the code runs in about a minute! Zooming, dragging and rotating also takes about a minute. Rendering quality Anatomy segmentation Geometry reconstruction Tissue measurement and statistics 14

15 The LabVIEW-Avizo Interface Use LabVIEW s text object and command object to create Avizo script and launch Avizo process. Avizo and LabVIEW threads are independent Users can control Avizo interactively within LabVIEW VI 15

16 Challenges addressed: Noise removal, Rendering quality, and Rendering interactivity LabVIEW data is filtered with a few noise removal algorithms, and rendered with high-quality (lighting and transparency), level-of-detail (for large data) based volume rendering at interactive frame rate on a laptop. 16

17 Challenges addressed: Anatomy Segmentation, Geometry reconstruction and tissue quantification Layers of tissues are segmented, reconstructed, and measured both in terms of geometry probes (annotated in upper part of the 3D window) and tissue statistics (the speadsheet window at lower right). Different tissues are visualized with different color code. The geometry can be used directly in FEA/CFD solvers for stress, flow, heat transfer analysis, which can be covisualized inside Avizo afterwards. 17

18 Case Study 2: structural analysis 3D bridge data generated by a simulated model at resonant frequency, which is then validated and calibrated using accelerometers, strain gages and displacement sensors. The experimental data is captured and pre-processed with LabVIEW, using data acquisition boards (DAQ) and signal conditioning modules (SCXI) data points in the simulated model, each carries x,y,z coordinates and two vectors representing two modes of displacement. Corresponding CAD geometry and simulation data is obtained using Abaqus FEA software CAD geometry in VRML format with 63,000 triangles. Data Courtesy: National Instrument 18

19 Open challenges Federating 3D CAD, point cloud measurement and volumetric simulation data Mode 1 Mode 2 19

20 Sensor location and CAD geometry co-visualization 20

21 Data derivation Sensor locations are colored by mode1 displacement magnitude, or any scalar field 21

22 Data clipping Multiple clipping plane can be activated to see inside the volume. 22

23 Volume data reconstruction from sensor cloud 3D volumetric data is reconstructed from the point cloud sensor data, and volume rendered, in this case, using displacement magnitude in mode 2. 23

24 Volume visualization: slicing and isosurfacing 24

25 Advanced vector visualization: LIC Displacement vector on bridge surface is visualized using line integral convolution (LIC). 25

26 Advanced vector visualization: vector glyphs Mode 2 displacement vector on bridge surface is visualized using LIC and vector glyphs. 26

27 Measurement, probing and statistics 27

28 Displacement simulation: Mode 1 28

29 Displacement simulation: Mode 2 29

30 Customer animation 30

31 Case Study 3: geophysics 3x5x6 3D thermocouples sensor array, capturing heat changes within a 3D model time steps of transient scalar data. Data courtesy, Kelly Knorr, Ryan Wilton and Barry Trapp of Saskatchewan Research Council, Canada. 31

32 Transient data visualization Time 32

33 Projects under discussion Real-time LabVIEW Avizo Interaction Large amount of transient data GPU acceleration 33

34 ETH: The need for 3D visualization of large data sets generated by Real Time Sampling Proposed Application #1: Networked Cube Satellite Constellation (100 Satellites) Each satellite utilizing EHT Remote Data Acquisition and Telemetry Pack (RATPAC) RATPAC is a low cost, low power and small volume onboard computer for CubeSats Up to 8 channels, 10 bit ADC, 10Ksps for each satellite. Controlled by Arm 7 utilizing LabVIEW Embedded. Onboard GPS and 2-way telemetry link using ZigBee or similar. Satellites are networked and all data is transmitted to ground station with active telemetry link. Ground station telemetry link acquires data for each satellite.(position, Velocity, Sensor Data) Courtesy, Eagle Harbor Technologies, INC 34

35 The need for 3D visualization of large data sets generated by Real Time Sampling Earth Downlink Cubesat Cross-link Courtesy, Eagle Harbor Technologies, INC 35

36 The need for 3D visualization of large data sets generated by Real Time Sampling Need: Acquire and process data in real time. Generate 3D visualization of data. (ie, Satellite Position, Senor Data) Enables real time user or control loop tasking of satellites with ground based computational resources not available on each small satellite. Satellite constellation now can act in coordinated manner providing low cost and redundant system with very high performance capabilities. Example applications. (In Space Telescopes and Radar Systems) Courtesy, Eagle Harbor Technologies, INC 36

37 The need for 3D visualization of large data sets generated by Real Time Sampling Proposed Application #2: Real Time, 3D Visualization and Modeling of Wind Tunnel Data Example: Kirsten Wind Tunnel at University of Washington Approximately 100, 10 Bit ADC channels, 100 Hz Sampling Frequency Data collected using 3 rd party hardware with LabVIEWcontrol software Current Data Collection and Display Process: Sensors ADC LabVIEW Processing and Storage of Data In House Visual Basic Script Courtesy, Eagle Harbor Technologies, INC Real Time 2D Plotting 37

38 The need for 3D visualization of large data sets generated by Real Time Sampling Optimum Data Collection and Display Process: Sensors ADC LabVIEW with Avizo LabVIEWData and Signal Processing GPU Accelerated Real Time 3D Display This process can also support real time numerical modeling (ie. CFD) with active empirical data feedback and control -an application currently desired by the DOD. It would provide an unprecedented level of aerodynamic modeling. Modeling routines will be integrated onto GPU (by EHT) for real time, massively parallel numerical simulations with 3D visualization supported by Avizo. Courtesy, Eagle Harbor Technologies, INC 38

39 SUNY-Buffalo NI cameralink board and LabVIEW based conebeam computed tomography (CBCT) system 3D geometry reconstruction and carotid tortuosity calculation Multiple coronary angiograms acquired by CBCT Courtesy: Dr. Kenneth R. Hoffmann, Professor, Department of Neurosurgery, University at Buffalo, SUNY CFD simulation and visualization 39

40 SRC Canada NI thermal couple sensor Real-time Avizo/LabVIEW interface SRC heat transfer simulation code developed with Avizo Simulation data post-processing and co-visualization with experiments Data courtesy: Kelly Knorr, Ryan Wilton and Barry Trapp of Saskatchewan Research Council, Canada. 40

41 Avizo/LabVIEW integration: 3 stages Disk-data based, post-processing bridge Script based co-processing bridge. Continue improvements Address-space based, co-processing bridge. Solicitate further interests for three-party joint effort 41

42 Concluding Remarks 3D visualization is becoming more important in LabVIEW applications. Avizo is a good complimentary tool to enhance LabVIEW s 3D capability, Avizo s graphical programming diagram fits well with LabVIEW convention, hence easier to adapt by LabVIEW developers. It is possible to extract visualization and data analysis tasks that are common to a category of LabVIEW applications. LabVIEW users will be able to take advantage of advanced 3D visualization and data analysis capabilities without re-inventing the wheel. 42

43 Concluding Remarks National Instrument and VSG are looking forward to working with LabVIEW users to meet their visualization challenges. 43

44 Thank you. LabView is a trademark of National Instruments, Corp. Avizo is a registered trademark of VSG, Visualization Sciences Group, SAS 44

45 LabVIEW/Avizo co-processing bridge 1. DLL (Call library function node) approach 2. CIN (Code interface node) approach LabVIEW call an external algorithm (C++) The external algorithm serves as a broker with Avizo customer module to communicate data Avizo customer module talk to the broker to check the data availability 3. ActiveX approach LabVIEW as ActiveX server Experience exists on both side (Avizo/visilog integration) 4. TCP/IP approach 45

46 NI 3D Capabilities Review 3D Graph Control ActiveX container interface Points/line/surface/parametric, pan/zoom/rotate, lighting/shading/ transparency/wireframe, contour, plane projection, Cartesian/polar/cylindrical coordinates, orthographic/perspective viewing, axis scals and labels. OpenGL 3D Picture control VRML/STL/ASE format OpenSceneGraph 3D Sensor mapping NI Insight DIAdem 46

47 Avizo: Open Framework Allow programmer to develop new modules File readers File writers Modules for visualization Modules for processing data Additional custom GUI elements (Qt) Integrate existing code C++ extension interface Comprehensive Avizo API, classes, including Open Inventor API Rapid development with wizard New Module Standard Edition Developer Edition 47

48 Avizo: Open framework for automation TCL scripting interface Scripting Script object Template C++ interface , Mercury Computer Systems

49 Avizo: Open framework for co-processing The MathWorks Inc. Matlab software LabVIEW More to come MATLAB is a registered trademark of The MathWorks, Inc , Mercury Computer Systems