Visualization of the Blood flow and the Stress distribution with the Diagnostic Support System for Circulatory Disease in the Volume Communications Environment Authors: Masahiro Watanabe*, Motoi Okuda**, Teruo Matsuzawa*** Speaker: Masahiro Watanabe** *m-wata@jaist.ac.jp, Center for Information Science, Japan Advanced Institute Science and Technology **o-motoi@jaist.ac.jp, Japan Advanced Institute Science and Technology and Fujitsu Limited *** matuzawa@jaist.ac.jp, Center for Information Science, Japan Advanced Institute Science and Technology 1
Today s Contents Introduction BackGround Diagnostic support system for circulatory disease Advantage of Volume Communication Environment Purpose Method Schematic View of Volume Communication Environment Generation of three dimension data Visualization for the handling data Results Summary and Future Works 2
Introduction As interdisciplinary collaborative research has become more common, the demand for high quality collaboration support environments has intensified. In addition, the fact that researchers and experimental facilities are now dispersed globally also has increased the need for remote collaboration capabilities. VizGrid Project have constructed the tele-immersive environment. And, to confirm the effectiveness our system, we executed by a diagnostic support system for circulatory disease based on the volume communication [1] [1]Construction of a diagnostic support system for circulatory disease, M. Okuda, M. Watanabe, T. Matsuzawa, Proc. the 5th IEEE International Symposium on Cluster Computing and the Grid 2005, (CDROM), (2005) Our system is based on handling three dimensional data, i.e. an integrated environment consisting of a data archiving system, a collaboration system, and a computational grid system With this system, it becomes easy for researchers in remote locations to collaboratively discuss the relevant object, even for complex explanations like the simulation results or the data for medical treatment 3
BackGround: Grid Project and Collaboration One of the three great challenges in the multimedia field is construction of a high presence remote collaboration environment[5] [5]ACM SIGMM Retreat Report on Future Directions in Multimedia Research, L. A. ROWE, R. JAIN, ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 1, No. 1, 2005. Related Collaboration Project AccessGRID: Multicast communication videoconferencing environment that uses grid. The system for the collaboration is developed on the grid The Office of the Future, Ramesh Raskar et al. : Concept (The Office of the Future) that makes the achievement of the high presence communications environment a target, displays 3D person image made from the TV camera image mutually between two points, and the commutation is proposed Related works Medical Grid Project @neurist BIRN Biomedical Informatics Research Network Project BIRN Project is offering the display tool of the medical treatment data GEMSS Project A geometrical simulation and the fluid simulation were used for the patient Our plan The collaboration system that can discuss it while sharing the data for medical treatment is constructed and verified Discussion object generates from simulation result of the diagnostic support system for Circulatory Disease 4
Diagnostic support system for circulatory disease Real-time Collaboration for Extraction of Vessel Wall Real-time Collaboration for Analysis of Simulation s s Results Medical Data MRI/CT CAD Data Researcher (Homodynamics) Radiologist Kanazawa Medical Univ Image based diagnosis Verification of results Simulation Result JAIST Simulation Result Extraction Confirming shape of blood vessel Verification of results Simulation Result Real-time Collaboration for Combination Simulation Mesh generation Coupling analysis JAEA Flow in Aortic Arch with Aneurysm : Simulation by Coupling Analysis Flow in Coronary with Stenosis Simulation by Voxel Coupling Analysis 5
Advantage of Volume Communication (1/2) Visualizing of 3D data for medical treatment enables the following Rotation and change in viewpoint Cutting of volume data Inside View Rotation, Outside View of simulation data Upper View Inside View Cut, Volume Rendering 6
Advantage of Volume Communication (2/2) Eye contact Pointing operation Conjugate gaze Participant's image is displayed in the direction of the front. Therefore, who you talk to is not understood at all. And The relation between the participant and the object is not understood. In the volume communications, each object including the participant is expressed by three dimensions, the expression by each participant's aspect can be obtained respectively. The The expression between objects becomes accurate by by 3D 3D image image important function in in communications 7
Purpose We would like to visualize the data for medical treatment on the VC environment, and verify the display result We would like to share three dimensional image of human as three dimensional data and simulated data on the system and the system have a visualization system for medical treatment 8
Specification of Volume Communication Environment 9
Schematic View of Volume Communications Environment A schematic view of the volume communication system This system has four components: volume data generation, synchronized multi volume data transmission, volume data allocation in virtual collaboration space and volume data visualization This system can unitedly manage 5 data : image of human as three dimensional data, 3D data reconstructed from MRI/CT images, Shape of Blood vessel reconstructed from the images, simulation data These data type are voxel data (Volume data) In addition, we developed I/F for the commercial software of visualization Therefore, As a result, visualizing the data of unstructured mesh became possible Shape restoration Voxel generation Extract aorta Voxel Coloring Voxel generation Simulation Encoding transmission Encoding transmission Encoding transmission Encoding transmission Common format Synchronous node Arrangement information (Position, Direction, Size) Decryption 復 号 化 reception 受 信 Decryption reception Decryption reception Decryption reception Volume overlay function Rendering Operation Extract aorta Simulation Visualized simulation data by commercial software Encoding transmission Generation of Volume Data Data Transmission Visualization and Placement 10
Generation method of three dimension data All the simulations use the shape restructured with CT/MRI that takes a image of the patient To unite formats for rendering, All the generated simulation data is converted into voxel data Data of unstructural grid (shape data, simulation data) is converted into the voxel data by the interpolating calculation Resolution of all data is 256 256 256, 128 128 128 3D data constructed from CT/MRI images Simulation data Shape of blood vessel reconstructed Simulation data (Simple Coupling Analysis) from CT/MRI images 11
Visualization method for the handling data 3D data reconstructed from MRI/CT images Volume Rendering with changing in color map (Arrangement of color pattern and permeability) Shape of blood vessel reconstructed from MRI/CT images Volume Rendering Simulation data Volume Rendering Contour: Wall shear stress, Pressure, Magnitude of Velocity components, Stress in the vessel wall Rendering by Commercial Software (AVS/Express): Streamline, Particle flow, etc.. 12
Analytical objects Healthy Aorta Aortic Aneurysm Abdominal Aortic Aneurysm Aortic Dissection 13
Results 14
Display the 3D data Result Display image animation of prototype system 15
Display the 3D data (a) Side view (b) Vertical view Simulation result 16
Display the 3D data Changing in color map for CT data Simulation result:wall Shear Stress 17 Contour for Magnitude of Velocity(Anime)
Display the 3D data Magnitude of Velocity: Aortic Dissection) Contour of Stress in the wall by coupling analysis Wall Shear Stress 18
Summary and Future Works Summary We have visualized the data for medical treatment on the VC environment, and were able to obtain the display result The data for the medical treatment can be accuracy visualized : CT data, Velocity, Stress, etc. For CT data, we can change the color map on VC environment The environment have I/F for commercial software of visualization. Therefore, the user can choice the method for visualization: Contour, Streamlines, Particle flow. The frame rate for the participant is from 4.0 to 5.0 [fps]. The frame rate for the data is from 0.5 [fps] to 1.0 about the resolution 256 256 256 and the polygon data from the visualization data Future works We would like to improve the VC environment that have function of sharing viewpoint because the person expression of a high resolution is possible, and the pointing function And we would like to improve the frame rate We will experiment by using an actual network in the near future Thank you for your attention. Web Page http://www.vizgrid.org/en/ E-mail vg-sec@jaist.ac.jp 19