visualization of the blood flow and the stress

Asian Simulation Conference 2006

1

Visualization of the Blood flow and the Stress distribution with the Diagnostic Support System for Circulatory Disease in the Volume Communications Environment

Authors: Masahiro Watanabe*, Motoi Okuda**, Teruo Matsuzawa***Speaker: Masahiro Watanabe**

*[email protected], Center for Information Science, Japan Advanced Institute Science and Technology

**[email protected], Japan Advanced Institute Science and Technology and Fujitsu Limited

*** [email protected], Center for Information Science, Japan Advanced Institute Science and Technology


2

Today’s Contents• Introduction• BackGround• Diagnostic support system for circulatory disease • Advantage of Volume Communication Environment• Purpose• Method

– Schematic View of Volume Communication Environment

– Generation of three dimension data• Visualization for the handling data

• Results • Summary and Future Works


3

Introduction• As interdisciplinary collaborative research has become more

common, the demand for high quality collaboration support environments has intensified.

• In addition, the fact that researchers and experimental facilities are now dispersed globally also has increased the need for remote collaboration capabilities.

• VizGrid Project have constructed the tele-immersive environment.• And, to confirm the effectiveness our system, we executed by a

diagnostic support system for circulatory disease based on the volume communication [1][1]Construction of a diagnostic support system for circulatory disease, M. Okuda, M. Watanabe, T. Matsuzawa, Proc. the 5th IEEE International Symposium on Cluster Computing and the Grid 2005, (CDROM), (2005)

• Our system is based on handling three dimensional data, i.e. an integrated environment consisting of a data archiving system, a collaboration system, and a computational grid system

• With this system, it becomes easy for researchers in remote locations to collaboratively discuss the relevant object, even for complex explanations like the simulation results or the data formedical treatment


4

One of the three great challenges in the multimedia field is construction of a high presence remote collaboration environment[5]

[5]ACM SIGMM Retreat Report on Future Directions in Multimedia Research, L. A. ROWE, R. JAIN, ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 1, No. 1, 2005.

Related Collaboration Project• AccessGRID: Multicast communication videoconferencing environment that uses grid. The system for

the collaboration is developed on the grid• The Office of the Future, Ramesh Raskar et al. : Concept (The Office of the Future) that makes the

achievement of the high presence communications environment a target, displays 3D person image made from the TV camera image mutually between two points, and the commutation is proposed

Related works Medical Grid Project• @neurIST• BIRN Biomedical Informatics Research Network Project

– BIRN Project is offering the display tool of the medical treatment data • GEMSS Project

– A geometrical simulation and the fluid simulation were used for the patient

Our plan • The collaboration system that can discuss it while sharing the data for medical treatment is

constructed and verified• Discussion object generates from simulation result of the diagnostic support system for

Circulatory Disease

BackGround: Grid Project and Collaboration


5

Diagnostic support system for circulatory disease

Radiologist

MRI/CT

Medical Data

ＣＡＤ Data

SimulationResult

JAISTKanazawa Medical Univ

RealReal--time Collaboration for Extraction oftime Collaboration for Extraction ofVessel WallVessel Wall

Simulation Result

Researcher (Homodynamics)

Flow in Aortic Arch with Aneurysm : Simulation by Coupling Analysis

Flow in Coronary with StenosisSimulation by Voxel Coupling Analysis

Simulation Result

RealReal--time Collaborationtime Collaboration for Analysis offor Analysis ofSimulationSimulation’’s Resultss Results

RealReal--time Collaborationtime Collaborationfor Combination Simulationfor Combination Simulation

JAEA

•Extraction•Confirming shape of blood vessel•Verification of results

•Mesh generation•Coupling analysis

•Image based diagnosis•Verification of results


6

Advantage of Volume Communication (1/2)

• Visualizing of 3D data for medical treatment enables the following– Rotation and change in

viewpoint– Cutting of volume data– Inside View

Upper View

Inside View

Rotation, Outside View of simulation data

Cut, Volume Rendering


7

Advantage of Volume Communication (2/2)

Participant's image is displayed in the direction of the front . Therefore, who you talk to is not understood at all.And The relation between the participant and the object is not understood.

Eye contact

Conjugate gazePointing operation

The expression between objects becomes accurate by 3D image

The expression between objects becomes accurate by 3D image

important function in communications

important function in communications

In the volume communications, each object including the participant is expressed by three dimensions, the expression by each participant's aspect can be obtained respectively.


8

• We would like to visualize the data for medical treatment on the VC environment, and verify the display result– We would like to share three dimensional image of human

as three dimensional data and simulated data on the system and the system have a visualization system for medical treatment

Purpose


9

Specification ofVolume Communication Environment


10

Schematic View of Volume Communications Environment• A schematic view of the volume communication system• This system has four components: volume data generation, synchronized

multi volume data transmission, volume data allocation in virtual collaboration space and volume data visualization

• This system can unitedly manage 5 data : image of human as three dimensional data, 3D data reconstructed from MRI/CT images, Shape of Blood vessel reconstructed from the images, simulation data– These data type are voxel data (Volume data)

• In addition, we developed I/F for the commercial software of visualization– Therefore, As a result, visualizing the data of unstructured mesh

became possibleVolum

e overlay function

Rendering

Synchronous node

復号化受信

Operation

Arrangement information(Position, Direction, Size)

Generation of Volume Data Data Transmission Visualization and Placement

Encoding transmission

Voxelgeneration

Common format

Decryption reception




Volume overlay function

Rendering

Synchronous node

復号化受信

Operation

Arrangement information(Position, Direction, Size)

Generation of Volume Data Data Transmission Visualization and Placement

Shape restoration


VoxelColoring

Shape restoration

Shape restoration



VoxelColoring

VoxelColoring



Voxelgeneration

Voxelgeneration

Common format

Common format








Decryption receptionExtract

aortaSimulation


Extract aorta

Extract aorta

SimulationSimulationEncoding

transmissionEncoding

transmission


Voxelgeneration



Voxelgeneration

Voxelgeneration

Extract aorta

SimulationEncoding

transmissionExtract aorta

Extract aorta

SimulationSimulationEncoding

transmissionEncoding

transmissionVisualized simulation data

by commercial software


11

Generation method of three dimension data• All the simulations use the shape restructured with CT/MRI that

takes a image of the patient• To unite formats for rendering, All the generated simulation

data is converted into voxel data– Data of unstructural grid (shape data, simulation data) is

converted into the voxel data by the interpolating calculation– Resolution of all data is 256×256×256, 128×128×128

3D data constructed from CT/MRI images

Shape of blood vessel reconstructed from CT/MRI images

Simulation data

Simulation data (Simple Coupling Analysis)


12

Visualization method for the handling data• 3D data reconstructed from MRI/CT images

– Volume Rendering with changing in color map (Arrangement of color pattern and permeability)

• Shape of blood vessel reconstructed from MRI/CT images– Volume Rendering

• Simulation data– Volume Rendering

• Contour: Wall shear stress, Pressure, Magnitude of Velocity components, Stress in the vessel wall

– Rendering by Commercial Software (AVS/Express): • Streamline, Particle flow, etc..


13

Healthy Aorta

Aortic Aneurysm Abdominal Aortic Aneurysm Aortic Dissection

Analytical objects


14

Results


15

Display the 3D data Result

Display image animation of prototype system


16

Display the 3D data

Simulation result

(a) Side view (b) Vertical view


17

Display the 3D data

Simulation result:Wall Shear Stress Contour for Magnitude of Velocity（Anime）

Changing in color map for CT data


18

Display the 3D data

Magnitude of Velocity: Aortic Dissection）

Wall Shear Stress

Contour of Stress in the wallby coupling analysis


19

Summary and Future WorksSummary• We have visualized the data for medical treatment on the VC

environment, and were able to obtain the display result– The data for the medical treatment can be accuracy visualized : CT

data, Velocity, Stress, etc.– For CT data, we can change the color map on VC environment– The environment have I/F for commercial software of visualization.

Therefore, the user can choice the method for visualization: Contour, Streamlines, Particle flow.

• The frame rate for the participant is from 4.0 to 5.0 [fps]. The frame rate for the data is from 0.5 [fps] to 1.0 about the resolution 256×256×256 and the polygon data from the visualization data

Future works• We would like to improve the VC environment that have function of

sharing viewpoint because the person expression of a high resolution is possible, and the pointing function

• And we would like to improve the frame rate• We will experiment by using an actual network in the near futureThank you for your attention.Web Page http://www.vizgrid.org/en/E-mail [email protected]

visualization of the blood flow and the stress

Documents