![Page 1: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/1.jpg)
Applied Anatomical Diagnostic Framework for Visualizing the
Human Body in a 3-D, Immersive, Navigable and
Interactive VR Environment
May 4, 2012Steven Beaudoin, BS
George D. Lecakes Jr., MSTony Aita, BS
Lawrence Weisberg, MDMichael Goldberg, MD
Vijay Rajput, MDShreekanth Mandayam, PhD
![Page 2: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/2.jpg)
Contributing Authors
Steven Beaudoin
George Lecakes, MS
Shreekanth Mandayam, PhD
Michael Goldberg, MD
Vijay Rajput, MD
Lawrence Weisberg, MD
![Page 3: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/3.jpg)
Overview
• Background• Objectives• Approach• Results• Future Goals• Conclusions• Acknowledgements
![Page 4: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/4.jpg)
-US Department of Education, 2010
“ To consider integration of 21st century competencies, expertise, such as critical thinking, complex problem solving, collaboration, multimedia communication, and technological competencies demonstrated by professional disciplines”
Cooper Medical School
![Page 5: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/5.jpg)
CAVE® at Medical School
• Basic anatomy
• Clinical correlation
• Systems based practice educational tool
• Simulation scenarios (simulated patients / conditions)
![Page 6: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/6.jpg)
BackgroundThe Rowan University CAVE®
![Page 7: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/7.jpg)
BackgroundThe Rowan University CAVE®
• 7.5'h x 10'w x 10'd tracked virtual environment covering 3-walls and a floor
• 4- active stereo DLP projectors, 3,000 ANSI lumens, 1400x1050 resolution, with short-throw zoom lens
• CAVE® structure fabricated with extruded & powdercoated 80/20 aluminum,
• 8-camera WorldViz IR position tracking system• CrystalEyes® active shutter glasses• 6 - PC computer cluster• WorldViz Vizard, Autodesk 3D Studio Max /
Maya
![Page 8: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/8.jpg)
Objectives
• Provide intuitive correlation of clinical information
• Utilize a CAVE® virtual reality (VR) environment to enhance viewing of data sets
• Ask “what if?” questions and simulate multiple scenarios for pathological/anatomical diagnosis
• Utilize multiple diagnostic imaging procedures for prognostic capability
![Page 9: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/9.jpg)
Approach
Data preparation
• CT- dataset of volunteer torso from the skull to the pelvis
• Consisted of 909 images at 1mm slices
• Provided in DICOM data format with each image having a different window center and window width
Data Preparation
Data Preprocessi
ng
Data Visualizatio
nReal-Time Processing
![Page 10: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/10.jpg)
Approach
Data preprocessing
• Utilize image processing tool (MATLAB) to convert images into a standard window center and window width
• Converted the various ranges into standard grayscale range (0-255)• 0 – Black• 255 – White
• Export images to CAVE compatible file format (tga,png,jpeg)
Data Preparation
Data Preprocessi
ng
Data Visualizatio
nReal-Time Processing
![Page 11: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/11.jpg)
Approach
Data Preparation
Data Preprocessi
ng
Data Visualizatio
nReal-Time Processing
Raw data
Processed Data
![Page 12: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/12.jpg)
Approach
Data Visualization
• Load images (textures) sequentially
• Textures are applied to a series of evenly spaced polygonal planes
• Each plane represents one cross-sectional slice of patient data
• Images are given transparency
• Images are rendered back to front Data
PreparationData
Preprocessing
Data Visualizatio
nReal-Time Processing
![Page 13: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/13.jpg)
Approach
Pixel Values
• Values from a CT scan represent different densities
• Radiolucent regions are low density – air
• Radiodense regions are higher density – bone
Data Preparation
Data Preprocessi
ng
Data Visualizatio
nReal-Time Processing
![Page 14: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/14.jpg)
Approach
Data Manipulation and Interface
1. Grayscale histogram – Cull pixel values from the histogram using a range slider.
2. Pseudo-color histogram – Cull pixel values and color the ranges with red, green, or blue ranges.
3. Clip Plane Mode – Clip the polygonal planes with an OpenGL clipping plane in any orientation.
Xbox 360® Controller – All functionality mapped to buttons
Data Preparation
Data Preprocessi
ng
Data Visualizatio
nReal-Time Processing
![Page 15: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/15.jpg)
![Page 16: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/16.jpg)
Educational / Future Medical Applications
• Learn anatomy / clinically applied anatomy in 3D virtual reality
• Anatomic pathology and radiological integration
• Correlation of surface and organ anatomy for surgical procedure
• Application of 3D virtual reality to understand system based practice – e.g. Assess Home environment for safety for geriatric patient
![Page 17: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/17.jpg)
Other uses of CAVE®
![Page 18: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/18.jpg)
Work In Progress
Fuse multiple image data sets (MRI, CT, PET) to distinguish redundant and complementary information for clinically applied anatomical education
![Page 19: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/19.jpg)
Work In Progress
![Page 20: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/20.jpg)
Acknowledgments
We gratefully acknowledge the assistance of:
Dr. H. Warren Goldman, MD, PhDProfessor and Chair of Neurosurgery
Cooper Hospital, Camden, NJ
Mr. Anthony AitaNeurosurgery Department
Cooper Hospital, Camden, NJ
![Page 21: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/21.jpg)
![Page 22: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/22.jpg)
Approach
![Page 23: May 4, 2012 Steven Beaudoin , BS George D. Lecakes Jr., MS Tony Aita , BS](https://reader036.vdocuments.site/reader036/viewer/2022062521/56816781550346895ddc8ee7/html5/thumbnails/23.jpg)
Approach