probe based laser diagnostics and optical image-guided ... · probe based laser diagnostics and...
TRANSCRIPT
![Page 1: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/1.jpg)
Probe based laser diagnostics and
optical image-guided interventions
and metrology
Eric Seibel
Mechanical Engineering
Human Photonics Laboratory
University of Washington, Seattle
ARPA-E Workshop, Chicago
July 23-24, 2015
![Page 2: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/2.jpg)
Receptors
Enzymes
Structures
Spatial resolution
Mo
lecu
lar
Se
nsitiv
ity
10 mm 100 mm 10 mm
mM
nM
mM
1 mm
MRI
High field MRS
X-ray CT
mCT full body
Optical
microscopy macroscopic .PET
SPECTmSPECT
Cells Glands/vessels Organ structure
Ultrasound (5MHz)0.3 mm resolution
Low molecular sensitivity
Medical Imaging
Tichauer et al., 2015
![Page 3: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/3.jpg)
Medical Imaging Attributes
• High spatial resolution (2D and 3D)
• Several methods of molecular sensitivity
– Reflectance
– Fluorescence
– Raman/CARS
– Scattering/OCT
• Wide bandwidth allows parallel channels
• High speed – video rates
• Limited depth of penetration*
• Limited field of view*
• Small size (portable)
* Overcome by
small probe-based
microscopy/endoscopy
and digital mosaicking
![Page 4: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/4.jpg)
Take Home Message
Any laser-based optical imaging
used in lab microscope studies
can be packaged into the size of an earthworm
for being field deployable
Next 30 slides show how we do this for medical imaging
![Page 5: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/5.jpg)
Problems with ultrathin & flexible
endoscopes and borescopes
• Not high image quality– Not high in both resolution and
field of view
• Not highly flexible– Fragile & Expensive
• Not integrated with laser based diagnosis & therapy
Lee, et al., 2010 J. Biophotonics
![Page 6: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/6.jpg)
SFE Animation
Animation by Mr. Duff Hendrickson, Seattle, WA, copyright University of Washington.
Rigid tip is size of grain of rice
![Page 7: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/7.jpg)
SFE Concept
Gaussian spot profile
Single mode
optical fiber
Piezo tube
scanner
Fiber scanned
at resonance
Optical
system
Reflectance/Fluorescence
light sensor/collector
Illumination
spot scan path
Spot size = wavelength / NA
NA = 0.02 Resolution = 20 mm
NA = 0.35 Resolution = 1 mm
Depth of Field (DoF)
NA = 0.02 DoF = 50 mm
SFE – Scanning Fiber Endoscope
![Page 8: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/8.jpg)
UW Scanning Laser Endoscopes
SFE – Scanning Fiber Endoscope
TCE – Tethered Capsule Endoscope
both in non-significant risk medical device studies
![Page 9: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/9.jpg)
Scanner Drive Signal
Imaging portion of drive Retrace portion of drive
No drive, settling time
Y axis is driven 90 degrees out of phase with the X axis.
During retrace drive phase is reversed (not shown) for rapid braking.
Drive amplitude can be shaped for best image quality (during calibration).
Settling time is adjusted to achieve desired frame rate.
Note: fewer spirals shown for clarity
![Page 10: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/10.jpg)
Spiral Scan Pattern
Current scanned fiber endoscopes scan in a spiral pattern starting in the center.
Spiral scan frequency is ≈ 11,000 Hertz (software corrects for any deviation).
250 spirals are used to form a 500-line image leaving 83 spirals for retrace
in a device with a 30 Hertz frame rate.
![Page 11: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/11.jpg)
Mapping Spiral Scan to Pixels
Image pixel areaIntensity sample
In central portion
of spiral multiple
samples are averaged
to form an image pixel
Samples are captured at a constant 25 MHz rate, oversampling the center.
![Page 12: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/12.jpg)
SFE System Block Diagram
Separate calibration for
each laser wavelength
reduces chromatic
distortion.
LASER
LASER
LASER Amp
Position
Sensing
Diode
PMT
PMT
PMT
Fiber
RGB
Combiner
Host Computer
Windows CPU Running
LabVIEW Control SW
Amp
Amp
Connector
SFE
Base
Station
Control
Display
Image
Display
Flexible
Probe
Calibration
Chamber
Color
Separation
System
Piezo
Drive
Amplifier
Temp
Control
FPGA Board with
Imbedded Processor &
Two Banks of Dynamic RAM
PCIexpress Interface
ADCs & DACs
Daughter Card
Disk
![Page 13: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/13.jpg)
Tethered-capsule SFE imaging human subject lower esophagus
![Page 14: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/14.jpg)
Tethered-Capsule EndoscopeSeibel et al., 2008; Carroll & Seitz, Intl. J. Computer Vision (2009)
![Page 15: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/15.jpg)
SFE in quadrant of 3.2 mm ID tube
SFE video frame showing
20 micron spatial resolution
1.2-mm SFE imaging
![Page 16: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/16.jpg)
Portable SFE System
Zhang, Nelson, & Seibel, J. Biomed Optics, 2011, 2012, & 2013.
![Page 17: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/17.jpg)
Bile duct imaging
SFE third human test**SpyGlass®, Boston Sci.*
*Complements: Dr. Anthony Bohorfoush,
Seattle Gastroenterology Associates**After biliary stones and sludge were removed
Seibel et al., Proc. SPIE, 2012
Templeton et al., GIE, 2014
![Page 18: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/18.jpg)
Delivery of Guided Interventions
Endoscopy, Pulmonology, Cystoscopy - Biopsy Angioscopy
SFE with stent retractor
in balloon catheter
Seibel, et al., Proc. SPIE 2012
Soper et al., IEEE TBME, 2010
Soper et al., IEEE TBME, 2012
SFE
SFE
balloon
![Page 19: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/19.jpg)
SFE Angioscopy of Microwire
Renal artery of live pig
McVeigh et al., 2014
![Page 20: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/20.jpg)
Angioscopy of Carotid Artery Interventions
McVeigh et al., Neurosurgery 2014
Live pig 1.5x speed Live pig 2x speed
![Page 21: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/21.jpg)
Frame Sequential Fluorescence
Spectroscopy
ScanPosition
Time
Image Scan Settling
![Page 22: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/22.jpg)
Multispectral Fluorescence Imaging
Laser
Reflectance-
Fluorescence
GI endoscope
(2 mm baby scope)
![Page 23: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/23.jpg)
Multi-Color Fluorescence & nM Sensitivity
• 3 fluorescence channel SFE
has been fabricated along
with a red reflectance
channel for grayscale imaging
and distance compensation
• Calibration standards are
used to determine 4 -10 nM
sensitivity (Yang JBO, 2014)
![Page 24: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/24.jpg)
24
Total
return light
Red/NIR
EmissionNIR PMT
Collimating
Optics
Focusing
Optic
Focusing
Optics
Blue PMT Green PMT Red PMT
488 nm
Notch
filter
495 nm
Beamsplitter
593 nm
Beamsplitter
649 nm
Beamsplitter
470/28 nm
Band pass filter
531/46 nm
Band pass filter
647 nm
Long pass filter458 nm
Long pass
filter
Blue
Emission
Green
EmissionRed
Reflectance
SFE Color Separation System-- for concurrent multi-channel detection: 3 fluorescence, 1 reflectance
![Page 25: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/25.jpg)
Multispectral SFE (in vivo mouse colon)
25
White light reflectance imaging Multispectral (RGB dye) fluorescence
Karl Storz veterinary rigid scope used to find polyps and clean the mouse colon.
Peptides (ErbB2/EGFR/CLDN-1) sprayed, 300 microMolar in 0.5 ml/each, 1.5 ml total.
After 5 minutes incubation and water rinsing, 2.1-mm multispectral SFE scope used.
![Page 26: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/26.jpg)
Endoscopic imaging challenges
• Uniform labeling
• Non-specific binding
• Lack of quantification
– Distance confounder
– Spectral overlap:
• Color mixing
• Autofluorescence
• Environment
– Photobleaching
• No digital record26
In vivo mouse colon
Arlene Smith U Michigan May 2015
![Page 27: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/27.jpg)
3D SFE Imaging
![Page 28: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/28.jpg)
SFE video-rate 2-photon fluorescence
PSF (FWHM) is 1.0 micron laterally and 7.7 microns axially
video rate calcium-indicator mapping of mouse brain activity (0.6 grams in situ)
Engelbrecht et al., Optics Express 2008
![Page 29: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/29.jpg)
SFE with Raman/CARS
contrast lipid imaging
Saar, Optics Letters 2011
![Page 30: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/30.jpg)
Excellent image quality in clinical setting
Primary brain cancer (human)
Stimulated Raman Scattering Microscopy
![Page 31: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/31.jpg)
SFE optical scattering contrast
Optical Coherence Tomography (OCT)
31
3D optical imaging with mosaicking to increase imaged fieldIn collaboration with Professor Audrey Ellerbee, Stanford University
Lurie et al., Optics Letters 2015
![Page 32: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/32.jpg)
Optical Coherence Tomography (OCT)
32Lurie et al., Optics Letters 2015 – red arrows indicate ink on paper along red dashed line
1.0 mm 2
0.2 mm
depth
OCT Mosaic
10 x 20 mm
Summed
Voxel
Projection
![Page 33: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/33.jpg)
3D optical metrology with SFE & robot
robotic
motion
Gong et al., Intl. J. Optomechatronics 2015 – Axial Stereo Application
M8 threaded hole
7-mm inner diameter 3D X-ray to 3D optical
0.4-mm average error
X-ray CT
Reconstructed image from 2 SFE frames
![Page 34: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/34.jpg)
Conclusions
SFE – A versatile, new fiber endoscope technology
• Highest image resolution for small size
• Forward-viewing to guide interventions
• Wide bandwidth (UV-visible-NIR-SWIR)
• Multimodal in 2D (reflectance & fluorescence)
• Integrated diagnosis and spectroscopy
• 3D imaging (two-photon fluor., Raman, & OCT)
• Disposable scope and tools
• Record and reconstruct
for quantitative analysis
• Future: multimodal in 3D
with mosaicking
![Page 35: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/35.jpg)
Demonstrated SFE Performance
SFE Spec
Rigid Tip Diameter [mm] ≥1.0
Rigid Tip Length [mm] 8-10
Shaft Length [m] 4.3
Viewing Direction Forward / Side demonstrated
Field of View [deg] ≤110 (air)
Resolution (microns) 1-50 (600 lines)
Depth of Field [mm] 2-50 (low NA lens)
Frame Rate [Hz] 30 @ 600 lines resolution
Image quality Low distortion
Image Modes RGB, Fluor, 2 Photon, CARS, Confocal, OCT
Use Testing In Vivo Animal + Human
University of Washington
![Page 36: Probe based laser diagnostics and optical image-guided ... · Probe based laser diagnostics and optical image-guided interventions and metrology Eric Seibel Mechanical Engineering](https://reader034.vdocuments.site/reader034/viewer/2022052611/5f0556877e708231d412787d/html5/thumbnails/36.jpg)
Contact for additional informationEric J. Seibel, Ph.D.
Research Professor
Department of Mechanical Engineering, Box 352600
University of Washington, Seattle, WA 98195
(206) 616-1486
Collaborators – Thank you!Tom Wang, Univ. of Michigan
Brian Wilson, Univ. Toronto
Fritjof Helmchen, Univ. Zurich
Sunney Xie, Harvard
Audrey Ellerbee, Stanford
INO (Quebec), Invenio-Imaging (CA), VerAvanti (WA)
Funding – Thank you!NIH-NCI/NIBIB, NSF, and industrial/academic contracts