real-time range imaging by phase-stamp method using correlation image sensor
DESCRIPTION
Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor. Akira Kimachi 1 and Shigeru Ando 2 1 Osaka Electro-Communication University, Japan 2 The University of Tokyo, Japan. Active Range Imaging. Active range imaging — Image sensor + Active l ight - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/1.jpg)
January 29, 2007 Videometrics IX, Electronic Imaging 2007, San Jose, CA, U.S.A.
Real-Time Range Imaging by Phase-Stamp Method
Using Correlation Image Sensor
Akira Kimachi1 and Shigeru Ando2
1Osaka Electro-Communication University, Japan 2The University of Tokyo, Japan
![Page 2: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/2.jpg)
Active Range Imaging• Active range imaging — Image sensor + Active light
– Time-of-flight methods– Triangulation methods
# of frames (scans)
Interpixel image processing
Image intensity-dependence
Light spot Many None Yes
Light stripe Many Stripe detection Yes
Time stamp light stripe
1 None Yes
Structured light 1 Fringe detection
Fringe order
Yes
Phase-shifting structured light
3-4 or more None No
![Page 3: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/3.jpg)
DepthScan angle of sheet beam ijStripe image location ),( ji
Light Stripe Range Finder (LSRF)
![Page 4: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/4.jpg)
Time Stamp LSRF (TSRF)
• Frame-rate operation• Pixel-wise sensing
– One image for one beam scan– Record a “Time Stamp” for lig
ht stripe arrival at each pixel
• “VLSI silicon range finder”– Gruss et al. (1991)– Kang et al. (1994)– Yokoyama et al. (1994)
ijzdepth
ij
beamangle
ijt
timestamp
![Page 5: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/5.jpg)
TSRF
threshold
threshold
LSRF
Effect of Spatially Nonuniform Reflectance/Background
• Intensity-dependent detection of light stripe causes errors in LSRF and TSRF
nonuniformsurface reflectance
nonuniformbackground illumination
nonuniformsurface reflectance
nonuniformbackground illumination
![Page 6: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/6.jpg)
Objectives
• Goal — Real-time active range imaging– Frame-rate operation– Pixel-wise sensing (image processing error-free)– Robustness to spatial nonuniformity in
• Surface reflectance• Background illumination
• Solution — Phase-Stamp Range Finder (PSRF)– Three-Phase Correlation Image Sensor (3PCIS)– Detect the sheet beam angle by “phase stamp”
![Page 7: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/7.jpg)
Three-Phase Time-Domain Correlation Image Sensor (3PCIS)
temporalcorrelation
S. Ando and A. Kimachi,IEEE Trans. ED (2003)
averageintensity
![Page 8: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/8.jpg)
Phase-Stamp Range Finder (PSRF)
• Three-phasereference signals
0f : Frame rate
),( ji
: Object surface reflectance
: Sheet beam intensity
: Background light intensity
ijR
ijI
)(tI bgij
: Arrival time of light stripeijt
• Image intensity at
![Page 9: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/9.jpg)
Phase-Stamp Imaging(1) Sheet beam arrives
(2) Phase stamped
(3) Converted to beam angleone scan
one image
![Page 10: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/10.jpg)
Real-Time Range Imaging by PSRF
3PCIS output
Phase stamp
Total light image
Sheet beam image
Range image
Beam angle imageknown functionby design
• Frame-rate range imaging• Pixel-wise beam angle detection• Robust to spatially nonuniform reflectance/background
Phase stamp imageuncorrelated to
)(tgk
![Page 11: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/11.jpg)
3PCIS Output Images in PSRF
• Sheet beam-only intensity image
• Total light intensity image
: Surface reflectance
: Sheet beam intensity
: Background intensity
ijR
ijI
)(tI bgij
0
/2
/2
• Phase stamp image
![Page 12: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/12.jpg)
Experimental PSRF System• 3PCIS camera
– 200x200 pixels– Frame rate @12.5 fps
• Sheet beam– 7 mW laser diode– Cylindrical lens– Scanning mirror
@25 scans/s
• Reference signals– PC + D/A board– @50 Hz
• Camera and geometry calibration– Based on Zhang’s meth
od
Referencesignals
Sheet beamangle
![Page 13: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/13.jpg)
Real-Time 3D Video Capture
Phase stampTotal light intensity Sheet beam intensity
![Page 14: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/14.jpg)
3D Imaging Examples
left thumb & palm
cone-shaped surface
23 mm
17 mm
40 mm40 mm
![Page 15: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/15.jpg)
3D Measurement Accuracy• Flat object @540 mm from the camera
phase stamp total lightsheet beam
Phase Std. dev. 4.08 deg
DepthStd. dev. 2.35 mm
Syst. error -1.96 mm
0
/2
/2
3D surface plot
![Page 16: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/16.jpg)
Nonuniform Background Illumination
Background absent striped
Std. dev. [mm] 2.35 3.11
Syst. err. [mm]
-1.96 -1.85
phase stamptotal light sheet beam
![Page 17: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/17.jpg)
Nonuniform Surface Reflectance
Reflectance uniform striped
Std. dev. [mm] 2.35 2.39
Syst. err. [mm]
-1.96 -1.62
phase stamptotal light sheet beam
![Page 18: Real-Time Range Imaging by Phase-Stamp Method Using Correlation Image Sensor](https://reader035.vdocuments.site/reader035/viewer/2022062518/568145f5550346895db2fb0e/html5/thumbnails/18.jpg)
Conclusions
• Phase-stamp range finder using the 3PCIS– Frame-rate operation– Pixel-wise sensing– Robustness to spatial nonuniformity in
• Surface reflectance• Background illumination
• Evaluation by an experimental system– Real-time range imaging @12.5 fps– Accuracy (@540mm)
• Deviation — 2.35 mm → fixed pattern noise (~4 deg) removal
• Systematic error — -1.96 mm → geometry calibration