images for paper
DESCRIPTION
Images for paper. By shooting. Sample collection. Hard/Soft vertical touch. timer. 5. Finger touch position. Background Subtraction. Normalization. Difference of Gaussian. Binary. Finger Analysis. Background Subtraction. Normalization. Approximate DoG. Binary. Finger Analysis. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/1.jpg)
Images for paper
By shooting
![Page 2: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/2.jpg)
2
Sample collection
• Hard/Soft vertical touch
Finger touch position
5
timer
![Page 3: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/3.jpg)
3
BackgroundSubtraction Normalization Simple
HighpassMono Threshold
BackgroundSubtraction Normalization Difference of
Gaussian Threshold
Normalization Difference of Gaussian
Background Subtraction Binary Finger Analysis
Normalization Difference of Gaussian
Background Subtraction Binary Finger Analysis
Normalization ApproximateDoG
Background Subtraction Binary Finger Analysis
![Page 4: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/4.jpg)
4
ImageFusion(Blend)
IR Camera
IR camera
Undistortion
Undistortion
HomoWarp
HomoWarp
ImageFusion
(Stitching)
IR Camera
IR camera
Undistortion
Undistortion
HomoWarp
HomoWarp
![Page 5: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/5.jpg)
5
DetectionModule Verify Next Parameter Set
Generator
DetectionResult
GroundTruth
Error RateParameter Set
Parameter Set
Parameter Set’
![Page 6: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/6.jpg)
6
![Page 7: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/7.jpg)
7
Detection systemSampleset
Training
Parameter Set
Detection Result
GroundTruth
OptimalParameter
Set
![Page 8: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/8.jpg)
8
VerifyNext Parameter Set
Generator
DetectionResult
GroundTruth
Error Rate
![Page 9: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/9.jpg)
9
Detection systemSampleset
Training
Parameter Set
Detection Result
GroundTruth
OptimalParameter Set
VerifyNext Parameter Set
Generator
DetectionResult
GroundTruth
Error Rate
Parameter Set
![Page 10: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/10.jpg)
10
![Page 11: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/11.jpg)
11
![Page 12: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/12.jpg)
12
Detection systemTest set
Optimal parameter finder
Parameter Combination
Detection Result
Optimal Parameter Combination
Ground truth(Trace)
VerifyNext Parameter Set
Generator
DetectionResult
GroundTruth
# of miss & # of false alarm
Parameter Combination
Optimal parameter finder
![Page 13: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/13.jpg)
Applicable Parameters Determinator
Parameter Combination
Detection Result
Applicable set of Parameters
TestSet
Touch Data
Ground truth(Trace)
Detection System
![Page 14: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/14.jpg)
14
frame 1
frame 2
miss frame 1
frame 2
False alarm
miss
![Page 15: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/15.jpg)
15
frame 1
frame 3
frame 2 frame 1
frame 3
frame 2
frame 3False alarm
miss
![Page 16: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/16.jpg)
16
frame 1
frame 1
False alarm
![Page 17: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/17.jpg)
17
Undistortion
![Page 18: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/18.jpg)
18
Dead zone
![Page 19: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/19.jpg)
19
![Page 20: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/20.jpg)
20
ImageStiching
FingerDetection
Finger Tracking
![Page 21: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/21.jpg)
21
Image blend
![Page 22: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/22.jpg)
![Page 23: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/23.jpg)
23
Hardware configuration
• Order of diffuser layer and touch-glass layer
Diffuser layer
IR illuminatorIR camera
spot
IR illuminatorIR camera
Touch-glass layer
IR camera
spot
IR camera
![Page 24: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/24.jpg)
24
Modified by 510
• Order of diffuser layer and touch-glass layer
Diffuser layer
IR illuminatorIR camera
spot
IR illuminatorIR camera
Touch-glass layer
IR camera
spot
IR camera
2
1
4 3
![Page 25: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/25.jpg)
Sampling
Measure
1 1( | )t tP X Z
1( | )t tP X Z
( | )t tP X Z
![Page 26: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/26.jpg)
INITIALIZE PARTICLES
PARTICLE GENERATION
WEIGHT COMPUTATION
1 2 M
1 2 M
NORMALIZE WEIGHTS
More iteration
Over l imited iteration
RESAMPLING
OUTPUTNo
Yes
Yes
No
……
……
PARTICLE GENERATION
WEIGHT COMPUTATION
![Page 27: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/27.jpg)
5 2
16
2 5
43
1
4
3
6
VSLH VS
RH
2
5
![Page 28: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/28.jpg)
5 2
16
2 5
43
1
4
3
6
VSLH VS
RH
2
5
![Page 29: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/29.jpg)
INITIALIZE PARTICLES
Particle Generation
Weight Computation
1 2 M
1 2 M
Normalize Weights
Mo re I te ra t ion
Over
Resampling
OUTPUTNo
Yes
Yes
No
![Page 30: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/30.jpg)
VSLH
![Page 31: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/31.jpg)
![Page 32: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/32.jpg)
![Page 33: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/33.jpg)
(2) IR Camera
(3) IR Illuminator
(1) Peripheral Projector
![Page 34: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/34.jpg)
![Page 35: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/35.jpg)
Optimal Parameter Finder
Finger Detection System
Interface
![Page 36: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/36.jpg)
GPU
Direct3D
HLSL
Dshow
![Page 37: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/37.jpg)
GShow DirectShow
HomoWarp ImageFusion
BackgroundSubtraction Normalization Difference
of Gaussian Binary FingerAnalysis
Multi-touch Finger Detection System
GShow DirectShow
HomoWarp ImageBlending
BackgroundSubtraction Normalization Difference
of Gaussian Binary FingerAnalysis
Multi-touch Finger Detection System
![Page 38: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/38.jpg)
Normalization Difference of Gaussian
Background Subtraction Binary Finger Analysis
![Page 39: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/39.jpg)
![Page 40: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/40.jpg)
![Page 41: Images for paper](https://reader036.vdocuments.site/reader036/viewer/2022062310/56816736550346895ddbe66a/html5/thumbnails/41.jpg)
Subtract value
Smooth kernel Threshold Finger size
Low bound 0 7 10 15
Step 3 2 3 9
High bound 15 17 25 60
RGBTo Gray
Background Subtraction Normalization Approximate
DoG Threshold
Frame per second 410 385 400 400