image registration & tracking dengan metode lucas & kanade
DESCRIPTION
Image Registration & Tracking dengan Metode Lucas & Kanade. Sumber: Forsyth & Ponce Chap. 19, 20 Tomashi & Kanade: Good Feature to Track. Feature Lucas-Kanade(LK). Extraksi feature dengan metode LK ini adalah sangat populer dalam aplikasi computer vision. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/1.jpg)
Image Registration & Tracking dengan Metode Lucas & Kanade
Sumber:-Forsyth & Ponce Chap. 19, 20-Tomashi & Kanade: Good Feature to Track
![Page 2: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/2.jpg)
Feature Lucas-Kanade(LK)
• Extraksi feature dengan metode LK ini adalah sangat populer dalam aplikasi computer vision.
• Feature diekstraksi dengan mengambil informasi gradient image.
• Selanjutnya feature ini bisa dimanfaatkan untuk Image registration, yg. Selanjutnya diugnakan utk. tracking, recognition, dan lain-lain
• Pemilihan feature image yang tepat adalah sangat menentukan keberhasilan proses recognition, tracking, etc.
![Page 3: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/3.jpg)
Sejarah Perkembangan LK
• Lucas & Kanade (IUW 1981)
LK BAHH ST S BJ HB BL G SI CETSC
• Bergen, Anandan, Hanna, Hingorani (ECCV 1992)
• Shi & Tomasi (CVPR 1994)
• Szeliski & Coughlan (CVPR 1994)
• Szeliski (WACV 1994)
• Black & Jepson (ECCV 1996)
• Hager & Belhumeur (CVPR 1996)
• Bainbridge-Smith & Lane (IVC 1997)
• Gleicher (CVPR 1997)
• Sclaroff & Isidoro (ICCV 1998)
• Cootes, Edwards, & Taylor (ECCV 1998)
![Page 4: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/4.jpg)
Image Registration
![Page 5: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/5.jpg)
Penerapan metode LK
![Page 6: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/6.jpg)
Penerapan pada aplikasi:
• Stereo
LK BAHH ST S BJ HB BL G SI CETSC
![Page 7: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/7.jpg)
Penerapan pada aplikasi:
• Stereo
• Dense optic flow
LK BAHH ST S BJ HB BL G SI CETSC
![Page 8: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/8.jpg)
Penerapan pada aplikasi:
• Stereo
• Dense optic flow
• Image mosaics
LK BAHH ST S BJ HB BL G SI CETSC
![Page 9: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/9.jpg)
Penerapan pada aplikasi:
• Stereo
• Dense optic flow
• Image mosaics
• Tracking
LK BAHH ST S BJ HB BL G SI CETSC
![Page 10: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/10.jpg)
Penerapan pada aplikasi:
• Stereo
• Dense optic flow
• Image mosaics
• Tracking
• Recognition
LK BAHH ST S BJ HB BL G SI CETSC
?
![Page 11: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/11.jpg)
Derivasi RumusanLucas & Kanade
#1
![Page 12: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/12.jpg)
rumusan L&K 1
I0(x)
)('0 xI
h
xIhxIh
)()(lim 00
0
)('0 xI
![Page 13: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/13.jpg)
rumusan L&K 1
)('0 xI
h
xIhxI )()( 00
h I0(x)
I0(x+h)
![Page 14: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/14.jpg)
rumusan L&K 1
h I0(x)
I(x)
![Page 15: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/15.jpg)
rumusan L&K 1
h I0(x)
h)(
)()('0
0
xI
xIxI
I(x)
![Page 16: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/16.jpg)
rumusan L&K 1
I0(x)
h
Rx xI
xIxI
R )(
)()(
||
1'0
0
RI(x)
![Page 17: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/17.jpg)
rumusan L&K 1
I0(x)
h
RxxxI
xIxIxw
xw )(
)]()()[(
)(
1'0
0
I(x)
![Page 18: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/18.jpg)
rumusan L&K 1
h0 I0(x)
0h
I(x)
RxxxI
xIxIxw
xw )(
)]()()[(
)(
1'0
0
![Page 19: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/19.jpg)
rumusan L&K 1
1h
Rxx
hxI
hxIxIxw
xwh
)(
)]()()[(
)(
1
0'0
000
I0(x+h0)
I(x)
![Page 20: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/20.jpg)
rumusan L&K 1
2h
Rxx
hxI
hxIxIxw
xwh
)(
)]()()[(
)(
1
1'0
101
I0(x+h1)
I(x)
![Page 21: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/21.jpg)
rumusan L&K 1
1kh
Rx k
k
x
k hxI
hxIxIxw
xwh
)(
)]()()[(
)(
1'0
0
I0(x+hk)
I(x)
![Page 22: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/22.jpg)
rumusan L&K 1
1kh
Rx k
k
x
k hxI
hxIxIxw
xwh
)(
)]()()[(
)(
1'0
0
I0(x+hf)
I(x)
![Page 23: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/23.jpg)
Derivasi RumusanLucas & Kanade
#2
![Page 24: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/24.jpg)
rumusan L&K 2
• Sum-of-squared-difference (SSD) error
E(h) = [ I(x) - I0(x+h) ]2x R
E(h) [ I(x) - I0(x) - hI0’(x) ]2x R
![Page 25: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/25.jpg)
rumusan L&K 2
2[I0’(x)(I(x) - I0(x) ) - hI0’(x)2] x Rh
E
I0’(x)(I(x) - I0(x))x R h I0’(x)2
x R
= 0
![Page 26: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/26.jpg)
Perbandingan
I0’(x)[I(x) - I0(x)] h I0’(x)2
x
x
h
w(x)[I(x) - I0(x)]
w(x)x
x I0’(x)
![Page 27: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/27.jpg)
Perbandingan
I0’(x)[I(x) - I0(x)] h I0’(x)2
x
h
x
w(x)[I(x) - I0(x)]
w(x)x
x I0’(x)
![Page 28: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/28.jpg)
Generalisasi metode Lucas-Kanade
![Page 29: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/29.jpg)
Rumus Original
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 30: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/30.jpg)
Rumus Original
• Dimension of image
h ) = x R
(E [I( x ) - (x ]2)+ h
1-dimensional
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 31: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/31.jpg)
Generalisasi 1a
• Dimension of image
h ) = x R
(E [I( x ) - (x ]2)+ h
y
xx2D:
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 32: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/32.jpg)
Generalisasi 1b
• Dimension of image
h ) = x R
(E [I( x ) - (x ]2)+ h
1
y
x
xHomogeneous 2D:
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 33: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/33.jpg)
Permasalahan A
LK BAHH ST S BJ HB BL G SI CETSC
Apakah iterasi bisa konvergen?
![Page 34: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/34.jpg)
Permasalahan A
Local minima:
![Page 35: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/35.jpg)
Permasalahan A
Local minima:
![Page 36: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/36.jpg)
Permasalahan B
- I0’(x)(I(x) - I0(x))x R h I0’(x)2
x R
h is undefined if I0’(x)2 is zerox R
LK BAHH ST S BJ HB BL G SI CETSC
Zero gradient:
![Page 37: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/37.jpg)
Permasalahan B
Zero gradient:
?
![Page 38: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/38.jpg)
Permasalahan B’
- (x)(I(x) - I0(x))x R
hy 2
x R
y
I )(0 xy
I
)(0 x
Aperture problem (mis. Image datar):
LK BAHH ST S BJ HB BL G SI CETSC
![Page 39: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/39.jpg)
Permasalahan B’
No gradient along one direction:
?
![Page 40: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/40.jpg)
Jawaban problem A & B
• Possible solutions:– Manual intervention
LK BAHH ST S BJ HB BL G SI CETSC
![Page 41: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/41.jpg)
• Possible solutions:– Manual intervention– Zero motion default
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 42: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/42.jpg)
• Possible solutions:– Manual intervention– Zero motion default– Coefficient “dampening”
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 43: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/43.jpg)
• Possible solutions:– Manual intervention– Zero motion default– Coefficient “dampening”– Reliance on good features
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 44: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/44.jpg)
• Possible solutions:– Manual intervention– Zero motion default– Coefficient “dampening”– Reliance on good features– Temporal filtering
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 45: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/45.jpg)
• Possible solutions:– Manual intervention– Zero motion default– Coefficient “dampening”– Reliance on good features– Temporal filtering– Spatial interpolation / hierarchical estimation
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 46: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/46.jpg)
• Possible solutions:– Manual intervention– Zero motion default– Coefficient “dampening”– Reliance on good features– Temporal filtering– Spatial interpolation / hierarchical estimation– Higher-order terms
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem A & B
![Page 47: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/47.jpg)
Kembali lagi: Rumus Original
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 48: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/48.jpg)
Rumus Original
• Transformations/warping of image
h ) = x R
(E [I( x ) -I(x ]2)+ h
Translations:
y
x
h
LK BAHH ST S BJ HB BL G SI CETSC
![Page 49: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/49.jpg)
Permasalahan C
Bagaimana bila ada gerakan(motion) tipe lain?
![Page 50: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/50.jpg)
Generalisasi 2a
• Transformations/warping of image
A, h) = x R
(E [I(Ax ) - (x ]2)+h
Affine:
dc
baA
y
x
h
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 51: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/51.jpg)
Generalisasi 2a
Affine:
dc
baA
y
x
h
![Page 52: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/52.jpg)
Generalisasi 2b
• Transformations/warping of image
A ) = x R
(E [I( A x ) - (x ]2)
Planar perspective:
187
654
321
aa
aaa
aaa
A
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 53: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/53.jpg)
Generalisasi 2b
Planar perspective:
187
654
321
aa
aaa
aaa
A
Affine +
![Page 54: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/54.jpg)
Generalisasi 2c
• Transformations/warping of image
h ) = x R
(E [I( f(x, h) ) - (x ]2)
Other parametrized transformations
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 55: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/55.jpg)
Generalisasi 2c
Other parametrized transformations
![Page 56: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/56.jpg)
Permasalahan B”
-(JTJ)-1 J (I(f(x,h)) - I0(x)) h ~
Generalized aperture problem:
LK BAHH ST S BJ HB BL G SI CETSC
- I0’(x)(I(x) - I0(x))x R h I0’(x)2
x R
![Page 57: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/57.jpg)
Permasalahan B”
?
Generalizedaperture problem:
![Page 58: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/58.jpg)
Rumus Original
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 59: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/59.jpg)
Rumus Original
• Image type
h ) = x R
(E [I( x ) - (x ]2)+ h
Grayscale images
I
LK BAHH ST S BJ HB BL G SI CETSC
![Page 60: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/60.jpg)
Generalisasi 3
• Image type
h ) = x R
(E ||I( x ) -I(x ||2)+ h
Color images
LK BAHH ST S BJ HB BL G SI CETSC
![Page 61: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/61.jpg)
Rumus Original
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 62: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/62.jpg)
Rumus Original
• Anggapan pixel punya konstan brightness (Constancy assumption)
h ) = x R
(E [I( x ) -I(x ]2)+ h
Brightness constancy
LK BAHH ST S BJ HB BL G SI CETSC
![Page 63: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/63.jpg)
Permasalahan C
Bagaimana bila iluminasi cahaya bervariasi?
![Page 64: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/64.jpg)
Generalisasi 4a
• Constancy assumption
h, )=x R
(E [I( x ) - I(x ]2)++ h
Linear brightness constancy
LK BAHH ST S BJ HB BL G SI CETSC
![Page 65: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/65.jpg)
Generalisasi 4a
![Page 66: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/66.jpg)
Generalisasi 4b
• Constancy assumption
h,) = x R
(E [I( x ) - B(x]2)+ h
Illumination subspace constancy
LK BAHH ST S BJ HB BL G SI CETSC
![Page 67: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/67.jpg)
Permasalahan C’
Bagaimana bila texture berubah?
![Page 68: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/68.jpg)
Generalisasi 4c
• Constancy assumption
h,) = x R
(E [I( x ) - ]2+ h
Texture subspace constancy
B(x)
LK BAHH ST S BJ HB BL G SI CETSC
![Page 69: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/69.jpg)
Permasalahan D
Jelas proses konvergensi menjadi lambat bila jumlah #parameters
bertambah !!!
![Page 70: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/70.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc.
LK BAHH ST S BJ HB BL G SI CETSC
Jawaban problem D
![Page 71: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/71.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc. – Selective parametrization
Jawaban problem D
LK BAHH ST S BJ HB BL G SI CETSC
![Page 72: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/72.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc. – Selective parametrization – Offline precomputation
Jawaban problem D
LK BAHH ST S BJ HB BL G SI CETSC
![Page 73: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/73.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc. – Selective parametrization – Offline precomputation
• Difference decomposition
LK BAHH ST S BJ HB G SI CETSC
Jawaban problem D
BL
![Page 74: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/74.jpg)
Jawaban problem D
• Difference decomposition
![Page 75: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/75.jpg)
Jawaban problem D
• Difference decomposition
![Page 76: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/76.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc. – Selective parametrization – Offline precomputation
• Difference decomposition
– Improvements in gradient descent
LK BAHH ST S BJ HB G SI CETSC
Jawaban problem D
BL
![Page 77: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/77.jpg)
• Percepat konvergensi dengan:– Coarse-to-fine, filtering, interpolation, etc. – Selective parametrization– Offline precomputation
• Difference decomposition
– Improvements in gradient descent• Multiple estimates of spatial derivatives
LK BAHH ST S BJ HB G SI CETSC
Jawaban problem D
BL
![Page 78: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/78.jpg)
Jawaban problem D
• Multiple estimates / state-space sampling
![Page 79: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/79.jpg)
Generalisasi metode Lucas-Kanade
x R
[I( x ) - (x ]2)+ h I
Modifikasi yg. Dibuat selama ini adalah:
![Page 80: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/80.jpg)
Rumus Original
• Error norm
h ) = x R
(E [I( x ) -I(x ]2)+ h
Squared difference:
LK BAHH ST S BJ HB BL G SI CETSC
![Page 81: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/81.jpg)
Permasalahan E
Permasalahan dengan ourliers? >> Gunakan
robust norm
![Page 82: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/82.jpg)
Generalisasi 5a
• Error norm
h ) = x R
(E (I( x ) -I(x ))+ h
Robust error norm:
22
2
)(uk
uuρ
LK BAHH ST S BJ HB BL G SI CETSC
![Page 83: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/83.jpg)
Rumus Original
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 84: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/84.jpg)
Rumus Original
• Image region / pixel weighting
h ) = x R
(E [I( x ) -I(x ]2)+ h
Rectangular:
LK BAHH ST S BJ HB BL G SI CETSC
![Page 85: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/85.jpg)
Permasalahan E’
Bagaimana bila background terjadi clutter
(bergoyang)?
![Page 86: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/86.jpg)
Generalisasi 6a
• Image region / pixel weighting
h ) = x R
(E [I( x ) -I(x ]2)+ h
Irregular:
LK BAHH ST S BJ HB BL G SI CETSC
![Page 87: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/87.jpg)
Permasalahan E”
Bagaimana bila objek terhalang (foreground
occlusion)?
![Page 88: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/88.jpg)
Generalisasi 6b
• Image region / pixel weighting
h ) = x R
(E [I( x ) -I(x ]2)+ h
Weighted sum:
w(x)
LK BAHH ST S BJ HB BL G SI CETSC
![Page 89: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/89.jpg)
Generalisasi metode Lucas-Kanade
x R
[I( x ) - (x ]2)+ h I
Modifikasi:
![Page 90: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/90.jpg)
Generalisasi metode Lucas-Kanade: Ringkasan
= x R
(I( ) - w(x) (x ))h )(E f(x, h)
h ) = x R
(E [I( x ) - (x ]2)+ h I
![Page 91: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/91.jpg)
Ringkasan
• Generalisasi– Dimension of image– Image transformations / motion models– Pixel type– Constancy assumption– Error norm– Image mask
L&K ?Y
Y
n
Y
n
Y
![Page 92: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/92.jpg)
Ringkasan
• Common problems:– Local minima– Aperture effect– Illumination changes– Convergence issues– Outliers and occlusions
L&K ?Y
maybe
Y
Y
n
![Page 93: Image Registration & Tracking dengan Metode Lucas & Kanade](https://reader035.vdocuments.site/reader035/viewer/2022062222/568150f8550346895dbf17bc/html5/thumbnails/93.jpg)
Penanganan aperture effect:– Manual intervention– Zero motion default– Coefficient “dampening”– Elimination of poor textures– Temporal filtering– Spatial interpolation / hierarchical – Higher-order terms
Ringkasan
L&K ?n
n
n
n
Y
Y
n