direct linear transformation & computer vision models
TRANSCRIPT
CE 59700: Digital Photogrammetric Systems Ayman F. Habib1
Direct Linear Transformation & Computer Vision Models
Chapter 7-A4
CE 59700: Digital Photogrammetric Systems Ayman F. Habib2
Photogrammetry Vs. Computer Vision• Conventional Photogrammetry is focusing on precise
geometric information extraction from imagery.– Topographic mapping from space borne and airborne imagery– Metrological information extraction through close-range
photogrammetry (terrestrial photogrammetry)• Object-to-camera distance is less than 100meter
• Computer Vision (CV) is mainly concerned with automated image understanding:– Object recognition,– Navigation and obstacle avoidance, and– Object modeling
CE 59700: Digital Photogrammetric Systems Ayman F. Habib3
Airborne Photogrammetric Mapping
CE 59700: Digital Photogrammetric Systems Ayman F. Habib4
Airborne Photogrammetric Mapping
CE 59700: Digital Photogrammetric Systems Ayman F. Habib5
Close-Range Photogrammetric Mapping
CE 59700: Digital Photogrammetric Systems Ayman F. Habib6
CV: Object Recognition
CE 59700: Digital Photogrammetric Systems Ayman F. Habib7
CV: Navigation & Obstacle Avoidance
CE 59700: Digital Photogrammetric Systems Ayman F. Habib8
Photogrammetry Vs. Computer Vision• Photogrammetry is always concerned with precise
geometric information extraction.– Photogrammetric mapping considers potential deviations from
the assumed perspective projection.• For Computer Vision (CV):
– Focus is always on automation.– Object recognition and navigation applications do not require
precise derivation of geometric information.– Depending on the application, object modeling might require
precise geometric information extraction.– CV usually assumes that the collinearity of the object point,
perspective center, and corresponding image point is maintained, even for un-calibrated cameras.
CE 59700: Digital Photogrammetric Systems Ayman F. Habib9
Object-to-Image Coordinate Transformation in Photogrammetry
Collinearity Equations
CE 59700: Digital Photogrammetric Systems Ayman F. Habib10
o
a
A
oa = λ oA
These vectors should be defined w.r.t.the same coordinate system.
Collinearity Equations
CE 59700: Digital Photogrammetric Systems Ayman F. Habib11
Oi
xc
yczc
A
XA
YA
ZA
a+
(xa, ya)
R( , , )ω φ κ
XG
YG
ZG
OG
pp+c
(Perspective Center)
XO
ZO
YO
Collinearity Equations
CE 59700: Digital Photogrammetric Systems Ayman F. Habib12
Collinearity Equations
The vector connecting the perspective center to the image point
w.r.t. the image coordinate system
o
a
−−−−−
=
−
−−
==cdistyydistxx
cyx
distydistx
rv ypa
xpa
p
p
ya
xacoai
0
CE 59700: Digital Photogrammetric Systems Ayman F. Habib13
Collinearity Equations
The vector connecting the perspective center to the object point
w.r.t. the ground coordinate system
o
A
−−−
=
−
==
oA
oA
oA
o
o
o
A
A
AmoAo
ZZYYXX
ZYX
ZYX
rV
CE 59700: Digital Photogrammetric Systems Ayman F. Habib14
Where: λ is a scale factor (+ve).
Collinearity Equations
11 12 13
21 22 23
31 32 33
( , , )c c mi oa O m oA
a p x A o
a p y A o
A o
v r M V R rx x dist m m m X Xy y dist m m m Y Y
c m m m Z Z
λ ω ϕ κ λ
λ
= = =− − −
− − = − − −
oAoa λ=
CE 59700: Digital Photogrammetric Systems Ayman F. Habib15
Collinearity EquationscmRM =
yoAoAoA
oAoAoApa
xoAoAoA
oAoAoApa
distZZmYYmXXmZZmYYmXXmcyy
distZZmYYmXXmZZmYYmXXmcxx
+−+−+−−+−+−−=
+−+−+−−+−+−−=
)()()()()()()()()()()()(
333231
232221
333231
131211
mcRR =
yoAoAoA
oAoAoApa
xoAoAoA
oAoAoApa
distZZrYYrXXrZZrYYrXXrcyy
distZZrYYrXXrZZrYYrXXrcxx
+−+−+−−+−+−−=
+−+−+−−+−+−−=
)()()()()()()()()()()()(
332313
322212
332313
312111
CE 59700: Digital Photogrammetric Systems Ayman F. Habib16
Object-to-Image Coordinate Transformation
Direct Linear TransformationComputer Vision Model
CE 59700: Digital Photogrammetric Systems Ayman F. Habib17
DLT & Computer Vision Models• The DLT and computer vision models encompass:
– Collinearity Equations,– Non-orthogonality (α) between the axes of the image/camera
coordinate system, and– Two scale factors (Sx, Sy) along the axes of the image
coordinate system.• DLT & CV models can directly deal with pixel
coordinates.• We will start with modifying the rotation matrix to
consider the impact of the non-orthogonality (α).– Primary rotation 𝜔 @ the 𝑋-axis of the ground coord. system– Secondary rotation 𝜑 @ the 𝑌 -axis– Tertiary rotation 𝜅 & (𝜅 + 𝛼) @ the𝑍 -axis
CE 59700: Digital Photogrammetric Systems Ayman F. Habib18
Primary Rotation (ω)
X
ZY
& Xω
YωZω
ω
CE 59700: Digital Photogrammetric Systems Ayman F. Habib19
Primary Rotation (ω)
=
−=
ω
ω
ω
ω
ω
ω
ω
ωωωω
zyx
Rzyx
zyx
zyx
cossin0sincos0001
CE 59700: Digital Photogrammetric Systems Ayman F. Habib20
Secondary Rotation (φ)
φ
Yω
Zω
Xω
Xωφ
Zωφ
& Yωφ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib21
Secondary Rotation (φ)
=
−=
φω
φω
φω
φ
ω
ω
ω
φω
φω
φω
ω
ω
ω
φφ
φφ
zyx
Rzyx
zyx
zyx
cos0sin010
sin0cos
CE 59700: Digital Photogrammetric Systems Ayman F. Habib22
Tertiary Rotation (κ)
Xωφ
Zωφ
YωφYωφκ
Xωφκ
& Zωφκ
κ
κ
κ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib23
Tertiary Rotation (κ)
=
−=
κφω
κφω
κφω
κ
φω
φω
φω
κφω
κφω
κφω
φω
φω
φω
κκκκ
zyx
Rzyx
zyx
zyx
1000cossin0sincos
CE 59700: Digital Photogrammetric Systems Ayman F. Habib24
Rotation in Space
=
κφω
κφω
κφω
κφω
zyx
RRRzyx
// to the ground coordinate system // to the image coordinate system
CE 59700: Digital Photogrammetric Systems Ayman F. Habib25
Rotation in Space
φωκφωκωκφωκω
φωκφωκωκφωκω
φκφ
κφ
κφω
coscossinsincoscossin
cossincossinsincossin
sinsinsincoscoscossinsinsincos
sinsincos
coscos:
33
32
31
23
22
21
13
12
11
333231
232221
131211
=+=
−=−=
−=+=
=−=
=
==
rrrrrrrrrwhere
rrrrrrrrr
RRRR
CE 59700: Digital Photogrammetric Systems Ayman F. Habib26
Xωφ
Zωφ
YωφYωφκ
Xωφκ
& Zωφκ
κ
κ
Consideration of the Non-Orthogonality (α)
++−
=
κφω
κφω
κφω
φω
φω
φω
ακκακκ
ZYX
ZYX
1000)cos(sin0)sin(cos
CE 59700: Digital Photogrammetric Systems Ayman F. Habib27
++−
=
κφω
κφω
κφω
φω
φω
φω
ακκακκ
ZYX
ZYX
1000)cos(sin0)sin(cos
−−−
=
κφω
κφω
κφω
φω
φω
φω
κακκκακκ
ZYX
ZYX
1000sincossin0cossincos
Consideration of the Non-Orthogonality (α)
κακακακακκακακακακ
sincossinsincoscos)cos(cossinsincoscossin)sin(
−=−=++=+=+
Assuming small non-orthogonality angle (α)
CE 59700: Digital Photogrammetric Systems Ayman F. Habib28
Consideration of the Non-Orthogonality (α)
−
−=
−−−
10001001
1000cossin0sincos
1000sincossin0cossincos α
κκκκ
κακκκακκ
−=
−=
κφω
κφω
κφω
κφω
κφω
κφω
κφω
αα
ZYX
RZYX
RRRZYX
10001001
10001001
CE 59700: Digital Photogrammetric Systems Ayman F. Habib29
Consideration of the Non-Orthogonality (α)
=
=
ZYX
RZYX
zyx
T
10001001 α
κφω
κφω
κφω
// to the image coordinate system // to the ground coordinate system
−=
κφω
κφω
κφωα
ZYX
RZYX
10001001
Note: 1 −𝛼 00 1 00 0 1 = 1 𝛼 00 1 00 0 1
CE 59700: Digital Photogrammetric Systems Ayman F. Habib30
Consideration of the Non-Orthogonality (α)• Collinearity Equations while considering the non-
orthogonality (α) between the axes of the image coordinate system.
−−−
=
−−−
O
O
OT
p
p
ZZYYXX
Rcyyxx
10001001 α
λ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib31
−−−
=
−−−
O
O
OT
yp
xp
ZZYYXX
Rcsyysxx
10001001
/)(/)( α
λ
−−−
−=
−−−−
O
O
OT
yp
xp
ZZYYXX
Rccsyycsxx
10001001
/1
)/()()/()( α
λ
• Divide both sides by (-c).
Consideration of the Scale Factors• Collinearity Equations while considering the non-
orthogonality (α) between the axes of the image coordinate system & different scale factors.
CE 59700: Digital Photogrammetric Systems Ayman F. Habib32
Consideration of the Scale Factors
−−−
′=
−−−−
O
O
OT
yp
xp
ZZYYXX
Rcyycxx
10001001
1)/()()/()( α
λ
−−−
′=
−−
−
−
O
O
OT
p
p
y
x
ZZYYXX
Ryyxx
cc
10001001
1)()(
1000/1000/1 α
λ
−−−
−
−′=
−−
O
O
OT
y
x
p
p
ZZYYXX
Rcc
yyxx
10001001
1000000
1)()( α
λ
• csx→ cx , csy→ cy & -λ/c → λ`.
CE 59700: Digital Photogrammetric Systems Ayman F. Habib33
DLT & Computer Vision Models
−−−
−
−−′=
−−
O
O
OT
y
xx
p
p
ZZYYXX
Rccc
yyxx
100000
1)()( α
λ
−−−
−
−−′=
−−
O
O
O
y
xx
p
p
ZZYYXX
rrrrrrrrr
ccc
yyxx
332313
322212
312111
100000
1)()( α
λ
𝒙 − 𝒙𝒑𝒚 − 𝒚𝒑𝟏 = 𝟏 𝟎 −𝒙𝒑𝟎 𝟏 −𝒚𝒑𝟎 𝟎 𝟏 𝒙𝒚𝟏 𝟏 𝟎 −𝒙𝒑𝟎 𝟏 −𝒚𝒑𝟎 𝟎 𝟏𝟏 = 𝟏 𝟎 𝒙𝒑𝟎 𝟏 𝒚𝒑𝟎 𝟎 𝟏&
CE 59700: Digital Photogrammetric Systems Ayman F. Habib34
DLT & Computer Vision Models𝒙 − 𝒙𝒑𝒚 − 𝒚𝒑𝟏 = 𝛌′ −𝒄𝒙 −𝜶𝒄𝒙 𝟎𝟎 −𝒄𝒚 𝟎𝟎 𝟎 𝟏 𝑹𝑻 𝑿 − 𝑿𝑶𝒀 − 𝒀𝑶𝒁 − 𝒁𝑶𝒙𝒚𝟏 = 𝛌′ 𝟏 𝟎 𝒙𝒑𝟎 𝟏 𝒚𝒑𝟎 𝟎 𝟏 −𝒄𝒙 −𝜶𝒄𝒙 𝟎𝟎 −𝒄𝒚 𝟎𝟎 𝟎 𝟏 𝑹𝑻 𝑿 − 𝑿𝑶𝒀 − 𝒀𝑶𝒁 − 𝒁𝑶𝒙𝒚𝟏 = 𝛌′ −𝒄𝒙 −𝜶𝒄𝒙 𝒙𝒑𝟎 −𝒄𝒚 𝒚𝒑𝟎 𝟎 𝟏 𝑹𝑻 𝑿 − 𝑿𝑶𝒀 − 𝒀𝑶𝒁 − 𝒁𝑶𝒙𝒚𝟏 = 𝛌′ −𝒄𝒙 −𝜶𝒄𝒙 𝒙𝒑𝟎 −𝒄𝒚 𝒚𝒑𝟎 𝟎 𝟏 𝑹𝑻 −𝑹𝑻𝑿𝑶 𝑿𝒀𝒁𝟏𝑿𝑶 = 𝑿𝑶 𝒀𝑶 𝒁𝑶 𝑻
CE 59700: Digital Photogrammetric Systems Ayman F. Habib35
DLT & Computer Vision Models𝒙𝒚𝟏 = 𝛌′ −𝒄𝒙 −𝜶𝒄𝒙 𝒙𝒑𝟎 −𝒄𝒚 𝒚𝒑𝟎 𝟎 𝟏 𝑹𝑻 −𝑹𝑻𝑿𝒐 𝑿𝒀𝒁𝟏𝒙𝒚𝟏 = 𝛌 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏𝑲 = −𝒄𝒙 −𝜶𝒄𝒙 𝒙𝒑𝟎 −𝒄𝒚 𝒚𝒑𝟎 𝟎 𝟏
Where:
CE 59700: Digital Photogrammetric Systems Ayman F. Habib36
DLT & Computer Vision Models
[ ]
[ ]
3
3
'1
1
0 { }0 0 1
{ }
TO
x x p
y p
TO
Xx
Yy K R I X
Z
c c xK c y Calibration Matrix
R I X Exterior Orientation Matrix
λ
α
= −
− − = − ≡
− ≡
𝑬𝒙𝒕𝒆𝒓𝒊𝒐𝒓 𝑶𝒓𝒊𝒆𝒏𝒕𝒂𝒕𝒊𝒐𝒏 𝑴𝒂𝒕𝒓𝒊𝒙 = 𝑹𝑻 𝟏 𝟎 𝟎 −𝑿𝑶𝟎 𝟏 𝟎 −𝒀𝑶𝟎 𝟎 𝟏 −𝒁𝑶
CE 59700: Digital Photogrammetric Systems Ayman F. Habib37
DLT & Computer Vision Models• The Direct Linear Transformation (DLT), which has
been developed by the photogrammetric community, is an alternative to the collinearity equations that allows for direct transformation between machine/pixel coordinates and corresponding ground coordinates.– 𝑥 = & 𝑦 =
• The DLT can be also represented by the following form:
– 𝑥𝑦1 = 𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿 𝑋𝑌𝑍1
CE 59700: Digital Photogrammetric Systems Ayman F. Habib38
DLT & Computer Vision Models
1 2 3
5 6 7
9 10 11
' 00 0 1
x x pT
y p
L L L c c xD L L L c y R
L L L
αλ
− − = = −
4
8
12
' 00 0 1
x x p OT
y p O
O
L c c x XL c y R YL Z
αλ
− − = − −
DLT: Direct Linear Transformation𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿 = 𝛌 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐
CE 59700: Digital Photogrammetric Systems Ayman F. Habib39
DLT & CV Models: Pixel Coordinates• The DLT & CV models can also consider the direct
transformation from pixel to ground coordinates.
𝒙𝒚𝟏 = 𝒖 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝒏𝒓 𝟐⁄ − 𝒗 × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟏
u
v
CE 59700: Digital Photogrammetric Systems Ayman F. Habib40
DLT & CV Models: Pixel Coordinates𝒙𝒚𝟏 = 𝒖 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝒏𝒓 𝟐⁄ − 𝒗 × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟏𝒙𝒚𝟏 = 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝟎 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 −𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝒏𝒓 𝟐⁄ × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 𝟎 𝟏 𝒖𝒗𝟏𝒙𝒚𝟏 = 𝛌 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝟎 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 −𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝒏𝒓 𝟐⁄ × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 𝟎 𝟏 𝒖𝒗𝟏= 𝛌 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏
CE 59700: Digital Photogrammetric Systems Ayman F. Habib41
DLT & CV Models: Pixel Coordinates𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝟎 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 −𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝒏𝒓 𝟐⁄ × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 𝟎 𝟏 𝒖𝒗𝟏 = 𝛌 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏𝒖𝒗𝟏 = 𝛌 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝟎 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 −𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝒏𝒓 𝟐⁄ × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 𝟎 𝟏𝟏 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏
𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝟎 − 𝒏𝒄 𝟐⁄ × 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 −𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆 𝒏𝒓 𝟐⁄ × 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆𝟎 𝟎 𝟏𝟏 = 𝟏 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝟎 𝒏𝒄 𝟐⁄𝟎 − 𝟏 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝒏𝒓 𝟐⁄𝟎 𝟎 𝟏
𝒖𝒗𝟏 = 𝛌 𝟏 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝟎 𝒏𝒄 𝟐⁄𝟎 − 𝟏 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝒏𝒓 𝟐⁄𝟎 𝟎 𝟏 𝑲𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏
CE 59700: Digital Photogrammetric Systems Ayman F. Habib42
DLT & CV Models: Pixel Coordinates• Modified Calibration Matrix:
𝐾 = 𝟏 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝟎 𝒏𝒄 𝟐⁄𝟎 − 𝟏 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝒏𝒓 𝟐⁄𝟎 𝟎 𝟏 −𝒄𝒙 −𝜶𝒄𝒙 𝒙𝒑𝟎 −𝒄𝒚 𝒚𝒑𝟎 𝟎 𝟏𝐾 = −𝒄𝒙 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ −𝜶𝒄𝒙 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ 𝒙𝒑 𝒙_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ + 𝒏𝒄 𝟐⁄0 𝒄 𝒚_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ −𝑦𝒑 𝑦_𝒑𝒊𝒙_𝒔𝒊𝒛𝒆⁄ + 𝒏 𝟐⁄0 0 1
𝒖𝒗𝟏 = 𝛌 𝑲 𝑹𝑻 𝑰𝟑 −𝑿𝒐 𝑿𝒀𝒁𝟏
CE 59700: Digital Photogrammetric Systems Ayman F. Habib43
DLT & CV Models: Pixel Coordinates• For DLT when working with pixel coordinates, we have
the following model.
– 𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝐿 = 𝛌 𝑲 𝑹𝑻 𝑰𝟑 −𝑿𝒐• 𝐿 𝐿 𝐿𝐿 𝐿 𝐿𝐿 𝐿 𝐿 = 𝛌 𝑲 𝑹𝑻• 𝐿𝐿𝐿 = −𝛌 𝑲 𝑹𝑻 𝑿𝒐𝑌𝒐𝑍𝒐
CE 59700: Digital Photogrammetric Systems Ayman F. Habib44
Modern Photogrammetry & Computer Vision• Modern Photogrammetry and Computer Vision are
converging fields.
Art and science of tool development for automatic generation of spatial and descriptive information from
multi-sensory data and/or systems
CE 59700: Digital Photogrammetric Systems Ayman F. Habib45
DLT → IOPs & EOPs
Approach # 1
CE 59700: Digital Photogrammetric Systems Ayman F. Habib46
DLT → IOP & EOP
1 2 3
5 6 7
9 10 11
00 0 1
x x pT
y p
L L L c c xD L L L c y R
L L L
αλ
− − = = −
4
8
12
00 0 1
x x p OT
y p O
O
L c c x XL c y R YL Z
αλ
− − = − − 𝐿𝐿𝐿 = − 𝐿 𝐿 𝐿𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝑋𝑌𝒐𝑍𝒐
CE 59700: Digital Photogrammetric Systems Ayman F. Habib47
DLT → IOP & EOP
No Sign Ambiguity
−=
O
O
O
ZYX
LLLLLLLLL
LLL
11109
765
321
12
8
4
• Given:
• Then:
−=
−
12
8
41
11109
765
321
LLL
LLLLLLLLL
ZYX
O
O
O
CE 59700: Digital Photogrammetric Systems Ayman F. Habib48
DLT → IOP & EOP
−−−
−
−−=
1000
10002
pp
yx
x
py
pxxT
yxcc
cycxcc
DD αα
λ
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
2211
210
2933)( λ=++=× LLLDD T
}{211
210
29 AmbiguitySignLLL ++±=λ
Then:
CE 59700: Digital Photogrammetric Systems Ayman F. Habib49
DLT → IOP & EOP
pT xLLLLLLDD 2
3112101913)( λ=++=×
)()(
211
210
29
31121019LLL
LLLLLLxp ++++=
No Sign Ambiguity
Then:
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib50
pT yLLLLLLDD 2
7116105923)( λ=++=×
DLT → IOP & EOP
)()(
211
210
29
71161059LLL
LLLLLLyp ++++=
No Sign Ambiguity
Then:
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib51
)()( 22227
26
2522 yp
T cyLLLDD +=++=× λ
DLT → IOP & EOP
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
5.02
211
210
29
27
26
25
)(
−++
++= py yLLLLLLc
No Sign Ambiguity
Then:
CE 59700: Digital Photogrammetric Systems Ayman F. Habib52
DLT → IOP & EOP
)()( 273625121 ppyx
T yxccLLLLLLDD +=++=× αλ
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
−++
++= ppyx yxLLLLLLLLLcc )(/1 2
11210
29
736251α
No Sign Ambiguity
Then:
CE 59700: Digital Photogrammetric Systems Ayman F. Habib53
)()( 2222223
22
2111 pxx
T xccLLLDD ++=++=× αλ
DLT → IOP & EOP
===
1173
1062
951
11109
765
3212)()(
LLLLLLLLL
LLLLLLLLL
KKRKRKDD TTTTT λλλ
5.0222
211
210
29
23
22
21
)(
−−++
++= pxx xcLLLLLLc α
No Sign Ambiguity
Then:
CE 59700: Digital Photogrammetric Systems Ayman F. Habib54
DLT → IOP & EOP• Given:
• Then:φλλ sin139 == rL
Sign Ambiguity
−
−−=
332313
322212
312111
11109
765
321
1000
rrrrrrrrr
ycxcc
LLLLLLLLL
py
pxx αλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib55
Collinearity Equations• Objective: Resolve the sign ambiguity in λ
• Since the scale factor is always +ve
• Assuming that the origin (0, 0, 0) is visible in the imagery
veZZrYYrXXr OOO −−+−+− )()()( 332313
veZrYrXr OOO −−−− 332313
−+−+−−+−+−−+−+−
=
−−−
)()()()()()()()()(
332313
322212
312111
OOO
OOO
OOO
p
p
ZZrYYrXXrZZrYYrXXrZZrYYrXXr
Scyyxx
CE 59700: Digital Photogrammetric Systems Ayman F. Habib56
DLT → IOP & EOP
• By choosing L12 = 1.
12 13 23 33
13 23 33
13 23 33
( )1 ( )
1( )
O O O
O O O
O O O
L r X r Y r Zr X r Y r Z
r X r Y r Z
λλ
λ
= − + += − − −
= − − −λ is Negative
211
210
29 LLL ++−=λ
−
−−−=
O
O
OT
py
pxx
ZYX
Rycxcc
LLL
1000
12
8
4 αλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib57
DLT → IOP & EOP
• No sign Ambiguity
211
210
29
9
139
sin
sin
LLLLrL
++−=
==
φ
φλλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib58
DLT → IOP & EOP
φωλλφωλλ
coscoscossin
3311
2310
==−==
rLrL
11
10tan LL−=ω
No Sign Ambiguity
−
−−=
332313
322212
312111
11109
765
321
1000
rrrrrrrrr
ycxcc
LLLLLLLLL
py
pxx αλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib59
DLT → IOP & EOP
−
−−
=
−
−−=
−
1000
1000
1
11109
765
321
333231
232221
131211
332313
322212
312111
11109
765
321
py
pxx
py
pxx
ycxcc
LLLLLLLLL
rrrrrrrrr
rrrrrrrrr
ycxcc
LLLLLLLLL
αλ
αλ
• Retrieve κ
• Note: There is an ambiguity in 𝜅 determination (±𝜅 cannot be distinguished).
φκ coscos 11r=
CE 59700: Digital Photogrammetric Systems Ayman F. Habib60
DLT → IOP & EOP
Approach # 2: Matrix Factorization
CE 59700: Digital Photogrammetric Systems Ayman F. Habib61
DLT → IOP (Factorization # 1)• Conceptual basis: Direct derivation of the calibration matrix
• Cholesky Decomposition of DDT→ λK (Calibration Matrix)? Wrong
−−−
−
−−=
===
1000
1000
)()(
2
1173
1062
951
11109
765
3212
pp
yx
x
py
pxxT
TTTTT
yxcc
cycxcc
DD
LLLLLLLLL
LLLLLLLLL
KKRKRKDD
αα
λ
λλλ
CE 59700: Digital Photogrammetric Systems Ayman F. Habib62
1
1)(−
−
==
NMMMNCHO
T TMM
TDDN = TKλKλ
TT
T
KKMMN
MMN21
1
1
λ==
=−−
−
11)]}({[ −−= TDDCHOKλ
TKλKλ
DLT → IOP (Factorization # 2)
CE 59700: Digital Photogrammetric Systems Ayman F. Habib63
−
−−
=
−
−−=
−
1000
1000
1
11109
765
321
333231
232221
131211
332313
322212
312111
11109
765
321
py
pxx
py
pxx
ycxcc
LLLLLLLLL
rrrrrrrrr
rrrrrrrrr
ycxcc
LLLLLLLLL
αλ
αλ
• Using the rotation matrix R, one can derive the individual rotation angles ω, φ and κ.
DLT → Rotation Angles
CE 59700: Digital Photogrammetric Systems Ayman F. Habib64
Analysis
CE 59700: Digital Photogrammetric Systems Ayman F. Habib65
Perspective Center
• (XO, YO , ZO) is the intersection point of three different planes whose surface normals are (L1, L2, L3), (L5, L6, L7) and (L9, L10, L11), respectively.
𝐿𝐿𝐿 = − 𝐿 𝐿 𝐿𝐿 𝐿 𝐿𝐿 𝐿 𝐿 𝑋𝑌𝑍𝐿 𝑋 + 𝐿 𝑌 +𝐿 𝑍 = −𝐿𝐿 𝑋 + 𝐿 𝑌 +𝐿 𝑍 = −𝐿𝐿 𝑋 + 𝐿 𝑌 +𝐿 𝑍 = −𝐿
CE 59700: Digital Photogrammetric Systems Ayman F. Habib66
Perspective Center
−
−−=
332313
322212
312111
11109
765
321
1000
rrrrrrrrr
ycxcc
LLLLLLLLL
py
pxx αλ
• Assuming:– xp ≈ 0.0 and yp ≈ 0.0– -αcx ≈ 0.0
−−−−−−
=
332313
322212
312111
11109
765
321
rrrrcrcrcrcrcrc
LLLLLLLLL
yyy
xxx
λ
• The three surfaces are orthogonal to each other.– This would lead to better intersection.
CE 59700: Digital Photogrammetric Systems Ayman F. Habib67
−
−−=
332313
322212
312111
11109
765
321
1000
rrrrrrrrr
ycxcc
LLLLLLLLL
py
pxx αλ
• Assuming:– xp ≠ 0.0 and yp ≠ 0.0– -αcx ≈ 0.0
+−+−+−+−+−+−
=
332313
333223221312
333123211311
11109
765
321
rrrryrcryrcryrcrxrcrxrcrxrc
LLLLLLLLL
pypypy
pxpxpx
λ
• As xp and yp increase, the surface normals become almost parallel.– This would lead to weak intersection.
Perspective Center
CE 59700: Digital Photogrammetric Systems Ayman F. Habib68
• The rows of D are not correlated:– They are orthogonal to each other.
• L-1 is well defined.
−
−−
=
−
1000
1
11109
765
321
333231
232221
131211
py
pxx
ycxcc
LLLLLLLLL
rrrrrrrrr α
λ
• Assuming:– xp ≈ 0.0 and yp ≈ 0.0– -αcx ≈ 0.0
−−−−−−
=
332313
322212
312111
11109
765
321
rrrrcrcrcrcrcrc
LLLLLLLLL
yyy
xxx
λ
Rotation Angles
CE 59700: Digital Photogrammetric Systems Ayman F. Habib69
−
−−
=
−
1000
1
11109
765
321
333231
232221
131211
py
pxx
ycxcc
LLLLLLLLL
rrrrrrrrr α
λ
• Assuming:– xp ≠ 0.0 and yp ≠ 0.0– -αcx ≈ 0.0
+−+−+−+−+−+−
=
332313
333223221312
333123211311
11109
765
321
rrrryrcryrcryrcrxrcrxrcrxrc
LLLLLLLLL
pypypy
pxpxpx
λ
• The rows of D tend to be highly correlated.• L-1 is not well defined.
Rotation Angles