Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

CM

PE 2

64

Imag

e A

naly

sis

and

Com

pute

r V

isio

n

Hai

Tao

03/2

7/02

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Wha

t is

com

pute

r vi

sion

?

�C

ompu

ting

geom

etri

c an

d dy

nam

ic p

rope

rtie

s of

the

3D

wor

ld f

rom

one

or

mor

e di

gita

l im

ages

(T

rucc

o&

Ver

ri)

�A

mac

hine

vis

ion

syst

em r

ecov

ers

usef

ul in

form

atio

n ab

out a

sce

ne f

rom

its

two-

dim

ensi

onal

pro

ject

ions

. Vis

ion

= G

eom

etry

+ M

easu

rem

ent +

Int

erpr

etat

ion

(R. J

ain,

R.

Kas

turi

, & B

. Sch

unck

)

�T

he g

oal o

f co

mpu

ter

visi

on is

to m

ake

usef

ul d

ecis

ion

abou

t rea

l phy

sica

l obj

ects

and

sce

nes

base

d on

sen

sed

imag

es (

L.G

. Sha

piro

& G

.C. S

tock

man

)

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Wha

t inf

orm

atio

n to

rec

over

?

�2D

imag

e fe

atur

es

�2D

and

3D

sce

ne g

eom

etry

�2D

and

3D

sce

ne m

otio

n

�Id

entif

y, lo

cate

, and

trac

k ob

ject

s

�O

bjec

t rec

ogni

tion

�U

nder

stan

d ac

tiviti

es

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Imag

e fe

atur

e de

tect

ion

�Fa

cial

fea

ture

det

ectio

n

Cou

rtes

y of

Ant

onio

Col

men

arez

, Phi

lips

Res

earc

h La

b.

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Imag

e se

gmen

tatio

n

�W

ater

shed

seg

men

tatio

n

Ori

gina

lT

hres

hold

ing

Wat

ersh

edSu

per-

impo

sed

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Rec

over

2D

and

3D

sce

ne g

eom

etry

�Im

age

mod

elin

g fr

om s

ingl

e im

age

VR

ML

dem

o of

the

reco

nstr

ucte

d m

odel

Cou

rtes

y of

Dr.

Ant

onio

Cri

min

isi,

Mic

roso

ft R

esea

rch.

La

Fla

gell

azio

ne d

i Cri

sto

(146

0),U

rbin

o,

Gal

leri

aN

azio

nale

del

le M

arch

eby

Pie

ro d

ella

Fran

cesc

a (1

416-

1492

).

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Rec

over

2D

and

3D

sce

ne g

eom

etry

�Im

age

base

d m

odel

ing

from

mul

tiple

vie

ws

Cou

rtes

y of

Mar

c Po

llefe

ys, K

.U.L

euve

n-

ES

AT

/PS

I, B

elgi

um.

VR

ML

dem

o of

the

reco

nstr

ucte

d m

odel

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Rec

over

2D

and

3D

sce

ne g

eom

etry

�Fr

om m

ultip

le im

ages

to 3

D g

eom

etry

, e.g

. Fou

ntai

n

Cou

rtes

y of

Mar

c Po

llefe

ys, K

.U.L

euve

n-

ES

AT

/PS

I, B

elgi

um.

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Rec

over

2D

and

3D

mot

ion

�2D

opt

ical

flo

w

Cou

rtes

y of

Sha

non

X. J

u, M

icha

el J

. Bla

ck, A

llan

D. J

epso

n.

Synt

heti

c se

quen

ce “

Yos

emit

e”

Opt

ical

flo

w in

fra

me

11

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Obj

ect d

etec

tion

and

loca

tion

�E

xam

ple:

det

ectin

g fa

ce in

an

imag

e

Cou

rtes

y of

Pau

l Vio

la a

nd M

ike

Jone

s, M

ER

L.

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Obj

ect t

rack

ing

�T

rack

ing

= c

orre

spon

denc

e +

con

stra

ints

+ e

stim

atio

n

�E

xam

ple:

hum

an tr

acki

ng

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Obj

ect r

ecog

nitio

n

�Fa

ce r

ecog

nitio

n

FER

ET

fac

e da

taba

se.

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Face

rec

ogni

tion

�Su

bspa

ce f

ace

reco

gniti

on

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Face

rec

ogni

tion

�E

igen

face

Cou

rtes

y of

Mat

thew

Tur

k an

d A

lex

Pent

land

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Act

ivity

mon

itori

ng

�U

nder

stan

d ac

tiviti

es f

rom

obj

ect t

rack

ing

in m

ultip

le

view

s

Cou

rtes

y of

MIT

AI

Lab

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Act

ivity

mon

itori

ng

�C

ombi

ning

dat

a fr

om m

ultip

le c

amer

as

Cou

rtes

y of

MIT

AI

Lab

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Act

ivity

mon

itori

ng

�O

bjec

t cla

ssif

icat

ion:

peo

ple

or c

ar, m

ale

or f

emal

e

�A

ctiv

ity c

lass

ific

atio

n/cl

uste

ring

�R

etri

eval

: e.g

. all

the

pers

on c

ame

in th

e bu

ildin

g ar

ound

4:

00 p

m

�O

utlie

r de

tect

ion:

odd

act

iviti

es

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

App

licat

ions

�In

dust

rial

insp

ectio

n an

d qu

ality

con

trol

�Su

rvei

llanc

e an

d se

curi

ty

�Fa

ce d

etec

tion

and

reco

gniti

on

�G

estu

re r

ecog

nitio

n

�T

raff

ic m

onito

ring

�Im

age

data

base

�M

edic

al im

agin

g

�A

uton

omou

s ve

hicl

es

�V

isio

n-ba

sed

grap

hics

�an

d m

any

mor

e …

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Rel

ated

fie

lds

�Im

age

proc

essi

ng•

2D L

ow le

vel i

mag

e tr

ansf

orm

atio

n an

d pr

oces

sing

. Use

d in

low

leve

l vis

ion

for

enha

ncin

g an

d ex

trac

ting

feat

ures

suc

h as

poi

nts,

line

s, c

onto

urs,

and

re

gion

s.

�C

ompu

ter

grap

hics

•Sy

nthe

size

imag

es u

sing

geo

met

ric

prim

itiv

es, p

hysi

cal p

rope

rtie

s of

obj

ects

, an

d ill

umin

atio

n co

nditi

ons.

It i

s th

e in

vers

e of

com

pute

r vi

sion

. Vis

ion-

base

d gr

aphi

cs is

bec

omin

g po

pula

r.

�Ph

otog

ram

met

ry•

Stud

y th

e ge

omet

ric

rela

tions

hip

betw

een

3D s

cene

s an

d th

eir

2D p

roje

ctio

ns

to o

btai

n ac

cura

te m

easu

rem

ents

fro

m n

onco

ntac

t im

agin

g.

�Pa

ttern

rec

ogni

tion

and

mac

hine

lear

ning

•St

atis

tical

and

syn

tact

ical

tech

niqu

es f

or c

lass

ifyi

ng p

atte

rns.

The

tech

niqu

es

are

wid

ely

used

in c

ompu

ter

visi

on, e

spec

ially

in o

bjec

t det

ecti

on a

nd

reco

gniti

on.

�A

rtif

icia

l Int

ellig

ence

•C

ompu

tati

onal

inte

llige

nce

that

incl

udes

per

cept

ion,

cog

niti

on, a

nd a

ctio

n.

Com

pute

r vi

sion

can

be

view

ed a

s a

subf

ield

of

AI

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Sylla

bus

1.In

trod

uctio

n 2.

Imag

e an

d vi

deo

acqu

isiti

on3.

Cam

era

mod

el I

4.

Imag

e fe

atur

es -

edge

, cor

ners

, lin

es, H

ough

Tra

nsfo

rm, d

efor

mab

le

cont

ours

5.

Cam

era

mod

el I

I an

d ca

libra

tion

6.3D

cam

era

mot

ion

estim

atio

n 7.

Ster

eops

is

8.2D

mot

ion

anal

ysis

-op

tical

flo

w e

stim

atio

n, d

iffe

rent

ial t

echn

ique

s9.

Shap

e fr

om X

-re

flec

tion

mod

el, s

hape

fro

m s

hadi

ng, s

hape

fro

m

text

ure,

sha

pe f

rom

def

ocus

ing

and

focu

sing

10

.T

rack

ing

-K

alm

anfi

lteri

ng, c

orre

latio

n-ba

sed

trac

king

, cha

nge-

base

d tr

acki

ng, 2

D la

yer

trac

king

, tra

ckin

g of

art

icul

ated

obj

ects

11

.O

bjec

t rec

ogni

tion

-Fe

atur

e, in

vari

ants

, sub

spac

e m

etho

d, f

ace

dete

ctio

n an

d re

cogn

ition

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Cou

rse

info

rmat

ion

Eva

luat

ion: Hom

ewor

k -

30%

Mid

term

-30

%Fi

nal p

roje

ct -

40%

Fina

l pro

ject

:

Prop

osal

due

by

Apr

il 26

Pro

gram

min

g to

ols

Mat

lab

Web

pag

e http

://w

ww

.soe

.ucs

c.ed

u/cl

asse

s/cm

pe26

4/Sp

ring

02

Dep

artm

ent o

f Com

pute

r Eng

inee

ring

Uni

vers

ity o

f Cal

iforn

ia a

t San

ta C

ruz

Hom

ewor

k

�W

rite

Mat

lab

prog

ram

s to

�re

ad a

BM

P co

lor

imag

e

�di

spla

y a

colo

r or

gra

y im

age

�w

rite

an

imag

e to

a f

ile