color is a powerful descriptor • human can discern thousands...

122
Image Comm. Lab EE/NTHU 1 Chapter 6 Color Image Processing • Color is a powerful descriptor Human can discern thousands of color shades. "color" is more pleasing than "black and white“. Full Color: color from full-color sensor, i.e., CCD camera Pseudo color: assign a color to a particular monochromatic intensity.

Upload: vocong

Post on 21-Apr-2018

222 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 1

Chapter 6Color Image Processing

• Color is a powerful descriptor• Human can discern thousands of color

shades.• "color" is more pleasing than "black and

white“.• Full Color: color from full-color sensor, i.e.,

CCD camera• Pseudo color: assign a color to a particular

monochromatic intensity.

Page 2: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 2

6.1 Color Fundamentals6.1 Color Fundamentals

Page 3: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 3

6.1 Color Fundamentals6.1 Color Fundamentals

Page 4: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 4

6.1 Color Fundamentals6.1 Color Fundamentals

Page 5: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 5

6.1 Color Fundamentals

Cone sensitivity

Page 6: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 6

6.1 Color Fundamentals

• The colors that humans perceive of an object are determined by the nature of the light reflected from the object.

• Incident light (electromagnetic wave) → human eye• The light is visible to human eyes if its wavelength is

between 380-780 (nm). Human eyes have the following sensitivity :1. Brightness : light intensity (energy)2. Color : different spectral composition

Page 7: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 7

6.1 Color Fundamentals

• how to specify color?(1) color matching(2) color difference(3) color appearance

Page 8: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 8

6.1 Color Fundamentals

• Color Mixture• light of any color can be synthesized by an

approximation mixture of three primary colors• Maxwell (1855) provided "colorimetry"

Test Color

Dark background

Adjust mixture of three primary colors

Page 9: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 9

6.1 Color Fundamentals

• Tristimulus values of a test color are the amounts of three primary colors required to give a match by additive mixture.

• Two rules of colorimetry :

⎩⎨⎧additivitylinearity

Page 10: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 10

6.1 Color Fundamentals

• linearity:

If S1(λ) S2(λ) then aS1(λ ) aS2(λ)

• additivity :

If S1(λ) S2(λ) and S3(λ ) S4(λ)

then S1(λ)+S3(λ) S2(λ)+S4(λ)

• Color with negative tri-stimulus values:

test color S aR(λ)–bG(λ)+cB (λ)

⎯⎯⎯ →←matchcolor

⎯⎯⎯ →←matchcolor

⎯⎯⎯ →←matchcolor

⎯⎯⎯ →←matchcolor

⎯⎯⎯ →←matchcolor

⎯⎯⎯ →←matchcolor

Page 11: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 11

6.1 Color Fundamentals6.1 Color Fundamentals

Page 12: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 12

6.1 Color Fundamental

• Additive Color System• Primary: RGB

Red Green Blue Color

Page 13: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 13

6.1 Color Fundamental

• Subtractive Color System:• Primary: CMY

Yellow Cyan MagentaWhite Color

Page 14: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 14

6.1 Color Fundamentals

• Color matching function : the tristimulusvalues of the spectral color with unit intensity light of single wavelength.

• The primary colors are the spectral color of wavelength:

⎪⎩

⎪⎨

)(8.435)(1.546)(0.700

0

0

0

BGR

Page 15: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 15

6.1 Color Fundamentals

• CIE RGB and XYZ color matching functions: RGB is shown in dashed lines, and XYZ are shown in solid lines.

Page 16: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 16

6.1 Color Fundamentals

• Any color S(λ) can be derived as the color sensitivity summation as

Using color matching function

λλλλλλλλ dBdGdRdS sss )()()()( ++=

components of valuesus tristimul: ,,

)(

)(

)(

sss

ss

ss

ss

BGR

dBB

dGG

dRR

∫∫∫

=

=

=

λ

λ

λ

λλ

λλ

λλ

r g b( ), ( ), ( )λ λ λ

λλλλλλλλλ dbSBdgSGdrSR sss )()( ,)()( ,)()( ∫∫∫ ===

Page 17: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 17

6.1 Color Fundamentals

• Color matches between

• metamer :• isomer:• Color matching function are averaged for people

with normal color vision.• Color matching normally depends on the conditions

of observation and previous exposure of eyes.

S S1 2↔

2211

2211

2211

)()()()(

)()()()(

)()()()(

BdbSdbSB

GdgSdgSG

RdrSdrSR

===

===

===

∫∫∫∫∫∫

λλλλλλ

λλλλλλ

λλλλλλ

S S1 2( ) ( ),λ λ≠

S S1 2( ) ( )λ λ= : the same spectral distribution

⎯⎯⎯ →←matchcolor S1 ( )λ S2 ( )λ

Page 18: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 18

6.1 Color Fundamentals - Color Coordinate System Transformation

where r+g+b=1 →reduced to 2-D color information -→ chromaticityThe 3rd information is the luminance

r RR G B

g GR G B

b BR G B

=+ +

=+ +

=+ +

1 =++⎥⎥⎥

⎢⎢⎢

⎡⎯⎯⎯⎯ →⎯

⎥⎥⎥

⎢⎢⎢

⎡bgr

bgr

BGR

ionnormalizat

Page 19: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 19

6.1 Color Fundamentals - Color Coordinate System Transformation

• Y(luminance) →The 3rd-dimension information• Luminance (Brightness) sensor• Different wavelengths contribute different

brightness to the sensor• The relative brightness response for the eye is

termed "relative luminous efficiency" y(λ)• y(λ) is obtained by photometric matches

(matching of brightness)

Page 20: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 20

6.1 Color Fundamentals - Color Coordinate System Transformation

• The luminance of any spectral distribution S(λ) is

where• Brightness match

λλλ dySkY m )()(∫=

2m 1 680 candelaslumenwattlumenskm ==

λλλλλλ dySdyS )()()()( 21∫ ∫=λλλλλ dSdSSS )()(or )( 2121 ∫∫ ≠≠

Page 21: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 21

6.1 Color Fundamentals-Standard CIE Color System

• The tristimulus values for two color-matched colors are different for different observers.

• Standard Observer : by averaging the color matching data of a large number of color normal observers.

• 1931, CIE defined standard observer which consists of color matching functions for primary stimuli of wavelengths:

• Unit normalized equal amount of three primaries are required to match the light from equal energy illumination energy.

700 546 1 435 80 0 0( ), . ( ), . ( )R G B ⇒

Page 22: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 22

6.1 Color Fundamentals-Standard CIE Color System

• CIE also define three new primaries : X, Y, Z

..(a)

• By matrix inversion, we obtain

..(b)• Y tristimulus value corresponds to the luminance

normalized.

⎪⎩

⎪⎨

++−=−+−=+−=

000

000

000

009.1089.0468.0014.0426.1897.0005.0515.0365.2

BGRZBGRYBGRX

R X YG X Y ZB X Y Z

0

0

0

0 490 0 1770 310 0 813 0 010 200 0 010 0 990

= += + += + +

. .. . .. . .

Page 23: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 23

6.1 Color Fundamentals-Standard CIE Color System

• The tristimulus values and color-matching function are always positive primaries; X, Y, Z are non-real (cannot be realized by actual color stimuli)

• Normalized tristimulus values: X, Y, Z→chromaticity

• x : red light → orange, reddish-purple• y : green light → bluish-green, yellowish-green.• small x, y : blue light → violet or purple

⎩⎨⎧

++=

++=

++=

luminance, tychromatici

color Y

yx

ZYXZz

ZYXYy

ZYXXx

Page 24: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 24

6.1 Color Fundamentals-Standard CIE Color System

• Chromaticity diagram : and • Pure spectral colors are plotted on the

elongated horseshoe-shaped curve called the spectral locus.

• line of purples : straight line consists of two extremes of the spectral locus

• chromaticity diagram ≠ color matching function

( , )r g0 0 ( , )x y

Page 25: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 25

6.1 Color Fundamentals

6.1 Color Fundamentals

y = 62% greenx = 25% redz = 13% blue

Page 26: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 26

6.1 Color Fundamentals

6.1 Color Fundamentals

Page 27: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 27

6.1 Color Fundamentals --Color Mixtures

Grassman's Law :• The tristimulus values of a color mixture are obtained by

the vector addition of the tristimulus values of the components of the mixture

• If colors: S1=(X1, Y1, Z1) and S2=(X2, Y2, Z2) are mixedas S=(X, Y, Z) then X=X1+X2 Y=Y1+Y2 Z=Z1+Z2

• If colors: S1=(x1, y1, Y1) and S2=(x2, y2, Y2) are mixedas S=(x, y, Y) then

)()( 2211

21

yYyYYYy

++

=)()(

)()(

2211

222111

yYyYyYxyYxx

++

=

x1, y1

x2, y2

x, y

Page 28: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 28

6.2 Color Models

• The color model (color space or color system) is to facilitate the specification of colors in some standards.

• Color model is a specification of a coordinate system and a subspace within the system where a color is represented.

• RGB for color monitor.• CMY (cyan, magenta, yellow) for color printing.• HIS (hue, intensity and saturation): decouple the

color and gray-scale information.

Page 29: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 29

6.2 Color Models6.2 Color Models

Page 30: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 30

6.2 Color Models6.2 Color Models

Page 31: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 31

6.2 Color Models6.2 Color Models

Page 32: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 32

6.2 Color Models

• Safe RGB colors (or all-system safe color, safe web color): a subset of colors that are likely to be reproduced faithfully reasonably independently of viewers hardware capability.

• 216 colors = 6×6× 6• 6 levels in R, G, and B: in decimal: 0, 51, 102,

153, 204, or 255.• In hex: 00, 33, 66, 99, CC, FF

Page 33: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 33

6.2 Color Models6.2 Color Models

Page 34: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 34

6.2 Color Models6.2 Color Models

Page 35: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 35

6.2 Color Models

• RGB to CMY conversion

• Instead of adding C,M, and Y to produce black, a fourth color black is added

⎥⎥⎥

⎢⎢⎢

⎡−

⎥⎥⎥

⎢⎢⎢

⎡=

⎥⎥⎥

⎢⎢⎢

BGR

YMC

111

Page 36: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 36

6.2 Color Models

• Human describes color in terms of hue saturation and brightness.

• Hue: describe the pure color, pure yellow, orange, green or red.

• Saturation measures the degree to which a pure color is diluted by white light.

• Brightness is a subjective descriptor difficult to be measured.

Page 37: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 37

6.2 Color Models6.2 Color Models

All pointes contained in the plane segment define by the intensity and boundary of the cube have the same hue

Page 38: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 38

6.2 Color Models - Converting colors

• From RGB to HSI

with

• S = 1–[3/(R+G+B)][min(R, G, B)]• I = (R+G+B)/3

⎩⎨⎧

>−≤

=GBifGBif

θ360

⎭⎬⎫

⎩⎨⎧

−−+−−+−

= −2/12

1

)])((()[()]()[(2/1cosBGBRGR

BRGRθ

Page 39: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 39

6.2 Color Models6.2 Color Models

Primary colors are separated by 120o

Page 40: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 40

6.2 Color Models - Converting colors

• From HSI to RGB• RG sector (0≤H<120), min(R, G, B)=B

B = I(1–S)

G = 3I–(R+B)

⎥⎦

⎤⎢⎣

⎡−

+=)60cos(

cos1H

HSIR o

Page 41: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 41

6.2 Color Models - Converting colors

• GB sector(120≤H<240)

• min(R, G, B)=R• H=H-120• R=I (1-S)•

• B=3I-(R+G)

• BR sector(240≤H<360)

• min(R, G, B)=G• H=H-240• G=I (1-S)•

• R=3I-(G+B)

⎥⎦

⎤⎢⎣

⎡−

+=)60cos(

cos1H

HSIG o ⎥⎦

⎤⎢⎣

⎡−

+=)60cos(

cos1H

HSIB o

Page 42: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 42

6.2 Color Models6.2 Color Models

Page 43: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 43

6.2 Color Models6.2 Color Models

Page 44: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 44

6.2 Color Models6.2 Color Models

Page 45: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 45

6.2 Color Models6.2 Color Models

Page 46: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 46

6.3 Pseudo Image Processing

• Assigning colors to gray values based on a specified criterion.• Intensity slicing: using a plane at f(x, y)=li to slice the image

function into two levels.• In general, we assume that P planes perpendicular to the

intensity axis defined at level li i=1,2,..P. These P planes partition the gray level in to P+1 intervals: Vk k=1,2,..P+1

• f(x, y)=ci if f(x, y) ∈Vk

• where ci is the color associated with the kth intensity intervalVk defined by the partition lanes at l=k-1 and l=k.

• From Figure 6.19; if more levels are used, the mapping function takes on a staircase form.

Page 47: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 47

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 48: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 48

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 49: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 49

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 50: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 50

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 51: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 51

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 52: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 52

6.3 Pseudo Image Processing- gray-level to color transformation

• Three independent transformation functions on the gray-level of each pixel.

• Piecewise linear function• Smooth non-linear function

Page 53: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 53

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Page 54: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 54

6.3 Pseudo Image Processing

6.3 Pseudo Image Processing

Figure 6.25 (a) Figure 6.25 (b)

Page 55: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 55

6.3 Pseudo Image Processing

6.3 Pseudo Image Processing

Page 56: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 56

6.3 Pseudo Image Processing

• Change the phase and frequency of each sinusoid can emphasize (in color) ranges in the gray scale.

• Peak → constant color region.• Valley → rapid changed color region.• A small change in the phase between the three

transforms produces little change in pixels whose gray level corresponding to the peaks in the sinusoidal.

• Pixels with gray level values in the steep sectionof the sinusoids are assigned much strong color.

Page 57: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 57

6.3 Pseudo Image Processing6.3 Pseudo Image Processing

Combine several monochrome images into a single color image.

Page 58: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 58

6.3 Pseudo Image Processing

6.3 Pseudo Image Processing

Page 59: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 59

6.3 Pseudo Image Processing

6.3 Pseudo Image Processing

Page 60: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 60

6.4 Full-Color Image Processing

• Two categories:– Process each component individually and then

form a composite processed color image from the components.

– Work with color pixels directly. In RGB system, each color point can be interpreted as a vector.

– c(x, y)=[cR(x, y), cG(x, y), cB(x, y)]

Page 61: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 61

6.4 Full-Color Image Processing6.4 Full-Color Image Processing

Page 62: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 62

6.5 Color Transformation- formulation

Gray-level transformationg(x, y)=T[f(x, y)]

Color transformationsi=Ti(r1, r2,….rn) i=1,2,….n

Where ri and si are variables denoting the color component of f(x, y) and g(x, y) at any point (x, y), n is the number of color components, and {Ti} is a set of transformation or color mapping functions.

Page 63: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 63

6.5 Color Transformation6.5 Color Transformation

Page 64: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 64

6.5 Color Transformation

• To modify the intensity of the image g(x, y)=kf(x, y) 0<k<1

• HSI : s3=kr3

• RGB: si=kri i=1, 2, 3• CMY: si=kri+(1-k) i=1, 2, 3

Page 65: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 65

6.5 Color Transformation6.5 Color Transformation

I H,S

Page 66: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 66

6.5 Color Transformation -Color Complements

• The hues directly opposite one another on the color circle are called complements

• Color complements are useful for enhancing detail that is embedded in dark regions of a color image

Page 67: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 67

6.5 Color Transformation - Color Complements6.5 Color Transformation - Color Complements

Page 68: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 68

6.5 Color Transformation - Color Complements6.5 Color Transformation - Color Complements

Page 69: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 69

6.5 Color Transformation - Color Slicing

• Highlighting a specific range of colors in an image is useful for separating object from their surrounding.

• The simplest way to “slice” a color image is to map the colors outside some range of interest to a nonprominent neutral color (e.g., (R, G, B)=(0.5, 0.5, 0.5)). If the colors of interest are enclosed by a cube (or hypercube for n>3) of width W and centered at a average color with component (a1, a2,…an) the necessary set of transformation is

[ ]⎪⎩

⎪⎨⎧ >−

= ≤≤

otherwiserWarif

si

njanyjji

12/5.0

Page 70: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 70

6.5 Color Transformation - Color Slicing

• If a sphere is used to specify the colors of interest then

• Forcing all other colors to the mid point of the reference color space.

• In RGB color space, the neural color is (0.5, 0.5, 0.5)

⎪⎩

⎪⎨⎧

>−= ∑

=

otherwiser

Rarifsi

n

ji 1

20

2)(5.0

Page 71: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 71

6.5 Color Transformation - Color Slicing6.5 Color Transformation - Color Slicing

Page 72: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 72

6.5 Color Transformation –Tone and Color Correction

• Digital Darkroom• Effective transformation are developed to

maintain a high degree of color consistencybetween the monitor used and the eventual output devices.

• Device independent color model: relate the color gamut (see Fig. 6.6) of the monitor and output devices as well as other devices to one another.

Page 73: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 73

6.5 Color Transformation –Tone and Color Correction

• The model choice for many color management systems (CMS) is the CIE L*a*b* model called CIELAB.

• The L*a*b* color component is given asL*=116h(Y/YW)-16, a*=500[h(X/XW)-h(Y/YW)]b*=200[h(Y/YW)-h (Z/ZW)]

where⎩⎨⎧

≤+>

=008856.0116/16878.7008856.0)(

3

qqqqqh

Page 74: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 74

6.5 Color Transformation –Tone and Color Correction

• XW,YW, ZW are reference white tristimulus values.• The L*a*b* color is colormetric (i.e., colors perceived

as matching are encoded identically), perceptual uniform (i.e., color differences among various hues are perceived uniformly), and device independent.

• It is not a directly displayable format.• The gamut of L*a*b* encompasses the entire visible

spectrum and can represent accurately the colors of any display, print, or input device.

• L*a*b* decouples intensity (L*) and color (a* and b*)

Page 75: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 75

6.5 Color Transformation –Tone and Color Correction

• Before color irregularities are solved, the image’s tonal range are corrected.

• The tonal range of an image (key type) refers to its general distribution of color intensity.

• High key image is concentrated at high/light intensity

• Low key image is concentrated at low intensity.• Middle key image lies in between.• It is desireable to distribute the intensities of a color

image equally between the highlights and the shadows

Page 76: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 76

6.5 Color Transformation -Color Correction

6.5 Color Transformation -Color Correction

Tonal transformation for flat, light and darkimages

Page 77: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 77

6.5 Color Transformation – Tone and Color Correction

6.5 Color Transformation – Tone and Color Correction

Color Balancing: The proportion of any color can be increased by decreasing the amount of opposite (complementary) color in the image. Refer to the color wheel (Figure 6.32) to see how one color component will affect the other.

Page 78: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 78

6.5 Color Transformation – Histogram Processing

• Equalized the histogram of each component will results in error color.

• Spread the color intensity (I) uniformly, leaving the color themselves (hues) unchanged.

• Equalizating the intensity histogram affects the relative appearance of colors in an image.

• Increasing the image’s saturation component after the intensity histogram equalization.

Page 79: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 79

6.5 Color Transformation – Histogram Processing6.5 Color Transformation – Histogram Processing

Mean=0.36

Mean=0.5

Page 80: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 80

6.6 Smoothing and Sharpening

• Let Sxy denote the set of coordinates defining a neighborhood centred at (x, y) in an RGB color space.

⎥⎥⎥⎥⎥⎥⎥

⎢⎢⎢⎢⎢⎢⎢

=

xy

xy

xy

Syx

Syx

Syx

yxBK

yxGK

yxRK

yx

),(

),(

),(

),(1

),(1

),(1

),(c

Page 81: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 81

6.6 Smoothing and Sharpening6.6 Smoothing and Sharpening

Page 82: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 82

6.6 Smoothing and Sharpening6.6 Smoothing and Sharpening

Page 83: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 83

6.6 Smoothing and Sharpening6.6 Smoothing and Sharpening

Smooth only the intensity

Page 84: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 84

6.6 Smoothing and Sharpening

• Image sharpening using Laplacian

⎥⎥⎥

⎢⎢⎢

∇∇∇

=∇),(),(),(

),(2

2

2

2

yxByxGyxR

yxc

Page 85: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 85

6.6 Smoothing and Sharpening6.6 Smoothing and Sharpening

Hue and Saturation unchanged

Page 86: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 86

6.7 Color Segmentation

• Partition an image into regions.• Segmentation in HIS color space.• Saturation is used as a masking image to

isolate further regions of interest in the hue image.

• The intensity image is used less frequently.

Page 87: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 87

6.7 Color Segmentation6.7 Color Segmentation

Page 88: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 88

6.7 Color Segmentation

• Segmentation in RGB color space• The measurement of color similarity is the Euclidean

distance between two colors z, and a, (i.e. Fig. 6.43(a)),D(z, a)=||z-a||=[(z-a)T(z-a)]1/2

• =[(zR-aR)2+ (zG-aG)2 +(zB-aB)2]1/2

• A generalization of distance measure isD(z, a)=||z-a||=[(z-a)TC-1(z-a)]1/2

• Where C is the covariance matrix of the samples representative of the color we want to segment.

• In Figure 6.43(b) describes the solid elliptical body with the principal axes oriented in the direction of maximum data spread.

Page 89: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 89

6.7 Color Segmentation6.7 Color Segmentation

Distance square without square root operation.

Page 90: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 90

||)(intensity IIjd j −=

))(cos(2)()()( 22chroma jSSSSjd jj θ−+=

2chroma

2intensity ))(())(()( jdjdjdcylindiral +=

ο

ο180(j) if )(

otherwise )(360{ ≤ΩΩ

Ω−j

j

||)( jHHj −=Ω

Find the distance of color ( Hj, Sj, Ij ) and the dominant color ( )

6.7 Color Segmentation

ISH ,,

Page 91: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 91

H

S

I

jII −

S

6.7 Color Segmentation

Page 92: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 92

6.7 Color Segmentation6.7 Color Segmentation

The dimension of the box along R-axis extended from (aR-1.25σR) to (aR+1.25σR)

Page 93: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 93

6.7.3 Color Edge detection

• The gradient operators introduced is effective for scalar image.

• Compute the gradient on individual images and then using the results to form a color image will lead to erroneous results.

Page 94: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 94

6.7.3 Color Edge Detection6.7.3 Color Edge Detection

Page 95: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 95

6.7.3 Color Edge Detection

• Let r, g, b be a unit vector along the R, G, B axis and define the unit vector as

• gxx= u •u =|∂R/∂x|2+|∂G/∂x|2+|∂B/∂x|2• gyy= v •v =|∂R/∂y|2+|∂G/∂y|2+|∂B/∂y|2• gxy= u •v =(∂R/∂x)(∂R/∂y) +(∂G/∂x) (∂G/∂y)

+(∂B/∂x)(∂B/∂y)

bgruxB

xG

xR

∂∂

+∂∂

+∂∂

=

bgrvyB

yG

yR

∂∂

+∂∂

+∂∂

=

Page 96: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 96

6.7.3 Color Edge Detection

• The direction of maximum rate of change of c(x, y)is given by the angle

• The value of the rate of change at (x, y) in the direction θ isF(θ)={0.5[(gxx+gyy)+(gxx-gyy)cos θ+2gxysin θ]}1/2

• There are two solved θ or θ +π/2 in orthogonal directions.

• One generate maximum F and the other generate minimum F.

⎥⎥⎦

⎢⎢⎣

−= −

)(2

tan21 1

yyxx

xy

ggg

θ

Page 97: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 97

6.7.3 Color Edge Detection6.7.3 Color Edge Detection

Page 98: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 98

6.7.3 Color Edge Detection6.7.3 Color Edge Detection

Page 99: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 99

6.8 Noise in Color Image

• The noise content of a color image has the same characteristics in each color channel.

• It is possible for color channels to be affected differently by noise.

• The fine grain noise (in Figure 6.48) tends to be less visually noticeable in a color image than it is in a monochrome image.

Page 100: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 100

6.8 Noise in Color Image6.8 Noise in Color Image

Page 101: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 101

6.8 Noise in Color Image6.8 Noise in Color Image

Page 102: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 102

6.8 Noise in Color Image6.8 Noise in Color Image

Page 103: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 103

6.8 Noise in Color Image

• Vector filtering

Page 104: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 104

6.8 Noise in Color Image

• Sliding filter window

Marginal Median OutputVector Median OutputVector Directional Filter OutputOriginal (Desired) Sample

Original AreaNoise Corrupted Area

Input SetX1X2………….… XN

Outlier

Artifact

•The 3 ×3 filtering mask with the window center x(N+1)/2= x5. •Operating at the pixel level, spatial filtering operators replace x(N+1)/2 with the output pixel ˆx(N+1)/2 = f(x1, x2, . . . , xN ) .

Page 105: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 105

6.8 Noise in Color Image

• Vector filtering techniques that treat the color image as a vector field are more appropriate.

• The filter output ˆx(N+1)/2 is a function of the vectorial inputs x1, x2, . . . , xN located within the supporting window W .

• A color red, green, blue (RGB) image x : Z2 → Z3, each pixel xi= [xi1, xi2, xi3]

T represents a three-component vector in a color space

Page 106: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 106

6.8 Noise in Color Image

• The color image x is a vector array or a 2-D matrix of three component samples xi with xik denoting the R (k = 1), G (k = 2), or B component (k = 3).

• The chromatic properties of xi is related to its magnitudeMxi =║xi║= [(xi1)

2 + (xi2)2 + (xi3)

2]1/2

and direction (orientation in the vector space) Oxi = xi / ║xi║= xi/Mxi , with ║Oxi║= 1.

• Both the magnitude and the direction can be used in classifying the differences between two vectorial inputs.

Page 107: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 107

6.8 Noise in Color Image

• (a) RGB color cube and (b), (c) the basic parameters related to the RGB color vector xi = [xi1, xi2, xi3]

T .• (b) The magnitude Mxi . • (c) The orientation defined as the point Oxi on unit sphere.

Page 108: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 108

6.8 Noise in Color Image

• Distance and similarity measures• The distance between two color vectors xi = [xi1, xi2, xi3]

T and xj = [xj1, xj2, xj3]T

in the magnitude domain is the generalized weighted Minkowski metricd(xi, xj) = ║xi − xj║L =

• The nonnegative scaling parameter c is a measure of the overall discrimination power.

• The exponent L defines the nature of the distance metric, i.e., L = 1 (city-block distance), L = 2 (Euclidean distance), L→∞ (The chess-board distance)

• The distance between the two 3-D vectors is considered equal to the maximum distance among their components.

• The parameter ξk measures the proportion of attention allocated to the dimensional component k and, therefore, Σkξk = 1.

• Vectors having a range of values greater than a desirable threshold can be scaled down by the use of the weighting function ξ .

( ) L

k

L

jkikkc/13

1∑ =− xxξ

Page 109: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 109

6.8 Noise in Color Image

• Opposite to distance measures, a similarity measure s(xi, xj) is defined as a symmetric function whose value is large when the vectorial inputs xi and xj are similar.

• Similarity in orientation is expressed through the normalized inner product s(xi, xj) = (xixj

T /(|xi||xj|) → the cosine of the anglebetween xi and xj.

• Since similar colors have almost parallel orientations and significantly different colors point in different overall directions in a 3-D color space, the normalized inner product, or equivalently the angular distance θ = arccos (xixj

T /(|xi||xj|), is used to quantify the dissimilarity (here the orientation difference) between the two vectors.

Page 110: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 110

6.8 Noise in Color Image

• Vector median filters (VMF)• The VMF is a vector processing operator that has been

introduced as an extension of the scalar median filter.• The generalized Minkowski metric║xi − xj║L is used

to quantify the distance between two color pixels xi and xj in the magnitude domain.

• The VMF output is the sample x(1)∈W that minimizes the distance to the other samples inside W as

Page 111: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 111

6.8 Noise in Color Image

• Vector directional filters (VDFs)• VDF represents a different type of vector processing filter. • VDF operates on the directions of image vectors, aiming at

eliminating vectors with atypical directions in the color space.• The Basic VDF (BVDF) operates in the directional domain of a

color image, its output is the color vector x(1)∈W whose direction is the MLE of directions of the input vectors.

• The BVDF output x(1) minimizes the angular ordering criteria to other samples inside the sliding filtering window W:

where θ(xi, xj) represents the angle between two vectors xi and xj.

Page 112: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 112

6.8 Noise in Color Image

• Algorithm of VMF or BVDF outputting the lowest ranked vector.

Page 113: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 113

6.8 Noise in Color Image

• Data Adaptive Filter• The general form of the data-dependent filter is given as a fuzzy

weighted average of the input vectors inside the supporting window W

• where f(·) is a nonlinear function that operates over the weighted average of the input set, and wi is the filter weight equivalent to the fuzzy membership function associated with the input color vector xi. with the constraints wi

∗ ≥ 0 and Σwi∗ = 1.

• The weights wi are determined adaptively using functions of a distance criterion between the input vectors as

wi =β(1 + exp{ })−r, where r is a parameter adjusting the weighting effect of the membership function, and β is a normalizing constant.

( )∑ =

N

j jid1

,xx

Page 114: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 114

6.8 Noise in Color Image

• Based on the difference between the observation (noisy) color vector xi = [xi1, xi2, xi3]

T and the original (desired) sample oi = [oi1, oi2, oi3]

T, the noise corruption is modeled via the additive noise model defined as follows:

xi = oi + viwhere vi = [vi1, vi2, vi3]

T is the vector describing the noiseprocess and i denotes the spatial position of the samples in the image. Note that vi can describe either signal-dependent or independent noise.

• Considering the likely presence of many noise sources, it is reasonable to assume that the overall noise process can be modeled as a zero mean white Gaussian, affecting each color component and pixel position independently.

• The noise variance σ is the same for all three color components in a correlated color space, such as RGB.

Page 115: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 115

6.8 Noise in Color Image

• Angular noise margins for a color signal.

Page 116: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 116

6.8 Noise in Color Image

• The noise can be reduced to a scalar perturbation, the magnitude of the noise vector pi = ║vi ║=

• It follows that the distribution of the pis is:

• This perturbation results in a “noise cone’’ in the RGB color space. • This vector magnitude perturbation can be translated into an angular

perturbation A. • Assuming ║oi║>>σ, A can be approximated to have the distribution

Pr(A) ≈ A(║o║2 /σ2)exp{−(║o║2 A2/(2σ2))}. • This is a Rayleigh distribution with mean .• Using this concept of color noise as an angular perturbation of the

original color vector represented in a correlated vector color space, the effect of the median operator can be roughly derived.

Page 117: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 117

6.8 Noise in Color Image

• Test image Parrots (512 × 512) corrupted by different kinds of noise: (a) original image, (b) additive Gaussian noise with σ = 20,

Page 118: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 118

6.8 Noise in Color Image

• (c) 5% impulsive noise, (d) mixed noise (additive Gaussian noise of σ = 20 followed by 5% impulsive noise).

Page 119: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 119

6.8 Noise in Color Image

• Additive Gaussian noise (σ = 20) filtered output. (a) VMF, (b) BVDF, and (c) data adaptive filter utilizing the angular distance measure.

Page 120: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 120

6.8 Noise in Color Image

• 5% impulsive noise filtered output. (a) VMF, (b) BVDF, and (c) data adaptive filter utilizing the angular distance measure.

Page 121: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 121

6.8 Noise in Color Image

• Mixed noise filtered output (Gaussian with σ = 20 and 5% impulsive noise. (a) VMF, (b) BVDF, and (c) data adaptive filter utilizing the angular distance measure.

Page 122: Color is a powerful descriptor • Human can discern thousands …read.pudn.com/downloads166/doc/fileformat/761778/ch… ·  · 2006-02-24following sensitivity : 1. Brightness :

Image Comm. Lab EE/NTHU 122

6.9 Color Image Compression

6.9 Color Image Compression

Using JPEG 2000, the compression ratio is 1:230.