cs9261 image fundamentals
TRANSCRIPT
![Page 1: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/1.jpg)
CS9261 – Lecturer series 1
Image Fundamentals
Prepared by Mohanalin
For FX
![Page 2: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/2.jpg)
Fundamentals
These slides show
Importance of images
Image acquisition systemsBasic concepts of digital images Evolution of image processing
Overview of Image processing
![Page 3: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/3.jpg)
Picture of earth’s moon taken by space probe in 1964. Picture made with a television camera (vidicon), transmitted to the earth by analog modulation, and digitized on the ground.
Images….What are they? Why it is important?
![Page 4: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/4.jpg)
Medical Images
![Page 5: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/5.jpg)
Satellite Images
![Page 6: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/6.jpg)
Radar Image
![Page 7: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/7.jpg)
Ancient times: Documentation and manual drawing
Photography: Documentation eg. Astronomy, particle physics
Imagine counting the stars manually
Imagine counting the hydrogen particles in a gas chamber
Then came the PCs which revolutionized the field
So how do images form?
Evolution of Images
![Page 8: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/8.jpg)
Fundamentals Let’s look at eye
![Page 9: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/9.jpg)
Fundamentals
We are mostly interested in the retina:
• consists of cones and rods• Cones• color receptors• About 7 million, primarily in the retina’s
central portion • for image details
• Rods• Sensitive to illumination, not involved in
color vision• About 130 million, all over the retina• General, overall view
![Page 10: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/10.jpg)
Fundamentals
Distribution of cones and rods:
![Page 11: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/11.jpg)
Fundamentals
The human eye is sensible to electromagnetic waves in the ‘visible spectrum’ :
![Page 12: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/12.jpg)
Fundamentals
The human eye is sensible to electromagnetic waves in the ‘visible
spectrum’ , which is around a wavelength of
0.000001 m = 0.001 mm
![Page 13: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/13.jpg)
Fundamentals
The human eye
• Is able to perceive electromagnetic waves in a certain spectrum
• Is able to distinguish between wavelengths in this spectrum (colors)
• Has a higher density of receptors in the center
• Maps our 3D reality to a 2 dimensional image !
![Page 14: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/14.jpg)
Fundamentals
…or more precise:
maps our continous (?) reality to a (spatially) DISCRETE 2D image
![Page 15: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/15.jpg)
Fundamentals
Some topics we have to deal with:
• Sharpness• Brightness
• Processing of perceived visual information
![Page 16: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/16.jpg)
Fundamentals
Sharpness
The eye is able to deal with sharpness in different distances
![Page 17: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/17.jpg)
Fundamentals
Brightness
The eye is able to adapt to different ranges of brightness
![Page 18: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/18.jpg)
Fundamentals
Processing of perceived information: optical illusions
![Page 19: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/19.jpg)
Fundamentals
optical illusions:
Digital Image Processing does NOT (primarily) deal with cognitive
aspects of the perceived image !
![Page 20: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/20.jpg)
Image Acquisition
There are two parts to the image formation process:
The geometry of image formation, which determines where in the image plane the projection of a point in the scene will be located.
The physics of light, which determines the brightness of a point in the image plane as a function of illumination and surface properties.
General purpose Image acquisition and processing system consists of 4 essential components:
An image acquisition system…e.g ccd camera, video recorder etc…
A frame grabber – to convert the electrical signal to digital Image
A PC to store
IP s/w to process
![Page 21: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/21.jpg)
Fundamentals
Acquisition
![Page 22: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/22.jpg)
Fundamentals
Acquisition
![Page 23: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/23.jpg)
A Simple model of image formation
The scene is illuminated by a single source. The scene reflects radiation towards the camera. The camera senses it via chemicals on film.
![Page 24: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/24.jpg)
Pinhole camera
This is the simplest device to form an image of a 3D scene on a 2D surface.
Straight rays of light pass through a “pinhole” and form an inverted image of the object on the image plane.
![Page 25: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/25.jpg)
Camera optics
In practice, the aperture must be larger to admit more light.
Lenses are placed to in the aperture to focus the bundle of rays from each scene point onto the corresponding point in the image plane
![Page 26: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/26.jpg)
Fundamentals
Typical sensor for images:
CCD (Charge Couple Devices) CMOS (complement metal oxide semiconductor)
• Use in digital cameras• Typical resolution 1024 x 768
(webcam)
![Page 27: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/27.jpg)
Fundamentals
CCD
![Page 28: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/28.jpg)
Fundamentals
CCD
![Page 29: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/29.jpg)
Fundamentals
CCD: 3.2 million pixels !
![Page 30: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/30.jpg)
CCD (Charged-Coupled Device) cameras
Tiny solid state cells convert light energy into electrical charge.
The image plane acts as a digital memory that can be read row by row by a computer.
![Page 31: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/31.jpg)
Frame grabber
Usually, a CCD camera plugs into a computer board (frame grabber).
The frame grabber digitizes the signal and stores it in its memory (frame buffer).
![Page 32: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/32.jpg)
Image digitization
• Sampling means measuring the value of an image at a finite number of points.
• Quantization is the representation of the measured value at the sampled point by an integer.
![Page 33: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/33.jpg)
Image digitization (cont’d)
![Page 34: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/34.jpg)
Image quantization(example)
• 256 gray levels (8bits/pixel) 32 gray levels (5 bits/pixel) 16 gray levels (4 bits/pixel)
• 8 gray levels (3 bits/pixel) 4 gray levels (2 bits/pixel) 2 gray levels (1 bit/pixel)
![Page 35: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/35.jpg)
Image sampling (example)
original image sampled by a factor of 2
sampled by a factor of 4 sampled by a factor of 8
![Page 36: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/36.jpg)
Digital image
• An image is represented by a rectangular array of integers.
• An integer represents the brightness or darkness of the image at that point.
• N: # of rows, M: # of columns, Q: # of gray levels– N = , M = , Q = (q is the # of bits/pixel)– Storage requirements: NxMxQ (e.g., N=M=1024, q=8, 1MB)
(0,0) (0,1) ... (0, 1)
(1,0) (1,1) ... (1, 1)
... ... ... ...
( 1,0) ( 1,1) ... ( 1, 1)
f f f M
f f f M
f N f N f N M
2 n 2m 2 q
![Page 37: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/37.jpg)
Image file formats
• Many image formats adhere to the simple model shown below (line by line, no breaks between lines).
• The header contains at least the width and height of the image.
• Most headers begin with a signature or “magic number” - a short sequence of bytes for identifying the file format.
![Page 38: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/38.jpg)
Common image file formats
• GIF (Graphic Interchange Format) -
• PNG (Portable Network Graphics)
• JPEG (Joint Photographic Experts Group)
• TIFF (Tagged Image File Format)
• PGM (Portable Gray Map)
• FITS (Flexible Image Transport System)
![Page 39: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/39.jpg)
Comparison of image formats
![Page 40: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/40.jpg)
PGM format
• A popular format for grayscale images (8 bits/pixel)
• Closely-related formats are:
– PBM (Portable Bitmap), for binary images (1 bit/pixel)
– PPM (Portable Pixelmap), for color images (24 bits/pixel)
» ASCII or binary (raw) storage
![Page 41: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/41.jpg)
ASCII vs Raw format
• ASCII format has the following advantages:– Pixel values can be examined or modified very easily using a standard text editor.– Files in raw format cannot be modified in this way since they contain many unprintable
characters.
• Raw format has the following advantages:– It is much more compact compared to the ASCII format.– Pixel values are coded using only a single character !
![Page 42: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/42.jpg)
Fundamentals
What is an image ?
![Page 43: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/43.jpg)
Fundamentals
A 2D grayvalue - image is a 2D -> 1D function,
v = f(x,y)
![Page 44: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/44.jpg)
Fundamentals
As we have a function, we can apply operators to this function, e.g.
H(f(x,y)) = f(x,y) / 2
Operator Image (= function !)
![Page 45: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/45.jpg)
Fundamentals
H(f(x,y)) = f(x,y) / 2
6 8 2 0
12 200 20 10
3 4 1 0
6 100 10 5
![Page 46: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/46.jpg)
Fundamentals
Remember: the value of the cells is the illumination (or brightness)
6 8 2 0
12 200 20 10
3 4 1 0
6 100 10 5
![Page 47: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/47.jpg)
Fundamentals
As we have a function, we can apply operators to this function…
…but why should we ?
some motivation for (digital) image processing
![Page 48: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/48.jpg)
Over view of IP
Finding Depth in images Classification of objects Motion estimation Extraction of features Restoration Exploring dynamic process Finding shapes Visual Inspection and so onnnnnnnn
![Page 49: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/49.jpg)
Fundamentals
• Image Enhancement
![Page 50: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/50.jpg)
Fundamentals
• Image Analysis / Recognition
![Page 51: Cs9261 Image Fundamentals](https://reader036.vdocuments.site/reader036/viewer/2022081502/5527ddc54a7959cf448b4586/html5/thumbnails/51.jpg)
Fundamentals
Digital vs. Analogue Images
Analogue:Function v = f(x,y): v,x,y are REAL
Digital:Function v = f(x,y): v,x,y are INTEGER