video media department of computer education kmutnb
TRANSCRIPT
![Page 1: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/1.jpg)
Video Media
Department of Computer EducationKMUTNB
![Page 2: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/2.jpg)
724401 2
Video MediaM
ultim
ed
iaVideo features in a range
of Multimedia application
• Entertainment – Broadcast television and VCR/DVD
recordings
• Interpersonal– Video telephony and videoconferencing
• Interactive– Windows containing short video clips
![Page 3: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/3.jpg)
724401 3
Video MediaM
ultim
ed
iaBroadcast Television
• 525 Lines– NTSC American standard– 60 Fields / second– 30 Frames / second
• 625 Lines– PAL European standard /CCIR/SECAM– 50 Fields / second– 25 Frames / second
![Page 4: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/4.jpg)
724401 4
Video MediaM
ultim
ed
iaScanning illustrated
Time
Volt
ag
e 1 2 3 4 5 6
123456
720 Sample
720 pixel
![Page 5: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/5.jpg)
724401 5
Video MediaM
ultim
ed
iaType of Scanning
• Progressive = every scan line done in turn.
• Interlaced = every other scan line done.– Creates two fields: odd field and even field.– NTSC: 262.5 lines per field at 60 fields per
sec.– PAL: 312.5 lines per field at 50 fields per
sec.
• Fields are separated in time.
![Page 6: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/6.jpg)
724401 6
Video MediaM
ultim
ed
iaComputer & TV
1 TV Frame = 2 Field
interlaced scan
1 Computer Frame
Progressive scan
![Page 7: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/7.jpg)
724401 7
Video MediaM
ultim
ed
iaComputer & TV
Television
Computer1 Frame
1 Frame
1 2 3 4 5 6 7 .. ….. 625
……. …..
……. …..
1 3 5 7 .. ….. 625 2 4 6 8 ……
624
…….
312.5 Even Field
312.5 Odd Field
![Page 8: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/8.jpg)
724401 8
Video MediaM
ultim
ed
iaVideo capture with both
fieldComputer 1
1 2
3 4
5 6
7 .. …
.. 625
……
. …..
……
. …..
1 3
5 7
.. …..
625
2 4
6 8
……
624
……
.
312
.5
Even
Field
312
.5
Odd
Field
Television Computer 2
1 2
3 4
5 6
7 .. …
.. 624
……
. …..
![Page 9: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/9.jpg)
724401 9
Video MediaM
ultim
ed
iaVideo capture with one
fieldComputer 1
1 2
3 4
5 6
7 .. ..3
12
….
……
. …..
1 3
5 7
.. …..
625
2 4
6 8
……
624
……
.
312
.5
Even
Field
312
.5
Odd
Field
Television
Discard
1MPEG ( VCD)
From Interlaced to Progressive system discard resolution in half
![Page 10: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/10.jpg)
724401 10
Video MediaM
ultim
ed
iaScanning Sequence in TV
Interlaced scanning principles
![Page 11: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/11.jpg)
724401 11
Video MediaM
ultim
ed
iaScanning Sequence in TV
525-line systems : 262.5 each field, 240 visible625-line systems : 312.5 each field, 288 visible
![Page 12: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/12.jpg)
724401 12
Safe Frame
From Camera View Finder
To TV
To Digital File
![Page 13: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/13.jpg)
724401 13
Video MediaM
ultim
ed
iaBroadcast Television
• Video resolution and quality
![Page 14: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/14.jpg)
724401 14
Video MediaM
ultim
ed
ia3 Main Properties of a
Color
• Hue: The actual color of the source, each color has a different frequency/wavelength and eye determines the color from this.
• Saturation: The strength of vividness of the color, a pastel color has a lower level of saturation than a color such as red.
• Brightness : The amount of energy that stimulates the eye and varies on a gray scale from black (lowest) Through to white(highest)
![Page 15: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/15.jpg)
724401 15
Video MediaM
ultim
ed
iaLuminance & Chrominance
• Luminance : is used to refer to the brightness of a source, and the hue and saturation
• Chrominance: is used to refer to the color characteristics.
![Page 16: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/16.jpg)
724401 16
Video MediaM
ultim
ed
iaTV Color Signals
Component Signal
Luminance
Chr omi nance
Traditional monochrome TV
White --> Black
Magnitude of the 3 electrical signals that energize the R,G,B Phosphors
0.299R + 0.587G + 0.114B
![Page 17: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/17.jpg)
724401 17
Video MediaM
ultim
ed
iaComposite Video Signals
Ys = 0.299 Rs + 0.587 Gs + 0.114 BsCr = Rs - YsCb = Bs - Ys
Ys is amplitude of luminance signalRs, Gs, Bs is magnitude of 3 color
component signals
![Page 18: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/18.jpg)
724401 18
Video MediaM
ultim
ed
iaComposite Video Signals
R
G
B
+
-
-Cr
Ys
Cb
-
Rs
Gs
Bs
monochrome
+
+Composite Video Signal
![Page 19: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/19.jpg)
724401 19
Video MediaM
ultim
ed
iaChrominance components
From Ys, Cr, CbPAL : Y = 0.299 R + 0.587 G + 0.114 B
U = 0.493 (B - Y) V = 0.877 (R - Y)
NTSC : Y = 0.299 R + 0.587 G + 0.114 B
I = 0.74 (R-Y) - 0.27(B-Y) Q = 0.48 (R-Y) + 0.41(B-Y)
![Page 20: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/20.jpg)
724401 20
Video MediaM
ultim
ed
iaSignal bandwidth
Baseband spectrum of color television signals in NTSC system 42NTSC : Y = . MHz
2 2 2 2=2 2 2 2 2= 1
![Page 21: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/21.jpg)
724401 21
Video MediaM
ultim
ed
iaSignal bandwidth
Baseband spectrum of color television signals in PAL system 2 2 2: =5 . 5
2 2 2 2= 3 2 2 2 2=3
![Page 22: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/22.jpg)
724401 22
Multimedia SummaryM
ultim
ed
iaDigital Video Frames
• Almost always progressive• 3 planes of pixel values (Y, U, and
V)• Pixel depth• Geometry of each plane: width x
height– Chrominance is generally
subsampled.
![Page 23: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/23.jpg)
724401 23
Video MediaM
ultim
ed
iaDigital video
• The visual perception of the eye have less sensitive for color than luminance
• This means that 2 chrominance signals can tolerate a reduced resolution relative to that used for the luminance signal
• Saving in terms of resulting bit rate and transmission bandwidth
![Page 24: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/24.jpg)
724401 24
Video MediaM
ultim
ed
iaDigital video standard
• International Telecommunications Union Radiocommunications Branch (ITU-R)
• Formerly known as the Consultative Committee for International Radiocommunications (CCIR)
Recommendation CCIR-601
![Page 25: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/25.jpg)
724401 25
Video MediaM
ultim
ed
iaCCIR-601
• Standard established for digitizing NTSC and PAL signals
DigitalComponent
AnalogCounterpart
CCIR-601Recommendation
Height Lines NTSC: 480PAL: 576
Width Continuousvoltage changesalong scan line.
Sample at 13.5 MHzResults in 702 pixelsRecommended 720
Pixel depth Voltage range. Gamma-corrected8-bit sample.
Chrominancesubsampling
Bandwidthdifferences
4:2:2, 4:2:0, 4:1:1
![Page 26: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/26.jpg)
724401 26
1,4
1,3
1,2
Video MediaM
ultim
ed
iaVideo Color Storing
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
The visual perception of the eye have less sensitive for color than luminance
From Source Storing method
![Page 27: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/27.jpg)
724401 27
1,4
1,3
1,2
Video MediaM
ultim
ed
iaVideo Color Playback
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,1
1,1
1,1
1,1 3,
13,1
3,1
3,1
3,2
3,2
3,3
3,3
3,4
3,4
Cr,Cb Cr,Cb
Playback process
![Page 28: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/28.jpg)
724401 28
Video MediaM
ultim
ed
iaVideo Digitization Formats
4:2:2 means 2:1 horizontal downsampling, no vertical downsampling. (Think 4 Y samples for every 2 Cb and 2 Cr samples in a
scanline.) 4:1:1 ought to mean 4:1 horizontal downsampling,
no vertical. (Think 4 Y samples for every 1 Cb and 1 Cr samples in a
scanline.) It is often misused to mean the same as 4:2:0 .
4:2:0 means 2:1 horizontal and 2:1 vertical downsampling. (Think 4 Y samples for every Cb and Cr samples in a scanline.)
![Page 29: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/29.jpg)
724401 29
Video MediaM
ultim
ed
ia4:2:2
• Use in television Studio• For every 4 luminance samples,
take 2 chrominance samples from odd lines and 2 from even lines.
• Chrom. planes just as tall, half as wide.
• JPEG does this.
![Page 30: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/30.jpg)
724401 30
Video MediaM
ultim
ed
ia4:2:2
Sample positions with 4:2:2 digitization format
![Page 31: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/31.jpg)
724401 31
Video MediaM
ultim
ed
ia4:2:2
Sample positions with 4:2:2 digitization format
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
From Source Storing method
Every 4 pixel
Keep 2 odd
Keep 2 even
Storage size Y+Cr+Cb Storage size Y+0.5Cr+0.5Cb
![Page 32: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/32.jpg)
724401 32
Video MediaM
ultim
ed
ia4:2:0
• Used in Digital Video broadcast application
• 2 chrominance samples for every 4 luminance samples, odd lines only.
• Chrominance halved in both directions.
• MPEG generally does this.
![Page 33: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/33.jpg)
724401 33
Video MediaM
ultim
ed
ia4:2:0
Sample positions with 4:2:0 digitization format
![Page 34: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/34.jpg)
724401 34
Video MediaM
ultim
ed
ia4:2:0
Sample positions with 4:2:0 digitization format
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
From Source Storing method
Every 4 pixel
Keep 2 odd
Keep 0 even
Storage size Y+Cr+Cb Storage size Y+0.25Cr+0.25Cb
![Page 35: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/35.jpg)
724401 35
Video MediaM
ultim
ed
ia4:2:0
4:2:0 playback process
1,2
YCr
Cb
1,1 2,
2
2,1
1,2
YCr
Cb
1,1
2,2
2,1Play
![Page 36: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/36.jpg)
724401 36
Video MediaM
ultim
ed
ia4:2:0
• To avoid flicker effect with the chrominance signal– the receiver uses the same chrominance value
from the sampled lines for the misslines
• Large-screen flicker effects are often reduced by– storing the incoming digitized signals of each
field in a memory buffer– Double the normal rate 100/120 Hz then used
with the stored set of signals used for the 2 field
![Page 37: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/37.jpg)
724401 37
Video MediaM
ultim
ed
iaHDTV
• High-Definition Television• Older 4/3 aspect ratio 1440 x 1152 pixels• newer 16/9 aspect ratio 1920 x 1152
pixels• 1080 visible lines per frame• 4:2:2 digitization for studio application
– Frame rate 50/60 Hz
• 4:2:0 digitization for broadcast application– Frame rate 25/30 Hz
![Page 38: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/38.jpg)
724401 38
Video MediaM
ultim
ed
iaSIF
• Source Intermediate Format• Used in Video Cassette Recorders (VCR)• Used Half spatial resolution in both
horizontal and vertical in 4:2:0 format• Frame rate 30 Hz for 525 line, 25 Hz for
625 line• Progressive (non interlaced) scanning• The receiver estimated by interpolating
between each pair of value missing line
![Page 39: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/39.jpg)
724401 39
Video MediaM
ultim
ed
iaSIF and CIF
Sample positions for SIF and CIF
![Page 40: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/40.jpg)
724401 40
Video MediaM
ultim
ed
iaSIF and CIF
Sample positions with 4:2:0 digitization format
1,4
1,3
1,2
YCr
Cb
1,1
2,4
2,3
2,2
2,1
3,4
3,3
3,2
3,1
4,4
4,3
4,2
4,1
1,3
Y1,1
3,3
3,1
From Source Storing method
Storage size Y+Cr+CbStorage size 0.25Y+0.0625Cr+0.0625Cb
CrCb
2,2
2,2
![Page 41: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/41.jpg)
724401 41
Video MediaM
ultim
ed
iaSIF and CIF
Sample positions with 4:2:0 digitization format
1,3
1,3
1,1
Y Cr All 2 ,2
Cb All 2 ,2
1,1
1,3
1,3
1,1
1,1
3,3
3,3
3,1
3,1
3,3
3,3
3,1
3,1
Playback
1,3
Y1,1
3,3
3,1
Storing method
CrCb
2,2
2,2
![Page 42: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/42.jpg)
724401 42
Video MediaM
ultim
ed
iaWhen Capture from Video
Tape
Sample positions with 4:2:0 digitization format
1,3
Y1,1
3,3
3,1
From Video Tapeor Home use Quality Signal
2,2
2,2 1,
3
YCr
Cb
1,1 3,
3
3,1
Capture to Computer
360x288360x288
VideoTape
VideoClip
![Page 43: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/43.jpg)
724401 43
Video MediaM
ultim
ed
iaCIF
• Common Intermediate Format• Defined for use in Videoconferencing
applications• Typical bit rate used is a single 64 kbps ISDN
channel• Can multiple channel for high bit rate
4CIF: Y= 720 x 576Cb = Cr = 360 x 288
16CIF: Y= 1440 x 1152Cb = Cr = 720 x 576
![Page 44: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/44.jpg)
724401 44
Video MediaM
ultim
ed
iaCIF
CIF 6 4 kbpsCIF 6 4 kbps
360x288
360x288
CIF720x576
720x576
CIF
CIFCIF CIF CIF
CIFCIF
256 kbps
256 kbps
6 4 kbps
6 4 kbps
In Videoconference Application
![Page 45: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/45.jpg)
724401 45
Video MediaM
ultim
ed
iaCommon Digital Video
Sizes
• CCIR-601 720x480 4:2:2, 4:2:0• SIF 360x240 4:2:0• CIF 360x288 4:2:0• 4:3 HDTV 1440x1152 4:2:2, 4:2:0• 9:16 HDTV 1920x1152 4:2:2,
4:2:0• 4CIF, 16CIF, QCIF
![Page 46: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/46.jpg)
724401 46
Video MediaM
ultim
ed
iaPC video digitization
formats
![Page 47: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/47.jpg)
724401 47
Video MediaM
ultim
ed
iaMultimedia Communication
Standards
• H.320 Video Teleconferencing Standard– Visual Telephone System over N-ISDN
• H.324– low bit rate multimedia communication terminal
for PSTN and Mobile Radio
• H.321, H.310 – high resolution broadband audiovisual
communication systems via B-ISDN
• H.322, H.323– narrowband visual telephone services on LAN
![Page 48: Video Media Department of Computer Education KMUTNB](https://reader036.vdocuments.site/reader036/viewer/2022062516/56649de45503460f94adbec2/html5/thumbnails/48.jpg)
724401 48
Video MediaM
ultim
ed
iaReferrence
• Multimedia communication Application, Networks, protocols and standards; fred halsall. Chapter 2 Multimedia information representation page 96-113; ISBN 0201398184
• http://www.sce.carleton.ca/courses/96502• http://www.crs4.it/~luigi/MPEG/ccir601.html• http://www.broadcastengineering.com/archives/
0198/199801be15.html• http://www.cs.unc.edu/~kmp/classes/sp01/comp249