1 multimedia audio / video communication standards (mpeg) course : 60 - 520 instructor : dr. a.k....

11

Multimedia Audio / Video Multimedia Audio / Video Communication StandardsCommunication Standards

(MPEG)(MPEG)

Course : 60 - 520Course : 60 - 520Instructor : Dr. A.K. Aggarwal Instructor : Dr. A.K. Aggarwal Presenter : Cheolhong ParkPresenter : Cheolhong Park

22

ContentsContents

IntroductionIntroduction About MPEGAbout MPEG

What is MPEG?What is MPEG? HistoryHistory MPEG compressionMPEG compression

Structure of MPEG-1Structure of MPEG-1 Features of other MPEGsFeatures of other MPEGs

MPEG 2/4/7/21MPEG 2/4/7/21 SummarySummary

33

IntroductionIntroduction

Nowadays, more and more Nowadays, more and more audio-visual audio-visual informationinformation is available from many sources around is available from many sources around the world and many consumer electronics and the world and many consumer electronics and telecommunication products incorporate telecommunication products incorporate complex complex technologiestechnologies

Therefore the need for availableTherefore the need for available standard standard is is required.required.

MPEG provides a standard to satisfy a wide variety MPEG provides a standard to satisfy a wide variety of applications and techniques. of applications and techniques.

44

About MPEGAbout MPEG

What is MPEG?What is MPEG?• DefinitionDefinition

• MPEG stands for Moving Pictures Experts Group.MPEG stands for Moving Pictures Experts Group.• MPEG is a group of people that meet under ISO to MPEG is a group of people that meet under ISO to

generate generate standards for digital video and audio standards for digital video and audio compression.compression.

• Basic principleBasic principle• to transform a stream of discrete samples into a to transform a stream of discrete samples into a

bitstream of tokens which takesbitstream of tokens which takes less less spacespace, but is , but is same to the eye or earsame to the eye or ear..

55

About MPEG(cntd.)About MPEG(cntd.)

History of MPEGHistory of MPEG• 1988 : MPEG is established1988 : MPEG is established• 1992 : MPEG-1 standard for Video CD and 1992 : MPEG-1 standard for Video CD and

MP3MP3• 1994 : MPEG-2 standard for Digital 1994 : MPEG-2 standard for Digital

Television and DVDTelevision and DVD• 1994 : MPEG-4 standard for multimedia 1994 : MPEG-4 standard for multimedia

applicationsapplications• 1996 : MPEG-7 standard for description and 1996 : MPEG-7 standard for description and

search of audio and visual contentsearch of audio and visual content• 2000: MPEG-21 standard for Multimedia 2000: MPEG-21 standard for Multimedia

FrameworkFramework

66

About MPEG(cntd.)About MPEG(cntd.)

AdvantageAdvantage• MPEG compression dramatically decreases MPEG compression dramatically decreases

the amount of storage space.the amount of storage space.• For example, watching 2 hour movie with 640*480 For example, watching 2 hour movie with 640*480

pixel and 16-bit color depthpixel and 16-bit color depth 133 GB are required.133 GB are required.

MPEG can compress 100:1MPEG can compress 100:1 1.33GB are required.1.33GB are required.

DisadvantageDisadvantage• Computational complexity Computational complexity higher CPU and more higher CPU and more

memory required.memory required.

77

About MPEG (cntd.)About MPEG (cntd.)

How?How?• Compression techniquesCompression techniques

• Losseless compressionLosseless compression• Lossy compressionLossy compression

• MPEG compression exploitsMPEG compression exploits• Temporal redundancyTemporal redundancy• Spatial redundancySpatial redundancy• Approximation IntensityApproximation Intensity

88

MPEG compressionMPEG compression

Temporal RedundancyTemporal Redundancy• Two adjacent frames in a motion picture Two adjacent frames in a motion picture

sequence are usually very nearly identical. sequence are usually very nearly identical. • The only difference is that some parts of The only difference is that some parts of

the picture are shifted slightly between the the picture are shifted slightly between the frames.frames.

• MPEG compression divides each new MPEG compression divides each new frame into the pieces and searching the frame into the pieces and searching the previous frame to determine where each previous frame to determine where each piece came from.piece came from.

99

MPEG compression (cntd.)MPEG compression (cntd.)

Spatial RedundancySpatial Redundancy• Within a single frame many parts, such as Within a single frame many parts, such as

regions of sky or walls are almost entirely regions of sky or walls are almost entirely the same color.the same color.

• MPEG compression divides images into MPEG compression divides images into convenient pieces and reducing such parts convenient pieces and reducing such parts to a single color. to a single color.

• If several pixel points in the same area are If several pixel points in the same area are almost the same color, then send the color for almost the same color, then send the color for the whole area once.the whole area once.

1010

MPEG compression (cntd.)MPEG compression (cntd.)

Approximation IntensityApproximation Intensity• The human eye sees less fine detail changes The human eye sees less fine detail changes

and color changes in images.and color changes in images.

• MPEG compression eliminates non-essential MPEG compression eliminates non-essential color and approximates the intensity of fine color and approximates the intensity of fine detail.detail.

1111

MPEG-1MPEG-1

FeaturesFeatures• Coding of moving pictures and associated Coding of moving pictures and associated

audio for digital mediaaudio for digital media

• Standard for efficient storage and retrieval Standard for efficient storage and retrieval of audio and video on compact disc.of audio and video on compact disc.

ApplicationsApplications• Video CD, VHS VCR, MP3Video CD, VHS VCR, MP3

1212

MPEG-1 (cntd.)MPEG-1 (cntd.)

MPEG-1 standards consists of 5 partsMPEG-1 standards consists of 5 parts

• Part 1 (System), Part 2 (video), Part 3 Part 1 (System), Part 2 (video), Part 3 (audio), Part 4 (Conformance Testing), Part (audio), Part 4 (Conformance Testing), Part 5 (Software Simulation)5 (Software Simulation)

1313


System partSystem part• combining one or more data streams from combining one or more data streams from

the video and audio with timing information the video and audio with timing information to form a single stream. to form a single stream.

1414


Video partVideo part• provides efficient encoding of pictures provides efficient encoding of pictures

with VHS quality.with VHS quality.

• the structure of pictures in the standard. the structure of pictures in the standard.

1515


Sound partSound part• provides encoding of stereo audio at 192 provides encoding of stereo audio at 192

kbits/skbits/s

1616


Conformance TestingConformance Testing• specifies how tests can be designed to specifies how tests can be designed to

verify whether bitstreams and decoders verify whether bitstreams and decoders meet the requirements as specified in parts meet the requirements as specified in parts 1, 2 and 3 of the MPEG-1 standard. 1, 2 and 3 of the MPEG-1 standard.

• These tests can be used by manufacturers These tests can be used by manufacturers and their customers.and their customers.

1717


Software SimulationSoftware Simulation• gives a full software implementation of gives a full software implementation of

the first three parts of the MPEG-1 the first three parts of the MPEG-1 standard.standard.

1818

MPEG-2MPEG-2

FeaturesFeatures• Generic coding of moving pictures and Generic coding of moving pictures and

associated Audio.associated Audio.• Standard for Digital Television and DVDStandard for Digital Television and DVD• improve the audio-visual quality of MPEG-1improve the audio-visual quality of MPEG-1

• Video QualityVideo Quality MPEG-1 : Video CDMPEG-1 : Video CD MPEG-2 : DVDMPEG-2 : DVD

• Audio QualityAudio Quality MPEG-1 : stereoMPEG-1 : stereo MPEG-2 : multichannelMPEG-2 : multichannel

ApplicationsApplications• digital TV / DVD / HDTVdigital TV / DVD / HDTV

1919

MPEG-4MPEG-4

FeaturesFeatures• Coding of audio-visual objectsCoding of audio-visual objects• Standard for multimedia applicationsStandard for multimedia applications• enable higher level of interaction with enable higher level of interaction with

media contents.media contents.• improve the video compression efficiencyimprove the video compression efficiency• work in a wide range of bitrate 64Kbps – work in a wide range of bitrate 64Kbps –

4Mbps4Mbps• provide robustness to information errors and provide robustness to information errors and

loss, resolution scalability, and object loss, resolution scalability, and object scalabilityscalability

2020


ApplicationsApplications• Internet multimediaInternet multimedia• Wireless multimediaWireless multimedia• Interactive video game Interactive video game • Interactive storage mediaInteractive storage media• Broadcasting applicationsBroadcasting applications

2121

MPEG-7MPEG-7

FeaturesFeatures• Multimedia Content Description InterfaceMultimedia Content Description Interface

• Standard for audio-visual information Standard for audio-visual information representation.representation.

• allow operation such as search, access, allow operation such as search, access, filter, retrieve, and manage audio-visual filter, retrieve, and manage audio-visual informationinformation

2222


MPEG-7MPEG-7

2323


ApplicationsApplications• Digital library (image catalog) or Digital library (image catalog) or

multimedia informationmultimedia information

• Broadcast media selectionBroadcast media selection

• Multimedia editingMultimedia editing

• Geographical information systemGeographical information system

• Home entertainments (searching game)Home entertainments (searching game)

• Much more…Much more…

2424

MPEG-21MPEG-21

FeaturesFeatures• Mutimedia Framework standardMutimedia Framework standard

• enables use of multimedia resources across enables use of multimedia resources across a wide range of networks and devices used a wide range of networks and devices used by different communitiesby different communities

• defines the description of content and defines the description of content and processes for accessing, searching, storing processes for accessing, searching, storing and and protecting the copyrights of content.protecting the copyrights of content.

2525


Key technologiesKey technologies1. Digital Item Declaration1. Digital Item Declaration2. Digital Item Identification and Description2. Digital Item Identification and Description3. Content Handling and Usage3. Content Handling and Usage4. Intellectual Property Management and 4. Intellectual Property Management and

ProtectionProtection5. Terminals and Networks5. Terminals and Networks6. Content Representation6. Content Representation7. Event Reporting7. Event Reporting

2626

Summary of MPEG standardsSummary of MPEG standards

ComparisonComparison

MPEG MPEG StandardStandard

Targeted UsageTargeted Usage

MPEG-1 MPEG-1 MPEG-2 MPEG-2 MPEG-4 MPEG-4

Coding of audio/visual contentCoding of audio/visual content

MPEG-7 MPEG-7 Providing metadata that describes Providing metadata that describes multimedia contentmultimedia content

MPEG-21 MPEG-21 Providing a framework for the all-Providing a framework for the all-electronic creation, production, delivery electronic creation, production, delivery and trade of content. and trade of content.

2727

ReferencesReferences

J. Watkinson, J. Watkinson, The MPEG handbookThe MPEG handbook, ISBN 0 240 51656 7, Focal Press, , ISBN 0 240 51656 7, Focal Press, 2001.2001.

J. K. Ng, K. R. Leung, W. Wong, V. C. Lee, and C. K. Hui, J. K. Ng, K. R. Leung, W. Wong, V. C. Lee, and C. K. Hui, Quality of Quality of Service for MPEG Video in Human PerspectiveService for MPEG Video in Human Perspective . In Proceedings of the . In Proceedings of the 8th Conference on RTCSA, 2002.8th Conference on RTCSA, 2002.

Dan He, Gilles Muller, and Julia L. Lawall, Dan He, Gilles Muller, and Julia L. Lawall, Distributing MPEG movies Distributing MPEG movies over the internet using programmable networksover the internet using programmable networks, In International , In International Conference on Distributed Computing Systems (ICDCS), July 2002.Conference on Distributed Computing Systems (ICDCS), July 2002.

The MPEG home pageThe MPEG home page, http://www.chiariglione.org/mpeg/, http://www.chiariglione.org/mpeg/ Leonardo Chiariglione, Leonardo Chiariglione, MPEG: achievements and current workMPEG: achievements and current work, ,

http://www.chiariglione.org/mpeg/mpeg_general.htmhttp://www.chiariglione.org/mpeg/mpeg_general.htm Leiming Qian, Leiming Qian, MPEG and H.263 TutorialMPEG and H.263 Tutorial, ,

http://www.ifp.uiuc.edu/~lqian/Computer/Tutorials/MPEG_H_263/mphttp://www.ifp.uiuc.edu/~lqian/Computer/Tutorials/MPEG_H_263/mpeg_h_263.htmleg_h_263.html

2828

Thank You !!!Thank You !!!

1 multimedia audio / video communication standards (mpeg) course : 60 - 520 instructor : dr. a.k....

Documents