mpeg video architectureduarte/elec542/notes_4_4.pdf · encoder/ decoder ntsc/ pal encoder video...

15
MPEG Video Architecture ECE 542 Spring 2005 Rice University Dr. T. Tran

Upload: others

Post on 20-Apr-2020

20 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

MPEG Video Architecture

ECE 542Spring 2005

Rice University

Dr. T. Tran

Page 2: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 2

• Group Of Picture or GOP– Each GOP begins with I-Frame and contains all I, B and P

frames. GOP structure is shown in the figure below.

MPEG Video Coding

I B B P B B P IB

Time

Page 3: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 3

• Example of MPEG reordering

MPEG Video Coding

I B B P B B P IB

Time

0 1 2 3 4 5 6

Encoder Input: I(0) B(1) B(2) P(3) B(4) B(5) P(6)

Encoder Out : I(0) P(3) B(1) B(2) P(6) B(4) B(5)

Decode : I(0) P(3) B(1) B(2) P(6) B(4) B(5)

Display : I(0) B(1) B(2) P(3) B(4) B(5) P(6)

Decoder Buf. : I(0) I(0) I(0) P(6) P(6)P(3) P(3) P(3) P(3)

B(1) B(2) B(4)2 pictures display latency 3 pictures buffer requirements

Page 4: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

VideoBuffer

Pre-Proc.

DCT Q

IQ

IDCT

VLC

Buffer

MC

ME

+

+

FrameBuffer

InputOutput

+_

Rate Cont.MPEG Video Encoder

Page 5: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

+

(x,y)

(x,y)

MV

To DCT

+-

(x,y)

Forward Motion Compensation

BestMatchingMacroblock

Current Picture

Past Picture

Prediction error

Page 6: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

+

(x,y)

(x,y)

MV-1

To DCT

+-

Bidirectional Motion Compensation

BestMatchingMacroblock

(x,y)

MV-2

Current Picture

Past Picture

Future Picture

++

-

MUX

+

1/2

Forward prediction error

Backward prediction errorInterpolative prediction error

Page 7: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

VideoBuffer IQ

IDCT

VLCDec.

PreviousPicture

+

FrameBuffer

Input

MPEG Video Decoder

FuturePicture

+1/2MUX

0

DecodedData

Page 8: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 8

Digital Video Market Segments

Portable Multimedia(Audio &

MPEG-4)

MPEG-4 (up to 320x240)

AudioJPEG Communication

Thin ClientOr Low CostVOD System(MPEG-2)

MPEG-2 (up to 720x480)

AudioMPEG-4 (up to

320x240)CommunicationVideo portPCI bus

Full Motion Digital Video (PVR)

MPEG-2 encode & decode (up to 720x480)

MPEG AudioCommunicationVideo portPCI busHard drive

High Perf.Digital Video

System (HDTV)

MPEG-2 encode & decode (up to 720x480)

MPEG-2 decode up to 1920x1080

CommunicationPlus PVR func.

Page 9: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 9

Mass StorageFlash

Hard DriveIDE CD

Stereo A/D, D/A+ Amplifier

TLV320AIC23

Power Management,Core, I/O Voltage

Power Supply

TPS65010

OMAP5910

STEREO 16Ω, S.E.

40mW

Connectivity

WiFi 802.11

USBConnector

LCD

EEPROM24WC256

Crystal12 MHz

Crystal32.768 KHz

Batteries

Keypads

IIC

PLL

RTCGPIOParallel

Bus

USB

LCD

MMC/SD

McBSP

GPIO

MMCSD

Page 10: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 10

Thin Client (Low Cost VOD)

CPU

Flash

CONTROLPANEL

MEM

10/100BaseT

MPEG-2Video

Decoder

NTSC/PAL

Encoder

PCIVideoPort NTSC

OrPAL

RJ45

Page 11: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 11

Thin Client (Low Cost VOD)

• Thin client VOD system– MPEG-2 full frame rate (30fps) and full MP@ML

resolution (720x480) decode– MPEG-1 audio decode– 10/100BaseT Ethernet controller– Embedded O/Ses such as embedded NT, Linux,

QNX– PCI and video port (CCIR601 or 656) required,

more and more embedded CPUs with PCI interface– Typical BOM cost < $100 – Market: Hotels, homes, schools, etc.

Page 12: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 12

Full Motion Digital Video (PVR)

CPU

Hard Drive

CONTROLPANEL

MEM

TVTuner

MPEG-2Video

Encoder/Decoder

NTSC/PAL

Encoder

VideoPort NTSC

OrPAL

CableOr

Broadcast ADC

Modem

HomeN/W

RJ45

RJ11

Page 13: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 13

• Full Motion Digital Video (PVR)– MP@ML MPEG-2 encoding and decoding full frame

rate and full resolution simultaneously– Capable of multiple MPEG-2 streams decode for video

re-modulated applications – Home networking for video distribution– V.90 or cable modem for downloading TV guide

information– Estimated system BOM cost < $200 (including hard

drive)– Market: Consumer entertainment devices (TIVO,

DirectTV, etc.)

Full Motion Digital Video (PVR)

Page 14: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 14

High Performance Digital Video (HDTV)

CPUHard Drive

CONTROLPANEL

MEM

Analog/Digital

TVTuner

MPEG-2Video

Encoder/Decoder

NTSC/PAL

Encoder

VideoPort NTSC

OrPAL

Cable,Antenna

Or Satellite

ADC

Modem

HomeN/W

RJ45

RJ11

ADC TransportDemux

MPEG-21080i or 720p

DecoderDAC YPbPr

Page 15: MPEG Video Architectureduarte/elec542/notes_4_4.pdf · Encoder/ Decoder NTSC/ PAL Encoder Video Port NTSC Or PAL Cable Or Broadcast ADC Modem Home N/W RJ45 RJ11. ECE 542 Rice University

ECE 542 Rice University 15

• High Performance HDTV System– MP@ML (720x480) MPEG-2 encoding and

decoding simultaneously– MP@HL (1920x1080) MPEG-2 decoding– All the features listed in the Digital Set-top box– Estimated system BOM cost < $400 (including

hard drive)– Market: Advanced consumer entertainment

devices

High Performance Digital Video (HDTV)