mpeg-1 part 2 notes - springer978-0-306-46983-1/1.pdf · mpeg-1 part 2 notes ... 442 mpeg video...

30
Appendix A MPEG-1 Part 2 Notes This appendix contains comments and errata pertaining to ISO 11172 Part 2: Video. To the best of our knowledge there are no technical corrigenda for MPEG-1 video. These notes assume that the reader has a copy of the standard available. We have arranged suspected errors and our comments under the respec- tive sections of the video standard. Typographical errors are expressed as “change” lists. We used ISO/IEC 11172-2 First edition 1993-08-01 Part 2: Video, purchased from ANSI in February 1994. Please remember that this appendix has no official significance. A . 1 Section 1: General 1.2: Identical to subclause 1.2 in Part 1 except for the reference to Part 1 instead of Part 2 in the first normative reference. 1.2: Change “IEEE Draft Standard P1180/D2 1990” to “IEEE Standard 1180-1990”. Change “Specificationto IEEE Standard Specifica- tions. Change “implementationto “implementations. A.2 Section 2: Technical elements 2.1: Identically the same phrases are defined in subclause 2.1 in Part 1. The definitions are essentially the same except for nomenclature that refers to parts of the standard. 2.2: Identical to subclause 2.2 in Part 1. 2.4.3.4: In vbv_delay 90 kHz was chosen as the greatest common multiple of various video and audio sample rates. Note that the R used in the 441

Upload: lytuyen

Post on 20-Jul-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

Appendix A

MPEG-1 Part 2 Notes

This appendix contains comments and errata pertaining to ISO 11172 Part2: Video. To the best of our knowledge there are no technical corrigendafor MPEG-1 video.

These notes assume that the reader has a copy of the standard available.We have arranged suspected errors and our comments under the respec-tive sections of the video standard. Typographical errors are expressed as“change” lists. We used ISO/IEC 11172-2 First edition 1993-08-01 Part 2:Video, purchased from ANSI in February 1994. Please remember that thisappendix has no official significance.

A . 1 Section 1: General

1.2: Identical to subclause 1.2 in Part 1 except for the reference to Part1 instead of Part 2 in the first normative reference.

1.2: Change “IEEE Draft Standard P1180/D2 1990” to “IEEE Standard1180-1990”. Change “Specification” to “IEEE Standard Specifica-tions” . Change “implementation” to “implementations” .

A.2 Section 2: Technical elements

2.1: Identically the same phrases are defined in subclause 2.1 in Part 1.The definitions are essentially the same except for nomenclature thatrefers to parts of the standard.

2.2: Identical to subclause 2.2 in Part 1.

2.4.3.4: In vbv_delay 90 kHz was chosen as the greatest common multipleof various video and audio sample rates. Note that the R used in the

441

442 MPEG VIDEO COMPRESSION STANDARD

equation is the full precision bit rate. Note also that the 90 kHzmeans 90,000 and not 90 × 1024.

2.4.3.6: Change (under coded_block_pattern) “If macroblock_intra iszero, cbp =0.” to “If macroblock_pattern is zero, cbp=0.” Thissentence did not appear in the DIS or the balloted IS.

2.4.4.2: Change “pattern[i]” to “pattern_code[i]” .

2.4.4.3: Change “pattern[i]” to “pattern_code[i]”.

A.3 Annex A: 8 by 8 Inverse discrete cosine trans-form

The IEEE Std 1180-1990 “IEEE Standard Specifications for the Implemen-tations of 8 × 8 Inverse Discrete Cosine Transform” was approved December6, 1990. It can be obtained from the Institute of Electrical and ElectronicsEngineers, Inc., 345 East 74th Street, New York, NY 10017, USA.

A.4 Annex B: Variable length code tables

Table B.4: Change column label “motion VLC code” to “VLC code”.Change column label “code” to “motion value”.

Table B.5a: Change the column label “dct_dc_size_luminance” to “dc_size_luminance” . Otherwise, dc_size_luminance is never defined.Subclause 2.4.3.7 explicitly states that dc_size_luminance is thenumber of bits, whereas the data element dct_dc_size_luminanceis the variable length code.

Table B.5b: Change column label from “dct_dc_size_chrominance” to“dc_size_chrominance” . (See note on Table B.5a.)

A.5 Annex C: Video buffering verifier

C.1.4 4th paragraph: Be aware that “the entire video bitstream” refersonly to the video data from the first sequence_start_code and thesequence_end_codeinclusive. It does not cross sequence boundaries.

C.1.4 equations: MPEG-1 assumes constant picture rate. These equa-tions only work for the case where the pictures are removed at con-stant time intervals between picture extractions.

CHAPTER A. MPEG-1 PART 2 NOTES 443

Figure C.1: The horizontal axis should have the lined up under theand the lined up under the . The occupancy line shouldhave had a jog at

A.6 Annex D: Guide to encoding video

Annex D is the first informative annex in Part 2. Informative annexes canriot contain any requirements and are present for informational purposesonly; consequently, errors in this annex are not catastrophic. In those caseswhere the informative annexes are in conflict or inconsistent with the “nor-mative” portions of the document, the standards conventions are clear thatthe normative portions govern. Annex D is known to contain technical er-rors, even in the IS publication.

D.5.1.9 second paragraph: Change “3 712” to “4 640”. 1.856 Mbits/sdivided by 400 equals 4,640. 3,712 times 400 equals 1.4848 Mbits/s.At one time, approximately 1.5 Mbits/s was going to be the con-strained parameter limit.

Table D.9: Change “0000 11 -4” to “0000 111 -4”. (See Table B.4.)

Table D.13: Change “3 to -2” to “-3 to -2”.

Figure D.30: The numbers in the figure and explanation for the zigzagscanning order run from 1 to 64. Do not confuse this figure withthe zigzag scanning matrix given in subclause 2.4.4.1 in which thenumbers run from 0 to 63. Coefficient 1 refers to the DC term andnot the first AC coefficient in this subclause.

A.7 Annex E: Bibliography

Note that the references are all prior to 1992,

Reference 1: The 1995 second edition is available and includes significantdiscussion of MPEG-1 and MPEG-2 [NH95].

Reference 6: This reference is available as an appendix in [PM93]. Thefinal ISO 10918-1 International Standard was published February 15,1994, and the CCITT version was official more than a year earlier.

A.8 Annex F: List of patent holders

The Committee Draft version of Part 2 did not mention patents. The DraftInternational Standard version of Part 2 had a table of company names

444 MPEG VIDEO COMPRESSION STANDARD

with “X”s under columns for Systems, Audio, and Video indicating thatthe patent holders claimed patents. That format was dropped in the finalInternational Standard. It included names not listed in the final version ofAnnex F.

Chapter 15 describes the Cable Laboratory consortium efforts to answerquestions about licensing MPEG video patents.

Bibliography

[AB85] E. H. Adelson and J. R. Bergen. Spatiotemporal models and theperception of motion. J. Opt. Soc. Am. A, 2(2):284–95, Feb 1985.

[ANR74] N. Ahmed, T. Natarajan, and R. K. Rao. Discrete Cosine Trans-form. IEEE Trans. on Computers, C-23:90–3, 1974.

[AP92] A.H Ahumada, Jr. and H. A. Peterson. Luminance-Model-BasedDCT Quantization for Color Image Compression. In SPIE Hu-man Vision, Visual Processing and Digital Display, volume 1666,pages 365–74, 1992.

[Ast91] Brian Astle. A proposal for mpeg video report. ISO/IECJTC1/SC2/WG11 MPEG 91/074, Apr 1991.

[ATS94] Digital Audio Compression (AC-3). ATSC Standard A/52, 1994.

[BA83] P. Burt and E. Adelson. The Laplacian pyramid as a compactimage code. IEEE Trans. Comm., COM-31(4):532–40, 1983.

[BCW90] Timothy C. Bell, John G. Cleary, and Ian H. Witten. Text Com-pression. Prentice Hall, Englewood Cliffs, New Jersey, 1990.

[Bea94] G. Beakley. MPEG vendor worksheet. StellaCom, Inc., March1994.

[Bec95] J. Beck. MPEG vendor worksheet. Digital Equipment Corp.,May 1995.

[Ben85] K. Blair Benson, editor. Television Engineering Handbook.McGraw-Hill, New York, 1985.

[BK95] V. Bhaskaran and K. Konstantinides. Image and Video Compres-sion Standards: Algorithms and Architectures. Kluwer AcademicPublishers, Boston, 1995.

[Cal85] R. J. Caldwell. Electronic Editing, chapter 20. In Benson [Ben85],1985.

445

446 MPEG VIDEO COMPRESSION STANDARD

[CCJC91] Liang-Gee Chen, Wai-Ting Chen, Yeu-Shen Jehng, and Tzi-DarChiueh. An Efficient Parallel Motion Estimation Algorithm forDigital Image Processing. IEEE Trans. Circuits Syst. VideoTech., l(4):378–85, Dec 1991.

[Chi91] L. Chiariglione, Convenor. Fifteenth meeting attendance list,ISO/IEC JTC1/SC2/WG11 — MPEG91/180, Aug 1991.

[Chi94] L. Chiariglione, Convenor. Press release, ISO/IECJTC1/SC29/WG11 MPEG94/N0822, Nov 1994.

Cheng-Tie Chen, Fure-Ching Jeng, Masahisa Kawashima,Sharad Singhal, and Andria H. Wong. Hybrid extended MPEGvideo coding algorithm for general video applications. SignalProc.: Image Comm., 5:21–37, 1993.

[CJOS94] Tae-Yun Chung, Kyu-Hwan Jung, Young-Nam Oh, and Dong-Ho Shin. Quantization control for improvement of image qualitycompatible with MPEG2. IEEE Trans. Consumer Electronics,40(4):821–5, Nov 1994.

[CL93] Keith Hung-Kei Chow and Ming L. Liou. Genetic Motion SearchAlgorithm for Video Compression. IEEE Trans. Circuits Syst.Vid. Tech., 3(6):440–5, Dec 1993.

[CLCR93] K. W. Chun, K. W. Lim, H. D. Cho, and J. B. Ra. An Adap-tive Perceptual Quantization Algorithm for Video Coding. IEEETrans. Consumer Electr., 39(3):555–8, Aug 1993.

[Cor70] Tom N. Cornsweet. Visual Perception. Harcourt Brace Jo-vanovich, Inc., Orlando, Florida, 1970.

[CP84] Wen-Hsiung Chen and W. K. Pratt. Scene Adaptive Coder.IEEE Trans. Comm., COM-32(3):225–32, Mar 1984.

[CR94] K. W. Chun and J. B. Ra. An improved block matching algorithmbased on successive refinement of motion vector candidates. Sig-nal Proc: Image Communications, 6:115–22, 1994.

[CWN87] J. G. Cleary, I. H. Witten, and R. M. Neal. Arithmetic Codingfor Data Compression. Commun. of the ACM, 30(6):520–40, Jun1987.

[DeL58] H. DeLange. Research into the Dynamic Nature of the HumanFovea-Cortex Systems with Intermittent and Modulated Light.J. Opt. Soc. Am., 48:777–84, 1958.

BIBLIOGRAPHY 447

[dHB94] Gerard de Haan and Paul W. A. C. Biezen. Sub-pixel motion es-timation with 3-D recursive search block-matching. Signal Proc:Image Comm., 6:229–239, 1994.

[DL95] W. Ding and B. Liu. Rate-Quantization Modeling for Rate Con-trol of MPEG Video Coding and Recording. In SPIE DigitalVideo Compression: Algorithms and Technologies ’95, volume2419, pages 139–50, 1995.

[DTV95a] Digital Television Standard for HDTV Transmission. ATSC Doc-ument A/53, 1995. April 12.

[DTV95b] Guide to the Use of Digital Television Standard for HDTV Trans-mission. ATSC Document A/54, 1995.

[EF95] S. Eckart and C. Fogg. ISO-IEC MPEG-2 software video codec.In SPIE Digital Video Compression: Algorithms and Technolo-gies ’95, volume 2419, pages 100–9, 1995.

[Eng94] B. Engel. MPEG vendor worksheet. General Instruments Corp.,November 1994.

C. E. Fogg, P. Au, S. Eckart, T. Hanamura, K. Oosa, B. Quandt,and H. Watanabe. ISO/IEC software implementation of MPEG-1video. In SPIE. Digital Video Compression on Personal Com-puters: Algorithms and Technologies, volume 2187, pages 249–52,1994.

[Fil94] L. Filippini. MPEG vendor worksheet. Center for AdvancedStudies, Research, and Development in Sardinia, October 1994.

[Fin85] D. G. Fink. Reference Data and Equations, chapter 22. In Benson[Ben85], 1985.

[FL90] E. Feig and E. Linzer. Discrete Cosine Transform Algorithms forImage Data Compression. In Proc. Electronic Imaging ’90 East,pages 84–7, Boston, MA, 1990.

[Ger88] B. Gerod. Eye movements and coding of video sequences. InSPIE Visual Communications and Image Processing, volume1001, pages 398–405, 1988.

[Gha90] M. Ghanbari. The Cross-Search Algorithm for Motion Estima-tion. IEEE Trans. Comm., 38(7):950–3, Jul 1990.

448 MPEG VIDEO COMPRESSION STANDARD

[Gil88] Michael Gilge. A High Quality Videophone Coder using Hierar-chical Motion Estimation and Structure Coding of the PredictionError. In SPIE Visual Communications and Image ProcessingIII, volume 1001, pages 864–74, 1988.

[Gil90] Michael Gilge. Motion estimation by scene adaptive block match-ing (SABM) and illumination correction. In SPIE Image Pro-cessing Algorithms and Techniques, volume 1244, pages 355–66,1990.

[Gir93] Bernd Girod. Motion-Compensating Prediction with Fractional-Pel Accuracy. IEEE Trans. Comm., 41(4):604–12, Apr 1993.

[Gon91] C. A. Gonzales. Private communication, 1991.

[Gon96] C. A. Gonzales. Private communication, Jan 1996.

[GV91] C. A. Gonzales and E. Viscito. Motion Video Adaptive Quan-tization in the Transform Domain. IEEE Trans. Circuits Syst.Video Tech., l(4):374–8, Dec 1991.

[Haa94] J. Haass. MPEG vendor worksheet. Sun Microsystems, Inc.,October 1994.

[Hab94] G. T. Haber. MPEG vendor worksheet. CompCore Multimedia,Inc., November 1994.

[Har94] S. Hartmann. MPEG vendor worksheet. Hartmann MultimediaService, October 1994.

[Has72] B. G. Haskell. Buffer and channel sharing by several interframePicturephone® coders. Bell Syst. Tech. J, 51(1):261–89, Jan1972.

[HMC72] B. G. Haskell, F. W. Mounts, and J. C. Candy. Interframe Codingof Videotelephone Pictures. Proc. IEEE, 60(7):792–800, Jul 1972.

[Hof97] Roy Hoffman. Data Compression in Digital Systems. Chapman& Hall, New York, NY, 1997.

[HPN97] Barry G. Haskell, Atul Puri, and Arun N. Netravali. DigitalVideo: An Introduction to MPEG-2. Chapman & Hall, NewYork, NY, 1997.

[Huf52] D. A. Huffman. A Method for the Construction of Minimum-Redundancy Codes. Proc. IRE, 40(9):1098–101, Sep 1952.

BIBLIOGRAPHY 449

[IEC86] Time and control code for video tape recorders. IEC StandardPublication 461, Second Edition, 1986.

[IEE91] IEEE Standard Specifications for the Implementations of 8x8Inverse Discrete Cosine Transform. IEEE Std 1180-1990, Mar1991.

[ISO93a] Information technology — Coding of moving pictures and asso-ciated audio for digital storage media at up to about 1,5 Mbits/s—. International Standard ISO/IEC 11172-2, Part 2, 1993.

[ISO93b] Test Model 5. Test Model Editing Committee. Standards docu-ment MPEG93/457, 1993.

[ISO95] MPEG-4 Proposal Package Description (PPD) - Revision2. ISO/IEC JTC1/SC29/WG11. AOE Sub Group. MPEG95/N0937, Mar 1995.

[ITU90] Recommendation H.261 – Video Codec for Audiovisual Servicesat p × 64 kbit/s. ITU-T (CCITT), Aug 1990. Specialist Groupon Coding for Visual Telephony.

[ITU93] Recommendation H.261: Video Codec for Audiovisual Servicesat p×64 kbits. ITU-T (CCITT), Mar 1993.

[ITU95] Draft Recommendation H.263: Video Coding for Low BitrateCommunication. ITU-T (CCITT), Dec 1995.

[JCC94] Her-Ming Jong, Liang-Gee Chen, and Tzi-Dar Chiueh. Paral-lel Architectures for 3-Step Hierarchical Search Block-MatchingAlgorithm. IEEE Trans. Circuits Syst. Vid. Tech., 4(4):407–16,Aug 1994.

[JJ81] Jaswant R. Jain and Anil K. Jain. Displacement Measurementand Its Application in Interframe Image Coding. IEEE Trans.Comm., COM-29(12):1799–808, Dec 1981.

[Kat93] Y. Katayama. Protection from IDCT Mismatch. ISO/IECJTC1/SC2/WG11 MPEG 93/283, Mar 1993.

[Kel61] D. H. Kelly. Visual responses to time-dependent stimuli. I. am-plitude sensitivity measurements. J. Opt. Soc. Am., 51:917–8,1961.

T. Koga, K. Linuma, A. Hirano, Y. Iijima, and T. Ishiguro.Motion-compensated interframe coding for video conferencing.In NTC 81 Proc., pages G5.3.1–5, New Orleans, LA, Dec 1981.

450 MPEG VIDEO COMPRESSION STANDARD

[KN90] Tero Koivunen and Ari Nieminen. Motion field restoration usingvector median filtering on high definition television sequences.In SPIE Visual Communications and Image Processing, volume1360, pages 736–42, 1990.

[Knu73] D. E. Knuth. Searching and Sorting, Vol 3, The Art of ComputerProgramming. Addison-Wesley, Reading, MA, 1973.

[Kop94a] T. Kopet. MPEG vendor worksheet. Array Microsystems, Inc.,October 1994.

[Kop94b] T. Kopet. MPEG vendor worksheet addendum. Array Microsys-tems, Inc., November 1994.

[Kor94] R. Korosec. MPEG vendor worksheet. IBM Microelectronics,April 1994.

[KP89] J. S. Kim and R. H. Park. Feature-based block matching algo-rithm using integral projections. Electr. Lett., 25(1):29–30, Jan1989.

[KR83] S. Kappagantula and K. R. Rao. Motion compensated predictivecoding. In Proc. Int. Tech. Symp. SPIE, San Diego, CA, Aug1983.

[Kro94] J. Krog. MPEG vendor worksheet. Texas Instruments, Inc.,November 1994.

[LD94] J. Lee and B. W. Dickinson. Temporally Adaptive Motion In-terpolation Exploiting Temporal Masking in Visual Perception.IEEE Trans. Image Proc., 3(5):513–26, Sep 1994.

Nan Li, Stefaan Desmet, Albert Deknuydt, Luc Van Eycken, andAndre Oosterlinck. Motion adaptive Quantization in TransformCoding for Exploiting Motion Masking Effect. In SPIE VisualCommunication and Image Processing, volume 1818, pages 1116-23, 1992.

[Lee86] Jong Soo Lee. Image Block Motion Estimation Using Fit byGeneralized Discrete Orthogonal Polynomials. In SPIE VisualCommunications and Image Processing, volume 707, pages 188-92, 1986.

[LG96] D. Le Gall. MPEG vendor worksheet. C-Cube Microsystems,Inc., August 1996.

BIBLIOGRAPHY 451

[LM75] J. 0. Limb and J. A. Murphy. Measuring the Speed of MovingObjects from Television Signals. IEEE Trans. Comm., 23(4):474–8, Apr 1975.

[Loh84] H. Lohscheller. Subjectively Adapted Image Communication Sys-tem. IEEE Trans. Comm., COM-32( 12): 1316–22, Dec 1984.

[Loo94] T. Lookabaugh. MPEG vendor worksheet. DiviCom, Inc., Octo-ber 1994.

[Lou85] B. D. Loughlin. Monochrome and Color Visual Information andTransmission, chapter 4. In Benson [Ben85], 1985.

[LR78] J. O. Limb and C. B. Rubinstein. On the Design of Quantizersfor DPCM Coders: A Functional Relationship Between Visibility,Probability and Masking. IEEE Trans. Comm., COM-26(5):573–8, May 1978.

[LRR92] H. Levkowitz, P. K. and B. E. Rogowitz. Color The-ory and Models for Computer Graphics and Visualization. Tech-nical Report RC 18192, IBM Research Division, 1992.

[LWLS93] Liang-Wei Lee, Jhing-Fa Wang, Jau-Yien Lee, and Jung-DarShie. Dynamic Search-Window Adjustment and InterlacedSearch for Block-Matching Algorithm. IEEE Trans. CircuitsSyst. Vid. 3(l):85–7, Feb 1993.

[LZ93] Bede Liu and Andre Zaccarin. New Fast Algorithms for theEstimation of Block Motion Vectors. IEEE Trans. Circuits Syst.Vid. Tech., 3(2):148–57, Apr 1993.

[Mac94] A. G. Maclnnis. MPEG-2 Systems. In SPIE. Digital Video Com-pression on Personal Computers: Algorithms and Technologies,volume 2187, pages 274–8, 1994.

[Mak94] B. Makley. MPEG vendor worksheet. FutureTel, Inc., November1994.

[Man94] M. Mansson. MPEG vendor worksheet. LSI Logic Corp., October1994.

[Mit95] J. L. Mitchell. Private communication, Nov 1995.

[MN89] D. L. McLaren and D. T. Nguyen. Activity function for DCTcoded images. Elect. Lett., 25(25):1704–5, Dec 1989.

452 MPEG VIDEO COMPRESSION STANDARD

[MPG85] Hans Georg Musmann, Peter Pirsch, and Hans-Joachim Grallert.Advances in Picture Coding. Proc. IEEE, 73(4):523–48, Apr1985.

[Mul85] K. T. Mullen. The Contrast Sensitivity of Human Colour Visionto Red-Green and Blue-Yellow Chromatic Gratings. J. Physiol.,359:381–400, 1985.

[NB67] F. I. Van Ness and M. A. Bouman. Spatial Modulation Transferin the Human Eye. J. Opt. Soc. Am., 57(3):401–6, Mar 1967.

[NH95] A. N. Netravali and B. G. Haskell. Digital Pictures. PlenumPress, New York and London, 1995. Second Edition.

[Nis88] B. Niss. Prediction of AC Coefficients from the DC values.ISO/IEC JTC1/SC2/WG8 N745, May 1988.

[NP77] A. N. Netravali and B. Prasada. Adaptive Quantization of Pic-ture Signals Using Spatial Masking. Proc. IEEE, 65(4):536–48,Apr 1977.

[NR79] A. N. Netravali and J. D. Robbins. Motion-Compensated Tele-vision Coding: Part I. BSTJ, 58(3):631–70, Mar 1979.

[NS79] A. N. Netravali and J. A. Stuller. Motion-Compensated Trans-form Coding. BSTJ, 58(7): 1703–18, Sep 1979.

[OR95] A. Ortega and K. Ramchandran. Forward-adaptive quantiza-tion with optimal overhead cost for image and video coding withapplications to MPEG video coders. In SPIE Digital Video Com-pression: Algorithms and Technologies ’95, volume 2419, pages129–38, 1995.

[Owe72] W. G. Owen. Spatio-temporal integration in the human periph-eral retina. Vision Res., 12:1011–26, 1972.

[PA90] A. Puri and R. Aravind. On comparing motion-interpolationstructures for video coding. In SPIE Visual Communicationsand Image Processing, volume 1360, pages 1560–71, 1990.

[PA91] Atul Puri and R. Aravind. Motion-Compensated Video Codingwith Adaptive Perceptual Quantization. IEEE Trans. CircuitsSyst. Video Tech., 1(4):351–61, Dec 1991.

[PA94] M. R. Pickering and J. F. Arnold. A Perceptually Efficient VBRRate Control Algorithm. IEEE Trans. Image Proc., 3(5):527–32,Sep 1994.

BIBLIOGRAPHY 453

[PAC92] M. Pickering, J. Arnold, and M. Cavenor. VBR Rate Controlwith a Human Visual System Based Distortion Measure. In Aus-tralian Broadband Switching and Services Symposium, Jul 1992.

[Pan94] D. Pan. An Overview of the MPEG/Audio Compression Algo-rithm. In SPIE. Digital Video Compression on Personal Com-puters: Algorithms and Technologies, volume 2187, pages 260–73,1994.

[Pea90] William A. Pearlman. Adaptive Cosine Transform Image Codingwith Constant Block Distortion. IEEE Trans. Comm., 38(5):698–703, May 1990.

[Pen96a] W. Pennebaker. MPEG vendor worksheet. Encoding ScienceConcepts, Inc., July 1996.

[Pen96b] W. B. Pennebaker. Technical report, in preparation, 1996.

[Pen96c] W. B. Pennebaker. Technical report, in preparation, 1996.

[Pen96d] W. B. Pennebaker. Bit-rate Reduction and Rate Control forMPEG. Technical Report ESC96-001, Encoding Science Con-cepts, Inc., Feb. 1996.

[Pen96e] W. B. Pennebaker. Motion Vector Search Strategies for MPEG-1.Technical Report ESC96-002, Encoding Science Concepts, Inc.,Feb. 1996.

[PHS87] A. Puri, H. M. Hang, and D. L. Shilling. An efficient block-matching algorithm for motion compensated coding. In Proc.IEEE ICASSP, pages 25.4.1–4, 1987.

[Pin94] J. Pineda. MPEG vendor worksheet. Logician, Inc., October1994.

[Pir81] Peter Pirsch. Design of DPCM Quantizers for Video SignalsUsing Subjective Tests. IEEE Trans. Comm., COM-29(7):990–1000, July 1981.

[PM93] William B. Pennebaker and Joan L. Mitchell. JPEG: Still ImageData Compression Standard. Van Nostrand Reinhold, New York,1993.

[Poy95a] C. A. Poynton. Frequently Asked Questions about Colour. In-ternet: www.inforamp.net / poynton, pages 1–24, 1995.

[Poy95b] C. A. Poynton. Frequently Asked Questions about Gamma. In-ternet: www.inforamp.net/ poynton, pages 1–10, 1995.

454 MPEG VIDEO COMPRESSION STANDARD

[Qua94] B. Quandt. MPEG vendor worksheet. HEURIS Logic Inc., March1994.

[Raz94] A. Razavi. MPEG vendor worksheet. Zoran Corp., March 1994.

[Rea73] C. Reader. Orthogonal Transform Coding of Still and MovingPictures. PhD thesis, University of Sussex, 1973.

[Rea96] C. Reader. MPEG4: Coding for content, interactivity, and uni-versal accessibility. Optical engineering, 35(l):104–8, Jan 1996.

[RF85] A. R. Robertson and J. F. Fisher. Color Vision, Representation,and Reproduction, chapter 2. In Benson [Ben85], 1985.

[Ris76] J. J. Rissanen. Generalized Kraft Inequality and Arithmetic Cod-ing. IBM J. Res. Develop., 20:198–203, May 1976.

[RJ91] M. Rabbani and P. W. Jones. Digital Image Compression Tech-niques. SPIE Optical Engineering Press, Bellingham, WA, 1991.

[Rob66] J. G. Robson. Spatial and temporal contrast-sensitivity functionsof the visual system. J. Opt. Soc. Am., 56:1141–2, Aug 1966.

[Roc72] F. Rocca. Television Bandwidth Compression Utilizing Frame-to-Frame Correlation and Movement Compensation. In Sym-posium on Picture Bandwidth Compression, 1969, MIT, Cam-bridge, Mass., 1972. Gorden and Breach.

[Rog83a] B. E. Rogowitz. Spatial/temporal interactions: Backward andforward metacontrast masking with sine wave gratings. VisualResearch, 23(10):1057–73, 1983.

[Rog83b] B. E. Rogowitz. The Human Visual System: A Guide for theDisplay Technologist. Proc. SID, 24(3):235–52, 1983.

[RY90] K. R. Rao and P. Yip. Discrete Cosine Transform. AcademicPress, New York, 1990.

[RZ72] Fabio Rocca and Silvio Zanoletti. Bandwidth Reduction ViaMovement Compensation on a Model of the Random Video Pro-cess. IEEE Trans. Comm, pages 960–5, Oct 1972.

[Say96] K. Sayood. Introduction to Data Compression. Morgan Kauf-mann Publishers, Inc., San Francisco, 1996.

[SB65] A. J. Seylor and Z. L. Budriikis. Detailed perception after scenechanges in television image presentation. IEEE Trans. Inf. The-ory, IT-11(l):31–43, Jan 1965.

BIBLIOGRAPHY 455

[Sey62] A. J. Seyler. The Coding of Visual Signals to Reduce Channel-Capacity Requirements. Technical Report Monograph No. 535E,The Institution of Electrical Engineers, July 1962.

[Sey94] J. Seymour. MPEG vendor worksheet. AuraVision Corp., 1994.

[SGV89] Description of Ref. Model 8 (RM8). CCITT Study Group XV.Specialist Group on Coding for Visual Telephony. Doc. No. 525,Jun 1989.

[Sha49] C. E. Shannon. The Mathematical Theory of Communication.The University of Illinois Press, Illinois, 1949.

[Ste94] P. Stevens. MPEG vendor worksheet. Siemens Ltd., Australia,October 1994.

[Tan92] Craig K. Tanner. The Cable TV Industry Looks for ImagingSolutions at Cable Labs. Advanced Imaging, pages 50–65, Oct1992.

[Tay94] M. Tayer. MPEG vendor worksheet. General Instruments Corp.,March 1994.

[Tom94] A. S. Tom. MPEG vendor worksheet. Imedia Corp., October1994.

[TR96] Jeffrey A. Trachtenberg and Mark Robichaux. Crooks CrackDigital Codes of Satellite TV. Wall Street Journal, page B1,January 12, 1996.

[Vas73] A. Vassilev. Contrast sensitivity near boarders: Significance oftest stimulus form, size, and duration. Vision Res., 13(4):719–30,Apr 1973.

[VCD94] Video CD Specification Version 2.0: Compact Disc Digital Video.JVC, Matsushita, Philips, and Sony, July 1994.

[WA85] A. B. Watson and A. J. Ahumada, Jr. Model of human visual-motion sensing. J. Opt. Soc. Am. A, 2(2):322–41, Feb 1985.

[Wan95] Brian A. Wandell. Foundations of Vision. Sinauer Associates,Inc, Sunderland, Massachusetts, 1995.

[WC90] Q. Wang and R. J. Clarke. Motion compensated sequence codingusing image pyramids. Elect. Lett., 26(9):575–6, Apr 1990.

[Wil91] R. N. Williams. Adaptive Data Compression. Kluwer AcademicPublishers, Boston, 1991.

456 MPEG VIDEO COMPRESSION STANDARD

[WMB94] Ian H. Witten, Alistair Moffat, and Timothy C. Bell. ManagingGigabytes. Van Nostrand Reinhold, New York, 1994.

[XEO90] Kan Xie, Luc Van Eycken, and Andre Oosterlinck. Motion-Compensated Interframe Prediction. In SPIE Applications ofDigital Image Processing XIII, volume 1349, pages 165–75, 1990.

[XEO92] Kan Xie, Luc Van Eycken, and Andre Oosterlinck. A new block-based motion estimation algorithm. Signal Proc.: Image Com-munications, 4:507–17, 1992.

[Yag93] Yagasaki. Oddification problem for iDCT mismatch. ISO/IECJTC1/SC2/WG11 MPEG 93/278, Mar 1993.

[Zur94] F. Zurla. MPEG vendor worksheet. IBM Microelectronics, March1994.

[ZZB91] Sohail Zafar, Ya-Qin Zhang, and John S. Baras. Predictive Block-Matching Motion Estimation for TV Coding – Part I: Inter-BlockPrediction. IEEE Trans. Broadcasting, 37(3):97 101, Sep 1991.

Index

1-D cosine transform, 331-D sine transform, 332-D DCT, 42

AC, 38, 91code table, 95coding, 137coding in I-pictures, 94coding in P- and B-pictures,

99access unit, 8, 19activity masking, 70additive color system, 52Advanced Television Systems Com-

mitteeATSC, 397

aliasing, 37alphabet, 84alychne, 63American National Standards In-

stituteANSI, 14

analog video formats, 5ANSI, 14, 16applications, 12arithmetic coding, 86asynchronous transmission mode

ATM, 31ATM, 31, 173ATSC, 397ATV, 397

1995 Digital Television Stan-dard, 397

Dolby AC-3 audio, 397EIA, 397

IEEE, 397JCIC, 397MPEG-2 video, 397NAB, 397NCTA, 397SMPTE, 397

audio, 1, 20MPEG-2, 31

audio stream, 119audio_bound, 126

B-frame picture, 174B-picture, 22, 90, 137

coding, 99motion vectors, 253

backward masking, 76backward motion vector coding, 159backward motion vectors, 253backward motion-compensated pre-

diction, 242backward_f, 159Bayesian estimation, 88bidirectionally predictive-coded pic-

tureB-picture, 22

big endian, 166bilinear interpolation, 240bit allocation, 313, 322, 333, 334,

354adjusting, 355in MPEG-2 TM5, 336

bit stuffing, 354bit_rate, 140, 342blacK, 52blanking, 5

457

458

Bloch’s law, 76block layer, 135, 160block matching, 240, 283, 299block (), 161brightness constancy, 55brightness perception, 54broken_link, 146bslbf, 133, 166buffer

constraints, 351decoder, 340encoder, 340occupancy, 340, 347overflow, 19, 333, 344, 351, 354underflow, 19, 333, 344, 351,

354bytealigned ( ) , 115

C language, 12, 105Cable television, 3CableLabs, 358, 398causal, 340, 347cbp, 99cbp,158CCITT, 2, 173CD-ROM, 2center of gravity law, 62CFF, 72chroma, 58chromaticity coordinates, 61chrominance, 4, 54CIE, 55CIE primaries, 64CIELAB, 55CIELAB color space, 66CIELUV, 55CIELUV color space, 66GIF,400,418close_gop, 146CMY, 52CMYK, 52code tree

Huffman, 87

coded block patterncbp, 99

codingentropy, 81interactions between pictures,

351model, 89system, 81system structure, 81zero blocks, 99zero macroblocks, 99

coding model, 29, 81coding order, 23color constancy, 60color coordinate transformations,

63color space

CIELAB, 66CIELUV, 66gamma-corrected RGB, 58perceptually uniform, 55YCrCb, 58YUV, 58

common intermediate formatGIF,400

compact decision notation, 108compliance testing, 17computational complexity, 284conditional probabilities, 89conditional replenishment, 90constrained parameters, 144, 179,

351constrained_parameters_

flag ,126, 144, 248, 334contrast sensitivity, 74contrast sensitivity function, 67cosine basis function, 40cosine basis functions, 8-point, 38cosine transform, 33critical flicker frequency, 72CSPS_flag, 126custom quantization tables, 46

cyan, magenta and yellowCMY, 52

D-MAC, 177D-picture, 22, 137, 174data element syntax summary, 165data reduction, 81data stream example, 166DC, 27, 38, 91

additional bits, 92coding, 137coding in I-pictures, 92coding in predicted pictures,

99nonintra coding, 268prediction in intra coding, 265size category, 92

DC coding, 161DCT, 25, 33, 69, 83, 90

1-D, 372-D, 422-D basis function, 438×8, 25AC, 27coefficient, 38DC, 27dequantization, 46, 49

intra, 263nonintra, 268

discarding high frequency co-efficients, 354

fast, 45minimax, 336precision, 45quantization, 46, 48, 90scaled, 45

DCT coefficient, 25DCT-based model, 90dead zone, 46, 272, 275decoder block diagram, 102decorrelation, 28, 44

DCT, 90default quantization, 46

dequantization, 49intra, 263nonintra, 268

descriptors, 82differential pulse code modulation,

83digital video, 3Digital Video Cassette Consortium

DVC, 398discrete cosine transform

DCT, 252-D, 42

discrete sine transformDST, 45

displacementcalculations, 253histograms, 286principal part, 245residual, 245sign convention, 242

display flicker, 72display order, 23

Dolby AC-3, 127Dolby AC-3 audio, 397, 398DPCM, 83, 92drop_frame_flag, 146DST, 45DTS, 131DVB, 398DVC, 398dynamic window switching, 21

EBU, 398elementary stream, 119, 123, 127,

174encoder block diagram, 100encoder decision strategies, 30encoder model, 82end-of-block, 30

EOB, 94end_of_macroblock, 137, 158energy compaction, 44entropy, 85

459

entropy coding, 21, 81, 82, 84adaptive, 87

EOB, 30, 94ETSI, 398European Broadcasting Union

EBU, 398European Digital Video Broadcast

DVB, 398European Telecommunications Stan-

dards InstituteETSI, 398

even function, 33even symmetry, 33extension data, 144extension_and_user_data ( ), 144,

150extension_start_code, 145, 187extra_bit_slice, 150, 169extra_information.picture, 150extra_information_slice, 150

f_code, 247facilitation, 70FDCT, 42

1-D, 42quantization, 48

field, 5fixed rate, 342fixed_flag, 126flowcharts, 135

decision notation, 108operators, 110primitives, 106rules, 105test notation, 108

forced updating, 49, 272Forward DCT, 42forward masking, 76forward motion vector, 251forward motion-compensated pre-

diction, 241, 242forward_f, 159forward_f-code, 245

frame, 5, 22full pel, 29full search, 241, 283full_pel_forward_vector, 245

G.711, 395G.722, 397G.723, 397G.728, 397gamma correction, 55gamma-corrected luminance, 58GOP, 136

adjusting, 354, 356Grassman's laws, 54group of pictures, 22group of pictures layer, 135, 145group_of_pictures ( )group_start_code, 145

, 145

H.221, 395H.223, 397H.230, 395H.242, 395H.245, 397H.261, 395, 399

block layer, 409comparison with MPEG, 399GQUANT, 405group of blocks layer, 405layers, 402MQUANT, 407oddification, 272overview, 395picture formats, 400picture layer, 403summary of data elements, 415video sequence, 402

H.261 macroblock layer, 406H.263, 397, 417

block layer, 431comparison with H.261, 417comparison with MPEG, 417DQUANT, 425, 431

460

GQUANT, 425group of blocks, 425macroblock layer, 428oddifkation, 272overview, 395picture formats, 418picture header, 422picture layer, 421summary of data elements, 439video sequence, 420

H.320, 395H.324, 397half-pel, 29HDTV, 13header_length, 126high-definition television, 13history of MPEG, 383horizontal_size, 140Huffman coding, 29, 84, 86

code assignment, 86code tree, 87symbol pairing, 86

human visual systemHVS, 51

HVS, 51spatial-temporal interactions,

72

I-picture, 22, 90, 137IDCT, 42, 263

1-D, 42clamping, 265, 268dequantization, 49IEEE specification, 269mismatch, 33, 49

IDCT mismatch, 185, 263, 269causes, 269control, 275

Katayama’s proposal, 277Yagasaki’s proposal, 279

IEC, 1IEEE

specification for IDCT, 269

Indio, 3informative, 7inter

nonintra, 22inter compression, 237interframe, 22interlace, 5, 171interlaced video, 174International Telecommunications

Union - Terminal SectorITU-T, 173

interpolated motion-compensatedprediction, 244

intra, 7, 22intra coding, 27, 137intra-coded picture

I-picture, 22intra_quantizer_matrix , 144intraframe, 22Inverse DCT, 42invQ_intra ( ), 263invQ_intra_Cb ( ), 266invQ_intra_Cr ( ), 266InvQ_intra_Y1 ( ), 265invQ_intra_Ynext ( ), 266InvQ_non_intra ( ), 268IS 11172

MPEG-1, 1ISO, 1ISO/IEC 11172 stream, 121ISO/IEC JTC1/SC29/WG11, 1iso_11172_end_code, 119,121,123ITTF, 135ITU, 2ITU-T, 173

JPEG, 82, 90, 92Motion, 398

language support, 119layer, 120level, 95level of difficulty, 14

461

462

Lightness, 55little endian, 166load_intra_quantizer_matrix , 144load_non_intra_

quantizer_matrix , 144local decoding, 29lossless, 7, 29, 81, 90lossy, 7, 51, 82luma, 58, 314luminance, 4, 54

MAC, 175, 198macroblock, 23

skipping, 160type selection, 333, 350

macroblock address, 151macroblock address increment, 99macroblock header, 151, 251macroblock layer, 135, 151macroblock skipping, 151macroblock ( ), 151macroblock_address_

increment, 151macroblock_escape,151macroblock_intra, 158macroblock_motion-backward, 158macroblock_motion_forward, 158macroblock_pattern,158macroblock_stuffing, 151

macroblock_type , 158, 251MAD, 241, 284

chroma, 292local minima, 292luma, 292relationship to coded bits, 286

main profile, 2main profile at main level, 172marker bit, 123, 140masking

artifact classification, 322block variance, 321coded bits, 328

correlation with observer data,329

DCT coefficient sum, 324DCT macroblock classification,

325DCT minimax, 323DCT-based, 323pattern classification, 315spatial, 314spatial derivative, 315, 317, 329

classification, 320spatial derivative error, 316spatial, in I-pictures, 328statistical activity classes, 322temporal, 314, 331

masking function, 314, 348match criterion, 241Maxwell triangle, 66mean absolute distortion

MAD, 241mean square distortion, 241mismatch

IDCT, 49modified discrete cosine transform,

21motion compensation, 11, 28, 90,

159, 237, 240, 283motion displacement, 251motion displacement prediction, 251motion estimation, 28, 237, 254,

283Motion JPEG, 398motion perception, 72motion scaling factor, 247motion sensing, 75motion variables, generic, 251motion vector

coding, 250correlation, 241, 292precision, 240prediction, 241

motion vector coding, 159

motion vector search2-D logarithmic, 3013-D, 306algorithms, 297computational complexity, 308conjugate direction, 301cost function, 295criterion, 284crossed diagonal, 304failure, 296fast algorithm comparison, 307fast algorithms, 300fractional-pel, 290median filtering, 307modified motion estimation, 301orthogonal, 304parallel processing, 304phase correlation, 306predictive pattern, 305range size, 286reference picture, 286sparse sampling, 304successive refinement, 304telescopic, 305three-step, 301tiebreaking, 295truncated summation, 311variable resolution, 304

motion vectors, 28motion_backward(), 253motion_code, 159, 247, 251motion_displacement ( ), 251motion_forward(), 251motion_horizontal_backward_

code, 159motion_horizontal_forward.

code, 159motion_r, 247, 251motion_vertical_backward_

code, 159motion_vertical_forward,

code, 159

MPEGapplications, 12

MPEG Audio Standard, 1, 17MPEG coding models, 90MPEG history, 383MPEG home page, 15MPEG on the internet, 15MPEG patents, 357

analysis, 357ISO position, 357problem, 358search, 360search sponsorship, 358

MPEG products, 363MPEG simulation software, 388MPEG Systems Standard, 1, 17MPEG vendors, 363

Array Microsystems, Inc., 367AuraVision Corp., 368C-Cube Microsystems, Inc.,

369CompCore Multimedia, Inc.,

369CRS4, 370Digital Equipment Corp., 371DiviCom, Inc., 371ESC, 372FutureTel, Inc., 372General Instrument Corp., 373Hartmann Multimedia Service,

374HEURIS Logic Inc., 374Hughes Aircraft Company, 375IBM, 375Imedia Corp., 376Logician, Inc., 377LSI Logic Corp., 377Siemens Ltd., 379StellaCom, Inc., 379Sun Microsystems, Inc., 380Texas Instruments Inc., 380worksheet, 363

463

Zoran Corp., 381MPEG video, 383MPEG Video Standard, 1, 17MPEG-1, 1, 383

AC code table, 95audio, 20chrominance sampling, 68five parts, 391overview, 17system layer, 17system syntax, 117video layers, 22vocabulary, 4

MPEG-1 applications, 3MPEG-1 errata, 441MPEG-1 video example, 166MPEG-2, 1, 13, 30, 145, 383

2:3 pull-down, 206advantages of, 171alternate_scan, 206applications, 172aspect_ratio_information, 191audio, 31B-field picture, 174B-frame, 175big picture, 202bit_rate ,191block(i), 225burst_ amplitude, 211chroma formats, 195chroma_420_type , 206chromaticity coordinates, 198chrominance sampling, 175code_block_pattern_420 , 224coded frame, 174coded_pattern( ), 224color coordinates, 198colour_description , 198composite_display_flag , 206concealment_motion_

vectors, 205constrained_parameters_

flag, 192copyright_extension( ), 212,

215copyright_flag, 215copyright_identifier, 215

, 191data element extensions, 189data partitioning, 178differences with MPEG-1, 185display aspect ratio, 191display height, 198display width, 198DTS, 174dual prime, 221dual-prime motion compensa-

tion, 256, 260error resilience, 173expanded parameter ranges, 187extension_and_user_data_

G(), 189P ( ), 189V ( ) , 196X ( ) , 189

extension_start_code, 183,189extra_bit_slice, 217extra_information_slice, 217f _codes, 205field, 174field motion, 256field parity, 174field picture, 260field_motion_type, 221field_sequence, 211forward motion vectors, 220frame, 174frame motion, 256frame picture, 260frame_motion_type, 221frame_pred_frame-dct, 205, 221frame_rate_code, 191frame_rate_value, 191group of pictures header, 184,

464

198group_start_code, 189high profile, 178I-field picture, 174I-frame, 174I-frame picture, 174IDCT mismatch, 185interlaced frame, 194intra-coded block reconstruc-

tion, 274intra_dc_mult, 205intra_dc_precision, 205intra_slice, 217intra_slice_flag, 217intra_vlc_format, 206intra_vlc_table, 227invQ_intra_( ), 274level, 192low_delay, 195, 202macroblock skipping, 216macroblock stuffing, 217macroblock_modes( ), 217macroblock_type, 217, 220main profile, 2, 30, 171, 178main profile data elements, 227main profile restrictions, 227main profile syntax, 187main profile video sequence, 183matrix_coefficients , 198motion compensated prediction,

261motion compensation, 256motion vector calculation, 256motion vector codes, 203motion_vector(r, s), 222motion_vectors(s), 222motion_vectors(sO), 220nine parts, 393nonintra block reconstruction,

275optional extensions, 195original_or_copy, 215

overview, 171P-field picture, 174P-frame, 174P-frame picture, 174packetized elementary stream

PES, 173PCR, 174pel reconstruction, 272PES, 173picture, 174picture coding extension, 203picture header, 184, 202picture_coding_type , 202picture_data( ), 215picture_display_

extension( ), 212picture_structure, 205, 221precision, 179profile_and_level_

indication, 194profiles, 178, 192program stream

PS, 173progressive frame, 194progressive_frame, 205, 206progressive_sequence, 195PS, 173PTS, 174q_scale_type, 206quant_matrix_extension(), 212quantiser_scale_code, 206, 217quantiser_scale_type, 217quantization defaults, 192repeat_first_field , 206reserved_bits , 217run-level tables, 227sample aspect ratio

SAR, 191SAR, 191scalability, 31, 171SCR, 174sequence header, 189

465

sequence_display_exten-sion ( ), 191, 196

sequence_extension(), 187, 192sequence_scalable_

extension(), 217simple profile, 178slice, 179slice(), 216slice_start_code, 216slice_vertical_

position, 215slice_vertical_position-

extension, 215SNR scalability, 177SNR scalable profile, 178spatial scalability, 178spatial_temporal_weight _

class, 221spatial-temporal_weight-

code_flag, 220spatially scalable profile, 178start codes, 187STD, 174sub_carrier, 211sub_carrier_phase, 211systems, 31, 173temporal scalability, 178Test Model 5, 327, 335TM5, 335top_field_first, 205transfer_characteristics ,

198transport stream

TS, 173TS, 173user data, 195user_data(), 212v_axis, 211VBV, 179vbv_buffer_size, 192video, 30video formats, 198

zero stuffing, 217zigzag scan, 206

MPEG-3, 1, 31, 383MPEG-4, 1, 31, 383

three parts, 393MPEG-patents

for more information, 362patent holders, 360

MSE, 241, 284mux_rate, 123, 126, 134

next_start_code( ), 117nextbits( ), 114non_intra_quantizer_

matrix, 144nonintra, 7, 22nonintra coding, 28, 137nonphysical primaries, 64nonuniform quantization, 21normative, 7NTSC, 5, 175, 198, 397Nyquist limit, 37, 40

odd function, 34odd symmetry, 33oddification, 265, 268, 271opponent model of human vision,

60optimum code length, 85orthogonal, 38other video standards, 395overscan, 5

p×64, 395, 399p×64 reference model, 334P-picture, 22, 90, 137

coding, 99motion vector coding, 242motion vectors, 253

pack, 18, 31, 120pack header, 120pack layer, 121pack procedure, 121

466

pack start code, 18pack_start_code, 121packet, 18, 31, 120packet header, 120, 127packet layer, 127packet start code, 18packet_data_bytes, 121packet_length, 120packet_start_code, 127packet_start_code_prefix, 119packet_start_codes, 119, 127PAL, 5, 175, 198patents

MPEG, 357pattern classification, 315pattern_code, 158pel, 6pel differences, 8pel reconstruction, 237, 263pel-recursion, 240, 283, 299pel_aspect_ratio, 140perceptual quality, 322picture, 4picture element, 6picture header, 251picture layer, 135, 147picture_coding_type, 147picture_rate , 140, 343pixel, 6pre-echoes, 21predicting uncovered background,

244predictive model, 90predictive-coded picture

P-picture, 22presentation time stamp

PTS, 19presentation unit, 8progressive, 171progressive scan, 140progressive video, 175pseudocode, 12, 135

branches, 111comments, 105data elements, 113do-while, 113for, 113 loop structures, 111operators, 110presentation, 106procedure call, 111syntax, 105while, 111

PTS, 19, 131

QCIF, 400quant, 158quantization, 27, 46, 48

DCT, 27default, 91rounding, 46scaling, 48switching overhead, 327, 349variable, 313visually-weighted, 27, 46, 69,

315uanti er_scale, 48, 150, 313

quarter CIFQCIF, 400

r_size, 247rate

uanti er_scale, 347rate buffer, 334rate control, 313, 333, 345

adaptive GOP, 339adjusting bit allocation, 355bit allocation, 339buffer occupancy, 347complexity estimation, 348complexity prediction, 338discarding DCT coef., 355error carry, 349feedback, 347interleaved systems, 349

467

limit cycle oscillation, 350literature review, 333picture complexity, 339picture repeating, 355profiles, 353rate discontinuities, 349recoding, 336recursive prediction, 337s-shaped curve, 335, 354stressing system, 356target rate, 348variable bitrate, 337

rate_bound, 126reconstructed data, 7reconstruction module, 100red-green-blue

RGB, 52region of support, 42repeating pictures, 354reserved_byte, 127residual, 247RGB, 52RGB CIE primary system, 64rounding

quantization, 46run

of zero coefficients, 95run-level, 95

SAD, 284sample, 4sampling format 4:2:0, 175sampling format 4:2:2, 175sampling format 4:4:4, 175satellite, 3scene change, 76, 297scene complexity, 321SCR, 123, 126SCR calculation examples, 133SECAM, 5, 175, 198sector, 134separable transform, 42sequence, 4

sequence header, 136, 140sequence header code,138sequence_end_code, 136sequence_error_code, 138SIF, 301Sign(), 115simultaneous masking, 20sine transform, 33, 99skipped macroblocks, 160slice, 23slice layer, 135, 150slice_start_code, 150slice_vertical_position, 167software reference model, 17source data, 7source input format, 301spatial masking, 314spatial resolution, 4standards vocabulary, 7start code value, 117start codes, 117, 119, 137statistical model, 88statistical modeling, 83

statistically sparse fast search, 304STD, 19, 120STD buffer size, 120STD_buffer_bound_scale , 127STD_buffer_size_bound, 127stereo, 2stream-id, 121, 127subband coding, 21subtractive color system, 52sustained signals in HVS, 74symbols, 30, 82, 83

combining, 89conditional probabilities, 89efficient set, 88pairing in Huffman coding, 86probabilities, 88

synchronization, 17system clock, 120system data element summary, 131

468

system header, 120, 123system layer, 117, 119, 135

MPEG-1, 17system start codes, 119, 138system syntax, 117system target decoder

STD, 19, 120system_audio_lock_flag, 126system_clock_frequency , 126system_clock_reference, 133system_header_start_code, 126system_video_lock_flag, 127systems, 1systems layer

MPEG-2, 31

teleconferencing, 3teleconferencing standards, 395

G.711 audio, 395G.722 audio, 397G.723 speech, 397G.728 audio, 397H.221 multiplex, 395H.223 multiplexing, 397H.230 control protocol, 395H.242 system control, 395H.245 control protocol, 397H.261 video, 395H.263 video, 397H.320 systems, 395H.324 terminal, 397

temporal masking, 21, 76, 314temporal_reference, 147three-color system, 53time stamp, 120time_code, 145time_code_hours, 146time_code_minutes, 146time_code_pictures, 146time_code_seconds, 146toggling, 274tracking of moving objects, 78transform coding, 359

transient signals in HVS, 74trichromatic theory, 52tristimulus values, 53true bitrate, 140, 344

U.S. Advanced TelevisionATV, 397

U.S. Advanced Television SystemsCommittee

ATSC, 397uimsbf, 133, 166user data, 144user_data_start_code, 145

variable length codes, 29variable quantization, 70, 313, 333

background drag, 331bitrate reduction, 332literature review, 314perceptual studies, 328still-picture coding, 315

VBV, 342picture removal, 345video buffering verifier, 333

vbv_buffer_size, 140, 343vbv_delay, 126, 147, 344vertical_size, 140video buffering verifier

VBV, 333video layers, 22, 117video sequence, 135, 138video sequence layer, 22, 135video simulation model, 385video start codes, 119, 138video_bound, 127video_sequence( ), 138Videotex, 3vlclbf, 166vocabulary, 7

Weber’s law, 54, 314White Book, 126, 172wraparound, 248

469

470

X3L3.1, 14XYZ CIE primary system, 64

YCbCr, 58YIQ, 59YUV, 58

zero frequency problem, 88zigzag, 94zigzag scan order, 29