Comparison and Performance Analysis of H.264, AVS-China, VC-1 and Dirac - by Jennie G. Abraham

EE5359 – Multimedia Processing, Fall 2009EE Dept., University of Texas at Arlington

Disclaimer

This is a proposal; to be used as a roadmap toward fulfilling the

objectives of the project as part of course requirement for

EE5359 – Multimedia Processing, Fall 2009

This powerpoint is not a comprehensive documentation on the

subjects and topics mentioned.

- Jennie G Abraham

Outline

Introduction Multimedia Network Home Media Ecosystem Motivation Project Detail Example project elements

Architecture Comparison Design Level Analysis Feature Comparison Algorithmic Comparison Performance Comparison

Expected Outcomes Project Timeline References

Introduction

What?- Video compression standards aiming at high quality - Some standards leave the implementation open and only standardize the

syntax and the decoder. Optimization beyond the obvious Complexity reduction for implementation

Who?- H.264 : ITU-T VCEG together with the ISO/IEC MPEG- AVS China : Audio Video Coding Workgroup of China- VC-1 : developed by Microsoft, released by SMPTE- Dirac : BBC

Why?- Different companies, different countries, different application, royalty

fees, better algorithms

Multimedia Network

Home Media Ecosystem

A case for seamless integration of video coding standards

Motivation

Possibly identify new areas of research

Exploit redundancies, develop cross platform applications etc.

Familiarize with the codecs :

H.264, AVS China, VC-1, Dirac

Availability of the codecs in MPL @ UTA

Lack of comprehensive documentation for these codecs

Project Detail

Overview of each standard

Implementation of each codec

Compile and tabulate the developers, timeline of release, royalty/patents

Architecture Analysis and Comparison Encoder/Decoder Block Diagram

Design Level Analysis and Comparison Profiles levels intended applications for each of the profile/standard

Feauture Analysis and Comparison Integer sizes MB sizes Partition sizes Modes Format

Algorithmic Element comparison Prediction Motion Vector Precision Transform In Loop filters Entropy coding.. And so on

Performance Comparison Bit rate PSNR MSE Compression Complexity ssim

Test Sequences Different test sequences Different formats - QCIF/CIF/SD/HDTV

Documentation The study and results Codec user manual

The project is detailed as follows:

Codec Architecture Comparison

H.264 Codec AVS China Codec

For Example :

Design Level Analysis

Example of specific coding parts for H.264 profiles

Feature Comparison

VC-1VC-1H.264H.264

• 8x8, 4x8, 8x4, 4x48x8, 4x8, 8x4, 4x4adaptive block transformadaptive block transform

•Frequency-independent de-Frequency-independent de-quantization scalingquantization scaling

•4 tap bi-cubic filters for MC4 tap bi-cubic filters for MC

•Relatively-simple loop filterRelatively-simple loop filter

•Overlap intra filteringOverlap intra filtering

•Range reduction/expansionRange reduction/expansion

•Resolution reduction/expansionResolution reduction/expansion

• 8x8 and 4x48x8 and 4x4adaptive block transformadaptive block transform

•Frequency-dependent Frequency-dependent de-quantization matrixde-quantization matrix

•Long filters for MCLong filters for MC

•Complex loop filterComplex loop filter

•Spatial intra predictionSpatial intra prediction

•Multi-picture arbitrary-order Multi-picture arbitrary-order referencingreferencing

•Intra PCMIntra PCM

Block motionBlock motion

16-bit integer 16-bit integer transformstransforms

Bit-exact specBit-exact spec

Fading predictionFading prediction

Loop filterLoop filter

For example:For example:

Overlap in feature sets is a major reason why many companies

are currently integrating both codecs into the same chip.

Algorithmic Comparison

Example :

…. and more of similar comparison

Algorithmic Element

H.264

(MPEG-4 AVC)

SMPTE VC-1

(WMV 9)

AVS China

Part 2 Dirac

Entropy coding CAVLC,CABAC

Adaptive VLC 2D variable length coding.

Arithmetic coding

Transform integer DCT,Hadamard

integer DCT DCT Wavelet

transform

Performance Comparison

Simulation with different test sequences Bit Rate Quality

PSNR MSE SSIM

Compression Ratio Complexity

Encoding Time Decoding

Expected Outcome

The different facet of the project is aimed at bringing out these outcomes….

Familiarity with these standards Simulation of the codecs

Modes of Configuration Modification of Parameters Input sequence specifications Analyze the codec output

Identify areas of research and unexplored problems Document a resourceful detailed ‘how to’ manual on each reference

codec Create a ‘how to’ format to draw on for other softwares available in MPL

and future Efficient use of time and re-use of knowledge

Timeline

IMPLEMENTATION: Project proposal –------------------------------------------------- Oct 1

AVS China Implementation-----------------by Oct 7Dirac, H.264 –---------------------------------- by Oct 14

VC-1 Implementation ---------------------- by Oct 21

DOCUMENTATION:Tabulation of initial results –------------------------------------ by Oct 28

Interim Report and Presentation ------------------------ Oct 29Start documentation ---------------------------------- by Oct 31

Submit draft of final report -------------------- Nov 19Start user manual documentation---- Nov 20

FINALFinal project report and presentation ------------------------- Dec 3

References

DIRAC REFERENCES:[1] T. Borer, and T. Davies, “Dirac video compression using open technology”, BBC EBU Technical Review, July 2005[2] BBC Research on Dirac: http://www.bbc.co.uk/rd/projects/dirac/index.shtml[3] The Dirac web page: http://dirac.sourceforge.net[4] T. Davies, “The Dirac Algorithm”: http://dirac.sourceforge.net/documentation/algorithm/, 2005.[5] Dirac developer support: Overlapped block-based motion compensation: http://dirac.sourceforge.net/documentation/algorithm/algorithm/toc.htm[6] “Dirac Pro to bolster BBC HD links”:

http://www.broadcastnow.co.uk/news/multi-platform/news/dirac-pro-to-bolster-bbc-hd-links/1732462.article[7] Dirac software and source code: http://diracvideo.org/download/dirac-research/[8] Dirac video codec - A programmer's guide:http://dirac.sourceforge.net/documentation/code/programmers_guide/toc.htm[9] Daubechies wavelet: http://en.wikipedia.org/wiki/Daubechies_wavelet[10] Daubechies wavelet filter design: http://cnx.org/content/m11159/latest/[11] Dirac developer support: Wavelet transform:

http://dirac.sourceforge.net/documentation/algorithm/algorithm/wlt_transform.xht[12] Dirac developer support: RDO motion estimation metric:http://dirac.sourceforge.net/documentation/algorithm/algorithm/rdo_mot_est.xht

H.264 REFERENCES: [13] T.Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on Circuit and Systems

for Video Technology, Vol.13, pp 560-576, July 2003.[14] T. Wiegand and G. J. Sullivan, “The H.264 video coding standard”, IEEE Signal Processing Magazine, vol.

24, pp. 148-153, March 2007.[15] D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE

Communications Magazine, vol. 44, pp. 134-143, Aug. 2006.[16] S.K.Kwon, A.Tamhankar and K.R.Rao, “Overview of H.264 / MPEG-4 Part 10” J. Visual Communication and

Image Representation, Vol 17, pp.186-216, April 2006. [17] A. Puri, X. Chen and A. Luthra, “Video coding using the H.264/MPEG-4 AVC compression standard”, Signal

Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004[18] H.264 AVC JM software: http://iphome.hhi.de/suehring/tml/[19] H.264/MPEG-4 AVC: http://en.wikipedia.org/wiki/H.264[20] M.Fieldler, “Implementation of basic H.264/AVC Decoder”, seminar paper at Chemnitz University of

Technology, June 2004[21] H.264 encoder and decoder: http://www.adalta.it/Pages/407/266881_266881.jpg[22] R. Schäfer, T. Wiegand and H. Schwarz, “The emerging H.264/AVC standard”, EBU Technical Review, Jan.

2003.[23] H.264 reference software download : http://iphome.hhi.de/suehring/tml/[24] D. Marpe, T. Wiegand, and S. Gordon, "H.264/mpeg4-avc fidelity range extensions: tools, profiles,

performance, and application areas," in, IEEE International Conference on Image Processing, vol. 1, pp. I-593-6, 2005.

[25] S. Saponara, C. Blanch, K. Denolf, and J. Bormans, "The JVT advanced video coding standard: complexity and performance analysis on a tool-by-tool basis," in Packet Video Workshop, Nantes, France, April 2003.

VC-1 REFERENCES:[26] VC-1 technical overview -

http://www.microsoft.com/windows/windowsmedia/howto/articles/vc1techoverview.aspx[27] Microsoft Windows Media: http://www.microsoft.com/windows/windowsmedia[28] http://en.wikipedia.org/wiki/VC-1[29] Sridhar Srinivasan, et al, “Windows Media Video 9: overview and applications”, Signal Processing: Image

Communication, Volume 19, Issue 9, October 2004, Pages 851-875AVS CHINA REFERENCES: [31] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2

JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008. [32] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 3: Audio,” Audio

Video Coding Standard Group of China (AVS), Doc. AVS-N1551, Sep. 2008. [33] Lu Yu et al., “Overview of AVS-Video: Tools, performance and complexity,” SPIE VCIP, vol. 5960, pp. 596021-1~

596021-12, Beijing, China, July 2005. [34] Liang Fan, Siwei Ma and Feng Wu, “Overview of AVS video standard,” IEEE Int’l Conf. on Multimedia and Expo,

ICME '04, vol. 1, pp. 423–426, Taipei, Taiwan, June 2004. [35] Wen Gao et al., “AVS – The Chinese next-generation video coding standard,” National Association of Broadcasters, Las

Vegas, 2004. [36] Special issue on 'AVS and its Applications' Signal Processing: Image Communication, vol. 24,pp. 245-344,

April 2009.[37] AVS China software : ftp://159.226.42.57/public/avs_doc/avs_software

PERFORMANCE COMPARISON REFERENCES:[38] K. Onthriar, K. K. Loo and Z. Xue, “Performance comparison of emerging Dirac video codec with H.264/AVC”,

IEEE International Conference on Digital Telecommunications, Vol. 06, Page: 22, Issue: 29-31, Aug. 2006. [39] X. Wang, D. Zhao "Performance comparison of AVS and H.264/AVC video coding standards" J. of computer science and technology, May 2006, Vol. 21, No. 3, pp. 310-314[40] Comparison of H.264 and VC-1:http://en.wikipedia.org/wiki/Comparison_of_H.264_and_VC-1[41] Alejandro A. Ramirez Acosta, et al. "MPEG-4 AVC/H.264 and VC-1 codecs comparison used in IPTV video

streaming technology," Electronics, Robotics and Automotive Mechanics Conference, 2008, pp.122-126[42] Comparison between AVC/H.264, VC-1 and MPEG-2 - http://www.ebu.ch/en/technical/trev/trev_302-

sunna.pdf[43] H. Kalva, J.B Lee, “The VC-1 and H.264 video compression standards for broadband video Services”,

Springer, 2008SSIM REFERENCES:[44] Z. Wang, et al “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. on Image

Processing, vol. 13, pp. 600-612, Apr. 2004. [45] SSIM index for image quality assessment: http://www.ece.uwaterloo.ca/~z70wang/research/ssim/[46]    Z. Wang, et al“Multi-scale structural similarity for image quality assessment,” IEEE Asilomar Conference on

Signals, Systems and Computers, Nov. 2003.[47] SSIM: http://en.wikipedia.org/wiki/SSIMVIDEO TEST SEQUENCES:[48] Video test sequences (YUV 4:2:0): http://trace.eas.asu.edu/yuv/index.html[49] Video test sequences ITU601: http://www.cipr.rpi.edu/resource/sequences/itu601.html