Submitted by: Kaustubh Vilas Dhonsale

5359 Multimedia Processing

Spring 2012

Overview of H.264 and Audio Video coding Standards (AVS) of China

Prediction is difficult - especially of the future.

– Bohr (1885-1962)

Outline

Introduction

MPEG -4 AVC/ H.264

AVS of China

Video evaluation parameters

Experimental results

4/24/2012

Introduction

Fig. 1 Example of multimedia ecosystem. [1]

4/24/2012

Audio/Video History

Fig. 2 History of audio and video standards [2]

4/24/2012

MPEG - 4 part 2 AVC/ H.264

Moving Picture Experts Group (MPEG)

formed in 1988

Focused on creating a simple and clean

solution, limiting options and features to a

minimum for video and audio data

Has seven profiles each targeted to a

specific class of applications

4/24/2012

Main Profiles of H.264 [3]

Baseline profile

Main profile

Extended profile

High profile

4/24/2012

Advantages of H.264

Up to 50% in bit rate savings[2]

High quality video

Error resilience

More efficient entropy coding

Network friendliness

Wide areas of applications

4/24/2012

AVS of China

Developed by a working group of China named as

“Audio video coding Standard”[3]

Originally was developed to replace MPEG 2 format

Important two different parts—

AVS Part 2

High-definition digital video broadcasting and high-density

storage media

AVS Part 7

– for low complexity, low resolution mobility applications

4/24/2012

Parts of AVS of China

4/24/2012

Parts of AVS Contents Stage

Part 1 System for broadcasting Final committee draft

Part 2 SD/HD Video National Standard

Part 3 Audio Final draft

Part4 Conformance test Final committee draft

Part5 Reference software Final committee draft

Part 6 Digital right management Final committee draft

Part 7 Mobility video Final draft

Part 8 System over IP Final draft

Part 9 File format Final draft

Table 1 AVS China parts [3]

Basic Profiles

Profiles Key Applications

Jizhun (baseline) profile Television broadcasting, HDTV, etc.

Jiben (basic) profile Mobility applications, etc.

Shenzhan (extended) profile Video surveillance, etc.

Jiaqiang (enhanced) profile Multimedia entertainment, etc.

Table 2 Application based profiles of AVS of China [4]

4/24/2012

Layered structure of AVS of China

Fig. 3 Layered structure of AVS of China

4/24/2012

Video evaluation parameters

Peak Signal to Noise Ratio (PSNR)

Mean Square Error (MSE)

Structural Similarity (SSIM)

4/24/2012

Performance comparison parameters

Simulation with different test sequences

Bit rate

Quality PSNR

MSE

SSIM

Compression ratio

4/24/2012

Experimental results for AVS of china

Software used : BM1.0v3 [13]

Microsoft visual C++ 2008 express edition [14]

MSU video quality measurement tool [15]

4/24/2012

Original sequence: foreman_cif.yuv

Resolution: 358 X 288

Frame rate: 25 frames / sec

Original file size: 44550 Kilobytes

Number of frames used: 300

4/24/2012

File description

Results of foreman_cif.yuv sequence

Table 3 MSE, PSNR and SSIM for AVS China for the sequence foreman_cif.yuv

4/24/2012

QP Compressed

File size(KB)

Bit rate

(Kbits/s) Bits/pixel Y-PSNR (dB) Y-MSE Y-SSIM

Compression

ratio

0 20734 17100 6.63 60.54 0.0573 0.9997 2.14 : 1

15 6213 5123.57 1.9877 45.8679 1.6837 0.9942 7.1 : 1

31 1045 860.94 0.3340 37.6255 11.2340 0.9737 42.63:1

45 206 169.21 0.0656 31.2507 48.7547 0.9186 216.3:1

63 34 27.67 0.0107 23.8649 267.0482 0.7114 1317.3:1

Results continued…..

4/24/2012

Bitrate=17100 Kbits/s Bitrate= 860.94 Kbits/s Bitrate = 23.67Kbits/s

PSNR= 60.54 dB PSNR = 37.6255 dB PSNR= 26.8649 dB

MSE= 0.0573 MSE= 11.2340 MSE= 267.0482

SSIM= 0.9997 SSIM= 0.9737 SSIM = 0.7114

Fig. 4 Obtained compressed AVS china frames for different Bitrates

Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence

4/24/2012

0 2000 4000 6000 8000 10000 12000 14000 16000 1800030

35

40

45

50

55

60

65

Bitrate in Kbps

PS

NR

in d

B

PSNR Vs. Bitrate

Fig. 5 PSNR Vs. Bitrate for foreman_cif.yuv sequence

4/24/2012

Fig. 6 MSE Vs. Bitrate for foreman_cif.yuv sequence

0 2000 4000 6000 8000 10000 12000 14000 16000 180000

50

100

150

200

250

300

Bitrate in Kbps

MS

E

MSE Vs. Bitrate

4/24/2012

Fig. 7 SSIM Vs. Bitrate for foreman_cif.yuv sequence

0 2000 4000 6000 8000 10000 12000 14000 16000 18000

0.75

0.8

0.85

0.9

0.95

1

Bitrate in Kbps

SS

IM

SSIM Vs. Bitrate

Original sequence: foreman_qcif.yuv

Resolution: 176 X 144

Frame rate: 25 frames / sec

Original file size: 11138 Kilobytes

Number of frames used: 300

4/24/2012

File description

Results of foreman_qcif.yuv sequence

Table 4 MSE, PSNR and SSIM for AVS China for the sequence foreman_qcif.yuv

4/24/2012

QP Compressed

File size(KB)

Bit rate

(Kbits/s) Bits/pixel Y-PSNR (dB) Y-MSE Y-SSIM

Compression

ratio

0 5762 4751.41 7.49 53.658 0.2823 0.9985 1.93 : 1

15 1843 1519.72 2.3985 44.894 2.214 0.9905 6.04 : 1

31 436 350.44 0.5531 36.038 16.319 0.9493 25.56 : 1

45 118 96.68 0.1526 29.161 79.499 0.855 94.39 : 1

63 14 11.12 0.0176 20.357 603.59 0.5186 795.57 : 1

Results continued…..

4/24/2012

Bitrate=4751.41 Kbits/s Bitrate= 350.44 Kbits/s

PSNR= 53.65 dB PSNR = 36.038 dB

MSE= 0.2823 MSE = 16.139

SSIM= 0.9985 SSIM = 0.9493

Fig. 8 Obtained compressed AVS china frames for different Bitrates

Bitrate = 11.12 Kbits/s

PSNR = 20.357 dB

MSE = 603.59

SSIM = 0.5186

Comparison at different bitrates for AVS of China for foreman_cif.yuv sequence

4/24/2012

Fig. 9 PSNR Vs. Bitrate for foreman_qcif.yuv sequence

0 500 1000 1500 2000 2500 3000 3500 4000 4500 500020

25

30

35

40

45

50

55

Bitrate in Kbps

PS

NR

in d

B

PSNR Vs. Bitrate

4/24/2012

Fig. 10 MSE Vs. Bitrate for foreman_qcif.yuv sequence

0 500 1000 1500 2000 2500 3000 3500 4000 4500 50000

100

200

300

400

500

600

700

Bitrate in Kbps

MS

E

MSE Vs. Bitrate

4/24/2012

Fig. 11 SSIM Vs. Bitrate for foreman_qcif.yuv sequence

0 500 1000 1500 2000 2500 3000 3500 4000 4500 50000.5

0.55

0.6

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

Bitrate in Kbps

SS

IM

SSIM Vs. Bitrate

Original sequence: akiyo_qcif.yuv

Resolution: 176 X 144

Frame rate: 25 frames / sec

Original file size: 11138 Kilobytes

Number of frames used: 300

4/24/2012

File description

Results of akiyo_cif.yuv sequence

Table 5 MSE, PSNR and SSIM for AVS China for the sequence akiyo_qcif.yuv

4/24/2012

QP Compressed

File size(KB)

Bit rate

(Kbits/s) Bits/pixel Y-PSNR (dB) Y-MSE Y-SSIM

Compression

ratio

0 2059 1697.68 2.6794 58.8256 0.0852 0.9993 5.41 : 1

15 391 322.26 0.5086 47.3606 1.1940 0.9902 28.49 : 1

31 99 80.79 0.1275 41.5042 4.5989 0.9747 112.51 : 1

45 37 29.64 0.0468 34.3129 24.087 0.9231 301.03 : 1

63 10 7.84 0.0124 26.8455 134.43 0.8022 1113.8 : 1

Results continued…..

4/24/2012

Bitrate = 1697.68 Kbits/s Bitrate = 80.79 Kbits/s

PSNR = 58.82 dB PSNR = 41.5042 dB

MSE= 0.0852 MSE = 4.5989

SSIM = 0.9993 SSIM = 0.9747

Fig. 12 Obtained compressed AVS china frames for different Bitrates

Bitrate = 7.84 Kbits/s

PSNR = 26.8455 dB

MSE = 134.43

SSIM = 0.8022

Comparison at different bitrates for AVS of China for akiyo_qcif.yuv sequence

4/24/2012

Fig. 13 PSNR Vs. Bitrate for akiyo_qcif.yuv sequence

0 200 400 600 800 1000 1200 1400 1600 180025

30

35

40

45

50

55

60

Bitrate in Kbps

PS

NR

in d

B

PSNR Vs. Bitrate

4/24/2012

Fig. 14 MSE Vs. Bitrate for akiyo_qcif.yuv sequence

0 200 400 600 800 1000 1200 1400 1600 18000

20

40

60

80

100

120

140

Bitrate in Kbps

MS

E

MSE Vs. Bitrate

4/24/2012

Fig. 15 SSIM Vs. Bitrate for akiyo_qcif.yuv sequence

0 200 400 600 800 1000 1200 1400 1600 18000.8

0.82

0.84

0.86

0.88

0.9

0.92

0.94

0.96

0.98

1

Bitrate in Kbps

SS

IM

SSIM Vs. Bitrate

MSU video quality measurement tools[13]

Fig. 16 Snapshot of MSU video quality measurement tool

References

1. AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2 JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008

2. ITU H.263 Video Compression : http://www.h263l.com/

3. K. R. Rao and D. N. Kim, “Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1,”

IEEE 42nd Southeastern symposium on system theory (SSST), March 7-9 2010, pp. 1-8, March 2010.

4. J. Watkinson, “The MPEG Handbook”, Second Edition, Elsevier/Focal Press, pp. 1, 2004.

5. “Advanced Audio Video Coding Standard Part 2: Video”, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1063, Dec, 2003.

6. L. Yu, et al, “Overview of AVS-video coding standards”, Elsevier Press, Signal Processing: Image Communication, vol. 24, pp. 247-262, April 2009

4/24/2012

References continued….

7. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H.264/AVC Video Coding Standard”, IEEE Trans. on circuits and systems for video technology, Vol. 13, pp. 560 - 576, JULY 2003.

8. L. Fan, S. Ma and F. Wu, “Overview of AVS Video Standards”, IEEE International Conference on Multimedia and Expo (ICME), pp. 423-426, 2004.

9. Audio Video Coding Standard Workgroup of China (AVS), “Video Coding Standard FCD1.0”, NOV.2003.

10. AVS Video Expert Group, “Information Technology —Advanced Audio Video Coding Standard Part 7: Mobility Video”, Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1151,Dec.2004

11. Z. Wang, et al “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. on Image Processing, vol. 13, pp. 600-612, Apr. 2004.

12. I.E. Richardson, “The H.264 Advanced Video compression standard”, second edition, Wiley,2010

4/24/2012

References continued….

13. AVS software: : ftp://124.207.250.92 (password required)

14. Microsoft Visual C++ 2008 express edition: http://msdn.microsoft.com/en- us/express/future/bb421473

15. MSU video quality measurement tool: http://compression.ru/video/quality_measure/vqmt_download_en.html#start

4/24/2012