26 -stand09-hagqvist

7/29/2019 26 -Stand09-Hagqvist

1/12

04.06.2009 1Public

Coding StandardsFICORA Standardization Seminar 17.11.2009

Dipoli, Espoo

Jari Hagqvist, Principal Member of Research Staff, Audio

Technology

Nokia Research Center, Tampere


2/12

17.11.2009 /

JHag

2Public

Outline

Speech/Audio:

Trends in Speech/Audio Coding

ITU-T SG16 Speech/Audio

3GPP Speech/Audio in TSG-SA4

Speech/Audio in Other Standardization Bodies

Video:Video Codec Evolution

Joint Video Team (JVT) Achievements

ITU-T / Video Codec Experts Group (VCEG)

ISO-IEC / MPEGMobile Use-cases


3/12

17.11.2009 /

JHag

3Public

Trends in Speech/Audio Coding

Quality improvements - moving to wider audio

bandwidths from narrowband telephony

Narrowband (-3.4 kHz) --> Wideband (-7 kHz) -->

Superwideband(-14 kHz)

--> Fullband(-20 kHz)

Approaching transparent quality for speech

Multi-mode codecs capable of both speech and audio

Collaborative approaches in standardization(especially in ITU-T)

Replacing traditional winner takes it all process

Proprietary solutions in Internet VoIP (Skype, .)

Pressure on fixed/mobile operators to improve quality ?

Open Source, royalty free codecs

Can they succeed ?


4/12

17.11.2009 /

JHag

4Public

ITU-T SG16 Speech/Audio

Several new codecs and extensions (Annexes) from SG16:

G.711 Appendix III Quality EnhancementToolbox (under

AAP)

G.711.0 Lossless compression of G.711 pulse code

modulation (PCM)

G.711.1 Wideband embedded extension for G.711 PCM (64,

80, 96 kbit/s)

G.718G.718 Frame error robust narrowband and wideband

embedded

coding of speech and audio from 8-32 kbit/s

+ Annex B Superwideband extension (28-48 kbit/s,

under AAP)

G.719 Low-complexity, full-band audio coding for high-

quality,

conversational applications (32 - 128 kbit/s)

G.720.1 Generic sound activity detector (under AAP)


5/12

17.11.2009 /

JHag

5Public

ITU-T SG16 Ongoing Work

Stereo extension to G.718 / G.729.1 (2010)

Superwideband extension to G.711.1 / G.722 (2010)

Lossless bitstream compression for G.711.1 (2010)


6/12

17.11.2009 /

JHag

6Public

3GPP Speech/Audio in TSG-SA4

AMR-Narrowband codec in wide use (mandatory for 3G

WCDMA)

AMR-Wideband speech codec standardized in 2001 (=

ITU G.722.2)

Now being deployed

Enhanced AMR-WB (AMR-WB+) and eAAC+ audio codecs

For non-realtime applications (streaming)

New study item on Enhanced Voice Services (EVS) for

LTE

Superwideband audio (50-14000 Hz audio)

Stereo

Possibly realized through enhancements on top of

AMR-WB


7/12

17.11.2009 /

JHag

7Public

Other Speech/Audio

MPEG

Unified Speech and Audio Codec (USAC),

standardization ongoing

IETF

iLBC royalty-free codec (narrowband) available

New work starting on a royalty-free VoIP wideband

codec

Several potential candidates (Skype Silk, Speex,BV16/32, CELT, )


8/12

17.11.2009 /

JHag

8Public

Video Codec Evolution (Simplified)

Human visual system based codingFull adaptivity to content

Context adaptive codingMulti-frame technologies

In-loop filtering

Sub-pixel motion compensationIntra prediction

Motion compensationTransform coding

H.261

Compressionefficiency/pictu

requality

1990 1995 2000 2005 2010

H.263

MPEG-1MPEG-2

H.264/AVC

VC-1

Real10

H.265/HVC

SVC/MVC

Real8

Leader of the pack

Offspring

DivX6H.263++MPEG-4WM8

AVS China


9/12

17.11.2009 /

JHag

9Public

Joint Video Team (JVT)* Achievements

JVT finalized the H.264/AVC in 2003

Big success in adoption, two Emmy awards given

After H.264/AVC, two large initiatives:

Scalable Video Coding (SVC)

Multiview Video Coding (MVC)

(Download Nokias MVC implementation:

http://research.nokia.com/research/mobile3D )

SVC is adopted in DVB as an optional codec in the toolbox

SVC is currently being considered in 3GPP

MVC is proposed to Blu-ray Forum

*) JVT= ITU-T Video Coding Experts Group (VCEG) + ISO/IEC Moving Picture

Experts Group (MPEG)


10/12

17.11.2009 /

JHag

10Public

ITU-T / Video Codec Experts Group

(VCEG)

Key Technological Area (KTA) software in VCEG to collect various

improvements

Some evidence has been shown to VCEG justifying start of a new

project (H.265):

- TNTM (Tandberg-Nokia Test Model)*

- Very significant complexity savings with improved coding

efficiency

- KTA Software: 20-30% improved coding efficiency with

increased complexity

VCEG identified two main requirements for next-generation video

coding standard

1. Compared to H.264/AVC High Profile achieves the same visual

quality, at half the bitrate

2. When operated at half the complexityof H.264/AVC High Profile,

25% more coding efficiency with the same visual quality

*) Toward a H.265 low complexity profile, ITU-T Q.6/SG16 Doc COM 16-C 145-E


11/12

17.11.2009 /

JHag

11Public

ISO-IEC / MPEG

Like VCEG, MPEG has increased speed towards next

generation video coding

In the April -09 meeting, Call for Evidence was issued

In June sufficient evidence to launch a new project

Currently there are discussions on forming a new

collaborative team between MPEG and VCEG (similar to JVT)

In addition, MPEG is working towards defining a 3D videostandard for advanced 3D displays.

Utilize depth information to synthesize views


12/12

17.11.2009 /

JHag

12Public

Mobile Use-cases

Current mobile video services will continue to

evolve towards higher resolution, first 720p and

then FullHD (1080p 60Hz) levels.

In addition, two use-cases are emerging and becoming

increasingly important for mobile industry:

- Internet Compliance

- Mobile Phone as Movable Multimedia Center

Other emerging use-cases

3D Video

26 -stand09-hagqvist

Documents