Download - 26 -Stand09-Hagqvist
-
7/29/2019 26 -Stand09-Hagqvist
1/12
04.06.2009 1Public
Coding StandardsFICORA Standardization Seminar 17.11.2009
Dipoli, Espoo
Jari Hagqvist, Principal Member of Research Staff, Audio
Technology
Nokia Research Center, Tampere
-
7/29/2019 26 -Stand09-Hagqvist
2/12
17.11.2009 /
JHag
2Public
Outline
Speech/Audio:
Trends in Speech/Audio Coding
ITU-T SG16 Speech/Audio
3GPP Speech/Audio in TSG-SA4
Speech/Audio in Other Standardization Bodies
Video:Video Codec Evolution
Joint Video Team (JVT) Achievements
ITU-T / Video Codec Experts Group (VCEG)
ISO-IEC / MPEGMobile Use-cases
-
7/29/2019 26 -Stand09-Hagqvist
3/12
17.11.2009 /
JHag
3Public
Trends in Speech/Audio Coding
Quality improvements - moving to wider audio
bandwidths from narrowband telephony
Narrowband (-3.4 kHz) --> Wideband (-7 kHz) -->
Superwideband(-14 kHz)
--> Fullband(-20 kHz)
Approaching transparent quality for speech
Multi-mode codecs capable of both speech and audio
Collaborative approaches in standardization(especially in ITU-T)
Replacing traditional winner takes it all process
Proprietary solutions in Internet VoIP (Skype, .)
Pressure on fixed/mobile operators to improve quality ?
Open Source, royalty free codecs
Can they succeed ?
-
7/29/2019 26 -Stand09-Hagqvist
4/12
17.11.2009 /
JHag
4Public
ITU-T SG16 Speech/Audio
Several new codecs and extensions (Annexes) from SG16:
G.711 Appendix III Quality EnhancementToolbox (under
AAP)
G.711.0 Lossless compression of G.711 pulse code
modulation (PCM)
G.711.1 Wideband embedded extension for G.711 PCM (64,
80, 96 kbit/s)
G.718G.718 Frame error robust narrowband and wideband
embedded
coding of speech and audio from 8-32 kbit/s
+ Annex B Superwideband extension (28-48 kbit/s,
under AAP)
G.719 Low-complexity, full-band audio coding for high-
quality,
conversational applications (32 - 128 kbit/s)
G.720.1 Generic sound activity detector (under AAP)
-
7/29/2019 26 -Stand09-Hagqvist
5/12
17.11.2009 /
JHag
5Public
ITU-T SG16 Ongoing Work
Stereo extension to G.718 / G.729.1 (2010)
Superwideband extension to G.711.1 / G.722 (2010)
Lossless bitstream compression for G.711.1 (2010)
-
7/29/2019 26 -Stand09-Hagqvist
6/12
17.11.2009 /
JHag
6Public
3GPP Speech/Audio in TSG-SA4
AMR-Narrowband codec in wide use (mandatory for 3G
WCDMA)
AMR-Wideband speech codec standardized in 2001 (=
ITU G.722.2)
Now being deployed
Enhanced AMR-WB (AMR-WB+) and eAAC+ audio codecs
For non-realtime applications (streaming)
New study item on Enhanced Voice Services (EVS) for
LTE
Superwideband audio (50-14000 Hz audio)
Stereo
Possibly realized through enhancements on top of
AMR-WB
-
7/29/2019 26 -Stand09-Hagqvist
7/12
17.11.2009 /
JHag
7Public
Other Speech/Audio
MPEG
Unified Speech and Audio Codec (USAC),
standardization ongoing
IETF
iLBC royalty-free codec (narrowband) available
New work starting on a royalty-free VoIP wideband
codec
Several potential candidates (Skype Silk, Speex,BV16/32, CELT, )
-
7/29/2019 26 -Stand09-Hagqvist
8/12
17.11.2009 /
JHag
8Public
Video Codec Evolution (Simplified)
Human visual system based codingFull adaptivity to content
Context adaptive codingMulti-frame technologies
In-loop filtering
Sub-pixel motion compensationIntra prediction
Motion compensationTransform coding
H.261
Compressionefficiency/pictu
requality
1990 1995 2000 2005 2010
H.263
MPEG-1MPEG-2
H.264/AVC
VC-1
Real10
H.265/HVC
SVC/MVC
Real8
Leader of the pack
Offspring
DivX6H.263++MPEG-4WM8
AVS China
-
7/29/2019 26 -Stand09-Hagqvist
9/12
17.11.2009 /
JHag
9Public
Joint Video Team (JVT)* Achievements
JVT finalized the H.264/AVC in 2003
Big success in adoption, two Emmy awards given
After H.264/AVC, two large initiatives:
Scalable Video Coding (SVC)
Multiview Video Coding (MVC)
(Download Nokias MVC implementation:
http://research.nokia.com/research/mobile3D )
SVC is adopted in DVB as an optional codec in the toolbox
SVC is currently being considered in 3GPP
MVC is proposed to Blu-ray Forum
*) JVT= ITU-T Video Coding Experts Group (VCEG) + ISO/IEC Moving Picture
Experts Group (MPEG)
-
7/29/2019 26 -Stand09-Hagqvist
10/12
17.11.2009 /
JHag
10Public
ITU-T / Video Codec Experts Group
(VCEG)
Key Technological Area (KTA) software in VCEG to collect various
improvements
Some evidence has been shown to VCEG justifying start of a new
project (H.265):
- TNTM (Tandberg-Nokia Test Model)*
- Very significant complexity savings with improved coding
efficiency
- KTA Software: 20-30% improved coding efficiency with
increased complexity
VCEG identified two main requirements for next-generation video
coding standard
1. Compared to H.264/AVC High Profile achieves the same visual
quality, at half the bitrate
2. When operated at half the complexityof H.264/AVC High Profile,
25% more coding efficiency with the same visual quality
*) Toward a H.265 low complexity profile, ITU-T Q.6/SG16 Doc COM 16-C 145-E
-
7/29/2019 26 -Stand09-Hagqvist
11/12
17.11.2009 /
JHag
11Public
ISO-IEC / MPEG
Like VCEG, MPEG has increased speed towards next
generation video coding
In the April -09 meeting, Call for Evidence was issued
In June sufficient evidence to launch a new project
Currently there are discussions on forming a new
collaborative team between MPEG and VCEG (similar to JVT)
In addition, MPEG is working towards defining a 3D videostandard for advanced 3D displays.
Utilize depth information to synthesize views
-
7/29/2019 26 -Stand09-Hagqvist
12/12
17.11.2009 /
JHag
12Public
Mobile Use-cases
Current mobile video services will continue to
evolve towards higher resolution, first 720p and
then FullHD (1080p 60Hz) levels.
In addition, two use-cases are emerging and becoming
increasingly important for mobile industry:
- Internet Compliance
- Mobile Phone as Movable Multimedia Center
Other emerging use-cases
3D Video