media technologies @ ericsson research (new organization ...€¦ · 1 media technologies @...
TRANSCRIPT
![Page 1: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/1.jpg)
1
media Technologies @ Ericsson research (New organization Taking Form)
System Identification Related Problems at MT@ER Erlendur Karlsson, PhD
![Page 2: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/2.jpg)
2
Outline
› Ericsson Publications and Blogs › System Identification related applications at MT › Important issues when dealing with real-world problems › Trends and opportunities
![Page 3: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/3.jpg)
3
Ericsson’s Publications and Blogs
› Ericsson Publications –https://www.ericsson.com/en/publications –https://www.ericsson.com/en/publications/white-papers
› Ericsson Research Blogg › http://www.ericsson.com/research-blog
› 5G › Cloud › Context Aware Communication › Data and Knowledge › Garage › Internet of Things (IoT)
› LTE › Media Coding › SDN › Security › Service Systems › Smart Cities
![Page 4: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/4.jpg)
4
Cloud Robotics for 5G Enabled Manufacturing› Traditional robots,
programmed to carry out specific functions are replaced by new robots connected to the cloud
› These new robots only include low-level controls, sensors and actuators
› Their intelligence is moved to the cloud where they have access to almost unlimited computing power.
![Page 5: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/5.jpg)
5
Telehaptic Control› Drone inspection of
wind turbines › Friction and vibration
feedback in haptic interface used to signal unsafe movement of drone around wind turbine
› An application example for 5G technology
![Page 6: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/6.jpg)
6
System Identification Related Applications at MT
› Audio and Speech Coding › Media Content Analytics (ASR, Object detection in images) › Audio Media Processing
–Acoustic Echo Cancellation –Noise Suppression –Voice Activity Detection –Spatial Audio Capture –Spatial Audio Rendering
› Video Coding (2D and 3D) › Objective Quality Estimation of Encoded Audio and Video › Congestion Control in IP Networks
![Page 7: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/7.jpg)
7
Audio and Speech Coding
› Clean speech signals can be modeled very efficiently with Code-Excited Linear Prediction (CELP) encoders (Based on ARX model of the speech signal)
› Music signals are better encoded with transform encoding methods (Subband filter banks, MDCT)
› Signal classification and hybrid encoding used to obtain efficient encoding of audio signals of varying content
› EVS (Enhanced Voice System) just standardized in 3GPP standardization
› Special EVS session at ICASSP 2015 in Australia › 3GPP is currently planning for coding activities for VR/AR
![Page 8: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/8.jpg)
8
CELP Speech Model
![Page 9: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/9.jpg)
9
EVS Speech/Audio Codecprototype HL structure
TD (+TD-BWE)
Bits
tream
Bits
tream
FBWB
Audio BW
[kHz]4 ~6 8
TD
FD
Bits
tream
FD
Mode Technology
TD Improved AMR-WB technology
Linear Pred. + ACELP FCBvariable sf.
TD-BWE
Parametric high band
Linear prediction, energy/gain
FD G.719-like Transform (LD-MDCT),block switching
bandwidths
16 20
AMRWB-like
SWB
Mode Dec.
TD-BWE
G.719 like FD-coding parametric
wb
VAD
CNG
input
![Page 10: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/10.jpg)
10
Acoustic Echo Cancellation
› Long echo impulse reponses: 300-500 msec › At 48 kHz sampling : 14,400 – 24,000 samples
![Page 11: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/11.jpg)
11
Ericsson In-Game Communication
Ericsson In-Game CommunicationEntropia Universe / MindArk
![Page 12: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/12.jpg)
12
EIGC System Concept
![Page 13: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/13.jpg)
13
Spatial Audio Capture
› Microphone arrays › Filter design in the spatial and frequency domains › Beamforming techniques › Adaptive tracking of the most active speakers in a room
![Page 14: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/14.jpg)
14
Spatial Audio Rendering
› Spatial hearing › 3D binaural rendering through Head Related Filtering (HRF) › Very useful in 3D gaming and evolved communication
solutions › Spatial audio rendering onto any loudspeaker configuration
![Page 15: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/15.jpg)
15
Spatial Hearing
![Page 16: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/16.jpg)
16
Right Head Related Filter (HRF)
Left Head Related Filter (HRF)
Acoustic Wave ReceptionThe listeners median plane
Ipsilateral ear
Listener
Sound wave
Contralateral ear
Length L
ITD = L/c where c=speed of sound
![Page 17: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/17.jpg)
17
Speech recognition is the problem of deciding on ›How to represent the signal ›How to model the constraints ›How to search for the most optimal answer
ASR System – Main Components
Training Data
Applying Constraints AcousticModels
LexicalModels
LanguageModels
Representation
SearchSpeech Signal
RecognizedWords
Feature Vector
![Page 18: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/18.jpg)
18
ASR System – Solution Components
AcousticModels
LexicalModels
LanguageModels
Representation
SearchSpeech Signal
RecognizedWords
Acoustic-Phonetic Modeling
Adaptation
Pattern Recognition
Speech SignalRepresentation
Vector Quantization& Clustering
Search Algorithms
Hidden Markov Modeling
NeuralNetworks
GraphicalModels
SegmentalModels
Finite-State Transducers
LanguageModels
GMMs
![Page 19: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/19.jpg)
19
Important issues when dealing with real-world problems› Understand the strengths and weaknesses of the different
identification methods › Preprocessing the data before the optimization can be
crucial › Choose the minimization criterion with care and adapt it to
the problem at hand –Different type of regularization components in the criterion can make
the difference between success and failure –Some times a criterion having components in both the time and
frequency domains will work, when single domain criterions fail. –When it comes to audio the spectral shape of the modelling error
relative to the spectral shape of the signal is very important ( due to the noise sensitivity of our hearing)
![Page 20: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/20.jpg)
20
Important issues when dealing with real-world problems 2› Some applications require classification based modelling,
where the current model used depends on signal classification of some signals
› Many systems have to deal with spurious events –This will require the detection of such events and special model
updates when they are detected –Monitoring of system model –Hypothesis testing and estimation
![Page 21: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/21.jpg)
21
Strong Trends› Cloudification
– More and more services are being moved to the cloud › Digitalization
– The amount of data becoming available in digital form over the internet is rapidly increasing
› Analytics – Due to the advances in machine learning technology, analytics on
large data sets are being explored at a rapidly increasing rate › Internet of things (IOT)
– Every thing that will benefit from a network connection will have one.
![Page 22: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/22.jpg)
22
Do we have an Inevitable Technology Development in front of us?› The Inevitable : Understanding the 12 technological forces
that will shape our future (2016) › The author Kevin Kelly is a visionary thinker who foresaw
the scope of the internet revolution (Founder and chief editor of Wired)
› In this book he provides a plausible optimistic road map for the next 30 years
› Ted talk –https://www.ted.com/talks/
kevin_kelly_how_ai_can_bring_on_a_second_industrial_revolution
![Page 23: media Technologies @ Ericsson research (New organization ...€¦ · 1 media Technologies @ Ericsson research (New organization Taking Form) System Identification Related Problems](https://reader036.vdocuments.site/reader036/viewer/2022062606/5feb50130ec51b637a28b888/html5/thumbnails/23.jpg)
Erlendur Karlsson, email: [email protected]