preprocessing & feature extraction in signal processing ... · scientists require signal...

23
1 © 2015 The MathWorks, Inc. Preprocessing & Feature Extraction in Signal Processing Applications Rick Gentile Product Manager Signal Processing and Communications

Upload: others

Post on 22-Aug-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

1© 2015 The MathWorks, Inc.

Preprocessing & Feature Extraction in

Signal Processing Applications

Rick Gentile

Product Manager

Signal Processing and Communications

Page 2: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

2

Signals and Data are Everywhere

temperature rotation

accelerationvibration

tilt

pressure

position

motionnoise

strain

phase

Page 3: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

3

Preprocess and Extract Features for Data Analysis

Data AnalysisConnect and AcquireSignal

Processing

Extract

FeaturesPreprocess

Challenge: Gain insights to improve data analysis

Page 4: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

4

Feature Extraction Techniques Help to Restore Arm Movement

Multichannel electrode implanted in the brain to

record brain signals

Wavelet techniques isolate frequency bands of

brain signals that govern movement

Wavelets help transform 3000 features per channel

into a single value

User Story: Battelle Neural Bypass Technology Restores

Movement to a Paralyzed Man’s Arm and Hand

Developed by Battelle Memorial Institute entirely in MATLAB and Wavelet Toolbox

Page 5: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

5

Real-World Signals are Challenging to Analyze

Large amounts of data– Wide data multiple streams, many sensors

– Tall data long signals

“Messy” time series– Noise

– Non-uniform sampling

– Lack of alignment between signals

– Missing data

– Data outliers

Page 6: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

6

Signal Processing for Engineers and Scientists

Signal Modeling,

Generation &

Preprocessing

Measurements &

Feature Extraction

Digital & Analog

Filter Design

Transforms &

Spectral AnalysisVibration Analysis

Is this a signal or just noise?

Are these signals related? How do I measure a delay between signals?

How do I compare signals? How do I align different signals?

Page 7: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

7

Support for Real-World Applications

Expanded focus over recent releases:

Scientists require signal processing techniques but may not be proficient in this area

GeologistScientist

Biologist

Mechanical Engineer

Oceanographer

Apps to work with data

Intuitive function names

Domain friendly defaults

Easy path to deeper analysis

Traditional users: Electrical Engineer with Signal Processing background

Page 8: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

8

Signal Preprocessing and Feature Extraction

Extract Features

PreprocessVisualize Transform

Signal Analyzer App

Page 9: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

9

Visualize

Extraction

Features

• Time and frequency

• Navigate, pan, &

zoom

• Compare multiple

signals

• Extract regions of

interest

Viewing and Exploring Signals with Signal Analyzer App

Page 10: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

10

Preprocess Messy Signals

Pre-processing for

sensor analytics

Non-uniformly sampled signals

Outliers & data gaps

Misaligned signals

Noise or unwanted frequency content

Preprocess

Visualize

Page 11: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

11

Resample Non-uniformly Sampled Signals

>>[y, Ty] = resample(x,nonUniformSig,desiredFs);

Page 12: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

12

What if Data is Missing?

>> [y, Ty] = resample(x,irregTx,desiredFs,'spline');

Page 13: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

13

Multiple Ways to Reconstruct Missing Data

>> x = y(1:3500);

>> x(2000:2600) = NaN;

>> y2 = fillgaps(x);

Resampling often best for

low frequency components

For large gaps in wideband

signals, autoregressive

modeling is more effective

Page 14: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

14

Synchronizing Signals from Multiple Sensors

Data collected asynchronously by multiple sensors may require alignment

»[x1,x3] = alignsignals(s1,s3);

»x2 = alignsignals(s2,s3);» dtw(s1,s2)

Page 15: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

15

Extract Features

Detect change points

Determine signal statistics

Find signal envelope

Extract

Features

Pre-processing for

sensor analytics

Find desired signal from patterns

Find peaks

Page 16: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

16

Finding Signals and Patterns of Interest

Similarity search for

finding repeat

occurrences

findsignal can be

used with time or

frequency data

Best match

in data

Signal we are

looking for

findsignal

Page 17: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

17

Searching the Spectral Content

Page 18: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

18

Finding a Signal of Interest

>>findsignal(PxxSignal,PxxMoan,'Normalization','power‘,'TimeAlignment','dtw',…

'Metric','symmkl','MaxNumSegments',3);

Page 19: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

19

Challenges of Time-Frequency Analysis

Fixed spectral windows can limit time-

frequency resolution

Features occurring at different scales

may be missed

Sinusoids may not be well localized in

frequency

May need a different class of functions to analyze real world signals

Page 20: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

20

Time-Frequency Analysis

Continuous

Wavelet Analysis

Discrete Wavelet

Analysis

Denoising and

CompressionFilter Banks

Transform

Extract

Features

Spectrogram

Fourier

Synchrosqueezed

Transform

Page 21: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

21

Localizing Unwanted Frequency Components

Wavelets used to localize & remove

unwanted spectral components

Wavelet

transform

Localize noise

frequency

Remove noise

Reconstruct

signal

Page 22: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

22

Summary

Real world signals are challenging

– MathWorks tools make preprocessing and feature extraction easy

MathWorks website includes many examples to get started with

– Data Analytics, Industrial, Automotive, Medical, Noise and Vibration, and

many others

Thank you for attending

Page 23: Preprocessing & Feature Extraction in Signal Processing ... · Scientists require signal processing techniques but may not be proficient in this area Scientist Geologist Biologist

23

More Resources

https://www.mathworks.com/products/wavelet.html

Wavelet Tech Talks

– Series of 4 short videos on wavelet concepts including

MATLAB-based examples

https://www.mathworks.com/products/signal.html