deep learning for aerospace applications - teratec … · batch norm 2 x ( 3x3 conv. + relu ) batch...

35
1 2017 Deep learning for aerospace applications Alexandre Boulch

Upload: others

Post on 08-Aug-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

1

2017

Deep learning for aerospace applications

Alexandre Boulch

Page 2: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

2

2017

Deep Learning

Lee Sedol 2015/10Ke Jie 2017/05

Page 3: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

3

2017

Deep Learning

Personal assistantPersonalised learningRecommendationsRéponse automatique

Deep learning and Big data for

cardiology

Page 4: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

4

2017

Deep Learning

Page 5: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

5

2017

Overview

Machine Learning

Deep Learning

DeLTA

Page 6: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

6

2017

AI

The science and engineering of making intelligent machines.

Logical, search, pattern recognition, planning, inference, learning from experience...

Page 7: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

7

2017

AIIntelligent machines

Machine LearningLearning from experience

Model withparametersInput Output

Tuning parameters

Trainingdata

Page 8: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

8

2017

Machine learning starts in the 60’s

Page 9: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

9

2017

Overview

Machine Learning

Deep Learning

DeLTA

Page 10: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

10

2017

Deep learning

Page 11: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

11

2017

Deep learning

Page 12: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

12

2017

Deep learning

DatasetsCompetitionEmulation

New optimizersNew neural layersNew architectures

...

BetterFaster Stronger

Page 13: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

13

2017

Deep learning

2017

Page 14: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

14

2017

Deep learning

AIIntelligent machines

Machine LearningLearning from experience

Deep learningAuto-learningDeep neural networks

Page 15: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

15

2017

Deep learning

Data

Feature extraction Decision

Expert

Machine learning

Knowledge about data and application

Knowledge about statistics

Page 16: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

16

2017

Deep learning: a massively data driven approach

Data

Features and decision

Data knowledge Statistics, optimization

Deep neural networks

Network suited for applications

Page 17: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

17

2017

Deep learning: a massively data driven approach

Data

Features and decision

Data knowledge Statistics, optimization

Deep neural networks

Network suited for applications

Page 18: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

18

2017

Machine learning at ONERA

DTIS

DAAA

DMAS

DMPE

DEMR DOTA

DPhiEE

Page 19: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

19

2017

Deep learning at ONERA

DTIS

DAAA

DMAS

DMPE

DEMR DOTA

DPhiEE

A. Chan-Hon-Tong, S. Herbin, B. Le Saux, A. Boulch ...

Page 20: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

20

2017

Semantic Map labeling

+

RG

BC

ompo

site

3 x

( 3x

3 c

onv.

+ R

eLU

)

Aerial images, multimodal (RGB, IR, DSM, ...)Fusion networksPhD Nicolas Audebert (nicolas.audebert.at)

Page 21: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

21

2017

Point cloud labeling

2 x ( 3x3 conv. + ReLU )

Max Pooling 2x2

Max Pooling 2x2

Max Pooling 2x2

Max Pooling 2x2

2 x ( 3x3 conv. + ReLU )

3 x ( 3x3 conv. + ReLU )

3 x ( 3x3 conv. + ReLU )

Deconv. 3x3

Batch Norm2 x ( 3x3 conv. + ReLU )

Batch Norm3 x ( 3x3 conv. + ReLU )

Batch Norm3x(3x3 conv. + ReLU )

Batch Norm2 x ( 3x3 conv. + ReLU )

VGG 16

Deconv. 3x3

Deconv. 3x3

Deconv. 3x3

3 x ( 3x3 conv. + ReLU )

Conca

tenati

on

Leader on Semantic 8 LIDAR datasetTransfer to photogrammetryCode available online (DeLTA website)

Page 22: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

22

2017

RGB and Depthfor persondetectionimprovment

PhD Joris Gueryjorisguerry.fr

Detection

Page 23: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

23

2017

Detection in low resolutionImagesExploitation of imagesSequences for detection

Juliette Chataigner (Intern)

Detection

Page 24: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

24

2017

Depth from defocus

Sensor specific processing Depth from de focus.PhD Macella Carvalho

Page 25: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

25

2017

Zero Shot Learning

Zero Shot LearningLearning based on attributesPhD Maxime Bucher

Zero-Shot Learning via Visual AbstractionStanislaw Antol, Larry Zitnick, Devi Parikh

Page 26: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

26

2017

Overview

Machine Learning

Deep Learning

DeLTA

Page 27: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

27

2017

Deep learning for aerospace ONERA⇒

Page 28: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

28

2017

Data

Frameworks

Development

R&D for aerospace and defense

Deep learning for aerospace ONERA⇒

Page 29: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

29

2017

LE PRF DeLTA

Deep Lab

Applications

Core skills

Page 30: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

30

2017

Domain adaptation

New architectures

State of the art

Databases

Core skills

Page 31: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

31

2017

LE PRF DeLTA

Software and help to solve problems with

machine learning

Tutorials

Code

Networks

Results

Datasets

Deep Lab

Academics and industrials

Improve ONERA research exposure

Page 32: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

32

2017

Deep Lab

Generic code

Problem code

Network base

Networks Database code

Database

Validation

How To

Learning

Practical case

Page 33: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

33

2017

DAAAFluid

mecanics

DTISRobotics

DMASMaterial

mecanics

DEMRDetection and

recognition

DOTAAtmospheric

Corr.

Deep Lab

Applications

Core skills

Page 34: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

34

2017

TransferExperimentEvaluate

Move forwardInnovate

CapitalizeShareReproduce

Deep Lab

Applications

Core skills

4 year project

delta-onera.github.io

Page 35: Deep learning for aerospace applications - Teratec … · Batch Norm 2 x ( 3x3 conv. + ReLU ) Batch Norm 3 x ( 3x3 conv. + ReLU ) Batch Norm 3x(3x3 conv. + ReLU ) ... Présentation

35

2017

“We chose it because we deal with huge amounts of data. Besides, it sounds really cool.”

Larry Page - Google