information and semantic fusion - ewisa-project.eu · fusion) data and information fusion...
TRANSCRIPT
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Information and Semantic Fusion
AIRBUS Defence and Space
Advanced Information Processing
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Presentation overview
• Data and Information Fusion: CONOPS within Intelligence domain
• Two major works
–PEA FURET 2: Fusion Hard sensors Fusion, operational oriented
–PEA FUTHANE: Hard sensors + soft sources Fusion, from R&T to operations
• Current R&T works
2
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Intelligence Requirement Management & Collection
Management (IRM&CM) PROCESS
3
DIRECTION
COLLECTION
PROCESSING
DISSEMINATION IRM&CM
Intelligence
Products Collection & Processing
Intelligence
Products
Requirements
not satisfiedFeedback
Matching with
Requirements
RFI
NAIs (Areas of Interest),
Priority Requirements (PIR)SAF CINC
GHQ COS
JOC
Commander
External inteligence
Agencies
Allied DIORequirement
Consolidation
Intelligence
Collection
Plan
ISR Collection
& eXploitation
Plan
Physical environment
Forces & military situation
Resources
Capabilities
OSINT, IMINT, ELINT
+ Intel Reports
Tasking
ISR Resource
Status
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Situation awareness and the diversity of implied automated and
human reasoning processes
4
level 1Object stateestimation
from detections(tracks, id., class.)
statisticalprocessing
level 0Feature and
stateestimation from
signalinformation
signalprocessing
level 2Aggregate state
estimation Relationships
level 3Threat level
intentionestimation
semanticprocessing
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
AIRBUS Defence and Space background information
5
Fusion is the process of combining information, usually imperfect, to infer, on a given and evolving situation,
a more accurate and certain knowledge
InformationSemanticLow Level Fusion High Level Fusion
Sensor DataNumerical
Situation Assessment Situation UnderstandingImpact Assessment
Multi-sensor Multi-target Tracking(incl. Bearing-Only Tracking)
Target Classification
Group TrackingOdB Recognition
Behaviour Analysis (Crowd, targets)
Identification (Friend/Hostile)
Entity Assessment
Track Fusion
Threat/Risk Assessment
1995 - 2015
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Data Ingestion using NATO CSD as source data Data correlation and tracking at individual target level
(1st level of fusion)
Data Identification of a group of targets (2nd level of
fusion)
Data Ingestion using NATO CSD as source data Data classification, individual target level (1st level of
fusion)
Data and Information Fusion operational services
Integration of environmental information and data Data Identification, individual target level (1st level of
fusion)
Data and Information Fusion management
Data Ingestion using adhoc connectors Data correlation and tracking of a group of targets
(2nd level of fusion)
Picture JC3IEDM Dissemination
Data registration Data classification of a group of targets (2nd level of
fusion)
Picture 4676 Dissemination
PEA FURET 2
7
Multi-sources
Data fusion
Complementarity
Redundancy
• Near real time exhaustive
& accurate situation
• Non real time Synthesized
& reliable intelligence
HUMINTIMINTCOMINTGMTI
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
PEA FUTHANE
8
A Common R&T Development Tool
for Information Fusion
Incremental
Development
Approach
Comparative
performance
assessment
Design, implement
and experiment
An Open Framework to Support Heterogeneous Information Fusion
DESIGN
EXECUTION
DEVELOPMENT
EVALUATION
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Integration within ADS assets and capitalization of R&T studies
9
WEBLAB
(MSA)
FUSIONLAB
(FUTHANE)
FUTHANE R&T
scope
OSINT
AIS data
Structured
Information
AIS, NE
Alerts
Interoperation
WebLab/FusionLab
FUSIONLAB
(FUTHANE)
ELODI R&T
scope
CEP4MSA
R&T scope
Misinformation
detection
Semantic CEP
WEBLAB
(MSA)
SITUATION UNDERSTANDING
INDICATIONS&WARNING (ALERTS)
DISINFORMATION
SUPPORT FOR
HARD&SOFT FUSION
(all sources incl. Unstructured)
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Valorization of available capabilities for business opportunities
Zephyr for GEO – Law Enforcement use case
Objective: demonstrate how information fusion
capabilities inherited from FUTHANE and FURET
work may be rapidly used for Zephyr for GEO (quick
win)
Demonstration based upon showcasing the Law
Enforcement use case: provide near real time
information about reckless driving behavior
Interest for Airbus:
• Synergy: combine strong Airbus capabilities together
(Zephyr, optical payload, imagery processing, fusion
information processing)
• Innovation: provide customer services by combining
technologies
• Performance: provide capabilities without having to
invest a large amount of money (exploitation software
is improving physical assets limitations)
10
Imagery & Fusion Processing
High speed detected
(75km/h 3 min)
Road networkZephyr video (2-5 Hz)
Demonstration on the 19th of April, 2016 in Toulouse
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
Currently on-going 2015-2016 R&T activities
• Semantic correlation schemes analysis
• Assessment of complex combined threats (military,
maritime, urban)
• clustering evaluation and improvement of informative
quality
• Misinformation detection algorithm
11
Th
is d
ocu
me
nt
an
d its
co
nte
nt is
th
e p
rop
ert
y o
f A
irb
us D
efe
nce
an
d S
pa
ce
.
It s
ha
ll n
ot
be
co
mm
un
ica
ted
to
an
y t
hir
d p
art
y w
ith
ou
t th
e o
wn
er’
s w
ritt
en
co
nse
nt | A
irb
us D
S S
AS
. A
ll r
igh
ts r
ese
rve
d.
2016-2017 R&T activities
12
Threat Assessment
Abnormal behaviour detection
Association techniques and Semantic
Fusion for Maritime Situation Awareness
Complex Event Processing within a
semantic environment for Maritime
Situation Awareness
Heterogeneous information fusion using
Big Data technologies
Heterogeneous data fusion of
unstructured and structured data