covariance cost functions for scheduling multistatic
TRANSCRIPT
Covariance Cost Functions for SchedulingMultistatic Sonobuoy Fields
Christopher Gilliam1, Daniel Angley2, Sofia Suvorova2, BrankoRistic1, Bill Moran2, Fiona Fletcher3, Sergey Simakov3, Simon
Williams2
1 School of Engineering, RMIT University, Australia2 Electrical & Electronic Engineering, The University of Melbourne, Australia
3 Maritime Division, Defence Science and Technology Group, Australia
11th July 2018
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 1 / 16
Outline
1 Multistatic Sonobuoy FieldsTwo Tasks =⇒ Search for and track underwater targetsPerformance dependent on scheduling sonobuoys
2 Recap on Tracking in Sonobuoy FieldsGeometric Modelling and MeasurementsTracking algorithm used to track targets
3 Sonobuoy Scheduling Using Covariance-based Cost FunctionsTracking Reward FunctionThe ’size’ of an ellipsoidCovariance-based Cost Functions
4 Simulation Results
5 Conclusions
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 2 / 16
Multistatic Sonobuoy Fields
A network of transmitters and sensors distributed across a large searchregion
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 3 / 16
Multistatic Sonobuoy Fields
Two tasks of the system:
Detect targets that are unknown to the system
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 3 / 16
Multistatic Sonobuoy Fields
Two tasks of the system:
Detect targets that are unknown to the system
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 3 / 16
Multistatic Sonobuoy Fields
Two tasks of the system:
Detect targets that are unknown to the systemAccurately track targets known to the system
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 3 / 16
Multistatic Sonobuoy Fields
Two tasks of the system:
Detect targets that are unknown to the systemAccurately track targets known to the system
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 3 / 16
Scheduling Problem
# Choose sequence of transmitters and waveforms to satisfy tasks
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 4 / 16
Scheduling Problem
# Choose sequence of transmitters and waveforms to satisfy tasks
At one transmission time:
Choose a Transmitter: T = {j1, j2, . . . , jNT}
where NT is the number of transmitters in the field
Choose a Waveform: W = {w1, w2, . . . , wNd}
where Nd is the number of possible waveforms
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 4 / 16
Scheduling Problem
# Choose sequence of transmitters and waveforms to satisfy tasks
At one transmission time:
Choose a Transmitter: T = {j1, j2, . . . , jNT}
where NT is the number of transmitters in the field
Choose a Waveform: W = {w1, w2, . . . , wNd}
where Nd is the number of possible waveforms
Possible waveforms:
Continuous Wave (CW) or Frequency Modulated (FM) waveform
1kHz or 2kHz frequency
2 second or 8 second duration
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 4 / 16
Scheduling Problem
# Choose sequence of transmitters and waveforms to satisfy tasks
At one transmission time:
Choose a Transmitter: T = {j1, j2, . . . , jNT}
where NT is the number of transmitters in the field
Choose a Waveform: W = {w1, w2, . . . , wNd}
where Nd is the number of possible waveforms
Action space:
Choose an action: a ∈ A, A = T ×W
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 4 / 16
Conflicting Objectives
Track vs Search =⇒ Which transmitter to choose...
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 5 / 16
Conflicting ObjectivesOur Approach:Combine both tasks in multi-objective framework and use multi-objective
optimization to decide scheduling
Transmitter
Sensor
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 5 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Sonobuoy Field Description:
Transmitter positionssj =
[xjs, y
js
]TReceiver positions
ri =[xir, y
ir
]TAssume positions are known at alltimes∗
∗Each buoy contains RF communications and may contain GPS equipment
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Target Description:
Target Position at time tk:p = [xk, yk]
T
Target Velocity at time tk:v = [xk, yk]
T
Time-varying statexk = [pT
k,vT
k]T
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Target Motion:
Noisy linear constant-velocity model
xk =
([1 T0 1
]⊗ I2
)xk−1︸ ︷︷ ︸
f(xk−1)
+ ek
Process noise ek is Gaussian withvariance
Q = ω
[T 3/3 T 2/2T 2/2 T
]⊗ I2
where T = tk − tk−1 is the sampling in time⊗ is the Kronecker product and I2 is 2× 2 identity matrix
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Measurements:
Signal amplitude β and Kinematicmeasurement z
z = h(i)j (xk) +w
(i)j
Measurements collected from asubset of receivers
Buoys have two waveformmodalities
Frequency Modulated (FM)Continuous Wave (CW)
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Using FM waveforms:
Bistatic Range:|pk − ri|+ |pk − sj |
Angle from Receiver:
arctan(
yk−yir
xk−xir
)Good positional information
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Using CW waveforms:
Bistatic Range:|pk − ri|+ |pk − sj |
Angle from Receiver:
arctan(
yk−yir
xk−xir
)Bistatic Range-Rate:
vT
[pk−ri|pk−ri| +
pk−si|pk−si|
]Good velocity information
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
Tracking Challenges:
High levels of clutter
Non-linear measurements
Low probability of detection
Many possible algorithms: ML-PDA, MHT, PMHT, JIPDA,PHD/CPHD, ... etc
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Modelling, Measurements & Tracking Algorithm
0 10 20 30 40 50 60
0
10
20
30
40
50
60
Distance (km)
Dis
tan
ce
(k
m)
‘x’ = Transmitters, ‘o’ = Receivers
The tracker:
Multi-Sensor Bernoulli filter[1]
(optimal multi-sensor Bayesian filterfor a single target)
Linear Multi-Target (LMT)Paradigm[2]
Gaussian mixture modelimplementation[3]
Process FM & CW measurements
[1] B. Ristic el al., ‘A tutorial on Bernoulli filters: Theory, implementation and applications’, IEEE Trans. Signal Process., 2013.[2] D. Musicki and B. La Scala, ‘Multi-Target Tracking in Clutter without Measurement Assignment’, IEEE Trans. Aerosp. Electron. Syst., 2008.[3] B. Ristic el al., ‘Gaussian Mixture Multitarget Multisensor Bernoulli Tracker for Multistatic Sonobuoy Fields’, IET Radar, Sonar & Navig., 2017.
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 6 / 16
Tracking Reward
Transmitter
Sensor
Previous Trajectory
Information
Predicted
Trajectory
Given previous tracking:
# Measure the gain in tracking information from action a
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 7 / 16
Tracking Reward
Transmitter
Sensor
Previous Trajectory
Information
Predicted
Trajectory
Approximate information matrix:
Single track: trace
[JPredict +
∑i∈R
P id(a)J
iMeasure(a)
]
Trace of only the positional elements of information matrixP id(a) Expected probability of detecting track
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 7 / 16
Tracking Reward
Transmitter
Sensor
Previous Trajectory
Information
Predicted
Trajectory
Predicted Information Matrix:
JPredict =[Fk−1Pk−1 [Fk−1]
T]−1︸ ︷︷ ︸
Propagation of error covariance due to motion model
where Fk−1 is the Jacobian of f(xk−1) and Pk−1 is the error covariance from tracker
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 7 / 16
Tracking Reward
Transmitter
Sensor
Previous Trajectory
Information
Predicted
Trajectory
Measurement Information Matrix:
JMeasure =[Hi
k(a)]T [
Rik(a)
]−1Hi
k(a)︸ ︷︷ ︸Gain in information from action
where Hik(a) is the Jacobian of ha(xk−1) and Ri
k(a) is the measurement covariance
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 7 / 16
How big is an ellipse
Figure: Ellipse showing the eigenvectors of the matrix definition of an ellipse,xΣxT = C
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 8 / 16
Possible Cost Functions
Analysed scheduling of multistatic sonobuoy fields using cost functionsbased on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 9 / 16
Possible Cost Functions
Analysed scheduling of multistatic sonobuoy fields using cost functionsbased on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 9 / 16
Possible Cost Functions
Analysed scheduling of multistatic sonobuoy fields using cost functionsbased on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 9 / 16
Possible Cost Functions
Analysed scheduling of multistatic sonobuoy fields using cost functionsbased on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 9 / 16
Possible Cost Functions
Analysed scheduling of multistatic sonobuoy fields using cost functionsbased on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 9 / 16
Analysis of Scheduler - Set Up
Distance (km)
0
10
20
30
40
50
60
Dis
tan
ce
(k
m)
0 10 20 30 40 50 60
‘x’ = Transmitters, ‘o’ = Receivers
Set-up:
4 × 4 transmitter grid
5 × 5 receiver grid
Buoy separation = 15km
50 Minute Scenario
1 transmission/minute
600 Simulations
Realistic measurements =⇒ Bistatic Range Independent Signal Excess (BRISE)
simulation environment
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 10 / 16
Analysis of Scheduler - Set Up
Distance (km)
0
10
20
30
40
50
60
Dis
tan
ce
(k
m)
0 10 20 30 40 50 60
‘x’ = Transmitters, ‘o’ = Receivers
Set-up:
4 × 4 transmitter grid
5 × 5 receiver grid
Buoy separation = 15km
50 Minute Scenario
1 transmission/minute
600 Simulations
Analyse the performance of the scheduler as cost function varies
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 10 / 16
Analysis of Scheduler - Results
Jprec
Jdet
Jjoint
Jtrace
Jmax
Cost Functions
0
0.05
0.1
0.15
0.2
0.25
0.3
Ve
loci
ty E
rro
r (m
/s)
(a) Velocity Error (m/s)
Jprec
Jdet
Jjoint
Jtrace
Jmax
Cost Functions
0
20
40
60
80
Po
siti
on
Err
or
(m)
Target Speed = 8 knots
Target Speed = 14 knots
(b) Position Error (m)
Figure: Performance of the scheduler shows the mean position and velocityerror obtained using the different cost functions. The blue lines for target speedof 8 knots, and the red lines for a target speed of 14 knots
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 11 / 16
Analysis of Scheduler - Transmitter Choice
1
2
3
4
0
10
20
30
40
50
Pro
po
rtio
n o
f T
ran
smis
sio
ns
(%)
1 2 3 4
(a) Using Jprec
1
2
3
4
0
10
20
30
40
50
Pro
po
rtio
n o
f T
ran
smis
sio
ns
(%)
1 2 3 4
(b) Using Jdet
1
2
3
4
0
10
20
30
40
50
Pro
po
rtio
n o
f T
ran
smis
sio
ns
(%)
1 2 3 4
(c) Using Jjoint
1
2
3
4
0
10
20
30
40
50
Pro
po
rtio
n o
f T
ran
smis
sio
ns
(%)
1 2 3 4
(d) Using Jtrace
1
2
3
4
0
10
20
30
40
50
Pro
po
rtio
n o
f T
ran
smis
sio
ns
(%)
1 2 3 4
(e) Using Jmax
Figure: Transmitter histograms for the target’s speed of 14 knots, showing theproportion of transmissions from each source when using the different costfunctions.
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 12 / 16
Analysis of Scheduler - Waveform Choice
FM 1kHz 2sec FM 1kHz 8sec FM 2kHz 2sec FM 2kHz 8sec CW 1kHz 2sec CW 1kHz 8sec CW 2kHz 2sec CW 2kHz 8sec0
10
20
30
40
50
60
70
80
90
100
Pro
po
rtio
n o
f W
av
efo
rms
Tra
nsm
itte
d (
%)
Jprec
Jdet
Jjoint
Jtrace
Jmax
(a) Target Speed = 8 knots
FM 1kHz 2sec FM 1kHz 8sec FM 2kHz 2sec FM 2kHz 8sec CW 1kHz 2sec CW 1kHz 8sec CW 2kHz 2sec CW 2kHz 8sec0
10
20
30
40
50
60
70
80
90
100
Pro
po
rtio
n o
f W
av
efo
rms
Tra
nsm
itte
d (
%)
Jprec
Jdet
Jjoint
Jtrace
Jmax
(b) Target Speed = 14 knots
Figure: Choice of waveforms used when the target’s speed is 8 and 14 knots.
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 13 / 16
Analysis of Scheduler - Results
0.04 0.06 0.08 0.1 0.12
Mean Velocity Error (m/s)
0
5
10
15
20
25
30
35
Me
an
Po
siti
on
Err
or
(m)
Jprec
Jdet
Jjoint J
trace
Jmax
Jprec
Jdet
Jjoint
Jtrace
Jmax
Target Speed = 8 knots
Target Speed = 14 knots
Figure: the means of both errors on a scatter
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 14 / 16
Conclusions
Analysed scheduling of multistatic sonobuoy fields using costfunctions based on the eigenvalues of the covariance estimate, P(a),λ1 ≥ λ2 . . . ≥ λn
1 Jtrace(a) = traceP(a) =∑
n λn
2 Jdet(a) = detP(a) =∏
n λn
3 Jpres(a) = 1/ traceP(a)−1
4 Jmax(a) = maxn λn = λ1
5 Jjoint(a) = λxλv
Analysed proposed scheduling via optimum source-waveform actionthat minimized the covariance cost function.
Demonstrated trade-off between position and velocity accuracy variesTrade-off characterised in terms of points on the Pareto front
Gilliam et al. Cost Functions for Scheduling Sonobuoy Fields 15 / 16