nonlinear shape modelling john ashburner. wellcome trust centre for neuroimaging, ucl institute of...
TRANSCRIPT
Nonlinear Shape Modelling
John Ashburner.Wellcome Trust Centre for Neuroimaging,
UCL Institute of Neurology,London, UK.
Motivation
• Imaging Biomarkers may be derived using pattern recognition methods.– Provide examples of scans and outcomes.– Learn to predict clinical outcomes from scans.
• Work with similarity measures among scans.– Many ways of measuring similarity.– Include prior knowledge and biological plausibility in
similarity model.
A simple multivariate morphometry illustration: Body Mass Index
BMI = weight / height2
log(BMI) = log(weight) – 2 log(height)
Inter-subject Variability... diverse and dissimilar fish [brains]
can be referred as a whole to identical functions of very different coordinate systems...
Suggests a generative model, whereby diverse and dissimilar brains are modeled by a common template (identical functions) deformed according to various spatial transformations (very different coordinate systems).D’Arcy Thompson
(1917). GROWTH AND FORM.
Encoding Relative Shapes
• Most shape models involve adding a smooth displacement field to an identity transform.– This is the small deformation approximation.– Assumes that deformations can be added and
subtracted linearly – which is not the case.
• Should use a model that assumes that deformations are composed – not added.
Small DisplacementsS
mal
l Def
orm
atio
n M
odel
Simple Small Deformation Registration
Estimate u that minimizes:
E = ½ || L u ||2 + ½ ||f – μ(φ)||2
where φ = x + u
and L may be something like a Laplacian operator
Regularization Matching term – sum of squares difference
Larger DisplacementsB
igge
r S
mal
l Def
orm
atio
n M
odel
Diffeomorphisms
• A diffeomorphism is a smooth continuous one-to-one mapping.
• Diffeomorphisms form a mathematical group under composition (warping one deformation by another).– Composition of group members is another group
member– The members have inverses– There is an identity member– The composition operations are associative
Diff
eom
orph
ic M
odel
Diffeomorphic Registration
Estimate v (a series of velocity fields over unit time) that minimizes:
E = ½ ∫t=0 ||Lvt||2dt + ½ ||f – μ(φ1)||2
where dφt/dt = vt(φt)
φ0 = Id.
Regularization – minimizes a
geodesic distance
Matching term
1
c.f. Hamilton’s principle of stationary action
In practice
• Modeled by the composition of a series of small deformations.• Each is one-to-one, so their composition should also be one-to-one.
E = (||Lv1||2 + ||Lv1||2 +… ||LvK||2 )/2K+ ½ ||f – μo(x+v1/K) o(x+v2/K) o…o(x+vK/K)||2
• This is the Large Deformation Diffeomorphic Metric Mapping (LDDMM) algorithm of Beg et al., which is optimized using gradient descent.
An initial value formulation
• It turns out that the dynamical system is determined from its initial conditions as:
(L†L)vt = |Dφt| (Dφt)T ((L†L)v0)oφt
dφt/dt = vt(φt)
• These “EPDiff” equations are used for modeling fluid dynamics.
• This integration procedure is a form of exponential map.
vertical
vertical
horizontal
horizontal
Velocity Field (v)
“Momentum” (Av)
Convolve with Greens Function of Differential Operator (K = A+)
Apply Differential Operator (A = L†L)
Some 2D Examples
Deformations
Inverse Deformations
Jacobian Determinants
Jacobian Determinants
Residuals
Reconstructed from Template & Residuals
Original Examples
Grey Matter (550 IXI Brains)
White Matter (550 IXI Brains)
Template: Grey Matter
Template: White Matter
Template: Other
Aligned IXI Brains
Diffeomorphic Eigenwarps550 scans from the IXI dataset, registered to a common average using a diffeomorphic registration model.
Eigen-decomposition of initial velocities/momenta.
Exaggerated warps generated by a geodesic shooting method.
- Preserves one-to-one mapping.
1st
3rd
10th
- +
PredictionsBrain shapes can be used to make predictions about individuals.
This figure shows predictions of subjects ages made from IXI dataset using Tipping’s Relevance Vector Regression (a kernel method).
More useful predictions may be possible from other data.
Cross-validation results for age predictions.
Caricatured Differences
• Used multivariate logistic regression to determine the initial velocity that best separates male from female brains.– Similar principles to Gaussian Process Classification, but with
kernel matrix related to that of:Wang, L., Beg, M., Ratnanather, J., Ceritoglu, C., Younes, L., Morris, J.C., Csernansky, J.G. & Miller, M.I. Large deformation diffeomorphism and momentum based hippocampal shape discrimination in dementia of the Alzheimer type. IEEE Transactions on Medical Imaging 26(4):462 (2007).
• Diffeomorphic shooting to obtain exaggerated deformations.
• Average brain deformed using these exaggerated deformations.
Another example
• Predicting the logarithm of the brain/CSF ratio.• Used a Gaussian Process Regression approach.• Deformed average, from a brain with very little
CSF, to one with a lot.
Some References• M. F. Beg, M. I. Miller, A.Trouve & L. Younes. "Computing
Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms". International Journal Of Computer Vision (2003).
• M. I. Miller, A. Trouve, & L. Younes. "Geodesic Shooting for Computational Anatomy". Journal of Mathematical Imaging and Vision (2004)
• L. Wang, M. F. Beg, J. T. Ratnanather, C. Ceritoglu, L. Younes, J. C. Morris, J. G. Csernansky & M. I. Miller. "Large Deformation Diffeomorphism and Momentum Based Hippocampal Shape Discrimination in Dementia of the Alzheimer Type". IEEE Trans. Med Imaging (2006)
• L. Younes, F. Arrate & M. I. Miller. "Evolution Equations in Computational Anatomy". Neuroimage (2008)
Enjoy your retirement Vin.
Metrics
It is useful if distance measures between scans have the properties of metrics.
Requirements are:• Non-negativity: d(A,B) ≥ 0• Triangle Inequality: d(A,C) ≤ d(A,B) + d(B,C)• Symmetry: d(A,B) = d(B,A)• Identity of discernibles: d(A,B) = 0 iff A=B
These are not satisfied by the small deformation approximation, but they are using the diffeomorphism framework of Miller, Younes et al.