frequency diffeomorphisms for efficient image …people.csail.mit.edu/ruizhi/ipmi2017_zhang.pdfimage...

13
See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/315662432 Frequency Diffeomorphisms for Efficient Image Registration Conference Paper · January 2017 CITATIONS 0 READS 132 7 authors, including: Some of the authors of this publication are also working on these related projects: Effects of general anesthesia on the developing brain View project Population Based Image Imputation View project Miaomiao Zhang Massachusetts Institute of Technology 17 PUBLICATIONS 73 CITATIONS SEE PROFILE Adrian V Dalca Massachusetts Institute of Technology 21 PUBLICATIONS 508 CITATIONS SEE PROFILE Jie Luo Washington University in St. Louis 18 PUBLICATIONS 228 CITATIONS SEE PROFILE Patricia Ellen Grant Harvard Medical School 280 PUBLICATIONS 7,593 CITATIONS SEE PROFILE All content following this page was uploaded by Miaomiao Zhang on 27 March 2017. The user has requested enhancement of the downloaded file. All in-text references underlined in blue are added to the original document and are linked to publications on ResearchGate, letting you access and read them immediately.

Upload: others

Post on 04-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Seediscussions,stats,andauthorprofilesforthispublicationat:https://www.researchgate.net/publication/315662432

FrequencyDiffeomorphismsforEfficientImageRegistration

ConferencePaper·January2017

CITATIONS

0

READS

132

7authors,including:

Someoftheauthorsofthispublicationarealsoworkingontheserelatedprojects:

EffectsofgeneralanesthesiaonthedevelopingbrainViewproject

PopulationBasedImageImputationViewproject

MiaomiaoZhang

MassachusettsInstituteofTechnology

17PUBLICATIONS73CITATIONS

SEEPROFILE

AdrianVDalca

MassachusettsInstituteofTechnology

21PUBLICATIONS508CITATIONS

SEEPROFILE

JieLuo

WashingtonUniversityinSt.Louis

18PUBLICATIONS228CITATIONS

SEEPROFILE

PatriciaEllenGrant

HarvardMedicalSchool

280PUBLICATIONS7,593CITATIONS

SEEPROFILE

AllcontentfollowingthispagewasuploadedbyMiaomiaoZhangon27March2017.

Theuserhasrequestedenhancementofthedownloadedfile.Allin-textreferencesunderlinedinblueareaddedtotheoriginaldocument

andarelinkedtopublicationsonResearchGate,lettingyouaccessandreadthemimmediately.

Page 2: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for

Ecient Image Registration

Miaomiao Zhang1, Ruizhi Liao1, Adrian V. Dalca1, Esra A. Turk2,Jie Luo2, P. Ellen Grant2, and Polina Golland1

1 Computer Science and Articial Intelligence Laboratory, MIT2 Boston Children's Hospital, Harvard Medical School

Abstract. This paper presents an ecient algorithm for large deforma-tion dieomorphic metric mapping (LDDMM) with geodesic shootingfor image registration. We introduce a novel nite dimensional Fourierrepresentation of dieomorphic deformations based on the key fact thatthe high frequency components of a dieomorphism remain stationarythroughout the integration process when computing the deformation as-sociated with smooth velocity elds. We show that manipulating highdimensional dieomorphisms can be carried out entirely in the bandlim-ited space by integrating the nonstationary low frequency components ofthe displacement eld. This insight substantially reduces the computa-tional cost of the registration problem. Experimental results show thatour method is signicantly faster than the state-of-the-art dieomorphicimage registration methods while producing equally accurate alignment.We demonstrate our algorithm in two dierent applications of imageregistration: neuroimaging and in-utero imaging.

1 Introduction

Dieomorphisms have been widely used in the eld of image registration [7,6], atlas-based image segmentation [4, 10], and anatomical shape analysis [14,22]. In this paper, we focus on a time-varying velocity eld representation fordieomorphisms as it supplies a distance metric that is critical to statisticalanalysis of anatomical shapes, for instance, by least squares, geodesic regression,or principal modes detection [13, 16, 22].

In spite of the advantages of supporting Riemannian metrics in LDDMM, theextremely high computational cost and large memory footprint of the currentimplementations has limited the use of time-varying velocity representations inimportant applications that require computational eciency. The original LD-DMM optimization performs gradient decent on the entire time-varying velocityeld that is dened on a dense image grid. Since a geodesic is uniquely de-termined by its initial conditions on the velocity eld, the geodesic shootingalgorithm has been shown to reduce the computational complexity and improveoptimization landscape by manipulating the initial velocity via the geodesic evo-lution equations [20]. FLASH (nite dimensional Lie algebras for shooting) [23]

Page 3: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

2 Zhang et al.

is a recent variant of LDDMM with geodesic shooting that employs a low dimen-sional bandlimited representation of the initial velocity eld to further improvethe convergence and eciency of the optimization. The algorithm still maps thevelocity elds from the low dimensional Fourier space back to the full image do-main to perform forward integration at each iteration [23]. The computationalcomplexity of this step thus dominates the entire procedure of dieomorphicimage registration.

Previous works that aimed to improve dieomorphic representations have re-duced the high degrees of freedom available to represent the velocity elds, butnot the dieomorphisms themselves. In this paper, we adopt the low dimensionalrepresentation of the tangent space of dieomorphisms [23] and propose an ef-cient way to compute dieomorphisms in the bandlimited space, thus furtherreducing the computational complexity of image registration. Our approach isbased on the important insight that only the low frequency components of thedieomorphisms vary over time when integrating a bandlimited velocity eld toobtain the deformation. Since the optimization of image registration can be di-rectly solved by advecting the inverse of dieomorphisms [17], we propose a novelFourier representation of the deformation in the inverse coordinate system thatis computed entirely in the low dimensional bandlimited space. The theoreticaltools developed in this paper are broadly applicable to other parametrizationof dieomorphic transformations, such as stationary velocity elds [2, 3, 19]. Toevaluate the proposed algorithm, we perform image registration of real 3D MRimages and show that the accuracy of the propagated segmentations is compa-rable to that obtained via the state-of-the-art dieomorphic image registrationmethods, while the runtime and the memory demands are dramatically lowerfor our method. We demonstrate the method in the context of atlas-based seg-mentation of brain images and of temporal alignment of in-utero MRI scans.

2 Background

Before introducing our development, we provide a brief overview of continuousdieomorphisms endowed with metrics on vector elds [6, 21] and of the nitedimensional Fourier representation of the tangent space of dieomorphisms [23].

Given an open and bounded d-dimensional domain Ω ⊂ Rd, we use Diff(Ω) todenote a space of continuous dierentiable and inverse dierentiable mappingsof Ω onto itself. The distance metric between the identity element e and anydieomorphism φ

dist(e, φ) =

∫ 1

0

(Lvt, vt) dt (1)

depends on the time-varying Eulerian velocity eld vt (t ∈ [0, 1]) in the tangentspace of dieomorphisms V = TDiff(Ω). Here L : V → V ∗ is a symmetric,positive-denite dierential operator, e.g., discrete Laplacian, with its inverseK : V ∗ → V , and mt ∈ V ∗ is a momentum vector that lies in the dual space V ∗

such that mt = Lvt and vt = Kmt.

Page 4: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for Ecient Image Registration 3

The path of deformation elds φt parametrized by t ∈ [0, 1] is generated by

dφtdt

= vt φt, (2)

where is a composition operator. The inverse mapping of φt is dened via

dφ−1tdt

= −Dφ−1t · vt, (3)

where D is the d × d Jacobian matrix at each voxel and · is an element-wisemultiplication.

The geodesic shooting algorithm estimates the initial velocity at t = 0 andrelies on the fact that a geodesic path of transformations φt and its inverse φ−1twith a given initial condition v0 can be uniquely determined through integratingthe Euler-Poincaré dierential equation (EPDi) [1, 12] as

∂vt∂t

= −K[(Dvt)

Tmt +Dmt vt +mt div(vt)], (4)

where div is the divergence operator and K is a smoothing operator that guar-antees the smoothness of the velocity elds.

2.1 Fourier Representation of Velocity Fields

Let f : Rd → R be a real-valued function. The Fourier transform F of f is givenby

F [f ](ξ1, . . . , ξd) =

∫Rd

f(x1, . . . , xd)e−2πi(x1ξ1+...+xdξd) dx1, . . . , dxd, (5)

where (ξ1, . . . , ξd) is a d-dimensional frequency vector. The inverse Fourier trans-form F−1 of a discretized Fourier signal f

F−1[f ](x1, . . . , xd) =∑

ξ1,...,ξd

f(ξ1, . . . , ξd)e2πi(ξ1x1+...+ξdxd) (6)

is an approximation of the original signal f . To ensure that f represents a real-valued vector eld in the spatial domain, we require f(ξ1, . . . , ξd) = f∗(−ξ1, . . . ,−ξd),where ∗ denotes the complex conjugate. When working with vector-valued func-tions of dieomorphisms φ and velocity elds v, we apply the Fourier transformto each vector component separately.

Since K is a smoothing operator that suppresses high frequencies in theFourier domain, the geodesic evolution equation (4) suggests that the velocityeld vt can be represented eciently as a bandlimited signal in Fourier space.Let V denote the discrete Fourier space of velocity elds. As shown in [23], forany two elements v, w ∈ V , the distance metric at identity e is dened as

〈u, v〉V =

∫(Lv(ξ), w(ξ))dξ,

Page 5: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

4 Zhang et al.

where L : V 7→ V ∗ is the Fourier transform of a commonly used Laplacianoperator (−α∆ + e)c, with a positive weight parameter α and a smoothnessparameter c, i.e.,

L(ξ1, . . . , ξd) =

−2α

d∑j=1

(cos(2πξj)− 1) + 1

c .The Fourier representation of the inverse operator K : V ∗ 7→ V is equal toK(ξ1, . . . , ξd) = L−1(ξ1, . . . , ξd).

Therefore, the geodesic shooting equation (4) can be eciently computed ina low dimensional bandlimited velocity space:

∂vt∂t

= −K[(Dvt)

T ? mt + ∇ · (mt ⊗ vt)], (7)

where ? is the truncated matrix-vector eld auto-correlation and Dvt is a tensorproduct D ⊗ vt with D(ξ1, . . . , ξd) = (i sin(2πξ1), . . . , i sin(2πξd)) representingthe Fourier frequencies of a central dierence Jacobian matrix D. Operator ∇· isthe discrete divergence of a vector eld v, which is computed as the sum of theFourier coecients of the central dierence operator D along each dimension,

i.e., ∇ · (ξ1, . . . , ξd) =d∑j=1

i sin(2πξj).

3 Frequency Dieomorphisms and Signal Decomposition

While geodesic shooting in the Fourier space (7) is ecient, integrating theordinary dierential equation (2) to compute the corresponding dieomorphismfrom a velocity eld remains computationally intensive. To address this problem,we introduce a Fourier representation of dieomorphisms that is simple and easyto manipulate in the bandlimited space. The proposed representation promisesimproved computational eciency of any algorithm that requires generation ofdieomorphisms from velocity elds.

Analogous to the continuous inverse ow in (3), we dene a sequence of time-dependent inverse dieomorphisms φ−1t in the Fourier domain that consequentlygenerates a path of geodesic ow. Because that the pointwise multiplication oftwo vector elds in the spatial domain corresponds to convolution in the Fourierdomain, we can easily compute the multiplication of a square matrix and a vectoreld in the Fourier domain as a single convolution for each row of the matrix.

Let Diff(Ω) denote the space of Fourier representations of dieomorphisms.To simplify the notation, we use ψ , φ−1 in the remainder of this section. Given

time-dependent velocity eld vt ∈ V , the dieomorphism ψt ∈ Diff(Ω) in thenite-dimensional Fourier domain can be computed as

dψtdt

= −Dψt ∗ vt, (8)

Page 6: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for Ecient Image Registration 5

where ∗ is a circular convolution with zero padding to avoid aliasing. To preventthe domain from growing innity, we truncate the output of the convolution ineach dimension to a suitable nite set.

Representing dieomorphisms entirely in the Fourier space eliminates theeort of converting their associated velocity elds back and forth from the Fourierdomain to the spatial domain. While current implementations of computing adieomorphism in (3) have complexity O(Nd) on a full image grid of linear sizeN , the complexity of naively integrating (8) is O(Nd logN) if the convolutionoperator is implemented via fast Fourier transform (FFT) [18]. Here we show howto reduce the complexity of (8) via frequency decomposition of the deformations.

In particular, we consider a representation ψ = e+ u, where e is the Fouriertransform of the identity transformation, and u is the Fourier transform of thedisplacement eld. We can now isolate the frequency response of the identitytransformation in (8) as follows:

dψtdt

= −D(e+ ut) ∗ vt = −De ∗ vt − Dut ∗ vt. (9)

Since De · vt = vt in the spatial domain, we have

De ∗ vt = F(De · vt) = F(vt) = vt. (10)

Substituting (10) into (9), we arrive at

dψtdt

= −vt − Dut ∗ vt with ψ0 = e, or

ut = −∫ t

0

vτ + Duτ ∗ vτ dτ with u0 = 0. (11)

Importantly, we observe that the high frequency components of the dieo-morphisms that come from the initial condition ψ0 = e remain unchanged, andonly low frequency components vary throughout the integration. Moreover, theevolution scheme for geodesic shooting in the Fourier domain (7) indeed main-tains vt as a bandlimited signal. The truncated convolution operation does notintroduce high frequencies if the displacement ut is also bandlimited. Fig. 1illustrates a 1D example of the integration (11).

The initial condition ψ0 = e corresponds to u0 = 0. We rst integrate (11)for bandlimited low frequency components of the signal and then add the highfrequency components back. Therefore we have

for ξ 6 η, ut(ξ) = −∫ t

0

vτ (ξ) + Duτ (ξ) ∗ vτ (ξ) dτ,

for ξ > η, ut(ξ) = 0, (12)

where ξ = (ξ1, . . . , ξd) and η = (η1, . . . , ηd) is the vector of upper bounds on thefrequency in the bandlimited representation of ψ.

Page 7: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

6 Zhang et al.

0

0.2

0.4

0.6

-0.1

-0.05

0

0.05

0.1

-0.01

-0.005

0

0.005

0.01

0

0.2

0.4

0.6

0.8

-0.05

0

0.05

0.01

0.02

0.03

0.04

0.05

0.1

0.2

0.3

0.4

0.5

1

2

3

4

5

0

0.2

0.4

0.6

0.8

1

2

3

4

5

Fig. 1: A 1D example of an initial velocity v0 as a sinusoid function and theresulting displacement eld ut and dieomorphism ψt at t = 0.1 and t = 1. BothFourier (red) and spatial (blue) representations are shown.

3.1 Frequency Dieomorphisms for Image Registration

In this section, we present a dieomorphic image registration algorithm basedon geodesic shooting that is carried out entirely in the Fourier space.

Let S be the source image and T be the target image dened on a torusdomain Γ = Rd/Zd (S(x), T (x) : Γ → R). The problem of dieomorphic imageregistration is to nd the shortest path of dieomorphisms ψt ∈ Diff(Γ ) : Γ →Γ, t ∈ [0, 1] such that Sψ1 is similar to T , where is a composition operator thatresamples S by the smooth mapping ψ1. LDDMM with geodesic shooting [20]leads to a gradient decent optimization of an explicit energy function

E(v0) =λ

2dist(S ψ1, T ) +

1

2‖v0‖2V (13)

under the constraints (2) and (4). The distance function dist(·, ·) measures thedissimilarity between images. Commonly used distance metrics include sum-of-squared dierence (L2-norm) of image intensities, normalized cross correla-tion (NCC), and mutual information (MI). Here λ > 0 is a weight parameter.

The energy function in the nite-dimensional Fourier space can be equiva-lently formulated as

E(v0) =λ

2dist(S ψ1, T ) +

1

2‖v0‖2V (14)

with the new constraints (7) and (8).We use a gradient decent algorithm on the initial velocity v0 to estimate the

path of dieomorphic ow ψt entirely in the bandlimited space. Beginningwith the initialization v0 = 0, the gradient of the energy (14) is computed viatwo steps below:

Page 8: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for Ecient Image Registration 7

1. Compute the gradient ∇v1E of the energy (14) at t = 1. This requiresintegrating both the dieomorphism ψt and the velocity eld vt forward intime, and then mapping ψ1 to the spatial domain to obtain ψ1. Formally,

∇v1E = KF(∂ dist(S ψ1, T )

∂ (S ψ1)· ∇(S ψ1)

). (15)

2. Bring the gradient ∇v1E in (15) back to t = 0 by reduced adjoint Jacobield equations [8, 23]. Integrate the reduced adjoint Jacobi eld equations

dv

dt= −ad†vh,

dh

dt= −v − advh+ ad†

hv (16)

in V to get the gradient update ∇v0E, where ad† is an adjoint operator and

v, h ∈ V are introduced adjoint variables.

The algorithm is summarized below.

Algorithm 1: Frequency Dieomorphisms for Image Registration

Input: source image S, target image T .Initialize v0 = 0.repeat

(a) Integrate (7) to compute vt at discrete time points t = [0, . . . , 1].(b) Integrate (8) to generate ψt.(ci) Convert ψ1 back to the spatial domain to transport the source image S.(cii) Compute the gradient ∇v1E (15) at time point t = 1.(d) Integrate ∇v1E backward in time via (16) to obtain ∇v0E.(e) Update v0 ← v0 − δ∇v0E, where δ is the step size.

until convergence

128 3 256 3 512 30

5

10

15

20

Tim

e(se

c)

FFTLinear Interpolation

Fig. 2: Exact run-time of FFT(blue) and linear interpolation(yellow).

Computational Complexity It has pre-viously been shown that the complexity ofsteps (a) and (d) is O(Tnd), where T is thenumber of time steps in the integration andn is the truncated dimension in the bandlim-ited space. The complexity of the currentmethods for computing dieomorphisms inthe high-dimensional image space via (2) isO(TNd). In contrast, our algorithm reducesthe complexity of this step to O(Tnd) (step(b)). To transport the images and measurethe image dissimilarity at t = 1, we con-vert the transformation ψ1 into the spatialdomain via FFT (O(Nd logN))(step (ci)).

Page 9: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

8 Zhang et al.

While the theoretical complexity of FFT is higher than the complexity of com-puting S ψ−11 , which is O(Nd), its empirical runtime for N a power of 2 isquite low by comparison. Fig. 2 reports the empirical runtime of FFT and oflinear interpolation for dierent image grid sizes (N = 27, 28, 29) as used by thecurrent methods and ours to transport S. We note that the linear interpolationrequires more than twice the amount of time than that of FFT.

4 Experimental Evaluation

To evaluate the proposed approach, we perform registration-based segmentationand examine the resulting segmentation accuracy, runtime and memory con-sumption of the algorithm. We compare the proposed method with the dieomor-phic demons implementation in ANTS software package [5] and the state-of-the-art fast geodesic shooting for LDDMM method FLASH [23] (downloaded from:https://bitbucket.org/FlashC/ashc). In all experiments, we set α = 1.5, c =3.0, λ = 1.0e4 and T = 10 for the time integration. A normalized cross corre-lation (NCC) metric for image dissimilarity and a multi-resolution optimizationscheme with three levels are used in all three methods. To evaluate volume over-lap between the propagated segmentation A and the manual segmentation Bfor each structure, we compute the Dice Similarity Coecient DSC(A,B) =2(|A| ∩ |B|)/(|A|+ |B|) where ∩ denotes an intersection of two regions.

4.1 Data

We evaluate the method on 3D brain MRI scans [9] and 4D in-utero MRI timeseries [11].

3D brain MRI Thirty six brain MRI scans (T1-weighted MP-RAGE) wereacquired in normal subjects and patients with Alzhimer's disease across a broadage range. The MRI images are of dimension 2563, 1mm isotropic voxels andwere computed by averaging three or four scans. All scans underwent skull strip-ping, intensity normalization, bias eld correction, and co-registration with anetransformation. An atlas was built from 20 images as a reference. Manual seg-mentations are available for all scans in the set. We perform image registrationof the 3D brain atlas to the remaining 16 subjects. We evaluate registrationby examining the accuracy of atlas-based delineations for white matter (WM),cortex (Cor), ventricles (Vent), hippocampus (Hipp), and caudate (Caud).

4D in-utero time-series volumetric MRI Ten pregnant women (threesingleton pregnancies, six twin pregnancies, and one triplet pregnancy) wererecruited and consented. Single-shot GRE-EPI image series were acquired foreach woman on a 3T MR scanner (Skyra Siemens, 18-channel body and 12-channel spine receive arrays, 3× 3mm2 in-plane resolution, 3mm slice thickness,interleaved slice acquisition, TR= 5.8 − 8s, TE= 32 − 36ms, FA= 90o). Oddand even slices of each volume were resampled onto an isotropic 3mm3 imagegrid to reduce the eects of interleaved acquisition. Each series includes around300 3D volumes. The placentae (total of 10) and fetal brains (total of 18) were

Page 10: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for Ecient Image Registration 9

8 16 32 64 128Number of frequencies

2.5

3

3.5

4O

ptim

al e

nerg

y

10 9

Fig. 3: Left: average nal energy for dierent values of the truncated dimensionn = 8, 16, . . . , 128. Right: example propagated segmentation with 35 structuresobtained by our method. 2D slices are shown for visualization only, all compu-tations are carried out fully in 3D.

manually delineated in the reference template and in ve additional volumes ineach series. When applying our method to in-utero MRI, we use it as part ofsequential registration of the consecutive frames in the scan series. Each seriesrequires about 300 consecutive image registration steps over time.

4.2 Results

3D brain MRI Fig. 3 reports the total energy (14) averaged over 16 test im-ages for dierent values of truncated dimension n = 8, 16, · · · , 128. Our methodarrives at the same solution at n = 32 and higher. For the remainder of this sec-tion, we use n = 32 to illustrate the results. An example segmentation obtainedby our algorithm is also illustrated in Fig. 3. Fig. 4 reports the volume over-lap of segmentations for our method and the two baseline algorithms. All threealgorithms produce comparable segmentation accuracy. The dierence is not sta-tistically signicant in a paired t-test for each labelled structure (p = 0.369). Ouralgorithm has substantially lower computational cost than ANTS and FLASH.Fig. 4 also provides runtime and memory consumption across all methods.

4D in-utero time-series volumetric MRI Similar to the previous exper-iment, we cross-validated the optimal truncated dimension n at dierent scalesand set n = 16 for the 4D in-utero time series. Once all the volumes in the seriesare aligned, we transform the manual segmentations in the rst volume to othervolumes in each series by using the estimated deformations. Fig. 5 illustratesresults for an example case from the study. We observe that the delineationsachieved by transferring manual segmentations from the reference frame to thecoordinate system of the target frame 25 align fairly well with the manual seg-mentations. Fig. 6 reports segmentation volume overlap for the fetal brains andplacenta, as well as the time and memory consumption for our method andthe two baseline algorithms. Again, our algorithm achieves comparable results

Page 11: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

10 Zhang et al.

WM Cor Vent Hipp Caud

0.2

0.4

0.6

0.8

1

Dic

e

ANTSFLASHOur method

Model Time(h) Memory(MB)

ANTS 2.1 4885

FLASH 0.5 3375

Our method 0.3 3083

Fig. 4: Left: volume overlap between atlas-based and manual segmentations forve important regions (white matter, cortex, ventricles, hippocampus, and cau-date) estimated via ANTS (black), FLASH (blue), and our method (red). Right:Runtime and memory consumption per image for all three methods.

(paired t-test p = 0.4671) while oering signicant improvements in computa-tional eciency.

Fig. 5: An example case from the in-utero MRI study. Left to right: source withmanual segmentation, deformed source, target with manual segmentation, andtarget with propagated segmentations for the fetal brains (green) and placenta(pink). 2D slices of axial view are shown for visualization only, all computationsare carried out fully in 3D.

5 Conclusion

We presented an ecient way to compute dieomorphisms in the setting of LD-DMM with geodesic shooting for image registration. Our method is the rst torepresent dieomorphisms in the Fourier space, which provides a way to com-pute transformations from the associated velocity elds entirely in the low di-

Page 12: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

Frequency Dieomorphisms for Ecient Image Registration 11

Brain Placenta0.8

0.85

0.9

0.95

1

Dic

e

ANTSFLASHOur method

Model Time(h) Memory(MB)

ANTS 96.75 253.62

FLASH 37.75 109.52

Our method 27.00 67.32

Fig. 6: Left: volume overlap between transferred and manual segmentations offetal brains and placenta averaged over all subjects. Statistics are reported forANTS (black), FLASH (blue), and our method (red). Right: Runtime and mem-ory consumption of 300 registrations for all three algorithms.

mensional bandlimited space. This approach reduces the computational cost ofthe algorithms without loss in accuracy. The theoretical tools employed in thiswork are not only broadly applicable to other representations of dieomorphictransformations such as stationary velocity elds, but also to the standard pathoptimization strategy in the original LDDMM. Our method can be naturallyinterpreted as operating with the left-invariant metric on the space of dieomor-phisms [15], which accepts spatially-varying smoothing kernels in special imageregistration scenarios where dierent regularizations are required at dierent lo-cations. Future research will explore more of numerical analysis, as well as itstheoretical connection and implications for dieomorphic image registration.

Acknowledgments This work was supported by NIH NIBIB NAC P41EB015902,NIH NINDS R01NS086905, NIH NICHD U01HD087211, and Wistron Corpora-tion.

References

1. Arnol'd, V.I.: Sur la géométrie diérentielle des groupes de Lie de dimension innieet ses applications à l'hydrodynamique des uides parfaits. Ann. Inst. Fourier 16,319361 (1966)

2. Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A log-Euclidean frameworkfor statistics on dieomorphisms. In: Medical Image Computing and Computer-Assisted Intervention, pp. 924931. Springer (2006)

3. Ashburner, J.: A fast dieomorphic image registration algorithm. Neuroimage38(1), 95113 (2007)

4. Ashburner, J., Friston, K.J.: Unied segmentation. Neuroimage 26(3), 839851(2005)

5. Avants, B.B., Epstein, C.L., Grossman, M., Gee, J.C.: Symmetric dieomorphicimage registration with cross-correlation: evaluating automated labeling of elderlyand neurodegenerative brain. Medical image analysis 12(1), 2641 (2008)

Page 13: Frequency Diffeomorphisms for Efficient Image …people.csail.mit.edu/ruizhi/IPMI2017_Zhang.pdfimage registration methods while producing equally accurate alignment. eW demonstrate

12 Zhang et al.

6. Beg, M., Miller, M., Trouvé, A., Younes, L.: Computing large deformation metricmappings via geodesic ows of dieomorphisms. International Journal of ComputerVision 61(2), 139157 (2005)

7. Christensen, G.E., Rabbitt, R.D., Miller, M.I.: Deformable templates using largedeformation kinematics. IEEE Transactions on Image Processing 5(10), 14351447(1996)

8. Francesco, B.: Invariant ane connections and controllability on lie groups. Tech.rep., technical Report for Geometric Mechanics, California Institute of Technology(1995)

9. Johnson, K.A., Jones, K., Holman, B.L., Becker, J.A., Spiers, P.A., Satlin, A.,Albert, M.S.: Preclinical prediction of alzheimer's disease using spect. Neurology50(6), 15631571 (1998)

10. Joshi, S., Davis, B., Jomier, M., Gerig, G.: Unbiased dieomorphic atlas construc-tion for computational anatomy. NeuroImage 23, Supplement1, 151160 (2004)

11. Liao, R., Turk, E.A., Zhang, M., Luo, J., Grant, P.E., Adalsteinsson, E., Golland,P.: Temporal registration in in-utero volumetric mri time series. In: InternationalConference on Medical Image Computing and Computer-Assisted Intervention. pp.5462. Springer (2016)

12. Miller, M.I., Trouvé, A., Younes, L.: Geodesic shooting for computational anatomy.Journal of Mathematical Imaging and Vision 24(2), 209228 (2006)

13. Niethammer, M., Huang, Y., Vialard, F.X.: Geodesic regression for image time-series. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 655662. Springer (2011)

14. Qiu, A., Younes, L., Miller, M.I.: Principal component based dieomorphic surfacemapping. Medical Imaging, IEEE Transactions on 31(2), 302311 (2012)

15. Schmah, T., Risser, L., Vialard, F.X.: Dieomorphic image matching with left-invariant metrics. In: Geometry, Mechanics, and Dynamics, pp. 373392. Springer(2015)

16. Singh, N., Fletcher, P.T., Preston, J.S., Ha, L., King, R., Marron, J.S., Wiener,M., Joshi, S.: Multivariate statistical analysis of deformation momenta relatinganatomical shape to neuropsychological measures. In: Medical Image Computingand Computer-Assisted Intervention, pp. 529537. Springer (2010)

17. Singh, N., Vialard, F.X., Niethammer, M.: Splines for dieomorphisms. Medicalimage analysis 25(1), 5671 (2015)

18. Van Loan, C.: Computational frameworks for the fast Fourier transform, vol. 10.Siam (1992)

19. Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Dieomorphic demons:Ecient non-parametric image registration. NeuroImage 45(1), S61S72 (2009)

20. Vialard, F.X., Risser, L., Rueckert, D., J.Cotter, C.: Dieomorphic 3D image regis-tration via geodesic shooting using an ecient adjoint calculation. In: InternationalJournal of Computer Vision. pp. 229241 (2012)

21. Younes, L., Arrate, F., Miller, M.: Evolutions equations in computational anatomy.NeuroImage 45(1S1), 4050 (2009)

22. Zhang, M., Fletcher, P.T.: Bayesian principal geodesic analysis in dieomorphicimage registration. In: Medical Image Computing and Computer-Assisted Inter-vention, pp. 121128. Springer (2014)

23. Zhang, M., Fletcher, P.T.: Finite-dimensional Lie algebras for fast dieomorphicimage registration. In: International Conference on Information Processing in Med-ical Imaging. pp. 249260. Springer (2015)

View publication statsView publication stats