Online citations, reference lists, and bibliographies.
← Back to Search

A Reproducible Evaluation Of ANTs Similarity Metric Performance In Brain Image Registration

B. Avants, N. Tustison, Gang Song, P. Cook, A. Klein, J. Gee
Published 2011 · Computer Science, Medicine

Cite This
Download PDF
Analyze on Scholarcy
Share
The United States National Institutes of Health (NIH) commit significant support to open-source data and software resources in order to foment reproducibility in the biomedical imaging sciences. Here, we report and evaluate a recent product of this commitment: Advanced Neuroimaging Tools (ANTs), which is approaching its 2.0 release. The ANTs open source software library consists of a suite of state-of-the-art image registration, segmentation and template building tools for quantitative morphometric analysis. In this work, we use ANTs to quantify, for the first time, the impact of similarity metrics on the affine and deformable components of a template-based normalization study. We detail the ANTs implementation of three similarity metrics: squared intensity difference, a new and faster cross-correlation, and voxel-wise mutual information. We then use two-fold cross-validation to compare their performance on openly available, manually labeled, T1-weighted MRI brain image data of 40 subjects (UCLA's LPBA40 dataset). We report evaluation results on cortical and whole brain labels for both the affine and deformable components of the registration. Results indicate that the best ANTs methods are competitive with existing brain extraction results (Jaccard=0.958) and cortical labeling approaches. Mutual information affine mapping combined with cross-correlation diffeomorphic mapping gave the best cortical labeling results (Jaccard=0.669±0.022). Furthermore, our two-fold cross-validation allows us to quantify the similarity of templates derived from different subgroups. Our open code, data and evaluation scripts set performance benchmark parameters for this state-of-the-art toolkit. This is the first study to use a consistent transformation framework to provide a reproducible evaluation of the isolated effect of the similarity metric on optimal template construction and brain labeling.
This paper references
Diffeomorphic Demons Using ITK's Finite Difference Solver Hierarchy
Tom Kamiel Magda Vercauteren (2007)
10.1007/s10851-005-3624-0
Geodesic Shooting for Computational Anatomy
M. Miller (2005)
Pattern theory and vision
D. Mumford (1998)
10.1109/TPAMI.1986.4767776
Efficient Synthesis of Gaussian Filters by Cascaded Uniform Filters
W. Wells (1986)
10.1016/j.neuroimage.2010.03.010
ABSORB: Atlas building by self-organized registration and bundling
Hongjun Jia (2010)
10.1118/1.598130
Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures.
C. Studholme (1997)
10.2307/1970699
Groups of diffeomorphisms and the motion of an incompressible fluid
D. Ebin (1970)
10.1016/j.neuroimage.2006.05.061
Automatic anatomical brain MRI segmentation combining label propagation and decision fusion
R. Heckemann (2006)
Computing metrics via geodesics on flows of diffeomorphisms
M. Beg (2005)
10.1007/11505730_18
Multi-dimensional Mutual Information Based Robust Image Registration Using Maximum Distance-Gradient-Magnitude
Rui Gan (2005)
10.1016/j.neuroimage.2010.01.091
Evaluation of volume-based and surface-based brain image registration methods
A. Klein (2010)
10.1016/j.neuroimage.2008.12.037
Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration
A. Klein (2009)
Pattern theory and vision. Questions Matheematiques En Traitement Du Signal et de L'Image
D Mumford (1998)
Insight into images. Ch. Non- Rigid Image Registration. A K Peters
B Avants (2004)
10.1016/j.neuroimage.2009.04.047
Skull stripping based on region growing for magnetic resonance brain images
J. G. Park (2009)
10.1007/978-3-540-75759-7_37
Spatiotemporal Normalization for Longitudinal Analysis of Gray Matter Atrophy in Frontotemporal Dementia
B. Avants (2007)
10.1016/j.media.2006.01.001
Retrospective evaluation of a topology preserving non-rigid registration method
V. Noblet (2006)
10.1006/nimg.2000.0582
Voxel-Based Morphometry—The Methods
J. Ashburner (2000)
10.1109/TPAMI.2006.34
Data driven image models through continuous joint alignment
E. Learned-Miller (2006)
10.1109/ICCV.2007.4409159
Multi-start Method with Prior Learning for Image Registration
Gang Song (2007)
10.1016/S0140-6736(01)05408-3
Imaging of onset and progression of Alzheimer's disease with voxel-compression mapping of serial magnetic resonance images
Nick C Fox (2001)
Fast normalized cross-correlation. Vision Interface: Canadian Image Processing and Pattern Recognition Society
J Lewis (1995)
10.1016/j.neuroimage.2008.08.042
A high-resolution computational atlas of the human hippocampus from postmortem magnetic resonance imaging at 9.4 T
P. Yushkevich (2009)
10.1016/j.neuroimage.2004.03.032
A hybrid approach to the skull stripping problem in MRI
F. Ségonne (2004)
10.1038/nn.2303
Circular analysis in systems neuroscience: the dangers of double dipping
N. Kriegeskorte (2009)
10.1109/4235.585893
No free lunch theorems for optimization
D. Wolpert (1997)
10.1023/A:1007958904918
Alignment by Maximization of Mutual Information
P. Viola (2004)
10.1016/S1077-3142(03)00116-4
Point similarity measures for non-rigid registration of multi-modal data
Peter Rogelj (2003)
10.2307/2324802
Ordinary Differential Equations
F. Brauer (1973)
10.1016/j.jneumeth.2004.07.014
Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans
B. Ardekani (2005)
10.1002/hipo.20619
Appearance and incomplete label matching for diffeomorphic template based hippocampus segmentation
J. Pluta (2009)
10.1117/12.480122
Symmetric image registration
Peter Rogelj (2003)
10.1109/TMI.2002.803111
HAMMER: hierarchical attribute matching mechanism for elastic registration
Dinggang Shen (2002)
10.1016/S1361-8415(98)80022-4
Image matching as a diffusion process: an analogy with Maxwell's demons
J. Thirion (1998)
10.1016/j.neuroimage.2009.09.062
The optimal template effect in hippocampus studies of diseased populations
B. Avants (2010)
10.1016/j.neuroimage.2008.03.034
Evaluation and comparison of GLM- and CVA-based fMRI processing pipelines with Java-based fMRI processing pipeline evaluation system
Jing Zhang (2008)
10.1016/j.neuroimage.2008.10.040
Diffeomorphic demons: Efficient non-parametric image registration
T. Vercauteren (2009)
N-D C k B-spline scattered data approximation
N J Tustison (2005)
10.1007/978-3-540-45087-0_32
Information Theoretic Similarity Measures in Non-rigid Registration
W. Crum (2003)
10.1109/42.563664
Multimodality image registration by maximization of mutual information
F. Maes (1997)
10.1146/ANNUREV.BIOENG.4.092101.125733
On the metrics and euler-lagrange equations of computational anatomy.
M. Miller (2002)
10.1109/ISBI.2002.1029264
Registration patterns: the generic framework for image registration of the insight toolkit
L. Ibáñez (2002)
10.1016/j.neuroimage.2007.10.051
The impact of skull-stripping and radio-frequency bias correction on grey-matter segmentation for voxel-based morphometry
Julio Acosta-Cabronero (2008)
10.1002/hbm.10123
Three‐dimensional maximum probability atlas of the human brain, with particular reference to the temporal lobe
A. Hammers (2003)
10.1097/00004728-199801000-00028
Automated image registration: II. Intersubject validation of linear and nonlinear models.
R. Woods (1998)
10.1016/j.neuroimage.2010.03.040
High-resolution structural and functional MRI of hippocampal CA3 and dentate gyrus in patients with amnestic Mild Cognitive Impairment
M. Yassa (2010)
ANTS: Advanced Open-Source Normalization Tools for Neuroanatomy
B. B. Avants (2009)
10.1007/978-3-540-73273-0_60
Nonrigid Image Registration Using Conditional Mutual Information
D. Loeckx (2007)
10.1109/TMI.2009.2035616
elastix: A Toolbox for Intensity-Based Medical Image Registration
S. Klein (2010)
10.1016/j.neuroimage.2004.07.068
Unbiased diffeomorphic atlas construction for computational anatomy
S. Joshi (2004)
10.1073/PNAS.200033797
Measuring the thickness of the human cerebral cortex from magnetic resonance images.
B. Fischl (2000)
10.1109/ISBI.2006.1625010
Open Source and Open Science: how it is changing the medical imaging community
L. Ibáñez (2006)
10.1109/TMI.2003.809072
PET-CT image registration in the chest using free-form deformations
D. Mattes (2003)
10.1016/j.media.2007.06.004
Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain
B. Avants (2008)
10.1523/JNEUROSCI.0859-10.2010
Early Stress Is Associated with Alterations in the Orbitofrontal Cortex: A Tensor-Based Morphometry Investigation of Brain Structure and Behavioral Risk
J. Hanson (2010)
10.1016/j.neuroimage.2009.08.050
Skull stripping using graph cuts
S. A. Sadananthan (2010)
10.1109/36.655338
A fast method to determine co-occurrence texture features
David A Clausi (1998)
10.1111/j.1745-6924.2009.01125.x
Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1
E. Vul (2009)
10.2307/2308959
Ordinary Differential Equations.
N. Parke (1958)
10.1016/j.neuroimage.2004.10.035
The LONI Debabeler: a mediator for neuroimaging software
S. Neu (2005)
10.1016/j.neuroimage.2010.01.041
Dementia induces correlated reductions in white matter integrity and cortical thickness: A multivariate neuroimaging study with sparse canonical correlation analysis
B. Avants (2010)
10.1016/j.neuroimage.2003.11.010
Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains
T. Rohlfing (2004)
10.1016/S0734-189X(89)80014-3
Multiresolution elastic matching
R. Bajcsy (1989)
Fast Normalized Cross-Correlation
J. P. Lewis (2010)
10.1109/TIP.2008.2010072
Directly Manipulated Free-Form Deformation Image Registration
N. Tustison (2009)
10.1109/TMI.2003.816961
Retrospective evaluation of intersubject brain registration
P. Hellier (2003)
10.1016/j.neuroimage.2009.12.007
Bias in estimation of hippocampal atrophy using deformation-based morphometry arises from asymmetric global normalization: An illustration in ADNI 3 T MRI data
P. Yushkevich (2010)
10.1145/146370.146374
A survey of image registration techniques
L. Brown (1992)
10.1016/S0031-3203(98)00093-4
On matching brain volumes
J. Gee (1999)
10.1109/83.536892
Deformable templates using large deformation kinematics
G. Christensen (1996)
10.1109/TIP.2003.814215
From the editor-in-chief
J. Kovacevic (2003)
J. Neurosci
10.1109/TASSP.1979.1163188
A fast two-dimensional median filtering algorithm
T. Huang (1979)
10.1016/j.neuroimage.2010.02.069
LONI MiND: Metadata in NIfTI for DWI
Vishal Patel (2010)
10.1016/j.neuroimage.2010.01.072
Improving intersubject image registration using tissue-class information benefits robustness and accuracy of multi-atlas based anatomical segmentation
R. Heckemann (2010)
10.1007/978-3-642-02498-6_18
A New Information-Theoretic Measure to Control the Robustness-Sensitivity Trade-Off for DMFFD Point-Set Registration
N. Tustison (2009)
10.1016/j.cmpb.2009.01.011
Symmetric inverse consistent nonlinear registration driven by mutual information
G. Tao (2009)
10.1097/00004728-198907000-00006
Segmentation of MR Brain Images into Cerebrospinal Fluid Spaces, White and Gray Matter
K. O. Lim (1989)
10.1007/3-540-45787-9_68
A Viscous Fluid Model for Multimodal Non-rigid Image Registration Using Mutual Information
E. D'Agostino (2002)
10.1016/j.neuroimage.2007.07.007
A fast diffeomorphic image registration algorithm
J. Ashburner (2007)
10.1109/42.796284
Nonrigid registration using free-form deformations: application to breast MR images
D. Rueckert (1999)
10.1023/A:1020830525823
Variational Methods for Multimodal Image Matching
G. Hermosillo (2004)
10.1007/11812715_10
Generalized n-D Ck B-Spline Scattered Data Approximation with Confidence Values
N. Tustison (2006)
10.1109/TMI.2002.808365
Coupling dense and landmark-based approaches for nonrigid registration
P. Hellier (2003)
10.1109/TIP.2005.860356
Fingerprint multicast in secure video streaming
H. V. Zhao (2006)
NeuroImage xxx (2010) xxx–xxx Please cite this article as A reproducible evaluation of ANTs similarity metric performance in brain image registration
B B Avants (2010)
10.1007/s10803-009-0790-8
Quantitative Architectural Analysis: A New Approach to Cortical Mapping
A. Schleicher (2009)
10.1016/j.neuroimage.2007.09.031
Construction of a 3D probabilistic atlas of human cortical structures
D. Shattuck (2008)
10.1016/j.neuroimage.2010.03.012
Accuracy and reproducibility study of automatic MRI brain tissue segmentation methods
R. Boer (2010)
10.1016/j.media.2005.04.008
Open science - combining open data and open source software: Medical image analysis with the Insight Toolkit
Terry S. Yoo (2005)



This paper is referenced by
Characterization and Perturbation of Functional Networks That Support Human Memory
E. Solomon (2019)
10.1162/NETN_a_00001
Evolution of brain network dynamics in neurodevelopment
Lucy R. Chai (2017)
Visualization and analysis of large medical image collections using pipelines
R. Sridharan (2015)
10.1007/978-3-030-59716-0_22
Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration
Zhe Xu (2020)
Encoding-Retrieval Relationships in Episodic Memory: A Functional Neuroimaging Perspective
Erik A. Wing (2015)
10.1016/j.nicl.2017.01.030
Cognitive behavioral therapy increases amygdala connectivity with the cognitive control network in both MDD and PTSD☆
H. Shou (2017)
10.1007/s11682-016-9520-y
Longitudinal assessment of local and global functional connectivity following sports-related concussion
T. Meier (2016)
10.1038/s41539-018-0029-6
Neural correlates of video game empathy training in adolescents: a randomized trial
T. Kral (2018)
Structural cortical grey matter changes during the transition from premanifest to manifest Huntington's disease : a methodological evaluation
Eileanoir Johnson (2018)
Multiscale imaging of white matter microstructure
Jeroen Mollink (2019)
Benchmarking confound regression strategies for the control of motion artifact in studies of functional connectivity
R. Ciric (2016)
10.1097/RCT.0b013e31828004ea
Assessing the Performance of Atlas-Based Prefrontal Brain Parcellation in an Aging Cohort
Benjamin S. Aribisala (2013)
10.1111/bdi.12581
Alterations of the cerebellum and basal ganglia in bipolar disorder mood states detected by quantitative T1ρ mapping
C. Johnson (2018)
Orienting Attention to Object Representations in Short-term Memory
K. C. Backer (2014)
10.1007/978-3-319-75238-9_32
MRI Augmentation via Elastic Registration for Brain Lesions Segmentation
Egor Krivov (2017)
10.3174/ajnr.A5109
Cognitive Implications of Deep Gray Matter Iron in Multiple Sclerosis
E. Fujiwara (2017)
10.1037/neu0000493
The Ipsilesional Attention Bias in Right-Hemisphere Stroke Patients as Revealed by a Realistic Visual Search Task: Neuroanatomical Correlates and Functional Relevance
B. Machner (2018)
10.1038/s41597-020-0379-9
High-resolution T2-FLAIR and non-contrast CT brain atlas of the elderly
Deepthi Rajashekar (2020)
10.7554/eLife.52059
Dynamic behavior of the locus coeruleus during arousal-related memory processing in a multi-modal 7T fMRI paradigm
H. I. Jacobs (2020)
10.1016/j.cortex.2020.09.012
Disconnection somewhere down the line: Multivariate lesion-symptom mapping of the line bisection error
Daniel Wiesen (2020)
10.1016/j.neuroimage.2020.117273
Non-Negative Data-Driven Mapping of Structural Connections with Application to the Neonatal Brain
E. Thompson (2020)
10.1101/2020.01.15.908087
The gamma-Protocadherins regulate the survival of GABAergic interneurons during developmentally-regulated cell death
Candace H. Carriere (2020)
10.7554/eLife.57023
Retrieval practice facilitates memory updating by enhancing and differentiating medial prefrontal cortex representations
Zhifang Ye (2020)
10.1101/750919
Temporal fluctuations in the brain’s modular architecture during movie-watching
R. Betzel (2019)
10.1101/664227
A Symmetric Prior for the Regularisation of Elastic Deformations: Improved Anatomical Plausibility in Nonlinear Image Registration
F. J. Lange (2020)
10.1007/978-3-319-46726-9_6
Diffeomorphic Density Registration in Thoracic Computed Tomography
C. Rottman (2016)
10.1049/iet-ipr.2017.0517
3D MRI image super-resolution for brain combining rigid and large diffeomorphic registration
Zifei Liang (2017)
10.1089/neu.2017.5022
Accelerated Changes in Cortical Thickness Measurements with Age in Military Service Members with Traumatic Brain Injury.
R. Savjani (2017)
10.1002/mrm.27927
Quantitative brain relaxation atlases for personalized detection and characterization of brain pathology
Gian Franco Piredda (2019)
10.1016/j.dcn.2016.02.004
Working memory filtering continues to develop into late adolescence
Matthew Peverill (2016)
10.1117/12.2217370
Comparison of template registration methods for multi-site meta-analysis of brain morphometry
J. Faskowitz (2016)
10.3389/fnana.2016.00012
A Digital Atlas of Middle to Large Brain Vessels and Their Relation to Cortical and Subcortical Structures
R. Viviani (2016)
See more
Semantic Scholar Logo Some data provided by SemanticScholar