Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration

All fields of neuroscience that employ brain imaging need to communicate their results with reference to anatomical regions. In particular, comparative morphometry and group analysis of functional and physiological data require coregistration of brains to establish correspondences across brain structures. It is well established that linear registration of one brain to another is inadequate for aligning brain structures, so numerous algorithms have emerged to nonlinearly register brains to one another. This study is the largest evaluation of nonlinear deformation algorithms applied to brain image registration ever conducted. Fourteen algorithms from laboratories around the world are evaluated using 8 different error measures. More than 45,000 registrations between 80 manually labeled brains were performed by algorithms including: AIR, ANIMAL, ART, Diffeomorphic Demons, FNIRT, IRTK, JRD-fluid, ROMEO, SICLE, SyN, and four different SPM5 algorithms ("SPM2-type" and regular Normalization, Unified Segmentation, and the DARTEL Toolbox). All of these registrations were preceded by linear registration between the same image pairs using FLIRT. One of the most significant findings of this study is that the relative performances of the registration methods under comparison appear to be little affected by the choice of subject population, labeling protocol, and type of overlap measure. This is important because it suggests that the findings are generalizable to new subject populations that are labeled or evaluated using different labeling protocols. Furthermore, we ranked the 14 methods according to three completely independent analyses (permutation tests, one-way ANOVA tests, and indifference-zone ranking) and derived three almost identical top rankings of the methods. ART, SyN, IRTK, and SPM's DARTEL Toolbox gave the best results according to overlap and distance measures, with ART and SyN delivering the most consistently high accuracy across subjects and label sets. Updates will be published on the http://www.mindboggle.info/papers/ website.

[1]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[2]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[3]  T.R. Martinez,et al.  Using permutations instead of student's t distribution for p-values in paired-difference algorithm comparisons , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Satrajit S. Ghosh,et al.  Region of interest based analysis of functional imaging data , 2003, NeuroImage.

[5]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[6]  Daniel Rueckert,et al.  Generalised Overlap Measures for Assessment of Pairwise and Groupwise Image Registration and Segmentation , 2005, MICCAI.

[7]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[8]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[9]  Gary E. Christensen,et al.  Consistent image registration , 2001, IEEE Transactions on Medical Imaging.

[10]  D. Louis Collins,et al.  Retrospective evaluation of intersubject brain registration , 2003, IEEE Transactions on Medical Imaging.

[11]  Paul M. Thompson,et al.  3 D pattern of brain atrophy in HIV / AIDS visualized using tensor-based morphometry , 2006 .

[12]  Hanna Damasio,et al.  Effects of spatial transformation on regional brain volume estimates , 2008, NeuroImage.

[13]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[14]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[15]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[16]  A. Schleicher,et al.  Cytoarchitectural maps of the human brain in standard anatomical space , 1997, Human brain mapping.

[17]  D. Berdichevsky,et al.  Anatomic Landmark-based Method for Assessment of Intersubject Image Registration Techniques: Woods vs Talairach , 1998, NeuroImage.

[18]  Satrajit S. Ghosh,et al.  Mindboggle: Automated brain labeling with multiple atlases , 2005, BMC Medical Imaging.

[19]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[20]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[21]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.

[22]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[23]  Arno Klein,et al.  Mindboggle: a scatterbrained approach to automate brain labeling , 2005, NeuroImage.

[24]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[25]  Lewis D. Griffin,et al.  Zen and the art of medical image registration: correspondence, homology, and quality , 2003, NeuroImage.

[26]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[27]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  R. Bechhofer,et al.  A Single-Sample Multiple Decision Procedure for Ranking Variances of Normal Populations , 1954 .

[29]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[30]  Pierre Hellier,et al.  Consistent intensity correction of MR images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Nicholas Ayache,et al.  Non-parametric Diffeomorphic Image Registration with the Demons Algorithm , 2007, MICCAI.

[32]  Isabelle Corouge,et al.  Inter Subject Registration of Functional and Anatomical Data Using SPM , 2002, MICCAI.

[33]  H. Benali,et al.  BrainVISA: Software platform for visualization and analysis of multi-modality brain data , 2001, NeuroImage.

[34]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[35]  J. Talairach.  Atlas d'anatomie stéréotaxique du télencéphale : études anatomo-radiologiques , 1967 .

[36]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[37]  D. V. van Essen,et al.  Computerized Mappings of the Cerebral Cortex: A Multiresolution Flattening Method and a Surface-Based Coordinate System , 1996, Journal of Cognitive Neuroscience.

[38]  David W. Paglieroni,et al.  Distance transforms: Properties and machine vision applications , 1992, CVGIP Graph. Model. Image Process..

[39]  Torsten Rohlfing,et al.  Performance-based classifier combination in atlas-based image segmentation using expectation-maximization parameter estimation , 2004, IEEE Transactions on Medical Imaging.

[40]  Gary E. Christensen,et al.  Consistent landmark and intensity-based image registration , 2002, IEEE Transactions on Medical Imaging.

[41]  Jason A. Tourville,et al.  A cortical and cerebellar parcellation system for speech studies , 2010 .

[42]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[43]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[44]  Pierre Hellier,et al.  Hierarchical estimation of a dense deformation field for 3-D robust registration , 2001, IEEE Transactions on Medical Imaging.

[45]  Pierre Jannin,et al.  Model for defining and reporting reference-based validation protocols in medical image processing , 2006, International Journal of Computer Assisted Radiology and Surgery.

[46]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[47]  D. L. Collins,et al.  On the validity of associating stereotactic coordinates with anatomical nomenclature , 2000, NeuroImage.

[48]  Nasser Kehtarnavaz,et al.  Brain Functional Localization: A Survey of Image Registration Techniques , 2007, IEEE Transactions on Medical Imaging.

[49]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[50]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[51]  N. Makris,et al.  MRI-Based Topographic Parcellation of Human Neocortex: An Anatomically Specified Method with Estimate of Reliability , 1996, Journal of Cognitive Neuroscience.

[52]  廣瀬雄一,et al.  Neuroscience , 2019, Workplace Attachments.

[53]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[54]  J A Fiez,et al.  Lesion segmentation and manual warping to a reference brain: Intra‐ and interobserver reliability , 2000, Human brain mapping.

[55]  Nicolas Toussaint,et al.  MedINRIA: Medical Image Navigation and Research Tool by INRIA , 2007 .

[56]  Guido Gerig,et al.  Valmet: A New Validation Tool for Assessing and Improving 3D Object Segmentation , 2001, MICCAI.

[57]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[58]  Christos Davatzikos,et al.  Estimating topology preserving and smooth displacement fields , 2004, IEEE Transactions on Medical Imaging.

[59]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[60]  D. Louis Collins,et al.  Animal: Validation and Applications of Nonlinear Registration-Based Segmentation , 1997, Int. J. Pattern Recognit. Artif. Intell..

[61]  H Whiting.  Maxwell's demons. , 1885, Science.

[62]  Michael A Yassa,et al.  A quantitative evaluation of cross-participant registration techniques for MRI studies of the medial temporal lobe , 2009, NeuroImage.

[63]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[64]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[65]  Babak A. Ardekani,et al.  Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans , 2005, Journal of Neuroscience Methods.

[66]  B. Ardekani,et al.  A Fully Automatic Multimodality Image Registration Algorithm , 1995, Journal of computer assisted tomography.

[67]  Luc Van Gool,et al.  Automated image registration , 2004 .

[68]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[69]  J. Xiong,et al.  Intersubject Variability in Cortical Activations during a Complex Language Task , 2000, NeuroImage.

[70]  D. Louis Collins,et al.  Retrospective Evaluation of Inter-subject Brain Registration , 2001, MICCAI.

[71]  Daniel Rueckert,et al.  A Framework for Detailed Objective Comparison of Non-rigid Registration Algorithms in Neuroimaging , 2004, MICCAI.

[72]  D. Louis Collins,et al.  Tuning and Comparing Spatial Normalization Methods , 2003, MICCAI.

[73]  Daniel Rueckert,et al.  Diffeomorphic Registration Using B-Splines , 2006, MICCAI.

[74]  R. Bechhofer.  A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with known Variances , 1954 .

[75]  James C. Gee,et al.  Validation of a nonrigid registration algorithm for multimodal data , 2002, SPIE Medical Imaging.

[76]  J. Mazziotta,et al.  Automated image registration , 1993 .

[77]  Stephan Heckers,et al.  A Method for Assessing the Accuracy of Intersubject Registration of the Human Brain Using Anatomic Landmarks , 1999, NeuroImage.

[78]  Terry M. Peters,et al.  3D statistical neuroanatomical models from 305 MRI volumes , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[79]  Charles A. Pelizzari,et al.  Noninvasive identification of human central sulcus: a comparison of gyral morphology, functional MRI, dipole localization, and direct cortical mapping , 2003, NeuroImage.

[80]  Jean-Francois Mangin,et al.  Anatomically Constrained Surface Parameterization for Cortical Localization , 2005, MICCAI.

[81]  Nicholas Ayache,et al.  Iconic feature based nonrigid registration: the PASHA algorithm , 2003, Comput. Vis. Image Underst..

[82]  Gary E. Christensen,et al.  Consistent Linear-Elastic Transformations for Image Matching , 1999, IPMI.

[83]  P. Jaccard.  THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .