Multimodal surface matching with higher-order smoothness constraints

&NA; In brain imaging, accurate alignment of cortical surfaces is fundamental to the statistical sensitivity and spatial localisation of group studies, and cortical surface‐based alignment has generally been accepted to be superior to volume‐based approaches at aligning cortical areas. However, human subjects have considerable variation in cortical folding, and in the location of functional areas relative to these folds. This makes alignment of cortical areas a challenging problem. The Multimodal Surface Matching (MSM) tool is a flexible, spherical registration approach that enables accurate registration of surfaces based on a variety of different features. Using MSM, we have previously shown that driving cross‐subject surface alignment, using areal features, such as resting state‐networks and myelin maps, improves group task fMRI statistics and map sharpness. However, the initial implementation of MSM's regularisation function did not penalize all forms of surface distortion evenly. In some cases, this allowed peak distortions to exceed neurobiologically plausible limits, unless regularisation strength was increased to a level which prevented the algorithm from fully maximizing surface alignment. Here we propose and implement a new regularisation penalty, derived from physically relevant equations of strain (deformation) energy, and demonstrate that its use leads to improved and more robust alignment of multimodal imaging data. In addition, since spherical warps incorporate projection distortions that are unavoidable when mapping from a convoluted cortical surface to the sphere, we also propose constraints that enforce smooth deformation of cortical anatomies. We test the impact of this approach for longitudinal modelling of cortical development for neonates (born between 31 and 43 weeks of post‐menstrual age) and demonstrate that the proposed method increases the biological interpretability of the distortion fields and improves the statistical significance of population‐based analysis relative to other spherical methods. HighlightsAdvances the Multimodal Surface Matching (MSM) method, for cortical surface registration of cortical surfaces, by improving control over the smoothness of the deformation.Enhances alignment of multimodal features, including the feature set used for the Human Connectome Project's parcellation of the human cerebral cortex.Also allows statistical modelling of longitudinal patterns of cortical growth.

[1]  Joseph V. Hajnal,et al.  Sensitivity Encoding for Aligned Multishot Magnetic Resonance Reconstruction , 2016, IEEE Transactions on Computational Imaging.

[2]  Mark W. Woolrich,et al.  Resting-state fMRI in the Human Connectome Project , 2013, NeuroImage.

[3]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[4]  Nikos Komodakis,et al.  Approximate Labeling via Graph Cuts Based on Linear Programming , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrew Melbourne,et al.  Cortical folding of the preterm brain: a longitudinal analysis of extremely preterm born neonates using spectral matching , 2016, Brain and behavior.

[6]  Hiroshi Ishikawa,et al.  Higher-Order Clique Reduction without Auxiliary Variables , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Bryan R. Conroy,et al.  A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex , 2011, Neuron.

[8]  D. V. van Essen,et al.  Mapping Human Cortical Areas In Vivo Based on Myelin Content as Revealed by T1- and T2-Weighted MRI , 2011, The Journal of Neuroscience.

[9]  Guido Gerig,et al.  Toward a Comprehensive Framework for the Spatiotemporal Statistical Analysis of Longitudinal Shape Data , 2012, International Journal of Computer Vision.

[10]  Satrajit S. Ghosh,et al.  Diffeomorphic functional brain surface alignment: Functional demons , 2017, NeuroImage.

[11]  Katrin Amunts,et al.  Cortical Folding Patterns and Predicting Cytoarchitecture , 2007, Cerebral cortex.

[12]  Patrice Koehl,et al.  Globally Optimal Cortical Surface Matching with Exact Landmark Correspondence , 2013, IPMI.

[13]  Daniel Rueckert,et al.  Construction of a fetal spatio-temporal cortical surface atlas from in utero MRI: Application of spectral surface matching , 2015, NeuroImage.

[14]  Andrew K Knutsen,et al.  Spatial and temporal variations of cortical growth during gyrogenesis in the developing ferret brain. , 2013, Cerebral cortex.

[15]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[16]  Stephen M. Smith,et al.  Permutation inference for the general linear model , 2014, NeuroImage.

[17]  Mark Jenkinson,et al.  MSM: A new flexible framework for Multimodal Surface Matching , 2014, NeuroImage.

[18]  Mark Jenkinson,et al.  Correspondences between retinotopic areas and myelin maps in human visual cortex , 2014, NeuroImage.

[19]  Li Fei-Fei,et al.  Locally-Optimized Inter-Subject Alignment of Functional Cortical Regions , 2014, 1606.02349.

[20]  Nicholas Ayache,et al.  Spherical Demons: Fast Diffeomorphic Landmark-Free Surface Registration , 2010, IEEE Transactions on Medical Imaging.

[21]  Chen Wang,et al.  A Primal-Dual Algorithm for Higher-Order Multilabel Markov Random Fields , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Tomoki Arichi,et al.  A dedicated neonatal brain imaging system , 2016, Magnetic resonance in medicine.

[23]  K. Amunts,et al.  Brodmann's Areas 17 and 18 Brought into Stereotaxic Space—Where and How Variable? , 2000, NeuroImage.

[24]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[25]  Bryan R. Conroy,et al.  Function-based Intersubject Alignment of Human Cortical Anatomy , 2009, Cerebral cortex.

[26]  Abraham Z. Snyder,et al.  Function in the human connectome: Task-fMRI and individual differences in behavior , 2013, NeuroImage.

[27]  Mark W. Woolrich,et al.  Bayesian analysis of neuroimaging data in FSL , 2009, NeuroImage.

[28]  Andrew Blake,et al.  Fusion Moves for Markov Random Field Optimization , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ben Glocker,et al.  Discrete Optimisation for Group-Wise Cortical Surface Atlasing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  Pierre-Louis Bazin,et al.  Multi-contrast multi-scale surface registration for improved alignment of cortical areas , 2015, NeuroImage.

[31]  Alain Trouvé,et al.  Statistical models of sets of curves and surfaces based on currents , 2009, Medical Image Anal..

[32]  Daniel Rueckert,et al.  The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction , 2017, NeuroImage.

[33]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[34]  Max A. Viergever,et al.  Development of Cortical Morphology Evaluated with Longitudinal MR Brain Images of Preterm Infants , 2015, PloS one.

[35]  T. Chan,et al.  Genus zero surface conformal mapping and its application to brain surface mapping. , 2004, IEEE transactions on medical imaging.

[36]  Ben Glocker,et al.  Deformable medical image registration: setting the state of the art with discrete methods. , 2011, Annual review of biomedical engineering.

[37]  David C. Van Essen,et al.  A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex , 2005, NeuroImage.

[38]  Matthew F. Glasser,et al.  The Brain Analysis Library of Spatial maps and Atlases (BALSA) database , 2017, NeuroImage.

[39]  Nicholas Ayache,et al.  Brain Transfer: Spectral Analysis of Cortical Surfaces and Functional Maps , 2015, IPMI.

[40]  R. Buckner,et al.  Parcellating Cortical Functional Networks in Individuals , 2015, Nature Neuroscience.

[41]  Timothy S. Coalson,et al.  Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. , 2012, Cerebral cortex.

[42]  Rainer Goebel,et al.  Functionally informed cortex based alignment: An integrated approach for whole-cortex macro-anatomical and ROI-based functional alignment , 2013, NeuroImage.

[43]  Nikos Komodakis,et al.  Beyond pairwise energies: Efficient optimization for higher-order MRFs , 2009, CVPR.

[44]  Peter J. Ramadge,et al.  Inter-subject alignment of human cortical anatomy using functional connectivity , 2013, NeuroImage.

[45]  Evan M. Gordon,et al.  Individual-specific features of brain systems identified with resting state functional correlations , 2017, NeuroImage.

[46]  Timothy Edward John Behrens,et al.  Task-free MRI predicts individual differences in brain activity during task performance , 2016, Science.

[47]  C. Grimm,et al.  A new method to measure cortical growth in the developing brain. , 2010, Journal of biomechanical engineering.

[48]  Hiroshi Ishikawa Higher-order clique reduction in binary graph cut , 2009, CVPR.

[49]  Tong Tong,et al.  Functional density and edge maps: Characterizing functional architecture in individuals and improving cross-subject registration , 2017, NeuroImage.

[50]  Matthew F. Glasser,et al.  Trends and Properties of Human Cerebral Cortex: Correlations with Cortical Myelin Content Introduction and Review , 2022 .

[51]  Vladimir Kolmogorov,et al.  Optimizing Binary MRFs via Extended Roof Duality , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  D. V. van Essen,et al.  A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex. , 2005, NeuroImage.

[53]  Nikos Komodakis,et al.  Performance vs computational efficiency for optimizing single and dynamic MRFs: Setting the state of the art with primal-dual strategies , 2008, Comput. Vis. Image Underst..

[54]  Daniel Rueckert,et al.  Dynamic patterns of cortical expansion during folding of the preterm human brain , 2017 .

[55]  Sébastien Ourselin,et al.  Longitudinal Analysis of the Preterm Cortex Using Multi-modal Spectral Matching , 2016, MICCAI.

[56]  Daniel Rueckert,et al.  Construction of a neonatal cortical surface atlas using multimodal surface matching , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[57]  Daniel Rueckert,et al.  Automatic Whole Brain MRI Segmentation of the Developing Neonatal Brain , 2014, IEEE Transactions on Medical Imaging.

[58]  Mark W. Woolrich,et al.  Large-scale Probabilistic Functional Modes from resting state fMRI , 2015, NeuroImage.

[59]  Mary A. Rutherford,et al.  Reconstruction of fetal brain MRI with intensity matching and complete outlier removal , 2012, Medical Image Anal..

[60]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[61]  Huzefa Firoz Neemuchwala,et al.  Entropic graphs for image registration. , 2005 .

[62]  Kaleem Siddiqi,et al.  Diffeomorphic Spectral Matching of Cortical Surfaces , 2013, IPMI.

[63]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[64]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[65]  Polina Golland,et al.  Functional Geometry Alignment and Localization of Brain Areas , 2010, NIPS.

[66]  Timothy S. Coalson,et al.  A Surface-Based Analysis of Hemispheric Asymmetries and Folding of Cerebral Cortex in Term-Born Human Infants , 2010, The Journal of Neuroscience.

[67]  Ilwoo Lyu,et al.  Robust estimation of group-wise cortical correspondence with an application to macaque and human neuroimaging studies , 2015, Front. Neurosci..

[68]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[69]  Daniel Rueckert,et al.  Comparison of Brain Networks with Unknown Correspondences , 2016, ArXiv.

[70]  Daniel Rueckert,et al.  Magnetic resonance imaging of the newborn brain: Manual segmentation of labelled atlases in term-born and preterm infants , 2012, NeuroImage.

[71]  Katrin Amunts,et al.  Cytoarchitecture of the cerebral cortex—More than localization , 2007, NeuroImage.

[72]  Steen Moeller,et al.  Multiband multislice GE‐EPI at 7 tesla, with 16‐fold acceleration using partial parallel imaging with application to high spatial and temporal whole‐brain fMRI , 2010, Magnetic resonance in medicine.

[73]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Nassir Navab,et al.  TriangleFlow: Optical Flow with Triangulation-Based Higher-Order Likelihoods , 2010, ECCV.