Simultaneous and consistent labeling of longitudinal dynamic developing cortical surfaces in infants

The human cerebral cortex develops extremely dynamically in the first 2years of life. Accurate and consistent parcellation of longitudinal dynamic cortical surfaces during this critical stage is essential to understand the early development of cortical structure and function in both normal and high-risk infant brains. However, directly applying the existing methods developed for the cross-sectional studies often generates longitudinally-inconsistent results, thus leading to inaccurate measurements of the cortex development. In this paper, we propose a new method for accurate, consistent, and simultaneous labeling of longitudinal cortical surfaces in the serial infant brain MR images. The proposed method is explicitly formulated as a minimization problem with an energy function that includes a data fitting term, a spatial smoothness term, and a temporal consistency term. Specifically, inspired by multi-atlas based label fusion, the data fitting term is designed to integrate the contributions from multi-atlas surfaces adaptively, according to the similarities of their local cortical folding with that of the subject cortical surface. The spatial smoothness term is then designed to adaptively encourage label smoothness based on the local cortical folding geometries, i.e., allowing label discontinuity at sulcal bottoms (which often are the boundaries of cytoarchitecturally and functionally distinct regions). The temporal consistency term is to adaptively encourage the label consistency among the temporally-corresponding vertices, based on their similarity of local cortical folding. Finally, the entire energy function is efficiently minimized by a graph cuts method. The proposed method has been applied to the parcellation of longitudinal cortical surfaces of 13 healthy infants, each with 6 serial MRI scans acquired at 0, 3, 6, 9, 12 and 18months of age. Qualitative and quantitative evaluations demonstrated both accuracy and longitudinal consistency of the proposed method. By using our method, for the first time, we reveal several hitherto unseen properties of the dynamic and regionally heterogeneous development of the cortical surface area in the first 18months of life.

[1]  Dinggang Shen,et al.  ABSORB: Atlas building by self-organized registration and bundling , 2010, NeuroImage.

[2]  Frithjof Kruggel,et al.  Automatic segmentation of human brain sulci , 2008, Medical Image Anal..

[3]  Yaozong Gao,et al.  Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation , 2014, NeuroImage.

[4]  Dinggang Shen,et al.  Measuring temporal morphological changes robustly in brain MR images via 4-dimensional template warping , 2004, NeuroImage.

[5]  Stephen T. C. Wong,et al.  A Novel Method for Cortical Sulcal Fundi Extraction , 2008, MICCAI.

[6]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[7]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[8]  Gabriele Lohmann,et al.  Automatic labelling of the human cortical surface using sulcal basins , 2000, Medical Image Anal..

[9]  A. Dale,et al.  Distinct genetic influences on cortical surface area and cortical thickness. , 2009, Cerebral cortex.

[10]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[11]  Bruce Fischl,et al.  Genetic topography of brain morphology , 2013, Proceedings of the National Academy of Sciences.

[12]  Lei Guo,et al.  An automated pipeline for cortical sulcal fundi extraction , 2010, Medical Image Anal..

[13]  Tuo Zhang,et al.  Parametric Representation of Cortical Surface Folding Based on Polynomials , 2009, MICCAI.

[14]  M. Styner,et al.  Longitudinal development of cortical and subcortical gray matter from birth to 2 years. , 2012, Cerebral cortex.

[15]  Wen Li,et al.  Automated parcellation of the brain surface generated from magnetic resonance images , 2013, Front. Neuroinform..

[16]  Dinggang Shen,et al.  LABEL: Pediatric brain extraction using learning-based meta-algorithm , 2012, NeuroImage.

[17]  Timothy S. Coalson,et al.  A Surface-Based Analysis of Hemispheric Asymmetries and Folding of Cerebral Cortex in Term-Born Human Infants , 2010, The Journal of Neuroscience.

[18]  Dinggang Shen,et al.  Neonatal brain image segmentation in longitudinal MRI studies , 2010, NeuroImage.

[19]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[20]  Dinggang Shen,et al.  Simulating deformations of MR brain images for validation of atlas-based segmentation and registration algorithms , 2006, NeuroImage.

[21]  Arno Klein,et al.  101 Labeled Brain Images and a Consistent Human Cortical Labeling Protocol , 2012, Front. Neurosci..

[22]  Dinggang Shen,et al.  Longitudinal development of cortical thickness, folding, and fiber density networks in the first 2 years of life , 2014, Human brain mapping.

[23]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[24]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[25]  Dinggang Shen,et al.  Mapping longitudinal hemispheric structural asymmetries of the human cerebral cortex from birth to 2 years of age. , 2014, Cerebral cortex.

[26]  Dinggang Shen,et al.  Brain anatomical networks in early human brain development , 2011, NeuroImage.

[27]  Dinggang Shen,et al.  Multi-atlas Based Simultaneous Labeling of Longitudinal Dynamic Cortical Surfaces in Infants , 2013, MICCAI.

[28]  J. Gilmore,et al.  Dynamic Development of Regional Cortical Thickness and Surface Area in Early Childhood. , 2015, Cerebral cortex.

[29]  Mert R. Sabuncu,et al.  Effects of Registration Regularization and Atlas Sharpness on Segmentation Accuracy , 2007, MICCAI.

[30]  Mert R. Sabuncu,et al.  Statistical analysis of longitudinal neuroimage data with Linear Mixed Effects models , 2013, NeuroImage.

[31]  Arthur W. Toga,et al.  Conformal Mapping via Metric Optimization with Application for Cortical Label Fusion , 2013, IPMI.

[32]  Richard M. Leahy,et al.  A Method for Automated Cortical Surface Registration and Labeling , 2012, WBIR.

[33]  Timothy S. Coalson,et al.  Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. , 2012, Cerebral cortex.

[34]  Kaiming Li,et al.  Gyral Folding Pattern Analysis via Surface Profiling , 2009, MICCAI.

[35]  Yaozong Gao,et al.  Segmentation of neonatal brain MR images using patch-driven level sets , 2014, NeuroImage.

[36]  Dinggang Shen,et al.  Deformable registration of cortical structures via hybrid volumetric and surface warping , 2004, NeuroImage.

[37]  Xintao Hu,et al.  Optimal combination of multiple cortical surface parcellations , 2010, Medical Imaging.

[38]  Stephen T. C. Wong,et al.  Least-square conformal brain mapping with spring energy , 2007, Comput. Medical Imaging Graph..

[39]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[40]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[41]  Dinggang Shen,et al.  4D Multi-Modality Tissue Segmentation of Serial Infant Images , 2012, PloS one.

[42]  Isabelle Bloch,et al.  A generic framework for the parcellation of the cortical surface into gyri using geodesic Voronoı̈ diagrams , 2003, Medical Image Anal..

[43]  Dinggang Shen,et al.  Learning-based deformable registration of MR brain images , 2006, IEEE Transactions on Medical Imaging.

[44]  J A Sethian,et al.  Computing geodesic paths on manifolds. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Dinggang Shen,et al.  Automatic segmentation of neonatal images using convex optimization and coupled level sets , 2011, NeuroImage.

[46]  Dinggang Shen,et al.  A computational growth model for measuring dynamic cortical development in the first year of life. , 2012, Cerebral cortex.

[47]  Dinggang Shen,et al.  Rabbit: Rapid Alignment of Brains by Building Intermediate Templates , 2022 .

[48]  Aaron Carass,et al.  Automated reliable labeling of the cortical surface , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[49]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[50]  Max A. Viergever,et al.  Label Fusion in Atlas-Based Segmentation Using a Selective and Iterative Method for Performance Level Estimation (SIMPLE) , 2010, IEEE Transactions on Medical Imaging.

[51]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[52]  Nicholas Ayache,et al.  Spherical Demons: Fast Diffeomorphic Landmark-Free Surface Registration , 2010, IEEE Transactions on Medical Imaging.

[53]  Degang Zhang,et al.  Automatic cortical surface parcellation based on fiber density information , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[54]  Dinggang Shen,et al.  Consistent reconstruction of cortical surfaces from longitudinal brain MR images , 2012, NeuroImage.

[55]  J. Gilmore,et al.  Infant Brain Atlases from Neonates to 1- and 2-Year-Olds , 2011, PloS one.

[56]  Brain Development Cooperative Group,et al.  The NIH MRI study of normal brain development (Objective-2): Newborns, infants, toddlers, and preschoolers , 2007, NeuroImage.

[57]  Torsten Rohlfing,et al.  Shape-Based Averaging , 2007, IEEE Transactions on Image Processing.

[58]  Arno Klein,et al.  Mindboggle: a scatterbrained approach to automate brain labeling , 2005, NeuroImage.

[59]  W. Eric L. Grimson,et al.  Logarithm Odds Maps for Shape Representation , 2006, MICCAI.

[60]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[61]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Dinggang Shen,et al.  Development Trends of White Matter Connectivity in the First Years of Life , 2011, PloS one.

[63]  R. Blair,et al.  An alternative method for significance testing of waveform difference potentials. , 1993, Psychophysiology.

[64]  Dinggang Shen,et al.  ORBIT: A Multiresolution Framework for Deformable Registration of Brain Tumor Images , 2008, IEEE Transactions on Medical Imaging.

[65]  J. Gilmore,et al.  Mapping Longitudinal Development of Local Cortical Gyrification in Infants from Birth to 2 Years of Age , 2014, The Journal of Neuroscience.

[66]  J. Gilmore,et al.  Mapping region-specific longitudinal cortical surface expansion from birth to 2 years of age. , 2013, Cerebral cortex.

[67]  Dinggang Shen,et al.  Consistent sulcal parcellation of longitudinal cortical surfaces , 2011, NeuroImage.

[68]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[69]  Lei Guo,et al.  A computational model of cerebral cortex folding. , 2010, Journal of theoretical biology.

[70]  Dinggang Shen,et al.  Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces , 2014, NeuroImage.

[71]  Dinggang Shen,et al.  RABBIT: Rapid alignment of brains by building intermediate templates , 2009, NeuroImage.

[72]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[73]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[76]  Dinggang Shen,et al.  Development of Cortical Anatomical Properties from Early Childhood to Early Adulthood , 2022 .

[77]  Jerry L Prince,et al.  Automated Sulcal Segmentation Using Watersheds on the Cortical Surface , 2002, NeuroImage.

[78]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[80]  Lei Guo,et al.  Automatic Cortical Sulcal Parcellation Based on Surface Principal Direction Flow Field Tracking , 2009, IPMI.