Scalable joint segmentation and registration framework for infant brain images

The first year of life is the most dynamic and perhaps the most critical phase of postnatal brain development. The ability to accurately measure structure changes is critical in early brain development study, which highly relies on the performances of image segmentation and registration techniques. However, either infant image segmentation or registration, if deployed independently, encounters much more challenges than segmentation/registration of adult brains due to dynamic appearance change with rapid brain development. In fact, image segmentation and registration of infant images can assists each other to overcome the above challenges by using the growth trajectories (i.e., temporal correspondences) learned from a large set of training subjects with complete longitudinal data. Specifically, a one-year-old image with ground-truth tissue segmentation can be first set as the reference domain. Then, to register the infant image of a new subject at earlier age, we can estimate its tissue probability maps, i.e., with sparse patch-based multi-atlas label fusion technique, where only the training images at the respective age are considered as atlases since they have similar image appearance. Next, these probability maps can be fused as a good initialization to guide the level set segmentation. Thus, image registration between the new infant image and the reference image is free of difficulty of appearance changes, by establishing correspondences upon the reasonably segmented images. Importantly, the segmentation of new infant image can be further enhanced by propagating the much more reliable label fusion heuristics at the reference domain to the corresponding location of the new infant image via the learned growth trajectories, which brings image segmentation and registration to assist each other. It is worth noting that our joint segmentation and registration framework is also flexible to handle the registration of any two infant images even with significant age gap in the first year of life, by linking their joint segmentation and registration through the reference domain. Thus, our proposed joint segmentation and registration method is scalable to various registration tasks in early brain development studies. Promising segmentation and registration results have been achieved for infant brain MR images aged from 2-week-old to 1-year-old, indicating the applicability of our method in early brain development study.

[1]  Nicholas Ayache,et al.  Non-parametric Diffeomorphic Image Registration with the Demons Algorithm , 2007, MICCAI.

[2]  Alan C. Evans,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2000, Nature.

[3]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[4]  Junzhou Huang,et al.  Towards robust and effective shape modeling: Sparse shape composition , 2012, Medical Image Anal..

[5]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[6]  Dinggang Shen,et al.  Registration of Longitudinal Image Sequences with Implicit Template and Spatial-Temporal Heuristics , 2010, MICCAI.

[7]  Dinggang Shen,et al.  Hierarchical and symmetric infant image registration by robust longitudinal-example-guided correspondence detection. , 2015, Medical physics.

[8]  D. Amaral,et al.  Neuroanatomy of autism , 2008, Trends in Neurosciences.

[9]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  J. Gilmore,et al.  Longitudinally guided level sets for consistent tissue segmentation of neonates , 2013, Human brain mapping.

[11]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[12]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[13]  A. Yezzi,et al.  A variational framework for joint segmentation and registration , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[14]  J. Gilmore,et al.  Infant Brain Atlases from Neonates to 1- and 2-Year-Olds , 2011, PloS one.

[15]  Brain Development Cooperative Group,et al.  The NIH MRI study of normal brain development (Objective-2): Newborns, infants, toddlers, and preschoolers , 2007, NeuroImage.

[16]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[17]  Dinggang Shen,et al.  Hierarchical multi-atlas label fusion with multi-scale feature representation and label-specific patch partition , 2015, NeuroImage.

[18]  Dimitris N. Metaxas,et al.  Deformable segmentation via sparse representation and dictionary learning , 2012, Medical Image Anal..

[19]  Dinggang Shen,et al.  Neonatal brain image segmentation in longitudinal MRI studies , 2010, NeuroImage.

[20]  Dinggang Shen,et al.  Mapping longitudinal hemispheric structural asymmetries of the human cerebral cortex from birth to 2 years of age. , 2014, Cerebral cortex.

[21]  Max A. Viergever,et al.  Multi-Atlas-Based Segmentation With Local Decision Fusion—Application to Cardiac and Aortic Segmentation in CT Scans , 2009, IEEE Transactions on Medical Imaging.

[22]  Christos Davatzikos,et al.  Joint Segmentation and Deformable Registration of Brain Scans Guided by a Tumor Growth Model , 2011, MICCAI.

[23]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[24]  Dinggang Shen,et al.  4D Multi-Modality Tissue Segmentation of Serial Infant Images , 2012, PloS one.

[25]  Dinggang Shen,et al.  Progressive Label Fusion Framework for Multi-atlas Segmentation by Dictionary Evolution , 2015, MICCAI.

[26]  Dinggang Shen,et al.  4D Segmentation of Brain MR Images with Constrained Cortical Thickness Variation , 2013, PloS one.

[27]  Dinggang Shen,et al.  iBEAT: A Toolbox for Infant Brain Magnetic Resonance Image Processing , 2012, Neuroinformatics.

[28]  Junzhou Huang,et al.  Deformable Segmentation via Sparse Shape Representation , 2011, MICCAI.

[29]  J. Piven,et al.  Magnetic resonance imaging and head circumference study of brain size in autism: birth through age 2 years. , 2005, Archives of general psychiatry.

[30]  Dinggang Shen,et al.  SharpMean: Groupwise registration guided by sharp mean image and tree-based registration , 2011, NeuroImage.

[31]  Dinggang Shen,et al.  CENTS: Cortical enhanced neonatal tissue segmentation , 2011, Human brain mapping.

[32]  W. Eric L. Grimson,et al.  A Bayesian model for joint segmentation and registration , 2006, NeuroImage.

[33]  William K. Pratt,et al.  Correlation Techniques of Image Registration , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Anant Madabhushi,et al.  A learning based fiducial-driven registration scheme for evaluating laser ablation changes in neurological disorders , 2014, Neurocomputing.

[35]  Dinggang Shen,et al.  Evidence on the emergence of the brain's default network from 2-week-old to 2-year-old healthy pediatric subjects , 2009, Proceedings of the National Academy of Sciences.

[36]  M. Styner,et al.  Longitudinal development of cortical and subcortical gray matter from birth to 2 years. , 2012, Cerebral cortex.

[37]  Paul M. Thompson,et al.  A framework for computational anatomy , 2002 .

[38]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[39]  Dinggang Shen,et al.  Registration of longitudinal brain image sequences with implicit template and spatial–temporal heuristics , 2012, NeuroImage.

[40]  Dinggang Shen,et al.  CLASSIC: Consistent Longitudinal Alignment and Segmentation for Serial Image Computing , 2006, NeuroImage.

[41]  Lingfeng Wang,et al.  Nonrigid medical image registration with locally linear reconstruction , 2014, Neurocomputing.

[42]  Daoqiang Zhang,et al.  Sparse Patch-Based Label Fusion for Multi-Atlas Segmentation , 2012, MBIA.

[43]  Dinggang Shen,et al.  S‐HAMMER: Hierarchical attribute‐guided, symmetric diffeomorphic registration for MR brain images , 2014, Human brain mapping.

[44]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[45]  Qiang Chen,et al.  Adaptive scale fuzzy local Gaussian mixture model for brain MR image segmentation , 2014, Neurocomputing.

[46]  Yaozong Gao,et al.  Segmentation of neonatal brain MR images using patch-driven level sets , 2014, NeuroImage.

[47]  Yihong Gong,et al.  Active contour model based on local and global intensity information for medical image segmentation , 2016, Neurocomputing.

[48]  Dinggang Shen,et al.  Development of Cortical Anatomical Properties from Early Childhood to Early Adulthood , 2022 .

[49]  U. Grenander,et al.  Statistical methods in computational anatomy , 1997, Statistical methods in medical research.

[50]  Rebecca C. Knickmeyer,et al.  A Structural MRI Study of Human Brain Development from Birth to 2 Years , 2008, The Journal of Neuroscience.