Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation

Segmentation of infant brain MR images is challenging due to poor spatial resolution, severe partial volume effect, and the ongoing maturation and myelination processes. During the first year of life, the brain image contrast between white and gray matters undergoes dramatic changes. In particular, the image contrast inverses around 6-8months of age, where the white and gray matter tissues are isointense in T1 and T2 weighted images and hence exhibit the extremely low tissue contrast, posing significant challenges for automated segmentation. In this paper, we propose a general framework that adopts sparse representation to fuse the multi-modality image information and further incorporate the anatomical constraints for brain tissue segmentation. Specifically, we first derive an initial segmentation from a library of aligned images with ground-truth segmentations by using sparse representation in a patch-based fashion for the multi-modality T1, T2 and FA images. The segmentation result is further iteratively refined by integration of the anatomical constraint. The proposed method was evaluated on 22 infant brain MR images acquired at around 6months of age by using a leave-one-out cross-validation, as well as other 10 unseen testing subjects. Our method achieved a high accuracy for the Dice ratios that measure the volume overlap between automated and manual segmentations, i.e., 0.889±0.008 for white matter and 0.870±0.006 for gray matter.

[1]  Simon K. Warfield,et al.  Segmentation of newborn brain MRI , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[2]  Daniel Rueckert,et al.  Automatic segmentation and reconstruction of the cortex from neonatal MRI , 2007, NeuroImage.

[3]  Dinggang Shen,et al.  Diffusion Tensor Image Registration Using Tensor Geometry and Orientation Features , 2008, MICCAI.

[4]  Dinggang Shen,et al.  Automatic segmentation of neonatal images using convex optimization and coupled level sets , 2011, NeuroImage.

[5]  Dinggang Shen,et al.  iBEAT: A Toolbox for Infant Brain Magnetic Resonance Image Processing , 2012, Neuroinformatics.

[6]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[7]  Dinggang Shen,et al.  Affine-invariant image retrieval by correspondence matching of shapes , 1999, Image Vis. Comput..

[8]  Lei Guo,et al.  Brain tissue segmentation based on DTI data , 2007, NeuroImage.

[9]  Anders M. Dale,et al.  Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex , 2001, IEEE Transactions on Medical Imaging.

[10]  Sébastien Ourselin,et al.  AdaPT: An adaptive preterm segmentation algorithm for neonatal brain MRI , 2013, NeuroImage.

[11]  Dinggang Shen,et al.  Patch-driven neonatal brain MRI segmentation with sparse representation and level sets , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[12]  Hiroshi Honda,et al.  Partial volume estimation and segmentation of brain tissue based on diffusion tensor MRI. , 2010, Medical physics.

[13]  Shu Liao,et al.  Prostate Segmentation by Sparse Representation Based Classification , 2012, MICCAI.

[14]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[15]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[16]  Daoqiang Zhang,et al.  Multimodal classification of Alzheimer's disease and mild cognitive impairment , 2011, NeuroImage.

[17]  Jean Ponce,et al.  Task-Driven Dictionary Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  J. Mangin,et al.  Atlas-Free Surface Reconstruction of the Cortical Grey-White Interface in Infants , 2011, PloS one.

[19]  Dinggang Shen,et al.  Consistent reconstruction of cortical surfaces from longitudinal brain MR images , 2012, NeuroImage.

[20]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[21]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[22]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[23]  Richard M. Leahy,et al.  Automated graph-based analysis and correction of cortical volume topology , 2001, IEEE Transactions on Medical Imaging.

[24]  J. Gilmore,et al.  Mapping region-specific longitudinal cortical surface expansion from birth to 2 years of age. , 2013, Cerebral cortex.

[25]  Dinggang Shen,et al.  Simulating deformations of MR brain images for validation of atlas-based segmentation and registration algorithms , 2006, NeuroImage.

[26]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Shu Liao,et al.  Sparse Patch-Based Label Propagation for Accurate Prostate Localization in CT Images , 2013, IEEE Transactions on Medical Imaging.

[28]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[29]  Max A. Viergever,et al.  Label Fusion in Atlas-Based Segmentation Using a Selective and Iterative Method for Performance Level Estimation (SIMPLE) , 2010, IEEE Transactions on Medical Imaging.

[30]  D. Parker,et al.  Analysis of partial volume effects in diffusion‐tensor MRI , 2001, Magnetic resonance in medicine.

[31]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[32]  Dinggang Shen,et al.  Integration of Sparse Multi-modality Representation and Geometrical Constraint for Isointense Infant Brain Segmentation , 2013, MICCAI.

[33]  Xiao Han,et al.  CRUISE: Cortical reconstruction using implicit surface evolution , 2004, NeuroImage.

[34]  Pierre-Louis Bazin,et al.  Topology Preserving Tissue Classification with Fast Marching and Topology Templates , 2005, IPMI.

[35]  Laura Gui,et al.  Morphology-driven automatic segmentation of MR images of the neonatal brain , 2012, Medical Image Anal..

[36]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[37]  Dinggang Shen,et al.  A computational growth model for measuring dynamic cortical development in the first year of life. , 2012, Cerebral cortex.

[38]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[39]  Dinggang Shen,et al.  CENTS: Cortical enhanced neonatal tissue segmentation , 2011, Human brain mapping.

[40]  Antonio Criminisi,et al.  Object categorization by learned universal visual dictionary , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[41]  Junzhou Huang,et al.  Deformable Segmentation via Sparse Shape Representation , 2011, MICCAI.

[42]  Dinggang Shen,et al.  ORBIT: A Multiresolution Framework for Deformable Registration of Brain Tumor Images , 2008, IEEE Transactions on Medical Imaging.

[43]  Stephen R. Dager,et al.  Journal of Neuroscience Methods Computational Neuroscience Adaptive Prior Probability and Spatial Temporal Intensity Change Estimation for Segmentation of the One-year-old Human Brain the Results of Igm-em Show Good Performance in Temporal and Prefrontal Lobe Areas , 2022 .

[44]  Dinggang Shen,et al.  Neonatal brain image segmentation in longitudinal MRI studies , 2010, NeuroImage.

[45]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[46]  D. Collins,et al.  Scoring by nonlocal image patch estimator for early detection of Alzheimer's disease☆ , 2012, NeuroImage: Clinical.

[47]  Simon K. Warfield,et al.  Highly Accurate Segmentation of Brain Tissue and Subcortical Gray Matter from Newborn MRI , 2006, MICCAI.

[48]  D. Rueckert,et al.  Segmentation of Brain MR Images via Sparse Patch Representation , 2012 .

[49]  Dinggang Shen,et al.  RABBIT: Rapid alignment of brains by building intermediate templates , 2009, NeuroImage.

[50]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[51]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[52]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[53]  Daniel Rueckert,et al.  A dynamic 4D probabilistic atlas of the developing brain , 2011, NeuroImage.

[54]  Guillermo Sapiro,et al.  Discriminative learned dictionaries for local image analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[56]  Suyash P. Awate,et al.  Clinical Neonatal Brain MRI Segmentation Using Adaptive Nonparametric Data Models and Intensity-Based Markov Priors , 2007, MICCAI.

[57]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[58]  Dinggang Shen,et al.  Statistical representation of high-dimensional deformation fields with application to statistically constrained 3D warping , 2006, Medical Image Anal..

[59]  Dinggang Shen,et al.  4D Multi-Modality Tissue Segmentation of Serial Infant Images , 2012, PloS one.

[60]  Dinggang Shen,et al.  Learning-based deformable registration of MR brain images , 2006, IEEE Transactions on Medical Imaging.

[61]  Christian Gaser,et al.  Topological correction of brain surface meshes using spherical harmonics , 2010, MICCAI.

[62]  Simon K. Warfield,et al.  Automatic segmentation of newborn brain MRI , 2009, NeuroImage.

[63]  Alan C. Evans,et al.  Maturation of white matter in the human brain: a review of magnetic resonance studies , 2001, Brain Research Bulletin.

[64]  Dinggang Shen,et al.  Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation , 2010, NeuroImage.

[65]  D. Louis Collins,et al.  Simultaneous segmentation and grading of anatomical structures for patient's classification: Application to Alzheimer's disease , 2012, NeuroImage.

[66]  John H. Gilmore,et al.  Automatic segmentation of MR images of the developing newborn brain , 2005, Medical Image Anal..

[67]  J. Gilmore,et al.  Longitudinally guided level sets for consistent tissue segmentation of neonates , 2013, Human brain mapping.

[68]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Petronella Anbeek,et al.  Probabilistic Brain Tissue Segmentation in Neonatal Magnetic Resonance Imaging , 2008, Pediatric Research.

[70]  Shu Liao,et al.  Unsupervised Deep Feature Learning for Deformable Registration of MR Brain Images , 2013, MICCAI.

[71]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[72]  Dinggang Shen,et al.  Spatial-Temporal Constraint for Segmentation of Serial Infant Brain MR Images , 2010, MIAR.

[73]  Dinggang Shen,et al.  Mapping longitudinal hemispheric structural asymmetries of the human cerebral cortex from birth to 2 years of age. , 2014, Cerebral cortex.

[74]  Dinggang Shen,et al.  Brain anatomical networks in early human brain development , 2011, NeuroImage.

[75]  Dinggang Shen,et al.  Multi-atlas Based Simultaneous Labeling of Longitudinal Dynamic Cortical Surfaces in Infants , 2013, MICCAI.

[76]  J. Gilmore,et al.  Infant Brain Atlases from Neonates to 1- and 2-Year-Olds , 2011, PloS one.

[77]  A. Schleicher,et al.  The human pattern of gyrification in the cerebral cortex , 2004, Anatomy and Embryology.

[78]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[79]  Dinggang Shen,et al.  ABSORB: Atlas building by self-organized registration and bundling , 2010, NeuroImage.

[80]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[81]  Mohamed-Jalal Fadili,et al.  Inpainting and Zooming Using Sparse Representations , 2009, Comput. J..

[82]  Yaozong Gao,et al.  Segmentation of neonatal brain MR images using patch-driven level sets , 2014, NeuroImage.

[83]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[84]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[85]  P. Ellen Grant,et al.  Detailed semiautomated MRI based morphometry of the neonatal brain: Preliminary results , 2006, NeuroImage.

[86]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[87]  Dinggang Shen,et al.  Development Trends of White Matter Connectivity in the First Years of Life , 2011, PloS one.

[88]  Lili He,et al.  Automated detection of white matter signal abnormality using T2 relaxometry: Application to brain segmentation on term MRI in very preterm infants , 2013, NeuroImage.

[89]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[90]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[91]  Dinggang Shen,et al.  Rabbit: Rapid Alignment of Brains by Building Intermediate Templates , 2022 .