Brain atlas fusion from high-thickness diagnostic magnetic resonance images by learning-based super-resolution

It is fundamentally important to fuse the brain atlas from magnetic resonance (MR) images for many imaging-based studies. Most existing works focus on fusing the atlases from high-quality MR images. However, for low-quality diagnostic images (i.e., with high inter-slice thickness), the problem of atlas fusion has not been addressed yet. In this paper, we intend to fuse the brain atlas from the high-thickness diagnostic MR images that are prevalent for clinical routines. The main idea of our works is to extend the conventional groupwise registration by incorporating a novel super-resolution strategy. The contribution of the proposed super-resolution framework is two-fold. First, each high-thickness subject image is reconstructed to be isotropic by the patch-based sparsity learning. Then, the reconstructed isotropic image is enhanced for better quality through the random-forest-based regression model. In this way, the images obtained by the super-resolution strategy can be fused together by applying the groupwise registration method to construct the required atlas. Our experiments have shown that the proposed framework can effectively solve the problem of atlas fusion from the low-quality brain MR images.

[1]  Yaozong Gao,et al.  Automatic labeling of MR brain images by hierarchical learning of atlas forests. , 2016, Medical physics.

[2]  Yaozong Gao,et al.  Locally-constrained boundary regression for segmentation of prostate and rectum in the planning CT images , 2015, Medical Image Anal..

[3]  Dinggang Shen,et al.  Predict brain MR image registration via sparse learning of appearance and transformation , 2015, Medical Image Anal..

[4]  Arthur W. Toga,et al.  A Probabilistic Atlas of the Human Brain: Theory and Rationale for Its Development The International Consortium for Brain Mapping (ICBM) , 1995, NeuroImage.

[5]  Yaozong Gao,et al.  Concatenated spatially-localized random forests for hippocampus labeling in adult and infant MR brain images , 2017, Neurocomputing.

[6]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[7]  Cheryl L. Dahle,et al.  Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. , 2005, Cerebral cortex.

[8]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Dinggang Shen,et al.  ABSORB: Atlas building by self-organized registration and bundling , 2010, NeuroImage.

[10]  Alan C. Evans,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2000, Nature.

[11]  Hayit Greenspan,et al.  MRI inter-slice reconstruction using super-resolution , 2002 .

[12]  Nick C Fox,et al.  The clinical use of structural MRI in Alzheimer disease , 2010, Nature Reviews Neurology.

[13]  Qian Wang,et al.  Automatic Segmentation of Spinal Canals in CT Images via Iterative Topology Refinement , 2015, IEEE Transactions on Medical Imaging.

[14]  Yaozong Gao,et al.  Learning of Atlas Forest Hierarchy for Automatic Labeling of MR Brain Images , 2014, MLMI.

[15]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[16]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[17]  Erik G. Learned-Miller,et al.  Data driven image models through continuous joint alignment , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  C. Jack,et al.  Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD , 2004, Neurology.

[19]  Dinggang Shen,et al.  SharpMean: Groupwise registration guided by sharp mean image and tree-based registration , 2011, NeuroImage.

[20]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[22]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[23]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[24]  B. J. Casey,et al.  Structural and functional brain development and its relation to cognitive development , 2000, Biological Psychology.

[25]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[27]  Kevin J. Parker,et al.  MRI isotropic resolution reconstruction from two orthogonal scans , 2001, SPIE Medical Imaging.

[28]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[29]  Dinggang Shen,et al.  Attribute Vector Guided Groupwise Registration , 2009, MICCAI.

[30]  S. Resnick,et al.  One-year age changes in MRI brain volumes in older adults. , 2000, Cerebral cortex.

[31]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[32]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[33]  J. Giedd,et al.  Brain development in children and adolescents: Insights from anatomical magnetic resonance imaging , 2006, Neuroscience & Biobehavioral Reviews.

[34]  Dinggang Shen,et al.  Hierarchical multi-atlas label fusion with multi-scale feature representation and label-specific patch partition , 2015, NeuroImage.

[35]  A. Toga,et al.  In vivo evidence for post-adolescent brain maturation in frontal and striatal regions , 1999, Nature Neuroscience.

[36]  Alan C. Evans,et al.  Maturation of white matter in the human brain: a review of magnetic resonance studies , 2001, Brain Research Bulletin.

[37]  Anthony Gamst,et al.  Estrogen Replacement Therapy for Treatment of Mild to Moderate Alzheimer Disease: A Randomized Controlled Trial , 2000 .

[38]  Suresh Venkatasubramanian,et al.  The geometric median on Riemannian manifolds with application to robust atlas estimation , 2009, NeuroImage.

[39]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[40]  Christos Davatzikos,et al.  GRAM: A framework for geodesic registration on anatomical manifolds , 2010, Medical Image Anal..

[41]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[42]  Jeffrey A. Cohen,et al.  Diagnostic criteria for multiple sclerosis: 2010 Revisions to the McDonald criteria , 2011, Annals of neurology.

[43]  Paul M. Thompson,et al.  The role of image registration in brain mapping , 2001, Image Vis. Comput..

[44]  Alain Trouvé,et al.  Bayesian template estimation in computational anatomy , 2008, NeuroImage.