Patch-wise label propagation for MR brain segmentation based on multi-atlas images

In many neuroscience and clinical studies, accurate and automatic segmentation of subcortical structures is an important and difficult task. Multi-atlas-based segmentation method has been focus of considerable research due to its promising performance. In general, this technique first employs deformable image registration to construct the correspondences between pre-labeled atlas images and the target image. Then, using the acquired deformation field, labels in the atlas are propagated to the target image space. Obviously, anatomical differences between the target image and atlas images possibly affect the image registration accuracy, thus influencing the final segmentation performance. Another limitation is that the label propagation in most conventional multi-atlas based methods is implemented under a voxel-wise strategy, which cannot adequately utilize the local label information to determine the final label of the target sample. In this paper, we propose a patch-wise label propagation method based on multiple atlases for MR brain segmentation. First, each image patch is characterized by patch intensities and abundant texture features, to increase the accuracy of the patch-based similarity measurement. To determine the weights of the training patches for representing the test sample, a patch-based sparse coding procedure is employed. In the label propagation stage, to alleviate possible misalignment from the registration stage, we perform a patch-wise label propagation strategy in a nonlocal manner to predict the final label for each target sample. To evaluate the proposed segmentation method, we comprehensively implement our proposed method by conducting hippocampus segmentation on the ADNI data set. Experimental results demonstrate the effectiveness of the proposed method and show that the proposed method outperforms two conventional multi-atlas-based methods.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[2]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[3]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[4]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[5]  Jun Zhang,et al.  Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks , 2017, IEEE Transactions on Image Processing.

[6]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yue Gao,et al.  Event Classification in Microblogs via Social Tracking , 2017, ACM Trans. Intell. Syst. Technol..

[8]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yaozong Gao,et al.  Landmark-Based Alzheimer's Disease Diagnosis Using Longitudinal Structural MR Images , 2016, MCV/BAMBI@MICCAI.

[10]  Daoqiang Zhang,et al.  Robust multi-atlas label propagation by deep sparse representation , 2017, Pattern Recognit..

[11]  Jayaram K. Udupa,et al.  New methods of MR image intensity standardization via generalized scale , 2005, SPIE Medical Imaging.

[12]  Daoqiang Zhang,et al.  Label-aligned multi-task feature learning for multimodal classification of Alzheimer’s disease and mild cognitive impairment , 2015, Brain Imaging and Behavior.

[13]  Alessandro Bertolino,et al.  Neuronal pathology in the hippocampal area of patients with bipolar disorder: a study with proton magnetic resonance spectroscopic imaging , 2003, Biological Psychiatry.

[14]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[15]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[16]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[17]  Dinggang Shen,et al.  Integrated feature extraction and selection for neuroimage classification , 2009, Medical Imaging.

[18]  Tianzi Jiang,et al.  Local label learning (LLL) for subcortical structure segmentation: Application to hippocampus segmentation , 2014, Human brain mapping.

[19]  Ben Glocker,et al.  Atlas Encoding by Randomized Forests for Efficient Label Propagation , 2013, MICCAI.

[20]  Dinggang Shen,et al.  Predicting Standard-Dose PET Image from Low-Dose PET and Multimodal MR Images Using Mapping-Based Sparse Representation , 2015, MLMI.

[21]  Jun Zhang,et al.  Local Energy Pattern for Texture Classification Using Self-Adaptive Quantization Thresholds , 2013, IEEE Transactions on Image Processing.

[22]  Dinggang Shen,et al.  Semisupervised Tripled Dictionary Learning for Standard-Dose PET Image Prediction Using Low-Dose PET and Multimodal MRI , 2017, IEEE Transactions on Biomedical Engineering.