Accurate segmentation of the brain into major tissue types, e.g., the gray matter, white matter, and cerebrospinal fluid, in magnetic resonance (MR) imaging is critical for quantification of the brain anatomy and function. The availability of 7T MR scanners can provide more accurate and reliable voxel-wise tissue labels, which can be leveraged to supervise the training of the tissue segmentation in the conventional 3T brain images. Specifically, a deep learning based method can be used to build the highly non-linear mapping from the 3T intensity image to the more reliable label maps obtained from the 7T images of the same subject. However, the misalignment between 3T and 7T MR images due to image distortions poses a major obstacle to achieving better segmentation accuracy. To address this issue, we measure the quality of the 3T-7T alignment by using a correlation coefficient map. Then we propose a cascaded nested network (CaNes-Net) for 3T MR image segmentation and a multi-stage solution for training this model with the ground-truth tissue labels from 7T images. This paper has two main contributions. First, by incorporating the correlation loss, the above mentioned obstacle can be well addressed. Second, the geodesic distance maps are constructed based on the intermediate segmentation results to guide the training of the CaNes-Net as an iterative coarse-to-fine process. We evaluated the proposed CaNes-Net with the state-of-the-art methods on 18 in-house acquired subjects. We also qualitatively assessed the performance of the proposed model and U-Net on the ADNI dataset. Our results indicate that the proposed CaNes-Net is able to dramatically reduce mis-segmentation caused by the misalignment and achieves substantially improved accuracy over all the other methods.
[1]
Amod Jog,et al.
PSACNN: Pulse sequence adaptive fast whole brain segmentation
,
2019,
NeuroImage.
[2]
Jie Wei,et al.
M3Net: A multi-model, multi-size, and multi-view deep neural network for brain magnetic resonance image segmentation
,
2019,
Pattern Recognit..
[3]
E. Halgren,et al.
Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity
,
2000,
Neuron.
[4]
Dinggang Shen,et al.
Learning-based 3T brain MRI segmentation with guidance from 7T MRI labeling.
,
2016,
Medical physics.
[5]
Andrew Blake,et al.
GeoS: Geodesic Image Segmentation
,
2008,
ECCV.
[6]
Ehsan Adeli,et al.
3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation
,
2019,
IEEE Transactions on Cybernetics.
[7]
Thomas Brox,et al.
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
,
2016,
MICCAI.
[8]
Loïc Le Folgoc,et al.
Attention U-Net: Learning Where to Look for the Pancreas
,
2018,
ArXiv.
[9]
Mark W. Woolrich,et al.
Advances in functional and structural MR image analysis and implementation as FSL
,
2004,
NeuroImage.
[10]
D. Rueckert,et al.
White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks
,
2017,
NeuroImage: Clinical.