Deep Learning based Segmentation for Multi MR Imaging Protocols using Transfer Learning for PET Attenuation Correction

Magnetic resonance (MR) image segmentation is a robust technique used for PET attenuation correction. However, the segmentation of the brain into different tissue classes is a challenging task because of the similarity of pixel intensity values. The objective of this work is to propose a deep learning network to segment T1-weighted MR images of a dataset consists of 50 patients. Additionally, transfer learning is applied to segment another MR image protocol which is T2-weighted. The pretrained network with T1-weighted images is finetuned then tested with a dataset of 14 patients only. The Dice coefficients of air, soft tissue, and bone classes for T1-weighted MR images are 0.98, 0.92, and 0.79 respectively. The results of transfer learning show the feasibility of finetuning a deep network trained with T1-weighted images to segment T2-weighted images.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  H. Zaidi,et al.  Vision 20/20: Magnetic resonance imaging-guided attenuation correction in PET/MRI: Challenges, solutions, and opportunities. , 2016, Medical physics.

[6]  A. McMillan,et al.  Deep learning Mr imaging–based attenuation correction for PeT/Mr imaging 1 , 2017 .

[7]  Francesco Sforazzini,et al.  From simultaneous to synergistic MR‐PET brain imaging: A review of hybrid MR‐PET imaging methodologies , 2018, Human brain mapping.

[8]  Barbara Caputo,et al.  Learning the Roots of Visual Domain Shift , 2016, ECCV Workshops.

[9]  Nassir Navab,et al.  Individual refinement of attenuation correction maps for hybrid PET/MR based on multi-resolution regional learning , 2017, Comput. Medical Imaging Graph..

[10]  Fang Liu,et al.  Technical Note: Deep learning based MRAC using rapid ultrashort echo time imaging , 2018, Medical physics.

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.