DenseX-Net: An End-to-End Model for Lymphoma Segmentation in Whole-Body PET/CT Images

Automatic lymphoma detection and accurate lymphoma boundary delineation from whole body Positron Emission Tomography/Computed Tomography (PET/CT) scans are essential for surgical navigation and radiation therapy. Besides, labeling the data, which means contouring the lymphoma contour in images is time-consuming, operator intensive and subjective. Hence, this paper integrates the supervised learning and unsupervised learning to propose an end-to-end segmentation network, namely DenseX-Net, for both lymphoma detection and segmentation. There are two important flows in the proposed DenseX-Net. One is a reconstruction flow (based on the convolutional encoder-decoder form) that can be used for learning semantic representations of different lymphomas by minimizing the discrepancy between each input and its output in an unsupervised learning form. The other one is a segmentation flow (based on DenseU-Net) that performs the lymphoma segmentation task. Note that, the encoders in both flows are trained jointly with the same weights, which can facilitate DenseX-Net obtaining the accurate segmentation using a little labeled data. We evaluate our proposed DenseX-Net for lymphoma segmentation on 80 real PET/CT cases (from General Hospital of Northern Military Area) with a Dice coefficient of 72.84%. Experimentations and comparisons demonstrate the accuracy and robustness of DenseX-Net as well as its performance advantages as compared with related segmentation networks.

[1]  Xiao Yang,et al.  Fast Predictive Image Registration , 2016, LABELS/DLMIA@MICCAI.

[2]  Guoyan Zheng,et al.  3D U-net with Multi-level Deep Supervision: Fully Automatic Segmentation of Proximal Femur in 3D MR Images , 2017, MLMI@MICCAI.

[3]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Tao Chan,et al.  Automatic detection and classification of nasopharyngeal carcinoma on PET/CT with support vector machine , 2012, International Journal of Computer Assisted Radiology and Surgery.

[6]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[7]  R. Wahl,et al.  From RECIST to PERCIST: Evolving Considerations for PET Response Criteria in Solid Tumors , 2009, Journal of Nuclear Medicine.

[8]  Y. Jhanwar,et al.  The role of PET in lymphoma. , 2006, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[9]  S M Larson,et al.  Segmentation of lung lesion volume by adaptive positron emission tomography image thresholding , 1997, Cancer.

[10]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Di Yan,et al.  Defining a radiotherapy target with positron emission tomography. , 2002, International journal of radiation oncology, biology, physics.

[15]  Su Ruan,et al.  3D automated lymphoma segmentation in PET images based on cellular automata , 2014, 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA).

[16]  Su Ruan,et al.  Semi-automatic lymphoma detection and segmentation using fully conditional random fields , 2018, Comput. Medical Imaging Graph..

[17]  Ursula Nestle,et al.  Target volume definition for 18F-FDG PET-positive lymph nodes in radiotherapy of patients with non-small cell lung cancer , 2007, European Journal of Nuclear Medicine and Molecular Imaging.

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[20]  Max A. Viergever,et al.  2D image classification for 3D anatomy localization: employing deep convolutional neural networks , 2016, SPIE Medical Imaging.

[21]  Habib Zaidi,et al.  PET-guided delineation of radiation therapy treatment volumes: a survey of image segmentation techniques , 2010, European Journal of Nuclear Medicine and Molecular Imaging.

[22]  Guido Gerig,et al.  4D active cut: An interactive tool for pathological anatomy modeling , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[23]  David Dagan Feng,et al.  Automated and Robust PERCIST-based Thresholding framework for whole body PET-CT studies , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Lingfeng Wen,et al.  Automatic detection and classification of regions of FDG uptake in whole-body PET-CT lymphoma studies , 2017, Comput. Medical Imaging Graph..

[25]  Jianjiang Feng,et al.  CFUN: Combining Faster R-CNN and U-net Network for Efficient Whole Heart Segmentation , 2018, ArXiv.

[26]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[27]  Paul M. Thompson,et al.  Agreement-Based Semi-supervised Learning for Skull Stripping , 2010, MICCAI.