Multi-scale fully convolutional network for gland segmentation using three-class classification

Abstract Automated precise segmentation of glands from the histological images plays an important role in glandular morphology analysis, which is a crucial criterion for cancer grading and planning of treatment. However, it is non-trivial due to the diverse shapes of the glands under different histological grades and the presence of tightly connected glands. In this paper, a novel multi-scale fully convolutional network with three class classification (TCC-MSFCN) is proposed to achieve gland segmentation. The multi-scale structure can extract different receptive field features corresponding to multi-size objects. However, the max-pooling in the convolution neural network will cause the loss of global information. To compensate for this loss, a special branch called high-resolution branch in our framework is designed. Besides, for effectively separating the close glands, a three-class classification with additional consideration of edge pixels is applied instead of the conventional binary classification. Finally, the proposed method is evaluated on Warwick-QU dataset and CRAG dataset with three reliable evaluation metrics, which are applied to our method and other popular methods. Experimental results show that the proposed method achieves the-state-of-the-art performance. Discussion and conclusion are presented afterwards.

[1]  Lei Zhang,et al.  Exudate-based diabetic macular edema recognition in retinal images using cascaded deep residual networks , 2018, Neurocomputing.

[2]  H. Wu,et al.  Segmentation of intestinal gland images with iterative region growing , 2005, Journal of microscopy.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[5]  Xiaobo Sharon Hu,et al.  Quantization of Fully Convolutional Networks for Accurate Biomedical Image Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[7]  Xin Yang,et al.  A Deep Model with Shape-Preserving Loss for Gland Instance Segmentation , 2018, MICCAI.

[8]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[9]  Hang Li,et al.  Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network , 2018, Neurocomputing.

[10]  Hui Kong,et al.  Automation‐assisted cervical cancer screening in manual liquid‐based cytology with hematoxylin and eosin staining , 2014, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[11]  Hao Chen,et al.  Gland segmentation in colon histology images: The glas challenge contest , 2016, Medical Image Anal..

[12]  Ehud Rivlin,et al.  Memory based active contour algorithm using pixel-level classified images for colon crypt segmentation , 2015, Comput. Medical Imaging Graph..

[13]  Yuan Zhang,et al.  Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function , 2018, Neurocomputing.

[14]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Erik Valdemar Cuevas Jiménez,et al.  Entropy-based imagery segmentation for breast histology using the Stochastic Fractal Search , 2018, Neurocomputing.

[16]  Anindya Sarkar,et al.  Prostate Cancer Grading: Use of Graph Cut and Spatial Arrangement of Nuclei , 2014, IEEE Transactions on Medical Imaging.

[17]  Yang Li,et al.  Gland Instance Segmentation Using Deep Multichannel Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[18]  Cenk Sokmensuer,et al.  Automatic segmentation of colon glands using object-graphs , 2010, Medical Image Anal..

[19]  Huiming Tang,et al.  Pixel-wise regression using U-Net and its application on pansharpening , 2018, Neurocomputing.

[20]  Xin Yang,et al.  A Skeletal Similarity Metric for Quality Evaluation of Retinal Vessel Segmentation , 2018, IEEE Transactions on Medical Imaging.

[21]  C C Compton,et al.  Updated protocol for the examination of specimens from patients with carcinomas of the colon and rectum, excluding carcinoid tumors, lymphomas, sarcomas, and tumors of the vermiform appendix: a basis for checklists. Cancer Committee. , 2000, Archives of pathology & laboratory medicine.

[22]  Mike May,et al.  A better lens on disease. , 2010, Scientific American.

[23]  Syed Muhammad Anwar,et al.  Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network , 2017, Neurocomputing.

[24]  Huchuan Lu,et al.  Learning Uncertain Convolutional Features for Accurate Saliency Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Hao Chen,et al.  MILD‐Net: Minimal information loss dilated network for gland instance segmentation in colon histology images , 2018, Medical Image Anal..

[26]  D. Yew,et al.  Propidium iodide (PI) stains Nissl bodies and may serve as a quick marker for total neuronal cell count. , 2015, Acta histochemica.

[27]  Nasir M. Rajpoot,et al.  A Stochastic Polygons Model for Glandular Structures in Colon Histology Images , 2015, IEEE Transactions on Medical Imaging.

[28]  David B. A. Epstein,et al.  MIMONet: Gland Segmentation Using Multi-Input-Multi-Output Convolutional Neural Network , 2017, MIUA.

[29]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Jian Sun,et al.  Instance-Aware Semantic Segmentation via Multi-task Network Cascades , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Stephen J. McKenna,et al.  Structure Prediction for Gland Segmentation With Hand-Crafted and Deep Convolutional Features , 2018, IEEE Transactions on Medical Imaging.

[33]  R. A. Zoroofi,et al.  An image analysis approach for automatic malignancy determination of prostate pathological images , 2007, Cytometry. Part B, Clinical cytometry.

[34]  Charles A Powell,et al.  International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society: international multidisciplinary classification of lung adenocarcinoma: executive summary. , 2011, Proceedings of the American Thoracic Society.

[35]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[36]  Lin Yang,et al.  Deep Adversarial Networks for Biomedical Image Segmentation Utilizing Unannotated Images , 2017, MICCAI.

[37]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[38]  Lin Yang,et al.  Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation , 2017, MICCAI.

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).