Automatic tissue segmentation by deep learning: from colorectal polyps in colonoscopy to abdominal organs in CT exam

Automatic tissue segmentation is extremely helpful in medical imaging related work. In this paper, we attempted to train two existing deep neural networks, SegNet and DeepLab, to solve two clinical imaging problems relevant to this topic. One is to locate the colorectal polyps in the colonoscopy images, and the other is to delineate the lung in CT images from axial direction. In order to enhance the segmentation capability of the two networks, the reversed version of long short term memory (LSTM) network are integrated with them by parallel connection. The performance is evaluated by mean intersection-over-union (IOU). We found that introducing LSTM is beneficial to segmentation of polyps, but not that significant for delineating the lung. The relevant results are reported in this work

[1]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[2]  Brahim Ait Skourt,et al.  Lung CT Image Segmentation Using Deep Neural Networks , 2018 .

[3]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[4]  Fernando Vilariño,et al.  Impact of image preprocessing methods on polyp localization in colonoscopy frames , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Fredrik Kahl,et al.  Deepseg: Abdominal Organ Segmentation Using Deep Convolutional Neural Networks , 2016 .

[6]  Debora Gil,et al.  Discarding Non Informative Regions for Efficient Colonoscopy Image Analysis , 2014, CARE@MICCAI.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Feng Chen,et al.  Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets , 2016, International Journal of Computer Assisted Radiology and Surgery.

[9]  Antonio M. López,et al.  A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images , 2016, Journal of healthcare engineering.

[10]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Wei-Min Liu,et al.  Semantic Segmentation of Colorectal Polyps with DeepLab and LSTM Networks , 2018, 2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[12]  Fernando Vilariño,et al.  Polyp Segmentation Method in Colonoscopy Videos by Means of MSA-DOVA Energy Maps Calculation , 2014, CLIP@MICCAI.

[13]  Ronald M. Summers,et al.  Anatomy-specific classification of medical images using deep convolutional nets , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).