Transfer Learning For Endoscopy Disease Detection & Segmentation With Mask-RCNN Benchmark Architecture

We proposed and implemented a disease detection and semantic segmentation pipeline using a modified mask-RCNN infrastructure model on the EDD2020 dataset1. On the images provided for the phase-I test dataset, for ’BE’, we achieved an average precision of 51.14%, for ’HGD’ and ’polyp’ it is 50%. However, the detection score for ’suspicious’ and ’cancer’ were low. For phase-I, we achieved a dice coefficient of 0.4562 and an F2 score of 0.4508. We noticed the missed and mis-classification was due to the imbalance between classes. Hence, we applied a selective and balanced augmentation stage in our architecture to provide more accurate detection and segmentation. We observed an increase in detection score to 0.29 on phase -II images after balancing the dataset from our phase-I detection score of 0.24. We achieved an improved semantic segmentation score of 0.62 from our phase-I score of 0.52.

[1]  Sharib Ali,et al.  Endoscopy artifact detection (EAD 2019) challenge dataset , 2019, ArXiv.

[2]  Xiaohong W. Gao,et al.  An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy , 2020, Scientific Reports.

[3]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[4]  Guoqiang Han,et al.  Quantitative analysis of patients with celiac disease by video capsule endoscopy: A deep learning method , 2017, Comput. Biol. Medicine.

[5]  M. Fujishiro,et al.  Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. , 2019, Gastrointestinal endoscopy.

[6]  M. Kudo,et al.  Computer-Aided Diagnosis Based on Convolutional Neural Network System for Colorectal Polyp Classification: Preliminary Experience , 2017, Oncology.

[7]  Peng Li,et al.  A deep neural network improves endoscopic detection of early gastric cancer without blind spots , 2019, Endoscopy.

[8]  Barbara Braden,et al.  Towards Real-Time Detection of Squamous Pre-Cancers from Oesophageal Endoscopic Videos , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[9]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[10]  Sharib Ali,et al.  Endoscopy disease detection challenge 2020 , 2020, ArXiv.

[11]  Hao Chen,et al.  Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[12]  Jun Ki Min,et al.  Overview of Deep Learning in Gastrointestinal Endoscopy , 2019, Gut and liver.

[13]  Yuichi Mori,et al.  Artificial intelligence for early gastric cancer: early promise and the path ahead. , 2019, Gastrointestinal endoscopy.