Improving the Classification Performance of Esophageal Disease on Small Dataset by Semi-supervised Efficient Contrastive Learning

The classification of esophageal disease based on gastroscopic images is important in the clinical treatment, and is also helpful in providing patients with follow-up treatment plans and preventing lesion deterioration. In recent years, deep learning has achieved many satisfactory results in gastroscopic image classification tasks. However, most of them need a training set that consists of large numbers of images labeled by experienced experts. To reduce the image annotation burdens and improve the classification ability on small labeled gastroscopic image datasets, this study proposed a novel semi-supervised efficient contrastive learning (SSECL) classification method for esophageal disease. First, an efficient contrastive pair generation (ECPG) module was proposed to generate efficient contrastive pairs (ECPs), which took advantage of the high similarity features of images from the same lesion. Then, an unsupervised visual feature representation containing the general feature of esophageal gastroscopic images is learned by unsupervised efficient contrastive learning (UECL). At last, the feature representation will be transferred to the down-stream esophageal disease classification task. The experimental results have demonstrated that the classification accuracy of SSECL is 92.57%, which is better than that of the other state-of-the-art semi-supervised methods and is also higher than the classification method based on transfer learning (TL) by 2.28%. Thus, SSECL has solved the challenging problem of improving the classification result on small gastroscopic image dataset by fully utilizing the unlabeled gastroscopic images and the high similarity information among images from the same lesion. It also brings new insights into medical image classification tasks.

[1]  Georg Dorffner,et al.  Investigating and Exploiting Image Resolution for Transfer Learning-based Skin Lesion Classification , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[2]  Hang Chang,et al.  Unsupervised Transfer Learning via Multi-Scale Convolutional Sparse Coding for Biomedical Applications , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bing Zeng,et al.  Review on the Applications of Deep Learning in the Analysis of Gastrointestinal Endoscopy Images , 2019, IEEE Access.

[4]  Zijian Zhao,et al.  The Role and Impact of Deep Learning Methods in Computer-Aided Diagnosis Using Gastrointestinal Endoscopy , 2021, Diagnostics.

[5]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[6]  Michael Riegler,et al.  KVASIR: A Multi-Class Image Dataset for Computer Aided Gastrointestinal Disease Detection , 2017, MMSys.

[7]  Hak-Keung Lam,et al.  A case study on computer-aided diagnosis of nonerosive reflux disease using deep learning techniques , 2021, Neurocomputing.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Long-Qi Chen,et al.  How Does the Number of Resected Lymph Nodes Influence TNM Staging and Prognosis for Esophageal Carcinoma? , 2010, Annals of Surgical Oncology.

[10]  Xiaoqi Liu,et al.  Fine-tuning Pre-trained Convolutional Neural Networks for Gastric Precancerous Disease Classification on Magnification Narrow-band Imaging Images , 2020, Neurocomputing.

[11]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[12]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[13]  Tao Gan,et al.  Automatic classification of esophageal disease in gastroscopic images using an efficient channel attention deep dense convolutional neural network. , 2021, Biomedical optics express.

[14]  Myriam Tami,et al.  An Overview of Deep Semi-Supervised Learning , 2020, ArXiv.

[15]  M. Arnal,et al.  Esophageal cancer: Risk factors, screening and endoscopic treatment in Western and Eastern countries. , 2015 .

[16]  Wenju Du,et al.  Efficient Transfer Laerning Used in the Classification of Gastroscopic Images with Small Dataset , 2020, 2020 17th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[17]  Kaiming He,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Fons van der Sommen,et al.  Automatic Detection of Early Esophageal Cancer with CNNS Using Transfer Learning , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[19]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[20]  Luming Huang,et al.  Artificial intelligence technique in detection of early esophageal cancer , 2020, World journal of gastroenterology.

[21]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[22]  Jianpeng Zhang,et al.  Semi-supervised adversarial model for benign-malignant lung nodule classification on chest CT , 2019, Medical Image Anal..

[23]  Quoc V. Le,et al.  Rethinking Pre-training and Self-training , 2020, NeurIPS.

[24]  Fons van der Sommen,et al.  Supportive automatic annotation of early esophageal cancer using local gabor and color features , 2014, Neurocomputing.

[25]  M. Fujishiro,et al.  Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. , 2019, Gastrointestinal endoscopy.

[26]  Takuya Yamada,et al.  Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. , 2019, Gastrointestinal endoscopy.

[27]  S. Constantinoiu,et al.  Current endoscopic methods of radical therapy in early esophageal cancer , 2015, Journal of medicine and life.

[28]  Jie Zheng,et al.  Identification of lesion images from gastrointestinal endoscope based on feature extraction of combinational methods with and without learning process , 2016, Medical Image Anal..

[29]  Sheng-Jie Yu,et al.  Esophageal cancer: Risk factors, genetic association, and treatment. , 2016, Asian journal of surgery.

[30]  María José Domper Arnal,et al.  Esophageal cancer: Risk factors, screening and endoscopic treatment in Western and Eastern countries. , 2015, World journal of gastroenterology.

[31]  Miguel Tavares Coimbra,et al.  Invariant Gabor Texture Descriptors for Classification of Gastroenterology Images , 2012, IEEE Transactions on Biomedical Engineering.

[32]  Bing Hu,et al.  Real-time automated diagnosis of precancerous lesion and early esophageal squamous cell carcinoma using a deep learning model (with videos). , 2019, Gastrointestinal endoscopy.

[33]  Anne L. Martel,et al.  Deep neural network models for computational histopathology: A survey , 2019, Medical Image Anal..

[34]  Michal Valko,et al.  Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning , 2020, NeurIPS.

[35]  Aymeric Histace,et al.  Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results From the MICCAI 2015 Endoscopic Vision Challenge , 2017, IEEE Transactions on Medical Imaging.

[36]  M. Vieth,et al.  A computer-assisted algorithm for narrow-band-imaging-based tissue characterization in Barrett's esophagus. , 2020, Gastrointestinal endoscopy.

[37]  Pritee Khanna,et al.  Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network , 2020, Biomed. Signal Process. Control..

[38]  Lequan Yu,et al.  Semi-Supervised Medical Image Classification With Relation-Driven Self-Ensembling Model , 2020, IEEE Transactions on Medical Imaging.

[39]  Ming-Hseng Tseng,et al.  A Deep Learning Model for Classification of Endoscopic Gastroesophageal Reflux Disease , 2021, International journal of environmental research and public health.

[40]  Kaiming He,et al.  Rethinking ImageNet Pre-Training , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[41]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.