Efficiently recognition of vaginal micro-ecological environment based on Convolutional Neural Network

Vaginal diseases caused by vaginal micro-ecological abnormalities mainly include Vulvovaginal Candidiasis (VVC), Aerobic Vaginitis (AV), and Bacterial Vaginosis (BV). Severe cases can lead to poor pregnancy outcomes and infertility. AI-based technologies are being deployed with an expectation to relieve doctors of routine, tedious work when implemented correctly in daily microscopy of vaginal micro-ecological abnormalities. In this paper, we built a clinical image dataset of the Gram stain of the vaginal discharge. By comparing the performance of state of art convolutional neural network models, we found the fine-tuning Inception ResNet V2 shows the best classification performance for vaginal diseases. It achieves 96%, 94%, 86% AUC in VVC, AV, BV classification respectively. The result shows that compared with human visual inspection, the method based on deep learning greatly improves the screening sensitivity. Besides, we found that transfer learning can reduce the required manual labeling by roughly 73% (about more than one thousand samples). But for BV, which is difficult to diagnose for both humans and AI. Unlike AV and VVC, it requires more labeled data and is insensitive to the transfer fine-tuning.

[1]  Marek Kowal,et al.  Computer-aided diagnosis of breast cancer based on fine needle biopsy microscopic images , 2013, Comput. Biol. Medicine.

[2]  K. Workowski,et al.  Sexually transmitted diseases treatment guidelines, 2015. , 2015, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[5]  Hongming Shan,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[6]  Lei Wang,et al.  HEp-2 Cell Image Classification with Convolutional Neural Networks , 2014, 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images.

[7]  K. Workowski,et al.  Centers for Disease Control and Prevention sexually transmitted diseases treatment guidelines. , 2007, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[8]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[9]  Nor Ashidi Mat Isa,et al.  Performance of neural network architectures: Cascaded MLP versus extreme learning machine on cervical cell image classification , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[13]  Faisal Mahmood,et al.  Deep learning and conditional random fields‐based depth estimation and topographical reconstruction from conventional endoscopy , 2017, Medical Image Anal..

[14]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[15]  Tao Han,et al.  Cross-Modal Transfer Learning for HEp-2 Cell Classification Based on Deep Residual Network , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[16]  S. le Cessie,et al.  Comparison of Amsel criteria, Nugent score, culture and two CE-IVD marked quantitative real-time PCRs with microbiota analysis for the diagnosis of bacterial vaginosis , 2019, European Journal of Clinical Microbiology & Infectious Diseases.

[17]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[18]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[19]  Gilbert Donders,et al.  2018 European (IUSTI/WHO) International Union against sexually transmitted infections (IUSTI) World Health Organisation (WHO) guideline on the management of vaginal discharge , 2018, International journal of STD & AIDS.

[20]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[21]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[22]  Li Zhang,et al.  Deep similarity learning for multimodal medical images , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[23]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Frans Coenen,et al.  One-class kernel subspace ensemble for medical image classification , 2014, EURASIP Journal on Advances in Signal Processing.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  George Shih,et al.  Hello World Deep Learning in Medical Imaging , 2018, Journal of Digital Imaging.

[28]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[29]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[30]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[31]  Robert F. Murphy,et al.  A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells , 2001, Bioinform..

[32]  Lei Wang,et al.  HEp-2 Cell Image Classification With Deep Convolutional Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[33]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[35]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of breast cancer histopathology images , 2016, Signal Process..