Deep Metric Learning for Cervical Image Classification

Cervical cancer is caused by the persistent infection of certain types of the Human Papillomavirus (HPV) and is a leading cause of female mortality particularly in low and middle-income countries (LMIC). Visual inspection of the cervix with acetic acid (VIA) is a commonly used technique in cervical screening. While this technique is inexpensive, clinical assessment is highly subjective, and relatively poor reproducibility has been reported. A deep learning-based algorithm for automatic visual evaluation (AVE) of aceto-whitened cervical images was shown to be effective in detecting confirmed precancer (i.e. direct precursor to invasive cervical cancer). The images were selected from a large longitudinal study conducted by the National Cancer Institute in the Guanacaste province of Costa Rica. The training of AVE used annotation for cervix boundary, and the data scarcity challenge was dealt with manually optimized data augmentation. In contrast, we present a novel approach for cervical precancer detection using a deep metric learning-based (DML) framework which does not incorporate any effort for cervix boundary marking. The DML is an advanced learning strategy that can deal with data scarcity and bias training due to class imbalance data in a better way. Three different widely-used state-of-the-art DML techniques are evaluated- (a) Contrastive loss minimization, (b) N-pair embedding loss minimization, and, (c) Batch-hard loss minimization. Three popular Deep Convolutional Neural Networks (ResNet-50, MobileNet, NasNet) are configured for training with DML to produce class-separated (i.e. linearly separable) image feature descriptors. Finally, a K-Nearest Neighbor (KNN) classifier is trained with the extracted deep features. Both the feature quality and classification performance are quantitatively evaluated on the same data set as used in AVE. It shows that, unlike AVE, without using any data augmentation, the best model produced from our research improves specificity in disease detection without compromising sensitivity. The present research thus paves the way for new research directions for the related field.

[1]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Sameer Antani,et al.  Cross-Dataset Evaluation of Deep Learning Networks for Uterine Cervix Segmentation , 2020, Diagnostics.

[4]  Rutwik Kulkarni,et al.  Automatic Detection of Cervical Region from VIA and VILI Images using Machine Learning , 2019, 2019 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[5]  Ahmad Hanif Asyhar,et al.  Automatic Approach for Cervical Cancer Detection Based on Deep Belief Network (DBN) Using Colposcopy Data , 2020, 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[6]  Hayit Greenspan,et al.  Automated and Interactive Lesion Detection and Segmentation in Uterine Cervix Images , 2010, IEEE Transactions on Medical Imaging.

[7]  Mark Schiffman,et al.  Interobserver Agreement in the Evaluation of Digitized Cervical Images , 2007, Obstetrics and gynecology.

[8]  Sameer Antani,et al.  Ensemble Deep Learning for Cervix Image Selection toward Improving Reliability in Automated Cervical Precancer Screening , 2020, Diagnostics.

[9]  L. Rodney Long,et al.  Deep Learning for Assessing Image Focus for Automated Cervical Cancer Screening , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[10]  L. R. Long,et al.  A demonstration of automated visual evaluation of cervical images taken with a smartphone camera , 2020, International journal of cancer.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Sameer Antani,et al.  An Observational Study of Deep Learning and Automated Evaluation of Cervical Images for Cancer Screening. , 2019, Journal of the National Cancer Institute.

[13]  Sameer Antani,et al.  Digital Tools for Collecting Data from Cervigrams for Research and Training in Colposcopy , 2006, Journal of lower genital tract disease.

[14]  Qian Du,et al.  Classification of Cervical Lesion Images Based on CNN and Transfer Learning , 2019, 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC).

[15]  Tao Xu,et al.  Multimodal Deep Learning for Cervical Dysplasia Diagnosis , 2016, MICCAI.

[16]  Tao Xu,et al.  A New Image Data Set and Benchmark for Cervical Dysplasia Classification Evaluation , 2015, MLMI.

[17]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[18]  Tao Xu,et al.  Adjustable adaboost classifier and pyramid features for image-based cervical cancer diagnosis , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[19]  Yuichiro Miyamoto,et al.  Application of deep learning to the classification of images from colposcopy , 2018, Oncology letters.

[20]  Yanchun Zhang,et al.  Automatic CIN Grades Prediction of Sequential Cervigram Image Using LSTM With Multistate CNN Features , 2020, IEEE Journal of Biomedical and Health Informatics.

[21]  Shelly Lotenberg,et al.  Automatic Detection of Anatomical Landmarks in Uterine Cervix Images , 2009, IEEE Transactions on Medical Imaging.

[22]  L. Gaffikin,et al.  Performance of Visual Inspection With Acetic Acid for Cervical Cancer Screening: A Qualitative Summary of Evidence to Date , 2003, Obstetrical & gynecological survey.

[23]  Othmane El Meslouhi,et al.  Semi-automatic Cervical Cancer Segmentation Using Active Contours without Edges , 2009, 2009 Fifth International Conference on Signal Image Technology and Internet Based Systems.

[24]  Tao Xu,et al.  Multi-feature based benchmark for cervical dysplasia classification evaluation , 2017, Pattern Recognit..

[25]  Jaime S. Cardoso,et al.  Automated Methods for the Decision Support of Cervical Cancer Screening Using Digital Colposcopies , 2018, IEEE Access.

[26]  Bing Bai,et al.  Cervical Lesion Detection Net , 2019, 2019 IEEE 13th International Conference on Anti-counterfeiting, Security, and Identification (ASID).

[27]  Xiaolei Huang,et al.  A Data Driven Approach to Cervigram Image Analysis and Classification , 2013 .

[28]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[29]  Ping Li,et al.  MDFI: Multi-CNN Decision Feature Integration for Diagnosis of Cervical Precancerous Lesions , 2020, IEEE Access.

[30]  Hayit Greenspan,et al.  Lesion detection and segmentation in uterine cervix images using an ARC-LEVEL MRF , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[31]  Sunanda Mitra,et al.  Classification of Cervix Lesions Using Filter Bank-Based Texture Mode , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[32]  Kihyuk Sohn,et al.  Improved Deep Metric Learning with Multi-class N-pair Loss Objective , 2016, NIPS.

[33]  Ser-Nam Lim,et al.  A Metric Learning Reality Check , 2020, ECCV.

[34]  Davide Chicco,et al.  Siamese Neural Networks: An Overview , 2021, Artificial Neural Networks, 3rd Edition.

[35]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[36]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[37]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.