Deep learning-based image evaluation for cervical precancer screening with a smartphone targeting low resource settings – Engineering approach

Cervical cancer is the fourth most common cancer among women and still one of the major causes of women’s death around the world. Early screening of high grade Cervical Intraepithelial Neoplasia (CIN), precursors to cervical cancer, is vital to efforts aimed at improving survival rate and eventually eliminating cervical cancer. Visual Inspection with Acetic acid (VIA) is an assessment method which can inspect the cervix and potentially detect lesions caused by human papillomavirus (HPV), which is a major cause of cervical cancer. VIA has the potential to be an effective screening method in low resource settings when triaged with HPV test, but it has the drawback that it depends on the subjective evaluation of health workers with varying levels of training. A new deep learning algorithm called Automated Visual Evaluation (AVE) for analyzing cervigram images has been recently reported that can automatically detect cervical precancer better than human experts. In this paper, we address the question of whether mobile phone-based cervical cancer screening is feasible. We consider the capabilities of two key components of a mobile phone platform for cervical cancer screening: (1) the core AVE algorithm and (2) an image quality algorithm. We consider both accuracy and speed in our assessment. We show that the core AVE algorithm, by refactoring to a new deep learning detection framework, can run in ~30 seconds on a low-end smartphone (i.e. Samsung J8), with equivalent accuracy. We developed an image quality algorithm that can localize the cervix and assess image quality in ~1 second on a low-end smartphone, achieving an area under the ROC curve (AUC) of 0.95. Field validation of the mobile phone platform for cervical cancer screening is in progress.

[1]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Peter Chiodini,et al.  Computer-Automated Malaria Diagnosis and Quantitation Using Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[5]  David Levitz,et al.  Characterization of cervigram image sharpness using multiple self-referenced measurements and random forest classifiers , 2018, BiOS.

[6]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Zhi Zhang,et al.  Bag of Freebies for Training Object Detection Neural Networks , 2019, ArXiv.

[13]  Xiandong Meng,et al.  RefineDetLite: A Lightweight One-stage Object Detection Framework for CPU-only Devices , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Ben Glocker,et al.  Improving RetinaNet for CT Lesion Detection with Dense Masks from Weak RECIST Labels , 2019, MICCAI.

[16]  L. Rodney Long,et al.  Deep Learning for Assessing Image Focus for Automated Cervical Cancer Screening , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[17]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[18]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[19]  K. Yeates,et al.  Evaluation of a Smartphone-Based Training Strategy Among Health Care Workers Screening for Cervical Cancer in Northern Tanzania: The Kilimanjaro Method , 2016, Journal of global oncology.

[20]  Sameer Antani,et al.  An Observational Study of Deep Learning and Automated Evaluation of Cervical Images for Cancer Screening. , 2019, Journal of the National Cancer Institute.

[21]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[24]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[25]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[26]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[28]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.