Computer-aided diagnosis tool for cervical cancer screening with weakly supervised localization and detection of abnormalities using adaptable and explainable classifier

While pap test is the most common diagnosis methods for cervical cancer, their results are highly dependent on the ability of the cytotechnicians to detect abnormal cells on the smears using brightfield microscopy. In this paper, we propose an explainable region classifier in whole slide images that could be used by cyto-pathologists to handle efficiently these big images (100,000x100,000 pixels). We create a dataset that simulates pap smears regions and uses a loss, we call classification under regression constraint, to train an efficient region classifier (about 66.8% accuracy on severity classification, 95.2% accuracy on normal/abnormal classification and 0.870 KAPPA score). We explain how we benefit from this loss to obtain a model focused on sensitivity and, then, we show that it can be used to perform weakly supervised localization (accuracy of 80.4%) of the cell that is mostly responsible for the malignancy of regions of whole slide images. We extend our method to perform a more general detection of abnormal cells (66.1% accuracy) and ensure that at least one abnormal cell will be detected if malignancy is present. Finally, we experiment our solution on a small real clinical slide dataset, highlighting the relevance of our proposed solution, adapting it to be as easily integrated in a pathology laboratory workflow as possible, and extending it to make a slide-level prediction.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Andrea Vedaldi,et al.  Interpretable Explanations of Black Boxes by Meaningful Perturbation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Hao Chen,et al.  Dual-path network with synergistic grouping loss and evidence driven risk stratification for whole slide cervical image analysis , 2021, Medical Image Anal..

[7]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[8]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[9]  Anne L. Martel,et al.  Deep neural network models for computational histopathology: A survey , 2019, Medical Image Anal..

[10]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[11]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[12]  Herbert Thoms,et al.  Diagnosis of Uterine Cancer by the Vaginal Smear , 1943, The Yale Journal of Biology and Medicine.

[13]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[14]  Mark Sherman,et al.  The 2001 Bethesda System: terminology for reporting results of cervical cytology. , 2002, JAMA.

[15]  M. Schiffman,et al.  Interobserver reproducibility of cervical cytologic and histologic interpretations: realistic estimates from the ASCUS-LSIL Triage Study. , 2001, JAMA.

[16]  Thomas C Wright,et al.  Consensus Guidelines for the Management of Women With Cervical Cytological Abnormalities , 2002 .

[17]  H. Kitchener,et al.  Automation-assisted versus manual reading of cervical cytology (MAVARIC): a randomised controlled trial. , 2011, The Lancet. Oncology.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Ling Zhang,et al.  Fine-Grained Classification of Cervical Cells Using Morphological and Appearance Based Convolutional Neural Networks , 2018, IEEE Access.

[20]  Hayit Greenspan,et al.  Chest pathology identification using deep feature selection with non-medical training , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[21]  Hui Kong,et al.  Automation‐assisted cervical cancer screening in manual liquid‐based cytology with hematoxylin and eosin staining , 2014, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[22]  Qisong Wu,et al.  Classification of Breast Cancer Histology Images Using Multi-Size and Discriminative Patches Based on Deep Learning , 2019, IEEE Access.

[23]  Ewert Bengtsson,et al.  Deep Convolutional Neural Networks for Detecting Cellular Changes Due to Malignancy , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[24]  Diane Solomon,et al.  The Bethesda interobserver reproducibility study (BIRST) , 2006, Cancer.

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Eric W. Tramel,et al.  Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach , 2018, ArXiv.

[27]  David C Wilbur,et al.  The Pap Test and Bethesda 2014 , 2015, Acta Cytologica.

[28]  Malay Kumar Kundu,et al.  Pap smear image classification using convolutional neural network , 2016, ICVGIP '16.

[29]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[30]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[31]  Melanie Kwon,et al.  Multi-label Classification of Single and Clustered Cervical Cells Using Deep Convolutional Networks , 2018 .

[32]  Gianluca Pollastri,et al.  A neural network approach to ordinal regression , 2007, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[33]  Joseph Boyd,et al.  Predicting Residual Cancer Burden In A Triple Negative Breast Cancer Cohort , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[34]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[35]  Hai Su,et al.  Graph temporal ensembling based semi-supervised convolutional neural network with noisy labels for histopathology image analysis , 2019, Medical Image Anal..

[36]  Classification driven Assisted Screening for cervical cancer using deep neural network , 2018 .

[37]  Amit Marathe,et al.  Soft Labels for Ordinal Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Lawrence Carin,et al.  Weakly supervised instance learning for thyroid malignancy prediction from whole slide cytopathology images , 2019, Medical Image Anal..

[39]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[40]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  N. Nachar The Mann ‐ Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution , 2007 .

[42]  Georgios Dounias,et al.  Pap-smear Benchmark Data For Pattern Classification , 2005 .