MSCI: A multistate dataset for colposcopy image classification of cervical cancer screening

BACKGROUND Cervical cancer is the second most common female cancer globally, and it is vital to detect cervical cancer with low cost at an early stage using automated screening methods of high accuracy, especially in areas with insufficient medical resources. Automatic detection of cervical intraepithelial neoplasia (CIN) can effectively prevent cervical cancer. OBJECTIVES Due to the deficiency of standard and accessible colposcopy image datasets, we present a dataset containing 4753 colposcopy images acquired from 679 patients in three states (acetic acid reaction, green filter, and iodine test) for detection of cervical intraepithelial neoplasia. Based on this dataset, a new computer-aided method for cervical cancer screening was proposed. METHODS We employed a wide range of methods to comprehensively evaluate our proposed dataset. Hand-crafted feature extraction methods and deep learning methods were used for the performance verification of the multistate colposcopy image (MSCI) dataset. Importantly, we propose a gated recurrent convolutional neural network (C-GCNN) for colposcopy image analysis that considers time series and combined multistate cervical images for CIN grading. RESULTS The experimental results showed that the proposed C-GCNN model achieves the best classification performance in CIN grading compared with hand-crafted feature extraction methods and classic deep learning methods. The results showed an accuracy of 96.87 %, a sensitivity of 95.68 %, and a specificity of 98.72 %. CONCLUSION A multistate colposcopy image dataset (MSCI) is proposed. A CIN grading model (C-GCNN) based on the MSCI dataset is established, which provides a potential method for automated cervical cancer screening.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Sunanda Mitra,et al.  Classification of Cervix Lesions Using Filter Bank-Based Texture Mode , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Xi Zheng,et al.  Unsupervised-Learning-Based Continuous Depth and Motion Estimation With Monocular Endoscopy for Virtual Reality Minimally Invasive Surgery , 2020, IEEE Transactions on Industrial Informatics.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Jia Gu,et al.  Automated image analysis of uterine cervical images , 2007, SPIE Medical Imaging.

[8]  Guangquan Xu,et al.  Security analysis of indistinguishable obfuscation for internet of medical things applications , 2020, Comput. Commun..

[9]  Clare Gilham,et al.  Performance of careHPV for detecting high-grade cervical intraepithelial neoplasia among women living with HIV-1 in Burkina Faso and South Africa: HARP study , 2016, British Journal of Cancer.

[10]  Lahouari Ghouti,et al.  A fully-automated deep learning pipeline for cervical cancer classification , 2020, Expert Syst. Appl..

[11]  M. Shamim Hossain,et al.  Recurrent convolutional neural network based multimodal disease risk prediction , 2019, Future Gener. Comput. Syst..

[12]  K. O. Wright,et al.  Cervical Cancer: Community Perception and Preventive Practices in an Urban Neighborhood of Lagos (Nigeria) , 2014, ISRN preventive medicine.

[13]  Michele Follen,et al.  Results of a pilot study of multispectral digital colposcopy for the in vivo detection of cervical intraepithelial neoplasia. , 2005, Gynecologic oncology.

[14]  Na Dong,et al.  Inception v3 based cervical cell classification combined with artificially extracted features , 2020, Appl. Soft Comput..

[15]  Clare Gilham,et al.  Efficacy of HPV-based screening for prevention of invasive cervical cancer: follow-up of four European randomised controlled trials , 2014, The Lancet.

[16]  Nicandro Cruz-Ramírez,et al.  Application of time series discretization using evolutionary programming for classification of precancerous cervical lesions , 2014, J. Biomed. Informatics.

[17]  Jeff Heflin,et al.  Multimodal Entity Coreference for Cervical Dysplasia Diagnosis , 2015, IEEE Transactions on Medical Imaging.

[18]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  L Gaffikin,et al.  A critical assessment of screening methods for cervical neoplasia , 2005, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[20]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[21]  Tao Xu,et al.  Multimodal Deep Learning for Cervical Dysplasia Diagnosis , 2016, MICCAI.

[22]  Gérard Biau,et al.  Analysis of a Random Forests Model , 2010, J. Mach. Learn. Res..

[23]  Trevor J Pugh,et al.  Landscape of genomic alterations in cervical carcinomas , 2013, Nature.

[24]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[25]  Laurence T. Yang,et al.  A GPU-based residual network for medical image classification in smart medicine , 2020, Inf. Sci..

[26]  Yanchun Zhang,et al.  Automatic CIN Grades Prediction of Sequential Cervigram Image Using LSTM With Multistate CNN Features , 2020, IEEE Journal of Biomedical and Health Informatics.

[27]  Shelly Lotenberg,et al.  Automatic Detection of Anatomical Landmarks in Uterine Cervix Images , 2009, IEEE Transactions on Medical Imaging.

[28]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[29]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[30]  Shiri Gordon,et al.  Content analysis of uterine cervix images: initial steps toward content based indexing and retrieval of cervigrams , 2006, SPIE Medical Imaging.

[31]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[32]  Ewert Bengtsson,et al.  Screening for Cervical Cancer Using Automated Analysis of PAP-Smears , 2014, Comput. Math. Methods Medicine.

[33]  M. Shamim Hossain,et al.  Cervical cancer classification using convolutional neural networks and extreme learning machines , 2020, Future Gener. Comput. Syst..

[34]  Jiong Jin,et al.  Efficient Human Activity Recognition Using a Single Wearable Sensor , 2020, IEEE Internet of Things Journal.

[35]  Tao Xu,et al.  Multi-feature based benchmark for cervical dysplasia classification evaluation , 2017, Pattern Recognit..

[36]  José Neves,et al.  A Deep Learning Approach to Case Based Reasoning to the Evaluation and Diagnosis of Cervical Carcinoma , 2018, ACIIDS.

[37]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[38]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[39]  Gunnar Rätsch,et al.  Soft Margins for AdaBoost , 2001, Machine Learning.