DeepCervix: A Deep Learning-based Framework for the Classification of Cervical Cells Using Hybrid Deep Feature Fusion Techniques

Cervical cancer, one of the most common fatal cancers among women, can be prevented by regular screening to detect any precancerous lesions at early stages and treat them. Pap smear test is a widely performed screening technique for early detection of cervical cancer, whereas this manual screening method suffers from high false-positive results because of human errors. To improve the manual screening practice, machine learning (ML) and deep learning (DL) based computer-aided diagnostic (CAD) systems have been investigated widely to classify cervical Pap cells. Most of the existing studies require pre-segmented images to obtain good classification results. In contrast, accurate cervical cell segmentation is challenging because of cell clustering. Some studies rely on handcrafted features, which cannot guarantee the classification stage's optimality. Moreover, DL provides poor performance for a multiclass classification task when there is an uneven distribution of data, which is prevalent in the cervical cell dataset. This investigation has addressed those limitations by proposing DeepCervix, a hybrid deep feature fusion (HDFF) technique based on DL, to classify the cervical cells accurately. Our proposed method uses various DL models to capture more potential information to enhance classification performance. Our proposed HDFF method is tested on the publicly available SIPaKMeD dataset and compared the performance with base DL models and the late fusion (LF) method. For the SIPaKMeD dataset, we have obtained the state-of-the-art classification accuracy of 99.85%, 99.38%, and 99.14% for 2-class, 3-class, and 5-class classification. This method is also tested on the Herlev dataset and achieves an accuracy of 98.32% for 2-class and 90.32% for 7-class classification. The source code of the DeepCervix model is available at: https://github.com/Mamunur-20/DeepCervix.

[1]  Georgios Dounias,et al.  Particle swarm optimization for pap-smear diagnosis , 2008, Expert Syst. Appl..

[2]  L. Irwig,et al.  Effect of study design and quality on unsatisfactory rates, cytology classifications, and accuracy in liquid-based versus conventional cervical cytology: a systematic review , 2006, The Lancet.

[3]  Naoufel Werghi,et al.  Classification of Cervical-Cancer Using Pap-Smear Images: A Convolutional Neural Network Approach , 2017, MIUA.

[4]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[5]  Chen Li,et al.  A Survey for Cervical Cytopathology Image Analysis Using Deep Learning , 2020, IEEE Access.

[6]  Ewert Bengtsson,et al.  Deep Convolutional Neural Networks for Detecting Cellular Changes Due to Malignancy , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  Kazuhiko Hamamoto,et al.  Computer Aided Diagnosis System for Detection of Cancer Cells on Cytological Pleural Effusion Images , 2018, BioMed research international.

[8]  A. Renshaw,et al.  American society of cytopathology workload recommendations for automated pap test screening: Developed by the productivity and quality assurance in the era of automated screening task force , 2013, Diagnostic cytopathology.

[9]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[10]  Zhiping Lin,et al.  Biomedical image classification based on a feature concatenation and ensemble of deep CNNs , 2019, J. Ambient Intell. Humaniz. Comput..

[11]  T. P. Deepa,et al.  A Study on Denoising of Poisson Noise in Pap Smear Microscopic Image , 2016 .

[12]  Hansang Lee,et al.  Segmentation of Overlapping Cervical Cells in Microscopic Images with Superpixel Partitioning and Cell-Wise Contour Refinement , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  K. Hamamoto,et al.  Computer-Assisted Screening for Cervical Cancer Using Digital Image Processing of Pap Smear Images , 2020, Applied Sciences.

[14]  Wei Xue,et al.  Remote Sensing Scene Classification Based on Multi-Structure Deep Features Fusion , 2020, IEEE Access.

[15]  Georgios Dounias,et al.  Pap smear diagnosis using a hybrid intelligent scheme focusing on genetic algorithm based feature selection and nearest neighbor classification , 2009, Comput. Biol. Medicine.

[16]  Zhiguo Jiang,et al.  Graph Convolutional Networks for Cervical Cell Classification , 2019 .

[17]  Syed Ahmad Chan Bukhari,et al.  Integrated design of deep features fusion for localization and classification of skin cancer , 2020, Pattern Recognit. Lett..

[18]  Sander Dieleman,et al.  Rotation-invariant convolutional neural networks for galaxy morphology prediction , 2015, ArXiv.

[19]  Liron Pantanowitz,et al.  Artificial intelligence in cytopathology: a review of the literature and overview of commercial landscape. , 2019, Journal of the American Society of Cytopathology.

[20]  Malay Kumar Kundu,et al.  Pap smear image classification using convolutional neural network , 2016, ICVGIP '16.

[21]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[22]  M. Narasimha Murty,et al.  Genetic K-means algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[24]  G. Papanicolaou,et al.  New cancer diagnosis , 1973 .

[25]  Georgios Dounias,et al.  Pap-smear Benchmark Data For Pattern Classification , 2005 .

[26]  Ho-Jin Choi,et al.  Automating Papanicolaou Test Using Deep Convolutional Activation Feature , 2017, 2017 18th IEEE International Conference on Mobile Data Management (MDM).

[27]  Amira S. Ashour,et al.  Multi-modal classifier fusion with feature cooperation for glaucoma diagnosis , 2019, J. Exp. Theor. Artif. Intell..

[28]  P. Sukumar,et al.  Computer Aided Detection of Cervical Cancer Using Pap Smear Images Based on Adaptive Neuro Fuzzy Inference System Classifier , 2016 .

[29]  Richard L Lozano,et al.  Comparison of computer-assisted and manual screening of cervical cytology. , 2007, Gynecologic oncology.

[30]  Teddy Mantoro,et al.  Segmentation and Classification of Cervical Cells Using Deep Learning , 2019, IEEE Access.

[31]  Muhammed Talo Diagnostic Classification of Cervical Cell Images from Pap Smear Slides , 2019 .

[32]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[33]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[34]  M. Mikov,et al.  Cervical Cancer, Different Treatments and Importance of Bile Acids as Therapeutic Agents in This Disease , 2019, Front. Pharmacol..

[35]  Chen Li,et al.  An Application of Transfer Learning and Ensemble Learning Techniques for Cervical Histopathology Image Classification , 2020, IEEE Access.

[36]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[39]  Abid Sarwar,et al.  Hybrid ensemble learning technique for screening of cervical cancer using Papanicolaou smear image analysis , 2015 .

[40]  Christophoros Nikou,et al.  Sipakmed: A New Dataset for Feature and Image Based Classification of Normal and Pathological Cervical Cells in Pap Smear Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[41]  Ling Zhang,et al.  Fine-Grained Classification of Cervical Cells Using Morphological and Appearance Based Convolutional Neural Networks , 2018, IEEE Access.

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[43]  Aditya Khamparia,et al.  Internet of health things-driven deep learning system for detection and classification of cervical cells using transfer learning , 2020, The Journal of Supercomputing.

[44]  Nir Shavit,et al.  Deep Learning is Robust to Massive Label Noise , 2017, ArXiv.

[45]  Xin Zhao,et al.  Identification of COVID-19 samples from chest X-Ray images using deep learning: A comparison of transfer learning approaches , 2020, Journal of X-ray science and technology.

[46]  Chuchart Pintavirooj,et al.  Comparisons of Pap Smear Classification with Deep Learning Models , 2019, 2019 IEEE 14th International Conference on Nano/Micro Engineered and Molecular Systems (NEMS).

[47]  M. Schiffman,et al.  American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer , 2012, CA: a cancer journal for clinicians.

[48]  Srishti Gautam,et al.  Considerations for a PAP Smear Image Analysis System with CNN Features , 2018, ArXiv.

[49]  Loris Nanni,et al.  Handcrafted vs. non-handcrafted features for computer vision classification , 2017, Pattern Recognit..

[50]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[51]  Yu-Dong Yao,et al.  Breast Cancer Detection Using Extreme Learning Machine Based on Feature Fusion With CNN Deep Features , 2019, IEEE Access.

[52]  Papanicolaou Gn,et al.  The diagnostic value of vaginal smears in carcinoma of the uterus. 1941. , 1997 .

[53]  Aditya Khamparia,et al.  DCAVN: Cervical cancer prediction and classification using deep convolutional and variational autoencoder network , 2020, Multimedia Tools and Applications.

[54]  Isabel Segura-Bedmar,et al.  Evaluation of pooling operations in convolutional architectures for drug-drug interaction extraction , 2018, BMC Bioinformatics.

[55]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[56]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).