Adaptive Pruning of Transfer Learned Deep Convolutional Neural Network for Classification of Cervical Pap Smear Images

Automatic classification of cervical Pap smear images plays a key role in computer-aided cervical cancer diagnosis. Conventional classification approaches rely on cell segmentation and feature extraction methods. Due to overlapping cells, dust, impurities and uneven irradiation, the accurate segmentation and feature extraction of Pap smear images are still challenging. To overcome the difficulties of the feature-based approaches, deep learning is becoming more important alternative. Since the number of cervical cytological images is limited, an adaptive pruning deep transfer learning model (PsiNet-TAP) is proposed for Pap smear images classification. We designed a novel network to classify Pap smear images. Due to the limited number of images, we adopted transfer learning to obtain the pre-trained model. Then it was optimized by modifying the convolution layer and pruning some convolution kernels that may interfere with the target classification task. The proposed method PsiNet-TAP was tested on 389 cervical Pap smear images. The method has achieved remarkable performance (accuracy: more than 98%), which demonstrates the strength of the proposed method for providing an efficient tool for cervical cancer classification in clinical settings.

[1]  Hanan Samet,et al.  Pruning Filters for Efficient ConvNets , 2016, ICLR.

[2]  Alioune Ngom,et al.  A new feature selection approach for optimizing prediction models, applied to breast cancer subtype classification , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[3]  Jyotismita Talukdar,et al.  Fuzzy Clustering Based Image Segmentation of Pap smear Images of Cervical Cancer Cell Using FCM Algorithm , 2013 .

[4]  Xudong Jiang,et al.  Accurate Cervical Cell Segmentation from Overlapping Clumps in Pap Smear Images , 2017, IEEE Trans. Medical Imaging.

[5]  Ziba Gandomkar,et al.  MuDeRN: Multi-category classification of breast histopathological image using deep residual networks , 2018, Artif. Intell. Medicine.

[6]  Rui Peng,et al.  Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures , 2016, ArXiv.

[7]  Xiangyu Zhang,et al.  MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  Rassoul Amirfattahi,et al.  An Automated Method for Segmentation of Epithelial Cervical Cells in Images of ThinPrep , 2010, Journal of Medical Systems.

[9]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[10]  Shervan Fekri Ershad,et al.  Texture image analysis and texture classification methods - A review , 2019, ArXiv.

[11]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[12]  Wei Yu,et al.  A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends , 2018, IEEE Access.

[13]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[14]  Babak Hassibi,et al.  Second Order Derivatives for Network Pruning: Optimal Brain Surgeon , 1992, NIPS.

[15]  Sansanee Auephanwiriyakul,et al.  Automatic cervical cell segmentation and classification in Pap smears , 2014, Comput. Methods Programs Biomed..

[16]  Zhi Chen,et al.  Computerized Medical Imaging and Graphics Segmentation of Cytoplasm and Nuclei of Abnormal Cells in Cervical Cytology Using Global and Local Graph Cuts , 2022 .

[17]  Malay Kumar Kundu,et al.  Automated classification of Pap smear images to detect cervical dysplasia , 2017, Comput. Methods Programs Biomed..

[18]  Jian Cheng,et al.  Quantized CNN: A Unified Approach to Accelerate and Compress Convolutional Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Ali Ridho Barakbah,et al.  The determinant factor of breast cancer on medical oncology using feature selection based clustering , 2016, 2016 International Conference on Knowledge Creation and Intelligent Computing (KCIC).

[20]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[21]  G. Birdsong Automated screening of cervical cytology specimens. , 1996, Human pathology.

[22]  José Manuel Benítez,et al.  Segmentation of cervical cell nuclei in high-resolution microscopic images: A new algorithm and a web-based software framework , 2012, Comput. Methods Programs Biomed..

[23]  Fuyong Xing,et al.  Deep Convolutional Hashing for Low-Dimensional Binary Embedding of Histopathological Images , 2019, IEEE Journal of Biomedical and Health Informatics.

[24]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[25]  Denise R. Aberle,et al.  An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification , 2018, Expert Syst. Appl..

[26]  Liujuan Cao,et al.  Towards Optimal Structured CNN Pruning via Generative Adversarial Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  X Yu,et al.  Classify epithelium‐stroma in histopathological images based on deep transferable network , 2018, Journal of microscopy.

[28]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of cervical Pap smear images , 2019, Biomed. Signal Process. Control..

[29]  Chandan Chakraborty,et al.  Her2Net: A Deep Framework for Semantic Segmentation and Classification of Cell Membranes and Nuclei in Breast Cancer Evaluation , 2018, IEEE Transactions on Image Processing.

[30]  Jianxin Wu,et al.  ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  A. Jemal,et al.  Global cancer statistics , 2011, CA: a cancer journal for clinicians.

[32]  Judith D. Cohn,et al.  Sparse coding of pathology slides compared to transfer learning with deep neural networks , 2018, BMC Bioinformatics.

[33]  Hamid R. Tizhoosh,et al.  Convolutional neural networks for histopathology image classification: Training vs. Using pre-trained networks , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[34]  Ju Jia Zou,et al.  Adapting fisher vectors for histopathology image classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[35]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Ryan Glass,et al.  Predicting histological subtypes of follicular variant of papillary thyroid carcinoma based on cytomorphology. Can cytomorphology optimize use of molecular testing? , 2016, Journal of the American Society of Cytopathology.

[37]  Chenggang Yan,et al.  Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networks , 2020, IEEE Transactions on Cybernetics.

[38]  S. Athinarayanan,et al.  Cervical cell for thinprep image enhancement using morphological segmentation , 2012 .

[39]  Shervan Fekri-Ershad,et al.  Pap smear classification using combination of global significant value, texture statistical features and time series features , 2019, Multimedia Tools and Applications.

[40]  V. Seenivasagam,et al.  Radial Tracing Method of Cytoplasm Segmentation in Overlapped Cervical Cell Images , 2015 .

[41]  Malay Kishore Dutta,et al.  Automated segmentation of colon gland using histology images , 2016, 2016 Ninth International Conference on Contemporary Computing (IC3).

[42]  Xu Liu,et al.  Wavelet-based statistical features for distinguishing mitotic and non-mitotic cells in breast cancer histopathology , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[43]  Juan V. Lorenzo-Ginori,et al.  Cervical Cell Classification Using Features Related to Morphometry and Texture of Nuclei , 2013, CIARP.

[44]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[45]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[46]  Yuanjie Zheng,et al.  Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model , 2017, Scientific Reports.