Deep learning for cell image segmentation and ranking

Ninety years after its invention, the Pap test continues to be the most used method for the early identification of cervical precancerous lesions. In this test, the cytopathologists look for microscopic abnormalities in and around the cells, which is a time-consuming and prone to human error task. This paper introduces computational tools for cytological analysis that incorporate cell segmentation deep learning techniques. These techniques are capable of processing both free-lying and clumps of abnormal cells with a high overlapping rate from digitized images of conventional Pap smears. Our methodology employs a preprocessing step that discards images with a low probability of containing abnormal cells without prior segmentation and, therefore, performs faster when compared with the existing methods. Also, it ranks outputs based on the likelihood of the images to contain abnormal cells. We evaluate our methodology on an image database of conventional Pap smears from real scenarios, with 108 fields-of-view containing at least one abnormal cell and 86 containing only normal cells, corresponding to millions of cells. Our results show that the proposed approach achieves accurate results (MAP = 0.936), runs faster than existing methods, and it is robust to the presence of white blood cells, and other contaminants.

[1]  Ick Chan Kwon,et al.  Differential response to doxorubicin in breast cancer subtypes simulated by a microfluidic tumor model , 2017, Journal of controlled release : official journal of the Controlled Release Society.

[2]  H. Sebastian Seung,et al.  Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification , 2017, Bioinform..

[3]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[4]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[5]  Rassoul Amirfattahi,et al.  An Automated Method for Segmentation of Epithelial Cervical Cells in Images of ThinPrep , 2010, Journal of Medical Systems.

[6]  Qi Dou Multi-level Contextual 3D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017 .

[7]  Bin Wang,et al.  MARCH: Multiscale-arch-height description for mobile retrieval of leaf images , 2015, Inf. Sci..

[8]  Ghassan Hamarneh,et al.  Evaluation of Three Algorithms for the Segmentation of Overlapping Cervical Cells , 2017, IEEE Journal of Biomedical and Health Informatics.

[9]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[10]  Christophoros Nikou,et al.  Overlapping Cell Nuclei Segmentation Using a Spatially Adaptive Active Physical Model , 2012, IEEE Transactions on Image Processing.

[11]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[12]  Zhi Chen,et al.  Computerized Medical Imaging and Graphics Segmentation of Cytoplasm and Nuclei of Abnormal Cells in Cervical Cytology Using Global and Local Graph Cuts , 2022 .

[13]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[14]  Defeng Wang,et al.  Recent developments in machine learning for medical imaging applications , 2017, Comput. Medical Imaging Graph..

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  H. Dehghani,et al.  A quantitative method to measure biofilm removal efficiency from complex biomaterial surfaces using SEM and image analysis , 2016, Scientific Reports.

[17]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[18]  Gustavo Carneiro,et al.  An Improved Joint Optimization of Multiple Level Set Functions for the Segmentation of Overlapping Cervical Cells , 2015, IEEE Transactions on Image Processing.

[19]  D. Solomon,et al.  The Bethesda system for reporting cervical cytology : definitions, criteria, and explanatory notes , 2004 .

[20]  Eugenio Aguirre,et al.  A multiscale algorithm for nuclei extraction in pap smear images , 2016, Expert Syst. Appl..

[21]  Meng-Hsiun Tsai,et al.  Nucleus and cytoplast contour detector of cervical smear image , 2008, Pattern Recognit. Lett..

[22]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[23]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[24]  José Manuel Benítez,et al.  Segmentation of cervical cell nuclei in high-resolution microscopic images: A new algorithm and a web-based software framework , 2012, Comput. Methods Programs Biomed..

[25]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[26]  Paul A. Midgley,et al.  Machine learning as a tool for classifying electron tomographic reconstructions , 2015, Advanced Structural and Chemical Imaging.

[27]  Jianping Yin,et al.  Cytoplasm and nucleus segmentation in cervical smear images using Radiating GVF Snake , 2012, Pattern Recognit..

[28]  Gen Zheng,et al.  3D Cell Nuclear Morphology: Microscopy Imaging Dataset and Voxel-Based Morphometry Classification Results , 2017 .

[29]  Sansanee Auephanwiriyakul,et al.  Automatic cervical cell segmentation and classification in Pap smears , 2014, Comput. Methods Programs Biomed..

[30]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[31]  Malay Kumar Kundu,et al.  Automated classification of Pap smear images to detect cervical dysplasia , 2017, Comput. Methods Programs Biomed..

[32]  Shyang Chang,et al.  A new criterion for automatic multilevel thresholding , 1995, IEEE Trans. Image Process..

[33]  Kevin W. Eliceiri,et al.  Automated quantification of aligned collagen for human breast carcinoma prognosis , 2014, Journal of pathology informatics.

[34]  J. Barba,et al.  A parametric fitting algorithm for segmentation of cell images , 1998, IEEE Transactions on Biomedical Engineering.

[35]  Ping Chen,et al.  Segmentation of Fetal Left Ventricle in Echocardiographic Sequences Based on Dynamic Convolutional Neural Networks , 2017, IEEE Transactions on Biomedical Engineering.

[36]  Daniela Ushizima,et al.  Segmentation of subcellular compartments combining superpixel representation with Voronoi diagrams , 2015 .

[37]  Olaf Hellwich,et al.  Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology , 2017, Comput. Medical Imaging Graph..