Accurate Cervical Cell Segmentation from Overlapping Clumps in Pap Smear Images

Accurate segmentation of cervical cells in Pap smear images is an important step in automatic pre-cancer identification in the uterine cervix. One of the major segmentation challenges is overlapping of cytoplasm, which has not been well-addressed in previous studies. To tackle the overlapping issue, this paper proposes a learning-based method with robust shape priors to segment individual cell in Pap smear images to support automatic monitoring of changes in cells, which is a vital prerequisite of early detection of cervical cancer. We define this splitting problem as a discrete labeling task for multiple cells with a suitable cost function. The labeling results are then fed into our dynamic multi-template deformation model for further boundary refinement. Multi-scale deep convolutional networks are adopted to learn the diverse cell appearance features. We also incorporated high-level shape information to guide segmentation where cell boundary might be weak or lost due to cell overlapping. An evaluation carried out using two different datasets demonstrates the superiority of our proposed method over the state-of-the-art methods in terms of segmentation accuracy.

[1]  Jianping Yin,et al.  Cytoplasm and nucleus segmentation in cervical smear images using Radiating GVF Snake , 2012, Pattern Recognit..

[2]  Jose Jeronimo,et al.  Human papillomavirus and cervical cancer , 2007, The Lancet.

[3]  Fang-Cheng Yeh,et al.  ACCOMP: Augmented cell competition algorithm for breast lesion demarcation in sonography. , 2010, Medical physics.

[4]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[5]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Hui Kong,et al.  A Generalized Laplacian of Gaussian Filter for Blob Detection and Its Applications , 2013, IEEE Transactions on Cybernetics.

[7]  Bai Ying Lei,et al.  Segmentation and Splitting of Touching Vaginal Bacteria Based on Superpixel and Effective Distance , 2014, 2014 IEEE International Conference on Data Mining Workshop.

[8]  Sabine Neuss,et al.  Size-dependent cytotoxicity of gold nanoparticles. , 2007, Small.

[9]  Ewert Bengtsson,et al.  Computerized Cell Image Analysis: Past, Present, and Future , 2003, SCIA.

[10]  Heikki Haario,et al.  Segmentation of Overlapping Elliptical Objects in Silhouette Images , 2015, IEEE Transactions on Image Processing.

[11]  Laura Antanas,et al.  Charisma: An integrated approach to automatic H&E-stained skeletal muscle cell segmentation using supervised learning and novel robust clump splitting , 2013, Medical Image Anal..

[12]  J. Hafner,et al.  Optical properties of star-shaped gold nanoparticles. , 2006, Nano letters.

[13]  Christophoros Nikou,et al.  Automated Detection of Cell Nuclei in Pap Smear Images Using Morphological Reconstruction and Clustering , 2011, IEEE Transactions on Information Technology in Biomedicine.

[14]  David C Wilbur,et al.  The Becton Dickinson FocalPoint GS Imaging System: clinical trials demonstrate significantly improved sensitivity for the detection of important cervical lesions. , 2009, American journal of clinical pathology.

[15]  Jie-Zhi Cheng,et al.  Cell-based two-region competition algorithm with a map framework for boundary delineation of a series of 2D ultrasound images. , 2007, Ultrasound in medicine & biology.

[16]  Louis-François Handfield,et al.  Local statistics allow quantification of cell-to-cell variability from high-throughput microscope images , 2015, Bioinform..

[17]  Selim Aksoy,et al.  Unsupervised segmentation and classification of cervical cell images , 2012, Pattern Recognit..

[18]  Hui Kong,et al.  Automation‐assisted cervical cancer screening in manual liquid‐based cytology with hematoxylin and eosin staining , 2014, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[19]  Christophoros Nikou,et al.  Overlapping Cell Nuclei Segmentation Using a Spatially Adaptive Active Physical Model , 2012, IEEE Transactions on Image Processing.

[20]  Yunhui Liu,et al.  Accurate Segmentation of Partially Overlapping Cervical Cells Based on Dynamic Sparse Contour Searching and GVF Snake Model , 2015, IEEE Journal of Biomedical and Health Informatics.

[21]  Karl Rohr,et al.  Efficient globally optimal segmentation of cells in fluorescence microscopy images using level sets and convex energy functionals , 2012, Medical Image Anal..

[22]  Yu Ding,et al.  Segmentation, Inference and Classification of Partially Overlapping Nanoparticles , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Brian C. Lovell,et al.  A Water Immersion Algorithm for Cytological Image Segmentation , 1996 .

[24]  G. Birdsong Automated screening of cervical cytology specimens. , 1996, Human pathology.

[25]  Ghassan Hamarneh,et al.  Segmentation of overlapping cervical cells: A variational method with star-shape prior , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[26]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[27]  Anant Madabhushi,et al.  Explicit shape descriptors: Novel morphologic features for histopathology classification , 2013, Medical Image Anal..

[28]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[29]  N. Isa Automated Edge Detection Technique for Pap Smear Images Using Moving K-Means Clustering and Modified Seed Based Region Growing Algorithm , 2005 .

[30]  Christophoros Nikou,et al.  A Review of Automated Techniques for Cervical Cell Image Analysis and Classification , 2013 .

[31]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  G. Papanicolaou A NEW PROCEDURE FOR STAINING VAGINAL SMEARS. , 1942, Science.

[33]  Sebastian Nowozin,et al.  Structured Learning and Prediction in Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[34]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[35]  Ana Maria Mendonça,et al.  Cell Nuclei and Cytoplasm Joint Segmentation Using the Sliding Band Filter , 2010, IEEE Transactions on Medical Imaging.

[36]  Zhi Chen,et al.  Computerized Medical Imaging and Graphics Segmentation of Cytoplasm and Nuclei of Abnormal Cells in Cervical Cytology Using Global and Local Graph Cuts , 2022 .

[37]  M. Schiffman,et al.  American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer , 2012, CA: a cancer journal for clinicians.

[38]  Sebastian Nowozin,et al.  On Parameter Learning in CRF-Based Approaches to Object Class Image Segmentation , 2010, ECCV.

[39]  Narendra Ahuja,et al.  Automatic segmentation of granular objects in images: Combining local density clustering and gradient-barrier watershed , 2014, Pattern Recognit..

[40]  Fabian Rudolf,et al.  Accurate cell segmentation in microscopy images using membrane patterns , 2014, Bioinform..

[41]  Chanho Jung,et al.  Unsupervised Segmentation of Overlapped Nuclei Using Bayesian Classification , 2010, IEEE Transactions on Biomedical Engineering.

[42]  Gustavo Carneiro,et al.  An Improved Joint Optimization of Multiple Level Set Functions for the Segmentation of Overlapping Cervical Cells , 2015, IEEE Transactions on Image Processing.

[43]  José Manuel Benítez,et al.  Segmentation of cervical cell nuclei in high-resolution microscopic images: A new algorithm and a web-based software framework , 2012, Comput. Methods Programs Biomed..

[44]  Peter Lorenzen,et al.  A Unified Graphical Models Framework for Automated Mitosis Detection in Human Embryos , 2014, IEEE Transactions on Medical Imaging.

[45]  E. Bengtsson,et al.  Recognizing signs of malignancy — The quest for computer assisted cancer screening and diagnosis systems , 2010, 2010 IEEE International Conference on Computational Intelligence and Computing Research.

[46]  Jie-Zhi Cheng,et al.  Computer-aided US diagnosis of breast lesions by using cell-based contour grouping. , 2010, Radiology.

[47]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[48]  Cigdem Demir,et al.  Attributed Relational Graphs for Cell Nucleus Segmentation in Fluorescence Microscopy Images , 2013, IEEE Transactions on Medical Imaging.

[49]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[51]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[53]  Yen-Ping Chu,et al.  Edge Enhancement Nucleus and Cytoplast Contour Detector of Cervical Smear Images , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[54]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[55]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[56]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..