Deep Learning Nuclei Detection in Digitized Histology Images by Superpixels

Background: Advances in image analysis and computational techniques have facilitated automatic detection of critical features in histopathology images. Detection of nuclei is critical for squamous epithelium cervical intraepithelial neoplasia (CIN) classification into normal, CIN1, CIN2, and CIN3 grades. Methods: In this study, a deep learning (DL)-based nuclei segmentation approach is investigated based on gathering localized information through the generation of superpixels using a simple linear iterative clustering algorithm and training with a convolutional neural network. Results: The proposed approach was evaluated on a dataset of 133 digitized histology images and achieved an overall nuclei detection (object-based) accuracy of 95.97%, with demonstrated improvement over imaging-based and clustering-based benchmark techniques. Conclusions: The proposed DL-based nuclei segmentation Method with superpixel analysis has shown improved segmentation results in comparison to state-of-the-art methods.

[1]  Bernhard Hill,et al.  Comparative analysis of the quantization of color spaces on the basis of the CIELAB color-difference formula , 1997, TOGS.

[2]  Dongxiang Zhou,et al.  Nuclei enhancement and segmentation in color cervical smear images , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[3]  Hui Kong,et al.  A Generalized Laplacian of Gaussian Filter for Blob Detection and Its Applications , 2013, IEEE Transactions on Cybernetics.

[4]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[6]  Hai Su,et al.  Deep Voting: A Robust Approach Toward Nucleus Localization in Microscopy Images , 2015, MICCAI.

[7]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[8]  Zhiguo Jiang,et al.  Graph Convolutional Networks for Cervical Cell Classification , 2019 .

[9]  L. Rodney Long,et al.  Histology image analysis for carcinoma detection and grading , 2012, Comput. Methods Programs Biomed..

[10]  Mbbs Md FRCPath Donald N. Pritzker Vinay Kumar Robbins and Cotran pathologic basis of disease , 2015 .

[11]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[12]  R. Joe Stanley,et al.  Nuclei Segmentation using a Level Set Active Contour Method and Spatial Fuzzy C-means Clustering , 2017, VISIGRAPP.

[13]  Zhong Ming Zhao Sequence and genome analytics : method and applications , 2010 .

[14]  Lin Yang,et al.  Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review , 2016, IEEE Reviews in Biomedical Engineering.

[15]  S. Naga Nandini Sujatha,et al.  A fast geometric active contour model with automatic region grid , 2010, 2010 IEEE International Conference on Computational Intelligence and Computing Research.

[16]  R. Newcombe,et al.  Reporting cervical intra‐epithelial neoplasia (CIN): Intra‐ and interpathologist variation and factors associated with disagreement , 1990, Histopathology.

[17]  Zhi Chen,et al.  Computerized Medical Imaging and Graphics Segmentation of Cytoplasm and Nuclei of Abnormal Cells in Cervical Cytology Using Global and Local Graph Cuts , 2022 .

[18]  Brijendra Kumar Joshi,et al.  A Review Paper: Noise Models in Digital Image Processing , 2015, ArXiv.

[19]  P W Hamilton,et al.  Inter‐ and intra‐observer variation in the histopathological reporting of cervical squamous in traepithelial lesion susing a modified Bethesda grading system , 1998, British journal of obstetrics and gynaecology.

[20]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.

[21]  Mrinal Mandal,et al.  A robust automatic nuclei segmentation technique for quantitative histopathological image analysis. , 2012, Analytical and quantitative cytopathology and histopathology.

[22]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[23]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[26]  Jinping Fan,et al.  Automated cervical cell image segmentation using level set based active contour model , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[27]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[28]  Matthew J. McAuliffe,et al.  Medical Image Processing, Analysis and Visualization in clinical research , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[29]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Fabio A. González,et al.  An unsupervised feature learning framework for basal cell carcinoma image analysis , 2015, Artif. Intell. Medicine.

[31]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[32]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[33]  Angel Cruz-Roa,et al.  Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features , 2014, Journal of medical imaging.

[34]  Stephen J. McKenna,et al.  Towards the automated prescreening of cervical smears , 1992 .

[35]  Brian C. Lovell,et al.  Classification of cervical cell nuclei using morphological segmentation and textural feature extraction , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[36]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[37]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[38]  R. Joe Stanley,et al.  Nuclei-Based Features for Uterine Cervical Cancer Histology Image Analysis With Fusion-Based Classification , 2016, IEEE Journal of Biomedical and Health Informatics.

[39]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Jun Xu,et al.  Multi-Pass Adaptive Voting for Nuclei Detection in Histopathological Images , 2016, Scientific Reports.

[41]  Mrinal K. Mandal,et al.  Automatic Nuclei Detection Based on Generalized Laplacian of Gaussian Filters , 2017, IEEE Journal of Biomedical and Health Informatics.

[42]  Bahram Parvin,et al.  When machine vision meets histology: A comparative evaluation of model architecture for classification of histology sections☆ , 2017, Medical Image Anal..

[43]  R. Joe Stanley,et al.  A fusion-based approach for uterine cervical cancer histology image classification , 2013, Comput. Medical Imaging Graph..

[44]  Danny Crookes,et al.  Assisted Diagnosis of Cervical Intraepithelial Neoplasia (CIN) , 2009, IEEE Journal of Selected Topics in Signal Processing.

[45]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[46]  C. Compton,et al.  AJCC Cancer Staging Manual , 2002, Springer New York.

[47]  A R Luxmoore,et al.  The Hough transform for locating cell nuclei. , 1992, Analytical and quantitative cytology and histology.

[48]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.