LIRNet: Local Integral Regression Network for Both Strongly and Weakly Supervised Nuclei Detection

Nuclei detection is one of the most important issues in the field 0fhistopathology i mage analysis. Recent studies exploit convolutional neural networks to either locate the centroids of nuclei (counting-based approaches) or isolate them with sophisticated boundaries (segmentation-based algorithms). However, the training of these two methods demands considerable and laborious pixel-wise annotations labeled by pathology experts. To reduce the annotation cost, we propose a novel local integral regression network (LIRNet) that allows both strongly and weakly supervised learning (SSL/WSL) frameworks on nuclei detection. In addition, the LIRNet is able to predict a refined density map of n uclei, in which locating e ach n ucleus is barely affected by the post-processing algorithms. Quantitative experimental results demonstrate that the SSL version of the LIRNet achieves state-of-the-art performance compared with counterparts. Besides, the WSL version possesses a competitive detection performance and an effortless data annotation that dramatically reduces annotation cost by 74.3%.

[1]  Richard J. Chen,et al.  Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images , 2018, IEEE Transactions on Medical Imaging.

[2]  Guorong Wu,et al.  SAU-Net: A Universal Deep Network for Cell Counting , 2019, BCB.

[3]  Priya Lakshmi Narayanan,et al.  ConCORDe-Net: Cell Count Regularized Convolutional Neural Network for Cell Detection in Multiplex Immunohistochemistry Images , 2019, MICCAI.

[4]  Parvaneh Saeedi,et al.  Cell-Net: Embryonic Cell Counting and Centroid Localization via Residual Incremental Atrous Pyramid and Progressive Upsampling Convolution , 2019, IEEE Access.

[5]  Thomas Walter,et al.  Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map , 2019, IEEE Transactions on Medical Imaging.

[6]  Thomas J. Fuchs,et al.  VOCA: Cell Nuclei Detection In Histopathology Images By Vector Oriented Confidence Accumulation , 2018, MIDL.

[7]  Shan-e-Ahmed Raza,et al.  Deconvolving Convolutional Neural Network for Cell Detection , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[8]  Joel H. Saltz,et al.  Sparse Autoencoder for Unsupervised Nucleus Detection and Representation in Histopathology Images , 2017, Pattern Recognit..

[9]  Reza Moradi Rad,et al.  Blastomere Cell Counting and Centroid Localization in Microscopic Images of Human Embryo , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[10]  Vishal Monga,et al.  Deep Networks with Shape Priors for Nucleus Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[11]  Filippo Molinari,et al.  Multi-tissue and multi-scale approach for nuclei segmentation in H&E stained images , 2018, Biomedical engineering online.

[12]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[13]  Cheng Lu,et al.  A watershed and feature-based approach for automated detection of lymphocytes on lung cancer images , 2018, Medical Imaging.

[14]  Hai Su,et al.  Efficient and robust cell detection: A structured regression approach , 2018, Medical Image Anal..

[15]  Chandan Chakraborty,et al.  Her2Net: A Deep Framework for Semantic Segmentation and Classification of Cell Membranes and Nuclei in Breast Cancer Evaluation , 2018, IEEE Transactions on Image Processing.

[16]  Hao Chen,et al.  SFCN-OPI: Detection and Fine-grained Classification of Nuclei Using Sibling FCN with Objectness Prior Interaction , 2017, AAAI.

[17]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Aimin Hao,et al.  An Extended Type Cell Detection and Counting Method based on FCN , 2017, 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE).

[19]  Yoshua Bengio,et al.  Count-ception: Counting by Fully Convolutional Redundant Counting , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[20]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[21]  Nilanjan Ray,et al.  Cell Counting by Regression Using Convolutional Neural Network , 2016, ECCV Workshops.

[22]  Mathieu Salzmann,et al.  Deep Convolutional Neural Networks for Human Embryonic Cell Counting , 2016, ECCV Workshops.

[23]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[24]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[25]  Ole Winther,et al.  Autoencoding beyond pixels using a learned similarity metric , 2015, ICML.

[26]  Hai Su,et al.  Beyond Classification: Structured Regression for Robust Cell Detection Using Convolutional Neural Network , 2015, MICCAI.

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Roman Monczak,et al.  Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies , 2013, IEEE Transactions on Medical Imaging.

[30]  Manohar Kuse,et al.  Local isotropic phase symmetry measure for detection of beta cells and lymphocytes , 2011, Journal of pathology informatics.

[31]  Andrew H. Beck,et al.  Systematic Analysis of Breast Cancer Morphology Uncovers Stromal Features Associated with Survival , 2011, Science Translational Medicine.

[32]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[33]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).