Deep learning nuclei detection: A simple approach can deliver state-of-the-art results

BACKGROUND Deep convolutional neural networks have become a widespread tool for the detection of nuclei in histopathology images. Many implementations share a basic approach that includes generation of an intermediate map indicating the presence of a nucleus center, which we refer to as PMap. Nevertheless, these implementations often still differ in several parameters, resulting in different detection qualities. METHODS We identified several essential parameters and configured the basic PMap approach using combinations of them. We thoroughly evaluated and compared various configurations on multiple datasets with respect to detection quality, efficiency and training effort. RESULTS Post-processing of the PMap was found to have the largest impact on detection quality. Also, two different network architectures were identified that improve either detection quality or runtime performance. The best-performing configuration yields f1-measures of 0.816 on H&E stained images of colorectal adenocarcinomas and 0.819 on Ki-67 stained images of breast tumor tissue. On average, it was fully trained in less than 15,000 iterations and processed 4.15 megapixels per second at prediction time. CONCLUSIONS The basic PMap approach is greatly affected by certain parameters. Our evaluation provides guidance on their impact and best settings. When configured properly, this simple and efficient approach can yield equal detection quality as more complex and time-consuming state-of-the-art approaches.

[1]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[2]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[3]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[4]  Junzhou Huang,et al.  Subtype Cell Detection with an Accelerated Deep Convolution Neural Network , 2016, MICCAI.

[5]  Bahram Parvin,et al.  Detection of nuclei in H&E stained sections using convolutional neural networks , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[6]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[7]  Pierre Baldi,et al.  Understanding Dropout , 2013, NIPS.

[8]  Horst Karl Hahn,et al.  Training Nuclei Detection Algorithms with Simple Annotations , 2017, Journal of pathology informatics.

[9]  Andrew Zisserman,et al.  Learning to Detect Cells Using Non-overlapping Extremal Regions , 2012, MICCAI.

[10]  B Terracini,et al.  Malignant mesothelioma of the pleura: interobserver variability. , 1995, Journal of clinical pathology.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[13]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[14]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[15]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[16]  Rasmus Larsen,et al.  Learning histopathological patterns , 2011, Journal of pathology informatics.

[17]  Gabriel J. Brostow,et al.  Detecting and Classifying Nuclei on a Budget , 2017, CVII-STENT/LABELS@MICCAI.

[18]  Hai Su,et al.  Beyond Classification: Structured Regression for Robust Cell Detection Using Convolutional Neural Network , 2015, MICCAI.

[19]  Hai Su,et al.  Deep Voting: A Robust Approach Toward Nucleus Localization in Microscopy Images , 2015, MICCAI.

[20]  Ian O Ellis,et al.  Tumor-infiltrating CD8+ lymphocytes predict clinical outcome in breast cancer. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Carsten Denkert,et al.  Standardized evaluation of tumor-infiltrating lymphocytes in breast cancer: results of the ring studies of the international immuno-oncology biomarker working group , 2016, Modern Pathology.

[22]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[23]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.