SAMS-NET: Stain-aware multi-scale network for instance-based nuclei segmentation in histology images

Segmentation of nuclear material in histology slides is an important step in the digital pathology work-flow, due to the ability for nuclei to act as key diagnostic markers. Manual segmentation can be a laborious task, where pathologists are often required to analyse many nuclei within a whole slide image (WSI). The rise in digital pathology has been matched with an increase in interest for automated nuclei segmentation in Hematoxylin & Eosin (H&E) stained histology images, yet this remains a challenge due to the heterogeneous appearance of different types of nuclei. This heterogeneity can lead to nuclei having a variable Hematoxylin intensity, which often has detrimental effects on the success of current methods. We propose a deep multi-scale neural network, with a novel loss function that is sensitive to the Hematoxylin intensity, for precise object-level nuclei segmentation. We show that the proposed network outperforms all competing methods for the computational precision medicine (CPM) nuclei segmentation challenge dataset as part of MICCAI 2017.

[1]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[2]  Hai Su,et al.  Robust Cell Detection of Histopathological Brain Tumor Images Using Sparse Reconstruction and Adaptive Dictionary Selection , 2016, IEEE Transactions on Medical Imaging.

[3]  Terry M. Peters,et al.  Segmentation of thalamic nuclei using a modified k-means clustering algorithm and high-resolution quantitative magnetic resonance imaging at 1.5 T , 2007, NeuroImage.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[6]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[7]  J Qi,et al.  Dense nuclei segmentation based on graph cut and convexity–concavity analysis , 2014, Journal of microscopy.

[8]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[9]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[10]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[14]  David B. A. Epstein,et al.  MIMO-Net: A multi-input multi-output convolutional neural network for cell segmentation in fluorescence microscopy images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[15]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .