Self-Supervised Nuclei Segmentation in Histopathological Images Using Attention

Segmentation and accurate localization of nuclei in histopathological images is a very challenging problem, with most existing approaches adopting a supervised strategy. These methods usually rely on manual annotations that require a lot of time and effort from medical experts. In this study, we present a self-supervised approach for segmentation of nuclei for whole slide histopathology images. Our method works on the assumption that the size and texture of nuclei can determine the magnification at which a patch is extracted. We show that the identification of the magnification level for tiles can generate a preliminary self-supervision signal to locate nuclei. We further show that by appropriately constraining our model it is possible to retrieve meaningful segmentation maps as an auxiliary output to the primary magnification identification task. Our experiments show that with standard post-processing, our method can outperform other unsupervised nuclei segmentation approaches and report similar performance with supervised ones on the publicly available MoNuSeg dataset. Our code and models are available online (https://github.com/msahasrabudhe/miccai2020_self_sup_nuclei_seg) to facilitate further research.

[1]  David S. Strayer,et al.  Comprar Rubin's Pathology,CLINICOPATHOLOGIC FOUNDATIONS OF MEDICINE | David S. Strayer | 9781451183900 | Lippincott Williams & Wilkins , 2014 .

[2]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[3]  Thomas Walter,et al.  Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map , 2019, IEEE Transactions on Medical Imaging.

[4]  Jin Tae Kwak,et al.  Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images , 2018, Medical Image Anal..

[5]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  R. Shui,et al.  Predictive value of tumor-infiltrating lymphocytes to pathological complete response in neoadjuvant treated triple-negative breast cancers , 2018, Diagnostic Pathology.

[8]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[9]  Max Welling,et al.  Gauge Equivariant Convolutional Networks and the Icosahedral CNN 1 , 2019 .

[10]  Nasir M. Rajpoot,et al.  PanNuke: An Open Pan-Cancer Histology Dataset for Nuclei Instance Segmentation and Classification , 2019, ECDP.

[11]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[12]  D. Gleason,et al.  Histologic grading of prostate cancer: a perspective. , 1992, Human pathology.

[13]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[14]  Alexei A. Efros,et al.  Curiosity-Driven Exploration by Self-Supervised Prediction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Junzhou Huang,et al.  Automatic extraction of cell nuclei from H&E-stained histopathological images , 2017, Journal of medical imaging.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Joel H. Saltz,et al.  Sparse Autoencoder for Unsupervised Nucleus Detection and Representation in Histopathology Images , 2017, Pattern Recognit..

[18]  B Terracini,et al.  Malignant mesothelioma of the pleura: interobserver variability. , 1995, Journal of clinical pathology.

[19]  Stephen McQuaid,et al.  The prognostic significance of the aberrant extremes of p53 immunophenotypes in breast cancer , 2014, Histopathology.

[20]  Andrea Vedaldi,et al.  Unsupervised Learning of Object Landmarks by Factorized Spatial Embeddings , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Andrew A. Renshaw,et al.  Rubin??s Pathology. Clinicopathologic Foundations of Medicine , 2008 .

[23]  Christophoros Nikou,et al.  Overlapping Cell Nuclei Segmentation Using a Spatially Adaptive Active Physical Model , 2012, IEEE Transactions on Image Processing.

[24]  Nikos Komodakis,et al.  Unsupervised Representation Learning by Predicting Image Rotations , 2018, ICLR.

[25]  Daniel E. Worrall,et al.  Deep Scale-spaces: Equivariance Over Scale , 2019, NeurIPS.