Strategies for Training Stain Invariant CNNS

An important part of Digital Pathology is the analysis of multiple digitised whole slide images from differently stained tissue sections. It is common practice to mount consecutive sections containing corresponding microscopic structures on glass slides, and to stain them differently to highlight specific tissue components. These multiple staining modalities result in very different images but include a significant amount of consistent image information. Deep learning approaches have recently been proposed to analyse these images in order to automatically identify objects of interest for pathologists. These supervised approaches require a vast amount of annotations, which are difficult and expensive to acquire—a problem that is multiplied with multiple stainings. This article presents several training strategies that make progress towards stain invariant networks. By training the network on one commonly used staining modality and applying it to images that include corresponding but differently stained tissue structures, the presented unsupervised strategies demonstrate significant improvements over standard training strategies.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Michael Gadermayr,et al.  Domain Adaptive Classification for Compensating Variability in Histopathological Whole Slide Images , 2016, ICIAR.

[3]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[4]  Gloria Bueno,et al.  Glomerulus Classification and Detection Based on Convolutional Neural Networks , 2018, J. Imaging.

[5]  Jaime S. Cardoso,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Geert J. S. Litjens,et al.  Automatic segmentation of histopathological slides of renal tissue using deep learning , 2018, Medical Imaging.

[8]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[9]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Abhijit Guha Roy,et al.  Multiple instance learning of deep convolutional neural networks for breast histopathology whole slide classification , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  Daniel A Beard,et al.  Region-Based Convolutional Neural Nets for Localization of Glomeruli in Trichrome-Stained Whole Kidney Sections. , 2018, Journal of the American Society of Nephrology : JASN.

[12]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[13]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[14]  Janne Heikkilä,et al.  Transfer Learning for Cell Nuclei Classification in Histopathology Images , 2016, ECCV Workshops.

[15]  Germain Forestier,et al.  Role of Task Complexity and Training in Crowdsourced Image Annotation , 2018, COMPAY/OMIA@MICCAI.

[16]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[17]  Gilles Louppe,et al.  Collaborative analysis of multi-gigapixel imaging data using Cytomine , 2016, Bioinform..

[18]  Germain Forestier,et al.  Stain unmixing in brightfield multiplexed immunohistochemistry , 2013, 2013 IEEE International Conference on Image Processing.

[19]  John E. Tomaszewski,et al.  Glomerular detection and segmentation from multimodal microscopy images using a Butterworth band-pass filter , 2018, Medical Imaging.

[20]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[21]  Melih Kandemir,et al.  Asymmetric Transfer Learning with Deep Gaussian Processes , 2015, ICML.