StainNet: A Fast and Robust Stain Normalization Network

Stain normalization often refers to transferring the color distribution to the target image and has been widely used in biomedical image analysis. The conventional stain normalization usually achieves through a pixel-by-pixel color mapping model, which depends on one reference image, and it is hard to achieve accurately the style transformation between image datasets. In principle, this difficulty can be well-solved by deep learning-based methods, whereas, its complicated structure results in low computational efficiency and artifacts in the style transformation, which has restricted the practical application. Here, we use distillation learning to reduce the complexity of deep learning methods and a fast and robust network called StainNet to learn the color mapping between the source image and the target image. StainNet can learn the color mapping relationship from a whole dataset and adjust the color value in a pixel-to-pixel manner. The pixel-to-pixel manner restricts the network size and avoids artifacts in the style transformation. The results on the cytopathology and histopathology datasets show that StainNet can achieve comparable performance to the deep learning-based methods. Computation results demonstrate StainNet is more than 40 times faster than StainGAN and can normalize a 100,000 × 100,000 whole slide image in 40 s.

[1]  Swati B. Dighe,et al.  Papanicolaou Stain , 2006, Acta Cytologica.

[2]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[3]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Donald E. Brown,et al.  Self-Attentive Adversarial Stain Normalization , 2019, ICPR Workshops.

[5]  R. Newcombe,et al.  Observer variation in histopathological diagnosis and grading of cervical intraepithelial neoplasia. , 1989, BMJ.

[6]  Bram van Ginneken,et al.  The importance of stain normalization in colorectal tissue classification with convolutional networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[7]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[8]  Gary W. Gill,et al.  Cytopreparation: Principles & Practice , 2012 .

[9]  Shaojin Cai,et al.  Stain Style Transfer Using Transitive Adversarial Networks , 2019, MLMIR@MICCAI.

[10]  Pegah Salehi,et al.  Pix2Pix-based Stain-to-Stain Translation: A Solution for Robust Stain Normalization in Histopathology Images Analysis , 2020, 2020 International Conference on Machine Vision and Image Processing (MVIP).

[11]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[12]  Filippo Molinari,et al.  Stain Color Adaptive Normalization (SCAN) algorithm: Separation and standardization of histological stains in digital pathology , 2020, Comput. Methods Programs Biomed..

[13]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[14]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[15]  Geert J. S. Litjens,et al.  Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology , 2019, Medical Image Anal..

[16]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[17]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Zhiguo Jiang,et al.  Stain Standardization Capsule for Application-Driven Histopathological Image Normalization , 2020, IEEE Journal of Biomedical and Health Informatics.

[19]  Chengjun Liu,et al.  Color space normalization: Enhancing the discriminating power of color spaces for face recognition , 2010, Pattern Recognit..

[20]  Yuanqing Xia,et al.  StainCNNs: An efficient stain feature learning method , 2020, Neurocomputing.

[21]  Andreea Anghel,et al.  A High-Performance System for Robust Stain Normalization of Whole-Slide Images in Histopathology , 2019, Front. Med..

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[24]  22nd International Conference on Pattern Recognition, ICPR 2014, Stockholm, Sweden, August 24-28, 2014 , 2014, ICPR.

[25]  Nassir Navab,et al.  Staingan: Stain Style Transfer for Digital Histological Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[26]  Ritu Gupta,et al.  GCTI-SN: Geometry-inspired chemical and tissue invariant stain normalization of microscopic medical images , 2020, Medical Image Anal..

[27]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jianhua Yao,et al.  Enhanced Cycle-Consistent Generative Adversarial Network for Color Normalization of H&E Stained Images , 2019, MICCAI.

[30]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[31]  Hyunseok Min,et al.  Neural Stain-Style Transfer Learning using GAN for Histopathological Images , 2017, ArXiv.

[32]  Daniel Racoceanu,et al.  Detection of Mitosis and Evaluation of Nuclear Atypia Score in Breast Cancer Histological Images , 2014 .