Improving Unsupervised Stain-To-Stain Translation using Self-Supervision and Meta-Learning

Nassim Bouteldja, Barbara M. Klinkhammer, Tarek Schlaich, Peter Boor, Dorit Merhof a Institute of Imaging and Computer Vision, RWTH Aachen University, Aachen, Germany b Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany c Department of Nephrology and Immunology, RWTH Aachen University Hospital, Aachen, Germany d Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany e Corresponding author: nbouteldja@ukaachen.de, University Hospital Aachen, Pauwelsstr. 16, 52074 Aachen, Germany

[1]  Michael Gadermayr,et al.  Unsupervisedly Training GANs for Segmenting Digital Pathology with Automatically Generated Annotations , 2018, MIDL.

[2]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[3]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[4]  Catherine P. Jayapandian,et al.  Development and evaluation of deep learning–based segmentation of histologic structures in the kidney cortex with multiple histologic stains , 2020, Kidney international.

[5]  A. Ozcan,et al.  Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning , 2018, Nature Biomedical Engineering.

[6]  Michael Gadermayr,et al.  Which Way Round? A Study on the Performance of Stain-Translation for Segmenting Arbitrarily Dyed Histological Images , 2018, MICCAI.

[7]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[8]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Michael Gadermayr,et al.  Generative Adversarial Networks in Digital Pathology: A Survey on Trends and Future Potential , 2020, Patterns.

[10]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[11]  Nassir Navab,et al.  Staingan: Stain Style Transfer for Digital Histological Images , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[12]  Pegah Salehi,et al.  Pix2Pix-based Stain-to-Stain Translation: A Solution for Robust Stain Normalization in Histopathology Images Analysis , 2020, 2020 International Conference on Machine Vision and Image Processing (MVIP).

[13]  Geoffrey F. Schau,et al.  SHIFT: speedy histological-to-immunofluorescent translation of a tumor signature enabled by deep learning , 2020, Scientific Reports.

[14]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[15]  Michael Gadermayr,et al.  Stain independent segmentation of whole slide images: A case study in renal histology , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[16]  Geert J. S. Litjens,et al.  Stain-Transforming Cycle-Consistent Generative Adversarial Networks for Improved Segmentation of Renal Histopathology , 2018, MIDL.

[17]  Kate Saenko,et al.  Adversarial Self-Defense for Cycle-Consistent GANs , 2019, NeurIPS.

[18]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[19]  Dorit Merhof,et al.  Supervised and Unsupervised Cell-Nuclei Detection in Immunohistology , 2019 .

[20]  Liyuan Liu,et al.  On the Variance of the Adaptive Learning Rate and Beyond , 2019, ICLR.

[21]  Nitin Singhal,et al.  Histopathological Stain Transfer Using Style Transfer Network with Adversarial Loss , 2020, MICCAI.

[22]  Hyunseok Min,et al.  Neural Stain-Style Transfer Learning using GAN for Histopathological Images , 2017, ArXiv.

[23]  Minjae Kim,et al.  U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation , 2019, ICLR.

[24]  Qianni Zhang,et al.  GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis , 2019, ArXiv.

[25]  Chia-Feng Juang,et al.  Cycle-consistent GAN-based stain translation of renal pathology images with glomerulus detection application , 2020, Appl. Soft Comput..

[26]  Peter Bankhead,et al.  Deep Learning-Based Segmentation and Quantification in Experimental Kidney Histopathology. , 2020, Journal of the American Society of Nephrology : JASN.

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Bart Smeets,et al.  Deep Learning-Based Histopathologic Assessment of Kidney Tissue. , 2019, Journal of the American Society of Nephrology : JASN.

[29]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Richard J. Chen,et al.  Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images , 2018, IEEE Transactions on Medical Imaging.

[31]  Ghassan Hamarneh,et al.  Adversarial Stain Transfer for Histopathology Image Analysis , 2018, IEEE Transactions on Medical Imaging.

[32]  Michael Gadermayr,et al.  Generative Adversarial Networks for Facilitating Stain-Independent Supervised and Unsupervised Segmentation: A Study on Kidney Histology , 2019, IEEE Transactions on Medical Imaging.