Virtual Staining for Mitosis Detection in Breast Histopathology

We propose a virtual staining methodology based on Generative Adversarial Networks to map histopathology images of breast cancer tissue from H&E stain to PHH3 and vice versa. We use the resulting synthetic images to build Convolutional Neural Networks (CNN) for automatic detection of mitotic figures, a strong prognostic biomarker used in routine breast cancer diagnosis and grading. We propose several scenarios, in which CNN trained with synthetically generated histopathology images perform on par with or even better than the same baseline model trained with real images. We discuss the potential of this application to scale the number of training samples without the need for manual annotations.

[1]  Mitko Veta,et al.  Mitosis Counting in Breast Cancer: Object-Level Interobserver Agreement and Comparison to an Automatic Method , 2016, PloS one.

[2]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[4]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[5]  K. Hebeda,et al.  Sequential immunohistochemistry: a promising new tool for the pathology laboratory , 2014, Histopathology.

[6]  Jan P. A. Baak,et al.  Validating the prognostic value of proliferation measured by Phosphohistone H3 (PPH3) in invasive lymph node-negative breast cancer patients less than 71 years of age , 2009, Breast Cancer Research and Treatment.

[7]  Nassir Navab,et al.  GANs for Medical Image Analysis , 2018, Artif. Intell. Medicine.

[8]  Qianni Zhang,et al.  GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis , 2019, ArXiv.

[9]  P. V. van Diest,et al.  Performance of 4 Immunohistochemical Phosphohistone H3 Antibodies for Marking Mitotic Figures in Breast Cancer , 2016, Applied immunohistochemistry & molecular morphology : AIMM.

[10]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[11]  Peter H. N. de With,et al.  Stain normalization of histopathology images using generative adversarial networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[12]  David Dagan Feng,et al.  Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs) , 2017, CMMI/RAMBO/SWITCH@MICCAI.

[13]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[14]  Teresa Ribalta,et al.  The Mitosis-Specific Antibody Anti-Phosphohistone-H3 (PHH3) Facilitates Rapid Reliable Grading of Meningiomas According to WHO 2000 Criteria , 2004, The American journal of surgical pathology.

[15]  Geert J. S. Litjens,et al.  Unsupervised Prostate Cancer Detection on H&E using Convolutional Adversarial Autoencoders , 2018, ArXiv.

[16]  Ghassan Hamarneh,et al.  Adversarial Stain Transfer for Histopathology Image Analysis , 2018, IEEE Transactions on Medical Imaging.

[17]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.