Optimized generation of high-resolution phantom images using cGAN: Application to quantification of Ki67 breast cancer images

In pathology, Immunohistochemical staining (IHC) of tissue sections is regularly used to diagnose and grade malignant tumors. Typically, IHC stain interpretation is rendered by a trained pathologist using a manual method, which consists of counting each positively- and negatively-stained cell under a microscope. The manual enumeration suffers from poor reproducibility even in the hands of expert pathologists. To facilitate this process, we propose a novel method to create artificial datasets with the known ground truth which allows us to analyze the recall, precision, accuracy, and intra- and inter-observer variability in a systematic manner, enabling us to compare different computer analysis approaches. Our method employs a conditional Generative Adversarial Network that uses a database of Ki67 stained tissues of breast cancer patients to generate synthetic digital slides. Our experiments show that synthetic images are indistinguishable from real images. Six readers (three pathologists and three image analysts) tried to differentiate 15 real from 15 synthetic images and the probability that the average reader would be able to correctly classify an image as synthetic or real more than 50% of the time was only 44.7%.

[1]  Lotte Steuten,et al.  Development of a web-based tool for the assessment of health and economic outcomes of the European Innovation Partnership on Active and Healthy Ageing (EIP on AHA) , 2015, BMC Medical Informatics and Decision Making.

[2]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[3]  Michael Goodman,et al.  Calculation of the Ki67 index in pancreatic neuroendocrine tumors: a comparative analysis of four counting methodologies , 2016, Modern Pathology.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Enrico Macii,et al.  Automated segmentation of tissue images for computerized IHC analysis , 2022 .

[6]  Abhinav Gupta,et al.  Generative Image Modeling Using Style and Structure Adversarial Networks , 2016, ECCV.

[7]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[8]  Berkman Sahiner,et al.  Classification of follicular lymphoma: the effect of computer aid on pathologists grading , 2015, BMC Medical Informatics and Decision Making.

[9]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[10]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[11]  Daniel Racoceanu,et al.  A model of tumor architecture and spatial interactions with tumor microenvironment in breast carcinoma , 2017, Medical Imaging.

[12]  M. Khalid Khan,et al.  Hot spot detection for breast cancer in Ki-67 stained slides: image dependent filtering approach , 2014, Medical Imaging.

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Michael Goodman,et al.  Calculation of the Ki67 index in pancreatic neuroendocrine tumors: a comparative analysis of four counting methodologies , 2015, Modern Pathology.

[15]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  M. Khalid Khan,et al.  Entropy based quantification of Ki-67 positive cell images and its evaluation by a reader study , 2013, Medical Imaging.

[19]  Berkman Sahiner,et al.  Nuclear IHC enumeration: A digital phantom to evaluate the performance of automated algorithms in digital pathology , 2018, PloS one.

[20]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[21]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[22]  D. Zaha,et al.  Significance of immunohistochemistry in breast cancer. , 2014, World journal of clinical oncology.

[23]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[24]  Vilppu J Tuominen,et al.  ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67 , 2010, Breast Cancer Research.

[25]  R M Levenson,et al.  Quantification of immunohistochemistry—issues concerning methods, utility and semiquantitative assessment II , 2006, Histopathology.