HER2 challenge contest: a detailed assessment of automated HER2 scoring algorithms in whole slide images of breast cancer tissues

Evaluating expression of the human epidermal growth factor receptor 2 (HER2) by visual examination of immunohistochemistry (IHC) on invasive breast cancer (BCa) is a key part of the diagnostic assessment of BCa due to its recognized importance as a predictive and prognostic marker in clinical practice. However, visual scoring of HER2 is subjective, and consequently prone to interobserver variability. Given the prognostic and therapeutic implications of HER2 scoring, a more objective method is required. In this paper, we report on a recent automated HER2 scoring contest, held in conjunction with the annual PathSoc meeting held in Nottingham in June 2016, aimed at systematically comparing and advancing the state‐of‐the‐art artificial intelligence (AI)‐based automated methods for HER2 scoring.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Uvais Qidwai,et al.  A novel system for scoring of hormone receptors in breast cancer histopathology slides , 2014, 2nd Middle East Conference on Biomedical Engineering.

[3]  Richard Chen,et al.  Identifying Metastases in Sentinel Lymph Nodes with Deep Convolutional Neural Networks , 2016, ArXiv.

[4]  David B. A. Epstein,et al.  Persistent Homology for Fast Tumor Segmentation in Whole Slide Histology Images , 2016, MIUA.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[7]  Marius Ilie,et al.  Assessment of the PD-L1 status by immunohistochemistry: challenges and perspectives for therapeutic strategies in lung cancer patients , 2016, Virchows Archiv.

[8]  E Provenzano,et al.  Astronomical algorithms for automated analysis of tissue protein expression in breast cancer , 2013, British Journal of Cancer.

[9]  Ravi Salgia,et al.  Molecular pathways and therapeutic targets in lung cancer , 2014, Oncotarget.

[10]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Cynthia Cohen,et al.  Whole Slide Imaging for Analytical Anatomic Pathology and Telepathology: Practical Applications Today, Promises, and Perils. , 2017, Archives of pathology & laboratory medicine.

[12]  Yukako Yagi,et al.  Stromal Filters in Automated Immunostain Scoring , 2014, Analytical Cellular Pathology (Amsterdam).

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Yang Gao,et al.  Compact Bilinear Pooling , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jorma Isola,et al.  ImmunoMembrane: a publicly available web application for digital image analysis of HER2 immunohistochemistry , 2012, Histopathology.

[16]  Ben Vainer,et al.  Optimizing HER2 assessment in breast cancer: application of automated image analysis , 2015, Breast Cancer Research and Treatment.

[17]  Manohar Kuse,et al.  Local isotropic phase symmetry measure for detection of beta cells and lymphocytes , 2011, Journal of pathology informatics.

[18]  Kingshuk Roy Choudhury,et al.  A Robust Automated Measure of Average Antibody Staining in Immunohistochemistry Images , 2010, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[19]  Stefan M Willems,et al.  The estimation of tumor cell percentage for molecular testing by pathologists is not accurate , 2014, Modern Pathology.

[20]  Po-Whei Huang,et al.  Automatic Classification for Pathological Prostate Images Based on Fractal Analysis , 2009, IEEE Transactions on Medical Imaging.

[21]  Shazia Akbar,et al.  Comparing computer-generated and pathologist-generated tumour segmentations for immunohistochemical scoring of breast tissue microarrays , 2015, British Journal of Cancer.

[22]  M. Salto‐Tellez,et al.  Digital pathology and image analysis in tissue biomarker research. , 2014, Methods.

[23]  Antonio C. Wolff,et al.  In reply [3] , 2007 .

[24]  Marios A. Gavrielides,et al.  Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers , 2014, Analytical cellular pathology.

[25]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[26]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[27]  Fang Yang,et al.  New breast cancer prognostic factors identified by computer-aided image analysis of HE stained histopathology images , 2015, Scientific Reports.

[28]  A. Jemal,et al.  Breast Cancer Statistics , 2013 .

[29]  C C Reyes-Aldasoro,et al.  An automatic segmentation algorithm for the morphological analysis of microvessels in immunostained histological tumour sections , 2011 .

[30]  Ian O Ellis,et al.  Review of the national external quality assessment (EQA) scheme for breast pathology in the UK , 2016, Journal of Clinical Pathology.

[31]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[32]  J. D. Webster,et al.  Whole-Slide Imaging and Automated Image Analysis , 2014, Veterinary pathology.

[33]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  David L Rimm,et al.  A prospective, multi-institutional diagnostic trial to determine pathologist accuracy in estimation of percentage of malignant cells. , 2013, Archives of pathology & laboratory medicine.

[37]  Søren Nielsen,et al.  Digital image analysis of membrane connectivity is a robust measure of HER2 immunostains , 2012, Breast Cancer Research and Treatment.

[38]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  John M S Bartlett,et al.  Updated UK Recommendations for HER2 assessment in breast cancer , 2014, Journal of Clinical Pathology.

[40]  Padraig Cunningham,et al.  Ensemble based system for whole-slide prostate cancer probability mapping using color texture features , 2011, Comput. Medical Imaging Graph..

[41]  Clive R Taylor,et al.  Predictive Biomarkers and Companion Diagnostics. The Future of Immunohistochemistry: “In Situ Proteomics,” or Just a “Stain”? , 2014, Applied immunohistochemistry & molecular morphology : AIMM.

[42]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[43]  Tomoyuki Kato,et al.  Cytometrical image analysis for immunohistochemical hormone receptor status in breast carcinomas , 2003, Pathology international.