Deep learning for detecting tumour-infiltrating lymphocytes in testicular germ cell tumours

Aims To evaluate if a deep learning algorithm can be trained to identify tumour-infiltrating lymphocytes (TILs) in tissue samples of testicular germ cell tumours and to assess whether the TIL counts correlate with relapse status of the patient. Methods TILs were manually annotated in 259 tumour regions from 28 whole-slide images (WSIs) of H&E-stained tissue samples. A deep learning algorithm was trained on half of the regions and tested on the other half. The algorithm was further applied to larger areas of tumour WSIs from 89 patients and correlated with clinicopathological data. Results A correlation coefficient of 0.89 was achieved when comparing the algorithm with the manual TIL count in the test set of images in which TILs were present (n=47). In the WSI regions from the 89 patient samples, the median TIL density was 1009/mm2. In seminomas, none of the relapsed patients belonged to the highest TIL density tertile (>2011/mm2). TIL quantifications performed visually by three pathologists on the same tumours were not significantly associated with outcome. The average interobserver agreement between the pathologists when assigning a patient into TIL tertiles was 0.32 (Kappa test) compared with 0.35 between the algorithm and the experts, respectively. A higher TIL density was associated with a lower clinical tumour stage, seminoma histology and lack of lymphovascular invasion. Conclusions Deep learning–based image analysis can be used for detecting TILs in testicular germ cell cancer more objectively and it has potential for use as a prognostic marker for disease relapse.

[1]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[2]  P. Babál,et al.  Prognostic role of programmed-death ligand 1 (PD-L1) expressing tumor infiltrating lymphocytes in testicular germ cell tumors , 2017, Oncotarget.

[3]  Anthony G Gallagher,et al.  Do we see what we think we see? The complexities of morphological assessment , 2009, The Journal of pathology.

[4]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[5]  J. Regadera,et al.  Quantification of immunocompetent cells in testicular germ cell tumours , 1997, Histopathology.

[6]  C. Verrill,et al.  Value of Supraregional Multidisciplinary Review for the Contemporary Management of Testicular Tumors , 2017, Clinical genitourinary cancer.

[7]  S Michiels,et al.  Tumor infiltrating lymphocytes are prognostic in triple negative breast cancer and predictive for trastuzumab benefit in early breast cancer: results from the FinHER trial. , 2014, Annals of oncology : official journal of the European Society for Medical Oncology.

[8]  T. Nielsen,et al.  The evaluation of tumor-infiltrating lymphocytes (TILs) in breast cancer: recommendations by an International TILs Working Group 2014. , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[9]  Dmitrii Bychkov,et al.  Deep learning based tissue analysis predicts outcome in colorectal cancer , 2018, Scientific Reports.

[10]  M. Walsh,et al.  An immunohistopathological characterisation of mixed non-seminomatous germ cell tumors , 2004, Urological Research.

[11]  F. Marincola,et al.  Cancer classification using the Immunoscore: a worldwide task force , 2012, Journal of Translational Medicine.

[12]  Andrew Feber,et al.  Human Papillomavirus Drives Tumor Development Throughout the Head and Neck: Improved Prognosis Is Associated With an Immune Response Largely Restricted to the Oropharynx. , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[14]  C. Verrill,et al.  Changing Practice Evaluation—Stage 1 Seminoma: Outcomes With Adjuvant Treatment Versus Surveillance: Risk Factors for Recurrence and Optimizing Follow‐up Protocols—Experience From a Supraregional Center , 2017, Clinical genitourinary cancer.

[15]  J. Becker,et al.  Tumor infiltrating lymphocytes in seminoma lesions comprise clonally expanded cytotoxic T cells , 2006, International journal of cancer.

[16]  C. Parker,et al.  The prognostic significance of the tumour infiltrating lymphocyte count in stage I testicular seminoma managed by surveillance. , 2002, European journal of cancer.

[17]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[18]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[19]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[20]  F. Marincola,et al.  Towards the introduction of the ‘Immunoscore’ in the classification of malignant tumours , 2013, The Journal of pathology.

[21]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.