Detection of malignancy in whole slide images of endometrial cancer biopsies using artificial intelligence

In this study we use artificial intelligence (AI) to categorise endometrial biopsy whole slide images (WSI) from digital pathology as either “malignant”, “other or benign” or “insufficient”. An endometrial biopsy is a key step in diagnosis of endometrial cancer, biopsies are viewed and diagnosed by pathologists. Pathology is increasingly digitised, with slides viewed as images on screens rather than through the lens of a microscope. The availability of these images is driving automation via the application of AI. A model that classifies slides in the manner proposed would allow prioritisation of these slides for pathologist review and hence reduce time to diagnosis for patients with cancer. Previous studies using AI on endometrial biopsies have examined slightly different tasks, for example using images alongside genomic data to differentiate between cancer subtypes. We took 2909 slides with “malignant” and “other or benign” areas annotated by pathologists. A fully supervised convolutional neural network (CNN) model was trained to calculate the probability of a patch from the slide being “malignant” or “other or benign”. Heatmaps of all the patches on each slide were then produced to show malignant areas. These heatmaps were used to train a slide classification model to give the final slide categorisation as either “malignant”, “other or benign” or “insufficient”. The final model was able to accurately classify 90% of all slides correctly and 97% of slides in the malignant class; this accuracy is good enough to allow prioritisation of pathologists’ workload.

[1]  Chen Wang,et al.  Clinical-grade endometrial cancer detection system via whole-slide images using deep learning , 2022, Frontiers in Oncology.

[2]  Sung Hak Lee,et al.  Deep Learning-Based Classification of Uterine Cervical and Endometrial Cancer Subtypes from Whole-Slide Histopathology Images , 2022, Diagnostics.

[3]  P. Konanahalli,et al.  Weakly supervised learning and interpretability for endometrial whole slide image diagnosis , 2022, Experimental biology and medicine.

[4]  Xiaowei He,et al.  Diagnosis of endometrium hyperplasia and screening of endometrial intraepithelial neoplasia in histopathological images using a global-to-local multi-scale convolutional neural network , 2022, Comput. Methods Programs Biomed..

[5]  Kazunori Hashimoto,et al.  Artificial intelligence in gynecologic cancers: Current status and future challenges - A systematic review , 2021, Artif. Intell. Medicine.

[6]  Leo Grady,et al.  Novel artificial intelligence system increases the detection of prostate cancer in whole slide images of core needle biopsies , 2020, Modern Pathology.

[7]  Jianhua Yao,et al.  Microsatellite Instability Prediction of Uterine Corpus Endometrial Carcinoma Based on H&E Histology Whole-Slide Imaging , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[8]  N. Razavian,et al.  Predicting endometrial cancer subtypes and molecular features from histopathology images using multi-resolution deep learning models , 2020, bioRxiv.

[9]  Tao Xu,et al.  Computer-Aided Diagnosis in Histopathological Images of the Endometrium Using a Convolutional Neural Network and Attention Mechanisms , 2019, IEEE Journal of Biomedical and Health Informatics.

[10]  Shaoqun Zeng,et al.  From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge , 2019, IEEE Transactions on Medical Imaging.

[11]  Meyke Hermsen,et al.  1399 H&E-stained sentinel lymph node sections of breast cancer patients: the CAMELYON dataset , 2018, GigaScience.

[12]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[13]  G. Makris,et al.  Image analysis and multi‐layer perceptron artificial neural networks for the discrimination between benign and malignant endometrial lesions , 2017, Diagnostic cytopathology.

[14]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[15]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[16]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[19]  Kevin A Hallgren,et al.  Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. , 2012, Tutorials in quantitative methods for psychology.

[20]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[21]  H. Mackay,et al.  Interpretable Deep Learning Predicts the Molecular Endometrial Cancer Classification from H&E Images: A Combined Analysis of the Portec Randomized Clinical Trials , 2022, SSRN Electronic Journal.