Software‐assisted decision support in digital histopathology

Tissue diagnostics is the world of pathologists, and it is increasingly becoming digitalised to leverage the enormous potential of personalised medicine and of stratifying patients, enabling the administration of modern therapies. Therefore, the daily task for pathologists is changing drastically and will become increasingly demanding in order to take advantage of the development of modern computer technologies. The role of pathologist has rapidly evolved from exclusively describing the morphology and phenomenology of a disease, to becoming a gatekeeper for novel and most effective treatment options. This is possible based on the retrieval and management of a wide range of complex information from tissue or a group of cells and associated meta‐data. Intelligent and self‐learning software solutions can support and guide pathologists to score clinically relevant decisions based on the accurate and robust quantification of multiple target molecules or surrogate biomarker as companion or complimentary diagnostics along with relevant spatial relationships and contextual information from digital H&E and multiplexed images. With the availability of multiplex staining techniques on a single slide, high‐resolution image analysis tools, and high‐end computer hardware, machine and deep learning solutions now offer diagnostic rulesets and algorithms that still require clinical validation in well‐designed studies. Before entering the clinical practice, the ‘human factor’ pathologist needs to develop trust in the output coming from the ‘digital black box of computational pathology’, including image analysis solutions and artificial intelligence algorithms to support critical clinical decisions which otherwise would not be available. © 2020 Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

[1]  David J. Harrison,et al.  Digital Pathology: Path into the Future , 2018 .

[2]  Z. Trajanoski,et al.  Integrative Analyses of Colorectal Cancer Show Immunoscore Is a Stronger Predictor of Patient Survival Than Microsatellite Instability. , 2016, Immunity.

[3]  P. Tan,et al.  New insights into the inflamed tumor immune microenvironment of gastric cancer with lymphoid stroma: from morphology and digital analysis to gene expression , 2018, Gastric Cancer.

[4]  Nicolas Brieu,et al.  Deep Semi Supervised Generative Learning for Automated Tumor Proportion Scoring on NSCLC Tissue Needle Biopsies , 2018, Scientific Reports.

[5]  Wenyu Liu,et al.  DeepMitosis: Mitosis detection via deep detection, verification and segmentation networks , 2018, Medical Image Anal..

[6]  B. Vainer,et al.  Application of automated image analysis reduces the workload of manual screening of sentinel lymph node biopsies in breast cancer , 2017, Histopathology.

[7]  Mogens Vyberg,et al.  Virtual Double Staining: A Digital Approach to Immunohistochemical Quantification of Estrogen Receptor Protein in Breast Carcinoma Specimens , 2017, Applied immunohistochemistry & molecular morphology : AIMM.

[8]  H. Moch,et al.  Specific immune cell and lymphatic vessel signatures identified by image analysis in renal cancer , 2019, Modern Pathology.

[9]  Ellery Wulczyn,et al.  Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer , 2018, npj Digital Medicine.

[10]  G. Kayser,et al.  How to implement digital pathology in tissue-based diagnosis (surgical pathology)? , 2015 .

[11]  Arno Schäpe,et al.  Image-Based Data Mining , 2018 .

[12]  Joshua E. Lewis,et al.  Predicting clinical outcomes from large scale cancer genomic profiles with deep survival models , 2017, Scientific Reports.

[13]  Septimiu E. Salcudean,et al.  A new era: artificial intelligence and machine learning in prostate cancer , 2019, Nature Reviews Urology.

[14]  J. Barrett,et al.  The Immunoscore: Colon Cancer and Beyond , 2019, Clinical Cancer Research.

[15]  Timo Kohlberger,et al.  Microscope 2.0: An Augmented Reality Microscope with Real-time Artificial Intelligence Integration , 2018, ArXiv.

[16]  K. Steele,et al.  Automated image analysis of NSCLC biopsies to predict response to anti-PD-L1 therapy , 2019, Journal of Immunotherapy for Cancer.

[17]  Navid Farahani,et al.  Overview of Telepathology. , 2016, Clinics in laboratory medicine.

[18]  Helen Pitman,et al.  Artificial intelligence in digital pathology: a roadmap to routine use in clinical practice , 2019, The Journal of pathology.

[19]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[20]  S. Al-Janabi,et al.  Validity of whole slide images for scoring HER2 chromogenic in situ hybridisation in breast cancer , 2016, Journal of Clinical Pathology.

[21]  George E. Dahl,et al.  Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists. , 2018, Archives of pathology & laboratory medicine.

[22]  Beate Sick,et al.  Single-Cell Phenotype Classification Using Deep Convolutional Neural Networks , 2016, Journal of biomolecular screening.

[23]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[24]  Xiaowei Wang,et al.  Scalable multi-sample single-cell data analysis by Partition-Assisted Clustering and Multiple Alignments of Networks , 2017, bioRxiv.

[25]  Olaf Hellwich,et al.  Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology , 2017, Comput. Medical Imaging Graph..

[26]  M. Athelogou,et al.  Tissue Phenomics For Diagnostic Pathology , 2018 .

[27]  Nathalie Harder,et al.  Tissue Phenomics for prognostic biomarker discovery in low- and intermediate-risk prostate cancer , 2018, Scientific Reports.

[28]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[29]  André Huisman,et al.  Pathology Image Exchange: The Dutch Digital Pathology Platform for Exchange of Whole-Slide Images for Efficient Teleconsultation, Telerevision, and Virtual Expert Panels , 2019, JCO clinical cancer informatics.

[30]  Linda G. Shapiro,et al.  Assessment of Machine Learning of Breast Pathology Structures for Automated Differentiation of Breast Cancer and High-Risk Proliferative Lesions , 2019, JAMA network open.

[31]  Andrew H. Beck,et al.  Computational pathology definitions, best practices, and recommendations for regulatory guidance: a white paper from the Digital Pathology Association , 2019, The Journal of pathology.

[32]  Jakob Nikolas Kather,et al.  Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer , 2019, Nature Medicine.

[33]  Ben Vainer,et al.  Optimizing HER2 assessment in breast cancer: application of automated image analysis , 2015, Breast Cancer Research and Treatment.

[34]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[35]  Timo Kohlberger,et al.  An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis , 2019, Nature Medicine.

[36]  Gerald Li,et al.  Integrated tumor identification and automated scoring minimizes pathologist involvement and provides new insights to key biomarkers in breast cancer , 2018, Laboratory Investigation.

[37]  Nathalie Harder,et al.  Machine Learning: A Data-Driven Approach to Image Analysis , 2018 .

[38]  M. Tiemann,et al.  Harmonized PD-L1 immunohistochemistry for pulmonary squamous-cell and adenocarcinomas , 2016, Modern Pathology.

[39]  R. Korn,et al.  Image Analysis for Tissue Phenomics , 2018 .

[40]  Andrew H. Beck,et al.  Systematic Analysis of Breast Cancer Morphology Uncovers Stromal Features Associated with Survival , 2011, Science Translational Medicine.

[41]  Daisuke Komura,et al.  Machine learning approaches for pathologic diagnosis , 2019, Virchows Archiv.

[42]  Nicholas E Thomford,et al.  Integrating Artificial and Human Intelligence: A Partnership for Responsible Innovation in Biomedical Engineering and Medicine. , 2020, Omics : a journal of integrative biology.