Expectations of Artificial Intelligence for Pathology

Within the last ten years, essential steps have been made to bring artificial intelligence (AI) successfully into the field of pathology. However, most pathologists are still far away from using AI in daily pathology practice. If one leaves the pathology annihilation model, this paper focuses on tasks, which could be solved, and which could be done better by AI, or image-based algorithms, compared to a human expert. In particular, this paper focuses on the needs and demands of surgical pathologists; examples include: Finding small tumour deposits within lymph nodes, detection and grading of cancer, quantification of positive tumour cells in immunohistochemistry, pre-check of Papanicolaou-stained gynaecological cytology in cervical cancer screening, text feature extraction, text interpretation for tumour-coding error prevention and AI in the next-generation virtual autopsy. However, in order to make substantial progress in both fields it is important to intensify the cooperation between medical AI experts and pathologists.

[1]  Elizabeth A. Krupinski,et al.  Pigeons (Columba livia) as Trainable Observers of Pathology and Radiology Breast Cancer Images , 2015, PloS one.

[2]  H. Lodish,et al.  Tumor Cells and the Onset of Cancer , 2000 .

[3]  Georges Dagher,et al.  Biobanks for life sciences and personalized medicine: importance of standardization, biosafety, biosecurity, and data management. , 2019, Current opinion in biotechnology.

[4]  B. van Ginneken,et al.  Automated deep-learning system for Gleason grading of prostate cancer using biopsies: a diagnostic study. , 2020, The Lancet. Oncology.

[5]  M. Gurcan,et al.  Digital pathology and artificial intelligence. , 2019, The Lancet. Oncology.

[6]  Bram van Ginneken,et al.  Automated Gleason Grading of Prostate Biopsies using Deep Learning , 2019, ArXiv.

[7]  Christos Sotiriou,et al.  The 2019 World Health Organization classification of tumours of the breast , 2020, Histopathology.

[8]  M. Salto‐Tellez,et al.  Artificial intelligence—the third revolution in pathology , 2019, Histopathology.

[9]  K. Cengel,et al.  Effectiveness of the SurePath liquid‐based Pap test in automated screening and in detection of HSIL , 2003, Diagnostic cytopathology.

[10]  Mahul B Amin,et al.  Contemporary Gleason Grading of Prostatic Carcinoma: An Update With Discussion on Practical Issues to Implement the 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma , 2017, The American journal of surgical pathology.

[11]  C. Tantibundhit,et al.  Automated Pap Smear Cervical Cancer Screening Using Deep Learning , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Wojciech Samek,et al.  Explainable ai – preface , 2019 .

[13]  Ning Yuan,et al.  Insights into Functionalization of Metal-Organic Frameworks Using In Situ NMR Spectroscopy , 2018, Scientific Reports.

[14]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[15]  Jorma Isola,et al.  Linking Whole-Slide Microscope Images with DICOM by Using JPEG2000 Interactive Protocol , 2009, Journal of Digital Imaging.

[16]  R V O'Toole,et al.  Automated screening for quality control using PAPNET: A study of 638 negative Pap smears , 1996, Diagnostic cytopathology.

[17]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[18]  Andreas Holzinger,et al.  Introduction to MAchine Learning & Knowledge Extraction (MAKE) , 2017, Mach. Learn. Knowl. Extr..

[19]  George E. Dahl,et al.  Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists. , 2018, Archives of pathology & laboratory medicine.

[20]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[21]  Scott R. Granter,et al.  AlphaGo, Deep Learning, and the Future of the Human Microscopist. , 2017, Archives of pathology & laboratory medicine.

[22]  Ellery Wulczyn,et al.  Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer , 2018, npj Digital Medicine.

[23]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[24]  Peter Hamilton,et al.  Machine learning classification of surgical pathology reports and chunk recognition for information extraction noise reduction , 2016, Artif. Intell. Medicine.

[25]  D. Cibula,et al.  Sentinel lymph node (SLN) concept in cervical cancer: Current limitations and unanswered questions. , 2019, Gynecologic oncology.

[26]  E. Arbustini,et al.  Management of the axilla in patients with breast cancer and positive sentinel lymph node biopsy: An evidence-based update in a European breast center. , 2019, European journal of surgical oncology : the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology.

[27]  Andreas Holzinger,et al.  NLP for the Generation of Training Data Sets for Ontology-Guided Weakly-Supervised Machine Learning in Digital Pathology , 2019, 2019 IEEE Symposium on Computers and Communications (ISCC).

[28]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[29]  Ron Kikinis,et al.  Implementing the DICOM Standard for Digital Pathology , 2018, Journal of pathology informatics.

[30]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[31]  Andreas Holzinger,et al.  From Machine Learning to Explainable AI , 2018, 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA).

[32]  A. Hałoń,et al.  Proliferation Index Evaluation in Breast Cancer Using ImageJ and ImmunoRatio Applications. , 2016, Anticancer research.

[33]  J. A. Ware,et al.  A review of image analysis and machine learning techniques for automated cervical cancer screening from pap-smear images , 2018, Comput. Methods Programs Biomed..

[34]  Shaoqun Zeng,et al.  From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge , 2019, IEEE Transactions on Medical Imaging.

[35]  Johannes Bernarding,et al.  Digital pathology: DICOM-conform draft, testbed, and first results , 2007, Comput. Methods Programs Biomed..

[36]  A Min Tjoa,et al.  Current Advances, Trends and Challenges of Machine Learning and Knowledge Extraction: From Machine Learning to Explainable AI , 2018, CD-MAKE.

[37]  Andreas Holzinger,et al.  Interactive machine learning for health informatics: when do we need the human-in-the-loop? , 2016, Brain Informatics.

[38]  B. Delahunt,et al.  The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma: Definition of Grading Patterns and Proposal for a New Grading System , 2015, The American journal of surgical pathology.

[39]  Andreas Holzinger,et al.  Usability engineering methods for software developers , 2005, CACM.

[40]  Andreas Holzinger,et al.  The European Legal Framework for Medical AI , 2020, CD-MAKE.

[41]  Andreas Holzinger,et al.  Machine Learning and Knowledge Extraction in Digital Pathology Needs an Integrative Approach , 2015, BIRS-IMLKE.

[42]  M. Duggan,et al.  Paired comparison of manual and automated pap test screening using the PAPNET system , 1997, Diagnostic cytopathology.

[43]  Andreas Holzinger,et al.  KANDINSKY Patterns as IQ-Test for Machine Learning , 2019, CD-MAKE.

[44]  Yingtao Jiang,et al.  A multilayer perceptron-based medical decision support system for heart disease diagnosis , 2006, Expert Syst. Appl..

[45]  Zheng Huang,et al.  Epithelium segmentation and automated Gleason grading of prostate cancer via deep learning in label‐free multiphoton microscopic images , 2019, Journal of biophotonics.

[46]  K. Zatloukal,et al.  Machine learning enhanced virtual autopsy , 2017, Autopsy & case reports.

[47]  Tae-Yeong Kwak,et al.  Artificial Intelligence in Pathology , 2018, Journal of pathology and translational medicine.

[48]  K. Zatloukal,et al.  Virtual autopsy: Machine Learning and AI provide new opportunities for investigating minimal tumor burden and therapy resistance by cancer patients , 2018, Autopsy & case reports.

[49]  Georg Langs,et al.  Causability and explainability of artificial intelligence in medicine , 2019, WIREs Data Mining Knowl. Discov..

[50]  Morris A. Swertz,et al.  State-of-the-Art and Future Challenges in the Integration of Biobank Catalogues , 2015, Smart Health.

[51]  A. Renshaw,et al.  American society of cytopathology workload recommendations for automated pap test screening: Developed by the productivity and quality assurance in the era of automated screening task force , 2013, Diagnostic cytopathology.

[52]  Regina Barzilay,et al.  Machine learning to parse breast pathology reports in Chinese , 2018, Breast Cancer Research and Treatment.

[53]  Yasuhiro Nakamura.  The Role and Necessity of Sentinel Lymph Node Biopsy for Invasive Melanoma , 2019, Front. Med..

[54]  Daniel Smilkov,et al.  Similar image search for histopathology: SMILY , 2019, npj Digital Medicine.

[55]  A W Smeulders,et al.  An analysis of pathology knowledge and decision making for the development of artificial intelligence-based consulting systems. , 1989, Analytical and quantitative cytology and histology.

[56]  I. Lazarou,et al.  US-Guided Biopsies: Overarching Principles , 2019, Front. Med..

[57]  Vilppu J Tuominen,et al.  ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67 , 2010, Breast Cancer Research.

[58]  T. Serre,et al.  Development of a Deep Learning Algorithm for the Histopathologic Diagnosis and Gleason Grading of Prostate Cancer Biopsies: A Pilot Study. , 2019, European urology focus.

[59]  Freddy Lécué,et al.  Explainable AI: The New 42? , 2018, CD-MAKE.

[60]  Andreas Holzinger,et al.  Towards a Deeper Understanding of How a Pathologist Makes a Diagnosis: Visualization of the Diagnostic Process in Histopathology , 2019, 2019 IEEE Symposium on Computers and Communications (ISCC).

[61]  Uthappa P. Poojitha,et al.  Hybrid Unified Deep Learning Network for Highly Precise Gleason Grading of Prostate Cancer , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[62]  Andreas Holzinger,et al.  Towards a Better Understanding of the Workflows: Modeling Pathology Processes in View of Future AI Integration , 2020, AI and ML for Digital Pathology.