Rise of the Machines: Advances in Deep Learning for Cancer Diagnosis.

Deep learning refers to a set of computer models that have recently been used to make unprecedented progress in the way computers extract information from images. These algorithms have been applied to tasks in numerous medical specialties, most extensively radiology and pathology, and in some cases have attained performance comparable to human experts. Furthermore, it is possible that deep learning could be used to extract data from medical images that would not be apparent by human analysis and could be used to inform on molecular status, prognosis, or treatment sensitivity. In this review, we outline the current developments and state-of-the-art in applying deep learning for cancer diagnosis, and discuss the challenges in adapting the technology for widespread clinical deployment.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Reports of the Death of the Microscope Have Been Greatly Exaggerated. , 2016, Archives of pathology & laboratory medicine.

[3]  Bernard Têtu,et al.  Canadian licensure for the use of digital pathology for routine diagnoses: one more step toward a new era of pathology practice without borders. , 2014, Archives of pathology & laboratory medicine.

[4]  A. Gazdar,et al.  Comprehensive analysis of lung cancer pathology images to discover tumor shape and boundary features that predict survival outcome , 2018, Scientific Reports.

[5]  Andrew Zisserman,et al.  ISSLS PRIZE IN BIOENGINEERING SCIENCE 2017: Automation of reading of radiological features from magnetic resonance images (MRIs) of the lumbar spine without human intervention is comparable with an expert radiologist , 2017, European Spine Journal.

[6]  Jesper Molin,et al.  Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: Digital pathology experiences 2006-2013 , 2014, Journal of pathology informatics.

[7]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[8]  Xiangqian Guo,et al.  The Application of Deep Learning in Cancer Prognosis Prediction , 2020, Cancers.

[9]  Jirí Sedlár,et al.  Predicting Deletion of Chromosomal Arms 1p/19q in Low-Grade Gliomas from MR Images Using Machine Intelligence , 2017, Journal of Digital Imaging.

[10]  Richard S. Savage,et al.  Predicting chemoinsensitivity in breast cancer with ’omics/digital pathology data fusion , 2016, Royal Society Open Science.

[11]  Geoffrey D Rubin,et al.  Computed tomography: revolutionizing the practice of medicine for 40 years. , 2014, Radiology.

[12]  Ce Zhang,et al.  Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features , 2016, Nature Communications.

[13]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[14]  Mitko Veta,et al.  Going fully digital: Perspective of a Dutch academic pathology lab , 2013, Journal of pathology informatics.

[15]  Pablo R Ros,et al.  Integrated Diagnostics: The Computational Revolution Catalyzing Cross-disciplinary Practices in Radiology, Pathology, and Genomics. , 2017, Radiology.

[16]  E. Topol,et al.  Adapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists. , 2016, JAMA.

[17]  William D. Dunn,et al.  MR imaging predictors of molecular profile and survival: multi-institutional study of the TCGA glioblastoma data set. , 2013, Radiology.

[18]  G. Paré,et al.  The Eastern Québec Telepathology Network: a three-year experience of clinical diagnostic services , 2014, Diagnostic Pathology.

[19]  Qianjin Feng,et al.  Pattern Classification for Gastrointestinal Stromal Tumors by Integration of Radiomics and Deep Convolutional Features , 2019, IEEE Journal of Biomedical and Health Informatics.

[20]  J. Leung,et al.  Artificial intelligence and deep learning - Radiology's next frontier? , 2018, Clinical imaging.

[21]  Laurent Martin,et al.  Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning , 2020, npj Digital Medicine.

[22]  George E. Dahl,et al.  Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists. , 2018, Archives of pathology & laboratory medicine.

[23]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[24]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[25]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[26]  A. Razavian,et al.  Artificial intelligence for analyzing orthopedic trauma radiographs , 2017, Acta orthopaedica.

[27]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[28]  C. Lehman,et al.  Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection. , 2015, JAMA internal medicine.

[29]  Scott R. Granter,et al.  AlphaGo, Deep Learning, and the Future of the Human Microscopist. , 2017, Archives of pathology & laboratory medicine.

[30]  Kevin Waugh,et al.  DeepStack: Expert-level artificial intelligence in heads-up no-limit poker , 2017, Science.

[31]  Maciej A Mazurowski,et al.  Radiogenomic analysis of breast cancer: luminal B molecular subtype is associated with enhancement dynamics at MR imaging. , 2014, Radiology.

[32]  James Diamond,et al.  The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. , 2004, Human pathology.

[33]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[34]  Puay Hoon Tan,et al.  Enabling digital pathology in the diagnostic setting: navigating through the implementation journey in an academic medical centre , 2016, Journal of Clinical Pathology.

[35]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[36]  H. Hricak,et al.  Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. , 2013, Radiology.

[37]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[38]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[39]  Tae-Young Heo,et al.  Development of a Deep-Learning-Based Artificial Intelligence Tool for Differential Diagnosis between Dry and Neovascular Age-Related Macular Degeneration , 2020, Diagnostics.

[40]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[41]  Charlene Liew The future of radiology augmented with Artificial Intelligence: A strategy for success. , 2018, European journal of radiology.

[42]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[43]  F. Sardanelli,et al.  Artificial intelligence as a medical device in radiology: ethical and regulatory issues in Europe and the United States , 2018, Insights into Imaging.

[44]  Michael A. Bruno,et al.  Understanding and Confronting Our Mistakes: The Epidemiology of Error in Radiology and Strategies for Error Reduction. , 2015, Radiographics : a review publication of the Radiological Society of North America, Inc.

[45]  Liron Pantanowitz,et al.  Regulatory barriers surrounding the use of whole slide imaging in the United States of America , 2014, Journal of pathology informatics.

[46]  J. Irwin,et al.  Identifying mechanism-of-action targets for drugs and probes , 2012, Proceedings of the National Academy of Sciences.

[47]  Andrew J. Schaumberg,et al.  DeepScope: Nonintrusive Whole Slide Saliency Annotation and Prediction from Pathologists at the Microscope , 2016, bioRxiv.

[48]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.

[49]  Anant Madabhushi,et al.  Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent , 2017, Scientific Reports.

[50]  Bradley J. Erickson,et al.  Toolkits and Libraries for Deep Learning , 2017, Journal of Digital Imaging.

[51]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[52]  Martial Guillaud,et al.  DNA ploidy compared with human papilloma virus testing (Hybrid Capture II) and conventional cervical cytology as a primary screening test for cervical high‐grade lesions and cancer in 1555 patients with biopsy confirmation , 2006, Cancer.

[53]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[54]  Marcus A. Badgeley,et al.  Automated deep-neural-network surveillance of cranial images for acute neurologic events , 2018, Nature Medicine.

[55]  Nico Karssemeijer,et al.  Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies , 2018, Modern Pathology.

[56]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[57]  Haipeng Shen,et al.  Artificial intelligence in healthcare: past, present and future , 2017, Stroke and Vascular Neurology.

[58]  Steffen Löck,et al.  A comparative study of machine learning methods for time-to-event survival data for radiomics risk modelling , 2017, Scientific Reports.

[59]  Bibb Allen The Role of the FDA in Ensuring the Safety and Efficacy of Artificial Intelligence Software and Devices. , 2019, Journal of the American College of Radiology : JACR.

[60]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[61]  David F. Steiner,et al.  Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer , 2018, The American journal of surgical pathology.

[62]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[63]  Bradley J. Erickson,et al.  Residual Deep Convolutional Neural Network Predicts MGMT Methylation Status , 2017, Journal of Digital Imaging.

[64]  Tao Liu,et al.  Searching for prostate cancer by fully automated magnetic resonance imaging classification: deep learning versus non-deep learning , 2017, Scientific Reports.

[65]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[66]  Nassir Navab,et al.  AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[67]  Darren Treanor,et al.  Future-proofing pathology: the case for clinical adoption of digital pathology , 2017, Journal of Clinical Pathology.

[68]  Tomoharu Kiyuna,et al.  Automated histological classification of whole-slide images of gastric biopsy specimens , 2018, Gastric Cancer.

[69]  Kumardeep Chaudhary,et al.  Deep Learning–Based Multi-Omics Integration Robustly Predicts Survival in Liver Cancer , 2017, Clinical Cancer Research.

[70]  Issam El Naqa,et al.  Introduction to machine and deep learning for medical physicists. , 2020, Medical physics.

[71]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[72]  C Briggs,et al.  Can automated blood film analysis replace the manual differential? An evaluation of the CellaVision DM96 automated image analysis system , 2009, International journal of laboratory hematology.

[73]  Jon Griffin,et al.  Digital pathology in clinical use: where are we now and what is holding us back? , 2017, Histopathology.

[74]  M. Vidne,et al.  A Novel System for Functional Determination of Variants of Uncertain Significance using Deep Convolutional Neural Networks , 2020, Scientific Reports.

[75]  Shaoqun Zeng,et al.  From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge , 2019, IEEE Transactions on Medical Imaging.

[76]  Alexis B. Carter,et al.  Artificial Intelligence and the Pathologist: Future Frenemies? , 2017, Archives of pathology & laboratory medicine.

[77]  D. Brat,et al.  Predicting cancer outcomes from histology and genomics using convolutional networks , 2017, Proceedings of the National Academy of Sciences.

[78]  Andrew J. Schaumberg,et al.  D R A F T H&E-stained Whole Slide Image Deep Learning Predicts SPOP Mutation State in Prostate Cancer , 2017 .