Artificial Intelligence in Surgery: Promises and Perils

Objective: The aim of this review was to summarize major topics in artificial intelligence (AI), including their applications and limitations in surgery. This paper reviews the key capabilities of AI to help surgeons understand and critically evaluate new AI applications and to contribute to new developments. Summary Background Data: AI is composed of various subfields that each provide potential solutions to clinical problems. Each of the core subfields of AI reviewed in this piece has also been used in other industries such as the autonomous car, social networks, and deep learning computers. Methods: A review of AI papers across computer science, statistics, and medical sources was conducted to identify key concepts and techniques within AI that are driving innovation across industries, including surgery. Limitations and challenges of working with AI were also reviewed. Results: Four main subfields of AI were defined: (1) machine learning, (2) artificial neural networks, (3) natural language processing, and (4) computer vision. Their current and future applications to surgical practice were introduced, including big data analytics and clinical decision support systems. The implications of AI for surgeons and the role of surgeons in advancing the technology to optimize clinical effectiveness were discussed. Conclusions: Surgeons are well positioned to help integrate AI into modern practice. Surgeons should partner with data scientists to capture data across phases of care and to provide clinical context, for AI has the potential to revolutionize the way surgery is taught and practiced with the promise of a future optimized for the highest quality patient care.

[1]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[2]  Richard Ernest Bellman,et al.  An Introduction to Artificial Intelligence: Can Computers Think? , 1978 .

[3]  H. E. Pople,et al.  Internist-I, an Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .

[4]  E. Emanuel,et al.  Four models of the physician-patient relationship. , 1992, JAMA.

[5]  G. Ginsburg,et al.  The evaluation of chest pain in women. , 1996, The New England journal of medicine.

[6]  J. Avorn,et al.  Strategies for improving comorbidity measures based on Medicare and Medicaid claims data. , 2000, Journal of clinical epidemiology.

[7]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[8]  Michael Egmont-Petersen,et al.  Image processing with neural networks - a review , 2002, Pattern Recognit..

[9]  George Hripcsak,et al.  Automated encoding of clinical documents based on natural language processing. , 2004, Journal of the American Medical Informatics Association : JAMIA.

[10]  Harlan M Krumholz,et al.  Participation in cancer clinical trials: race-, sex-, and age-based disparities. , 2004, JAMA.

[11]  I. Sim,et al.  Physicians' use of electronic medical records: barriers and solutions. , 2004, Health affairs.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Bruce G. Buchanan,et al.  A (Very) Brief History of Artificial Intelligence , 2005, AI Mag..

[14]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[15]  R. Parks,et al.  Identification of severe acute pancreatitis using an artificial neural network. , 2007, Surgery.

[16]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[17]  A. Chang,et al.  Gender Bias in Cardiovascular Testing Persists after Adjustment for Presenting Characteristics and Cardiac Risk , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[18]  Sally Hopewell,et al.  Publication bias in clinical trials due to statistical significance or direction of trial results. , 2009, The Cochrane database of systematic reviews.

[19]  Peter C Austin,et al.  Logistic regression had superior performance compared with regression trees for predicting in-hospital mortality in patients hospitalized with heart failure. , 2010, Journal of clinical epidemiology.

[20]  Lucila Ohno-Machado,et al.  Natural language processing: an introduction , 2011, J. Am. Medical Informatics Assoc..

[21]  Steven H. Brown,et al.  Automated identification of postoperative complications within an electronic medical record using natural language processing. , 2011, JAMA.

[22]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Paul O'Shea,et al.  Future medicine shaped by an interdisciplinary new biology , 2012, The Lancet.

[25]  Gregory D. Hager,et al.  Surgical gesture classification from video and kinematic data , 2013, Medical Image Anal..

[26]  J. Birkmeyer,et al.  Surgical skill and complication rates after bariatric surgery. , 2013, The New England journal of medicine.

[27]  David Sussillo,et al.  Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural Networks , 2013, Neural Computation.

[28]  A. Aldo Faisal,et al.  The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas , 2013, Expert review of medical devices.

[29]  I. Kohane,et al.  Finding the missing link for big biomedical data. , 2014, JAMA.

[30]  Cynthia Rudin,et al.  Discovery with Data: Leveraging Statistics with Computer Science to Transform Science and Society , 2014 .

[31]  José Luis Rojo-Álvarez,et al.  Data-driven Temporal Prediction of Surgical Site Infection , 2015, AMIA.

[32]  Mark J. F. Gales,et al.  Improving the interpretability of deep neural networks with stimulated learning , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[33]  T. Grantcharov,et al.  Characterising ‘near miss’ events in complex laparoscopic surgery through video analysis , 2015, BMJ Quality & Safety.

[34]  Beat P. Müller-Stich,et al.  Computer-assisted abdominal surgery: new technologies , 2015, Langenbeck's Archives of Surgery.

[35]  K. Borgwardt,et al.  Machine Learning in Medicine , 2015, Mach. Learn. under Resour. Constraints Vol. 3.

[36]  Peter Groves,et al.  The 'big data' revolution in healthcare: Accelerating value and innovation , 2016 .

[37]  Antonio Soriano Payá,et al.  Using machine learning methods for predicting inhospital mortality in patients undergoing open repair of abdominal aortic aneurysm , 2016, J. Biomed. Informatics.

[38]  J. Birkmeyer,et al.  Video Ratings of Surgical Skill and Late Outcomes of Bariatric Surgery. , 2016, JAMA surgery.

[39]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[40]  Tyler R Grenda,et al.  Using Surgical Video to Improve Technique and Skill. , 2016, Annals of surgery.

[41]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[42]  José Luis Rojo-Álvarez,et al.  Support Vector Feature Selection for Early Detection of Anastomosis Leakage From Bag-of-Words in Electronic Health Records , 2016, IEEE Journal of Biomedical and Health Informatics.

[43]  Richard Koubek,et al.  Usability Evaluation of a Blood Glucose Monitoring System With a Spill-Resistant Vial, Easier Strip Handling, and Connectivity to a Mobile App , 2016, Journal of diabetes science and technology.

[44]  Z. Obermeyer,et al.  Predicting the Future - Big Data, Machine Learning, and Clinical Medicine. , 2016, The New England journal of medicine.

[45]  Gregory D. Hager,et al.  Recognizing Surgical Activities with Recurrent Neural Networks , 2016, MICCAI.

[46]  B. Skinner,et al.  The Behavior of Organisms: An Experimental Analysis , 2016 .

[47]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[48]  José Luis Rojo-Álvarez,et al.  Predicting colorectal surgical complications using heterogeneous clinical data and kernel methods , 2016, J. Biomed. Informatics.

[49]  Klaus-Robert Müller,et al.  Interpretable deep neural networks for single-trial EEG classification , 2016, Journal of Neuroscience Methods.

[50]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[51]  Prashant Natarajan,et al.  Demystifying Big Data and Machine Learning for Healthcare , 2017 .

[52]  Borim Ryu,et al.  Impact of an Electronic Health Record-Integrated Personal Health Record on Patient Participation in Health Care: Development and Randomized Controlled Trial of MyHealthKeeper , 2017, Journal of medical Internet research.

[53]  T. Grantcharov,et al.  Are We Ready for Our Close-up?: Why and How We Must Embrace Video in the OR. , 2017, Annals of surgery.

[54]  Martin Wattenberg,et al.  Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation , 2016, TACL.

[55]  F. Cabitza,et al.  Unintended Consequences of Machine Learning in Medicine , 2017, JAMA.

[56]  S. Agboola,et al.  Designing Patient-Centered Text Messaging Interventions for Increasing Physical Activity Among Participants With Type 2 Diabetes: Qualitative Results From the Text to Move Intervention , 2017, JMIR mHealth and uHealth.

[57]  Jonathan H. Chen,et al.  Machine Learning and Prediction in Medicine - Beyond the Peak of Inflated Expectations. , 2017, The New England journal of medicine.

[58]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[59]  Sherri Rose,et al.  Classifying Lung Cancer Severity with Ensemble Machine Learning in Health Care Claims Data , 2017, MLHC.

[60]  R. Barzilay,et al.  High-Risk Breast Lesions: A Machine Learning Model to Predict Pathologic Upgrade and Reduce Unnecessary Surgical Excision. , 2017, Radiology.

[61]  M. Ferguson,et al.  Nutritional monitoring of patients post‐bariatric surgery: implications for smartphone applications , 2018, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[62]  Guy Rosman,et al.  Surgical Video in the Age of Big Data. , 2017, Annals of surgery.