Automatic matching of surgeries to predict surgeons' next actions

OBJECTIVE More than half a million surgeries are performed every day worldwide, which makes surgery one of the most important component of global health care. In this context, the objective of this paper is to introduce a new method for the prediction of the possible next task that a surgeon is going to perform during surgery. MATERIAL AND METHOD We formulate the problem as finding the optimal registration of a partial sequence to a complete reference sequence of surgical activities. We propose an efficient algorithm to find the optimal partial alignment and a prediction system using maximum a posteriori probability estimation and filtering. We also introduce a weighting scheme allowing to improve the predictions by taking into account the relative similarity between the current surgery and a set of pre-recorded surgeries. RESULTS Our method is evaluated on two types of neurosurgical procedures: lumbar disc herniation removal and anterior cervical discectomy. Results show that our method outperformed the state of the art by predicting the next task that the surgeon will perform with 95% accuracy. CONCLUSIONS This work shows that, even from the low-level description of surgeries and without other sources of information, it is often possible to predict the next surgical task when the conditions are consistent with the previously recorded surgeries. We also showed that our method is able to assess when there is actually a large divergence between the predictions and decide that it is not reasonable to make a prediction.

[1]  Geoffrey I. Webb,et al.  Dynamic Time Warping Averaging of Time Series Allows Faster and More Accurate Classification , 2014, 2014 IEEE International Conference on Data Mining.

[2]  Jenny Dankelman,et al.  Discovery of high-level tasks in the operating room , 2011, J. Biomed. Informatics.

[3]  Catherine Yoon,et al.  Analysis of surgical errors in closed malpractice claims at 4 liability insurers. , 2006, Surgery.

[4]  M S Waterman,et al.  Identification of common molecular subsequences. , 1981, Journal of molecular biology.

[5]  Jörg Becker,et al.  Designing and implementing a framework for event-based predictive modelling of business processes , 2014, EMISA.

[6]  I. Pavlidis,et al.  Fast by Nature - How Stress Patterns Define Human Experience and Performance in Dexterous Tasks , 2012, Scientific Reports.

[7]  T. Neumuth,et al.  Recording of Surgical Processes: A Study Comparing Senior and Junior Neurosurgeons During Lumbar Disc Herniation Surgery , 2010, Neurosurgery.

[8]  Blaz Zupan,et al.  Predictive data mining in clinical medicine: Current issues and guidelines , 2008, Int. J. Medical Informatics.

[9]  Nassir Navab,et al.  Random Forests for Phase Detection in Surgical Workflow Analysis , 2014, IPCAI.

[10]  Pierre Jannin,et al.  Surgical process modelling: a review , 2014, International Journal of Computer Assisted Radiology and Surgery.

[11]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Huilong Duan,et al.  Variation Prediction in Clinical Processes , 2011, AIME.

[13]  L. MacKenzie,et al.  Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[14]  Germain Forestier,et al.  Non-linear temporal scaling of surgical processes , 2014, Artif. Intell. Medicine.

[15]  D. Louis Collins,et al.  Multi-site study of surgical practice in neurosurgery based on surgical process models , 2013, J. Biomed. Informatics.

[16]  Jakob E. Bardram,et al.  Phase recognition during surgical procedures using embedded and body-worn sensors , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[17]  Germain Forestier,et al.  Unsupervised Trajectory Segmentation for Surgical Gesture Recognition in Robotic Training , 2016, IEEE Transactions on Biomedical Engineering.

[18]  Milos Hauskrecht,et al.  Clinical Time Series Prediction with a Hierarchical Dynamical System , 2013, AIME.

[19]  Germain Forestier,et al.  Classification of surgical processes using dynamic time warping , 2012, J. Biomed. Informatics.

[20]  Emmanuel Conchon,et al.  Context Awareness for Medical Applications , 2013 .

[21]  Yoshito Otake,et al.  An electromagnetic “Tracker-in-Table” configuration for X-ray fluoroscopy and cone-beam CT-guided surgery , 2012, International Journal of Computer Assisted Radiology and Surgery.

[22]  Pierre Jannin,et al.  A Framework for the Recognition of High-Level Surgical Tasks From Video Images for Cataract Surgeries , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Jose Miguel Puerta,et al.  Single- and Multi-label Prediction of Burden on Families of Schizophrenia Patients , 2013, AIME.

[24]  Geoffrey I. Webb,et al.  Faster and more accurate classification of time series by exploiting a novel dynamic time warping averaging algorithm , 2015, Knowledge and Information Systems.

[25]  David Julià,et al.  Surgical skill and complication rates after bariatric surgery. , 2014 .

[26]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[27]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[28]  Silvana Quaglini,et al.  Estimation of human trunk movements by wearable strain sensors and improvement of sensor’s placement on intelligent biomedical clothes , 2012, Biomedical engineering online.

[29]  M. Frecker,et al.  Sequence and task analysis of instrument use in common laparoscopic procedures , 2002, Surgical Endoscopy And Other Interventional Techniques.

[30]  Peter Szolovits,et al.  The coming of age of artificial intelligence in medicine , 2009, Artif. Intell. Medicine.

[31]  Germain Forestier,et al.  Optimal Sub-Sequence Matching for the Automatic Prediction of Surgical Tasks , 2015, AIME.

[32]  Nassir Navab,et al.  Statistical modeling and recognition of surgical workflow , 2012, Medical Image Anal..

[33]  E NicholsonAnn,et al.  Faster and more accurate classification of time series by exploiting a novel dynamic time warping averaging algorithm , 2016 .

[34]  Sudanthi N. R. Wijewickrema,et al.  Pattern-based real-time feedback for a temporal bone simulator , 2013, VRST '13.

[35]  S Schumann,et al.  Distance measures for surgical process models. , 2013, Methods of information in medicine.

[36]  Stuart R. Lipsitz,et al.  Patterns of Technical Error Among Surgical Malpractice Claims: An Analysis of Strategies to Prevent Injury to Surgical Patients , 2007, Annals of surgery.

[37]  Piers Page Surgical skill and complication rates after bariatric surgery. , 2014 .

[38]  Thomas Neumuth,et al.  Sensor-based surgical activity recognition in unconstrained environments , 2014, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[39]  Thomas Neumuth,et al.  Intervention time prediction from surgical low-level tasks , 2013, J. Biomed. Informatics.

[40]  Pierre Jannin,et al.  Automatic Phases Recognition in Pituitary Surgeries by Microscope Images Classification , 2010, IPCAI.

[41]  Eamonn J. Keogh,et al.  Detecting time series motifs under uniform scaling , 2007, KDD '07.