Prediction of task-based, surgeon efficiency metrics during robotic-assisted minimally invasive surgery

We present a machine learning algorithm for predicting surgeon performance on future tasks given performance on previous tasks during robotic-assisted surgery. Performance is estimated via six heuristics, called metrics, which are derived from da Vinci Surgical System data streams and which have previously demonstrated significance in differentiating expertise. We use a boosted ensemble of regression trees, which learns a regression from 193 system data features to one of the six target metrics. Predictions from our algorithm are evaluated on whether they achieve significantly lower error than two intelligent guesses: (1) guessing a surgeon performs the future task exactly as how she performed the previous task (GUESS_PREV) and (2) guessing a surgeon will have average performance on the future task (GUESS_MEAN). We show that our algorithm can predict metrics of future tasks, significantly $(p\lt 0.05)$ outperforming GUESS_PREV on 19 out of 36 metrics and task pairs and GUESS_MEAN on 8 out of 36 metrics and task pairs. This work serves as a first step towards pre-operative performance estimation, where a surgeon can proactively improve performance rather than relying solely on post-operative feedback

[1]  Anthony Jarc,et al.  Utilizing Machine Learning and Automated Performance Metrics to Evaluate Robot-Assisted Radical Prostatectomy Performance and Predict Outcomes. , 2018, Journal of endourology.

[2]  Crowdsourced versus expert evaluations of the vesico-urethral anastomosis in the robotic radical prostatectomy: is one superior at discriminating differences in automated performance metrics? , 2018, Journal of Robotic Surgery.

[3]  Tomoko Mizota,et al.  Fundamentals of Robotic Surgery , 2018 .

[4]  Ilana Nisky,et al.  Robot-assisted surgery: an emerging platform for human neuroscience research , 2015, Front. Hum. Neurosci..

[5]  Shing-Hwa Liu,et al.  Comparison of outcome and cost among open, laparoscopic, and robotic surgical treatments for rectal cancer: A propensity score matched analysis of nationwide inpatient sample data , 2018, Journal of surgical oncology.

[6]  A. Darzi,et al.  Objective assessment of technical skills in surgery , 2003, BMJ : British Medical Journal.

[7]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[8]  Gregory D. Hager,et al.  Sparse Hidden Markov Models for Surgical Gesture Classification and Skill Evaluation , 2012, IPCAI.

[9]  T. Ind,et al.  Objective assessment of technical surgical skill , 2005 .

[10]  David Julià,et al.  Surgical skill and complication rates after bariatric surgery. , 2014 .

[11]  Mark R. Segal,et al.  Multivariate random forests , 2011, WIREs Data Mining Knowl. Discov..

[12]  Anthony Jarc,et al.  Development and Validation of Objective Performance Metrics for Robot‐Assisted Radical Prostatectomy: A Pilot Study , 2018, The Journal of urology.

[13]  T. Judkins,et al.  Objective evaluation of expert and novice performance during robotic surgical training tasks , 2009, Surgical Endoscopy.

[14]  Mathew D. Sorensen,et al.  Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education. , 2017, Journal of graduate medical education.

[15]  Inderbir S. Gill,et al.  Use of Automated Performance Metrics to Measure Surgeon Performance during Robotic Vesicourethral Anastomosis and Methodical Development of a Training Tutorial , 2018, The Journal of urology.

[16]  J. Collins,et al.  Comprehensive training in robotic surgery , 2019, Current opinion in urology.

[17]  I. Gill,et al.  Automated Performance Metrics and Machine Learning Algorithms to Measure Surgeon Performance and Anticipate Clinical Outcomes in Robotic Surgery. , 2018, JAMA surgery.

[18]  Fernando De la Torre,et al.  Selective Transfer Machine for Personalized Facial Action Unit Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Gregory D. Hager,et al.  Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. , 2006 .

[20]  Y. Novitsky,et al.  Comparative analysis of perioperative outcomes of robotic versus open transversus abdominis release , 2018, Surgical Endoscopy.

[21]  Karsten M. Borgwardt,et al.  Covariate Shift by Kernel Mean Matching , 2009, NIPS 2009.

[22]  May Liu,et al.  A Review of Training Research and Virtual Reality Simulators for the da Vinci Surgical System , 2015, Teaching and learning in medicine.