Proving the Effectiveness of the Fundamentals of Robotic Surgery (FRS) Skills Curriculum: A Single-blinded, Multispecialty, Multi-institutional Randomized Control Trial.

MINI: Question: Is the Fundamentals of Robotic Surgery (FRS) proficiency-based progression curriculum effective for teaching basic robotic surgery skills? FINDINGS In an international multi-institutional, multispecialty, blinded, randomized control trial, implementation of the FRS skills curriculum using various simulation platforms led to improved performance of surgical trainees on a transfer test compared with controls.Meaning: The FRS is an effective simulation-based course for training to proficiency on basic robotic surgery skills before surgeons apply those skills clinically. OBJECTIVE To demonstrate the noninferiority of the fundamentals of robotic surgery (FRS) skills curriculum over current training paradigms and identify an ideal training platform. SUMMARY BACKGROUND DATA There is currently no validated, uniformly accepted curriculum for training in robotic surgery skills. METHODS Single-blinded parallel-group randomized trial at 12 international American College of Surgeons (ACS) Accredited Education Institutes (AEI). Thirty-three robotic surgery experts and 123 inexperienced surgical trainees were enrolled between April 2015 and November 2016. Benchmarks (proficiency levels) on the 7 FRS Dome tasks were established based on expert performance. Participants were then randomly assigned to 4 training groups: Dome (n = 29), dV-Trainer (n = 30), and DVSS (n = 32) that trained to benchmarks and control (n = 32) that trained using locally available robotic skills curricula. The primary outcome was participant performance after training based on task errors and duration on 5 basic robotic tasks (knot tying, continuous suturing, cutting, dissection, and vessel coagulation) using an avian tissue model (transfer-test). Secondary outcomes included cognitive test scores, GEARS ratings, and robot familiarity checklist scores. RESULTS All groups demonstrated significant performance improvement after skills training (P < 0.01). Participating residents and fellows performed tasks faster (DOME and DVSS groups) and with fewer errors than controls (DOME group; P < 0.01). Inter-rater reliability was high for the checklist scores (0.82-0.97) but moderate for GEARS ratings (0.40-0.67). CONCLUSIONS We provide evidence of effectiveness for the FRS curriculum by demonstrating better performance of those trained following FRS compared with controls on a transfer test. We therefore argue for its implementation across training programs before surgeons apply these skills clinically.

[1]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[2]  Steven M. Downing,et al.  Assessment in Health Professions Education , 2009 .

[3]  E. Matsumoto,et al.  A Randomized Comparison of 2 Robotic Virtual Reality Simulators and Evaluation of Trainees' Skills Transfer to a Simulated Robotic Urethrovesical Anastomosis Task. , 2018, Urology.

[4]  Winston Bennett,et al.  Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis , 1998 .

[5]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[6]  A. Goh,et al.  Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. , 2012, The Journal of urology.

[7]  Vipul Patel,et al.  Fundamentals of robotic surgery: a course of basic robotic surgery skills based upon a 14‐society consensus template of outcomes measures and curriculum development , 2014, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  William Beach,et al.  A Proficiency-Based Progression Training Curriculum Coupled With a Model Simulator Results in the Acquisition of a Superior Arthroscopic Bankart Skill Set. , 2015, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[9]  Nabeel A. Arain,et al.  Developing a comprehensive, proficiency-based training program for robotic surgery. , 2012, Surgery.

[10]  C. R. Larsen,et al.  The efficacy of virtual reality simulation training in laparoscopy: a systematic review of randomized trials , 2012, Acta obstetricia et gynecologica Scandinavica.

[11]  Anthony G Gallagher,et al.  Metric-based simulation training to proficiency in medical education:- What it is and how to do it , 2012, The Ulster medical journal.

[12]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[13]  R. M. Satava,et al.  Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training , 2003, Surgical Endoscopy And Other Interventional Techniques.

[14]  Anthony G Gallagher,et al.  Prospective, randomized, double-blind trial of curriculum-based training for intracorporeal suturing and knot tying. , 2007, Journal of the American College of Surgeons.

[15]  F. C. Holsinger,et al.  Morbidity and Mortality Associated With Robotic Head and Neck Surgery: An Inquiry of the Food and Drug Administration Manufacturer and User Facility Device Experience Database. , 2016, JAMA otolaryngology-- head & neck surgery.

[16]  Linda S. Hynan,et al.  Comprehensive proficiency-based inanimate training for robotic surgery: reliability, feasibility, and educational benefit , 2012, Surgical Endoscopy.

[17]  Dimitrios Stefanidis,et al.  Optimal acquisition and assessment of proficiency on simulators in surgery. , 2010, The Surgical clinics of North America.

[18]  A. Gallagher,et al.  Objective structured assessment of technical skills and checklist scales reliability compared for high stakes assessments , 2014, ANZ journal of surgery.

[19]  G. Kilic,et al.  Medicolegal review of liability risks for gynecologists stemming from lack of training in robot-assisted surgery. , 2011, Journal of minimally invasive gynecology.

[20]  Timothy T. Baldwin,et al.  Transfer of Training: A Meta-Analytic Review , 2010 .

[21]  Teodor P Grantcharov,et al.  A consensus-based framework for design, validation, and implementation of simulation-based training curricula in surgery. , 2012, Journal of the American College of Surgeons.

[22]  K. Gurusamy,et al.  Laparoscopic surgical box model training for surgical trainees with no prior laparoscopic experience. , 2014, The Cochrane database of systematic reviews.

[23]  R. Aggarwal,et al.  Virtual reality training for surgical trainees in laparoscopic surgery. , 2009, The Cochrane database of systematic reviews.

[24]  Kieran McGlade,et al.  Prospective, Randomized Assessment of Transfer of Training (ToT) and Transfer Effectiveness Ratio (TER) of Virtual Reality Simulation Training for Laparoscopic Skill Acquisition , 2013, Annals of surgery.

[25]  J. Korndorffer,et al.  Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload , 2010, Surgical Endoscopy.

[26]  Jon C. Gould,et al.  Validation of a virtual reality-based robotic surgical skills curriculum , 2013, Surgical Endoscopy.

[27]  A. Cuschieri,et al.  A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery. , 2016, European urology.

[28]  Nabeel A. Arain,et al.  Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises , 2012, Surgical Endoscopy.

[29]  Hueylan Chern,et al.  Current robotic curricula for surgery residents: A need for additional cognitive and psychomotor focus. , 2017, American journal of surgery.

[30]  Anthony G. Gallagher,et al.  Prospective, randomised and blinded comparison of proficiency-based progression full-physics virtual reality simulator training versus invasive vascular experience for learning carotid artery angiography by very experienced operators , 2016, BMJ Simulation & Technology Enhanced Learning.