Comparison of Experts and Residents Performing a Complex Procedure in a Temporal Bone Surgery Simulator.

OBJECTIVE To investigate the use of automated metrics from a virtual reality (VR) temporal bone surgery simulator to determine how the performance of experts and trainees differs when performing a complex otological procedure (mastoidectomy with posterior tympanotomy and cochleostomy). STUDY DESIGN Cohort study. METHODS Using the University of Melbourne VR temporal bone surgery simulator, seven ENT consultants and seven ENT residents performed two trials of the surgical approach to cochlear implantation on a virtual temporal bone. Simulator recordings were used to calculate a range of automated metrics for each stage of the procedure, capturing efficiency, technique characteristics, drilled bone regions, and damage to vital anatomical structures. RESULTS Results confirm that experts drilled more efficiently than residents. Experts generally used larger burrs and applied higher forces, resulting in faster material removal. However, they exercised more caution when drilling close to anatomical structures. Residents opened the temporal bone more widely, but neglected important steps in obtaining a clear view toward the round window, such as thinning the external ear canal wall and skeletonizing the medial aspect of the facial nerve. Residents used higher magnification and reoriented the temporal bone more often than experts. CONCLUSION VR simulation provides metrics that allow the objective analysis of surgical technique, and identification of differences between the performance of surgical residents and their senior colleagues. The performance of residents could be improved with more guidance regarding how much force they should apply, what burr size they should use, how they should orient the bone, and for cochlear implant surgery guidance regarding anatomical regions requiring particular attention, to visualize the round window.

[1]  Sudanthi N. R. Wijewickrema,et al.  Adaptation of marching cubes for the simulation of material removal from segmented volume data , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[2]  James Bailey,et al.  Transfer Learning of a Temporal Bone Performance Model via Anatomical Feature Registration , 2014, 2014 22nd International Conference on Pattern Recognition.

[3]  Sudanthi N. R. Wijewickrema,et al.  Pattern-based real-time feedback for a temporal bone simulator , 2013, VRST '13.

[4]  Adam Dubrowski,et al.  Using a Virtual Reality Temporal Bone Simulator to Assess Otolaryngology Trainees , 2007, The Laryngoscope.

[5]  James Bailey,et al.  Constructive Real Time Feedback for a Temporal Bone Simulator , 2013, MICCAI.

[6]  Shih-Ching Yeh,et al.  Evaluation of a haptics-based virtual reality temporal bone simulator for anatomy and surgery training , 2014, Comput. Methods Programs Biomed..

[7]  M. Fried,et al.  The role of virtual reality in surgical training in otorhinolaryngology , 2007, Current opinion in otolaryngology & head and neck surgery.

[8]  Ara Darzi,et al.  The relationship between motion analysis and surgical technical assessments. , 2002, American journal of surgery.

[9]  Gregor Kennedy,et al.  Differentiating levels of surgical experience on a virtual reality temporal bone simulator. , 2010, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[10]  Dan Morris,et al.  Providing metrics and performance feedback in a surgical simulator , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[11]  Erlend Fagertun Hofstad,et al.  A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance , 2013, Surgical Endoscopy.

[12]  Gregor Kennedy,et al.  Can Virtual reality simulator be used as a training aid to improve cadaver temporal bone dissection? Results of a randomized blinded control trial , 2011, The Laryngoscope.

[13]  Bradley J Champagne,et al.  Virtual Reality Simulator Training for Laparoscopic Colectomy: What Metrics Have Construct Validity? , 2014, Diseases of the colon and rectum.

[14]  Don Stredney,et al.  Training and simulation in otolaryngology. , 2011, Otolaryngologic clinics of North America.

[15]  James Bailey,et al.  Developing Effective Automated Feedback in Temporal Bone Surgery Simulation , 2015, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[16]  R. Satava,et al.  Virtual reality as a metric for the assessment of laparoscopic psychomotor skills , 2002, Surgical Endoscopy And Other Interventional Techniques.

[17]  Wade W Chien,et al.  Technical skills improve after practice on virtual‐reality temporal bone simulator , 2012, The Laryngoscope.

[18]  Sudanthi N. R. Wijewickrema,et al.  Region-Specific Automated Feedback in Temporal Bone Surgery Simulation , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[19]  A P George,et al.  Review of temporal bone dissection teaching: how it was, is and will be. , 2010, The Journal of laryngology and otology.

[20]  James Bailey,et al.  A Temporal Bone Surgery Simulator with Real-Time Feedback for Surgical Training , 2014, MMVR.

[21]  Mauro Maiorca,et al.  Towards Haptic Performance Analysis Using K-Metrics , 2008, HAID.

[22]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[23]  Ara Darzi,et al.  Objective Skills Assessment and Construct Validation of a Virtual Reality Temporal Bone Simulator , 2012, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[24]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[25]  James Bailey,et al.  Automated Segmentation of Surgical Motion for Performance Analysis and Feedback , 2015, MICCAI.

[26]  Gregor Kennedy,et al.  Validation of a Networked Virtual Reality Simulation of Temporal Bone Surgery , 2008, The Laryngoscope.