Validation of a novel hip arthroscopy simulator: establishing construct validity

Abstract Hip arthroscopy (HA) is technically demanding and associated with a prolonged learning curve. Recently, arthroscopic simulators have been developed to anatomically model various joints including the knee, shoulder and hip. The purpose of this study is to validate a novel HA simulator. Twenty trainees and one sports medicine fellowship-trained orthopaedic surgeon at a single academic institution were recruited to perform a diagnostic HA procedure using the VirtaMed ArthroS hip simulator. Trainee characteristics, including level of training, general arthroscopy experience and hip specific arthroscopy experience, were gathered via questionnaire. For the purpose of this study, participants were categorized as novice (<25), intermediate (25–74) or experienced (≥75) based on the number of prior arthroscopies performed. Various performance metrics, including composite score, time and camera path length were recorded for each attempt. Metrics were analyzed categorically using ANOVA tests with significance set to P < 0.05. Composite performance score in the novice cohort was 114.5 compared with 146.4 and 151.5 in the intermediate and experienced cohorts (P = 0.0019), respectively. Novice arthroscopists performed the simulated diagnostic arthroscopy procedure in an average time of 321 s compared with 202 s and 181 s in the intermediate and experienced cohorts (P < 0.002), respectively. Cartilage damage and simulator safety score did not differ significantly between groups (P = 0.775). Simulator composite score and procedure time showed strong correlation with year of training (r = 0.65 and −0.70, respectively) and number of arthroscopies performed (r = 0.65 and −0.72). The ArthroS hip simulator shows good construct validity and performance correlates highly with total number of arthroscopic cases reported during training.

[1]  V. Khanduja,et al.  Virtual reality hip arthroscopy simulator demonstrates sufficient face validity , 2018, Knee Surgery, Sports Traumatology, Arthroscopy.

[2]  J. Tofte,et al.  Fundamentals of Arthroscopic Surgery Training Program Improves Knee Arthroscopy Simulator Performance in Arthroscopic Trainees. , 2018, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[3]  R. Marx,et al.  Defining the Learning Curve for Hip Arthroscopy: A Threshold Analysis of the Volume-Outcomes Relationship , 2018, The American journal of sports medicine.

[4]  A. Judge,et al.  Prior Generic Arthroscopic Volume Correlates with Hip Arthroscopic Proficiency: A Simulator Study , 2018, The Journal of bone and joint surgery. American volume.

[5]  A. Amendola,et al.  Who Is Performing Hip Arthroscopy?: An Analysis of the American Board of Orthopaedic Surgery Part-II Database , 2017, The Journal of bone and joint surgery. American volume.

[6]  K. Briggs,et al.  Right Versus Left Hip Arthroscopy for Surgeons on the Learning Curve , 2017, Arthroscopy techniques.

[7]  Jeffrey J. H. Cheung,et al.  Validation of a Dry Model for Assessing the Performance of Arthroscopic Hip Labral Repair , 2017, The American journal of sports medicine.

[8]  B. Waterman,et al.  Simulation Training Improves Surgical Proficiency and Safety During Diagnostic Shoulder Arthroscopy Performed by Residents. , 2016, Orthopedics.

[9]  B. Waterman,et al.  Arthroscopic Shoulder Surgical Simulation Training Curriculum: Transfer Reliability and Maintenance of Skill Over Time. , 2015, Journal of surgical education.

[10]  A. Ranawat,et al.  Arthroscopy Skills Development With a Surgical Simulator , 2015, The American journal of sports medicine.

[11]  William E Garrett,et al.  Improving residency training in arthroscopic knee surgery with use of a virtual-reality simulator. A randomized blinded study. , 2014, The Journal of bone and joint surgery. American volume.

[12]  M. Safran,et al.  Hip arthroscopy: from the beginning to the future—an innovator’s perspective , 2014, Knee Surgery, Sports Traumatology, Arthroscopy.

[13]  Y. Ha,et al.  Learning curve of basic hip arthroscopy technique: CUSUM analysis , 2013, Knee Surgery, Sports Traumatology, Arthroscopy.

[14]  Robert A Pedowitz,et al.  Current and future use of surgical skills training laboratories in orthopaedic resident education: a national survey. , 2013, The Journal of bone and joint surgery. American volume.

[15]  V. Pellegrini,et al.  Resident duty-hour restrictions-who are we protecting?: AOA critical issues. , 2012, The Journal of bone and joint surgery. American volume.

[16]  R. Pedowitz,et al.  Motor skills training in orthopaedic surgery: a paradigm shift toward a simulation-based educational curriculum. , 2012, The Journal of the American Academy of Orthopaedic Surgeons.

[17]  Jonathan L Rees,et al.  Simulated hip arthroscopy skills: learning curves with the lateral and supine patient positions: a randomized trial. , 2012, The Journal of bone and joint surgery. American volume.

[18]  V. Khanduja,et al.  Hip arthroscopy: evolution, current practice and future developments , 2012, International Orthopaedics.

[19]  J. Harrast,et al.  Trends in hip arthroscopy. , 2012, The Journal of bone and joint surgery. American volume.

[20]  J. Wolf,et al.  Orthopaedic resident and program director opinions of resident duty hours: a national survey. , 2011, The Journal of bone and joint surgery. American volume.

[21]  R. Arciero,et al.  The development of an objective model to assess arthroscopic performance. , 2009, The Journal of bone and joint surgery. American volume.

[22]  J L Rees,et al.  Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. , 2008, The Journal of bone and joint surgery. British volume.

[23]  T. Peabody The Effect of Work Hour Restrictions on the Education of Orthopaedic Surgery Residents , 2006, Clinical orthopaedics and related research.

[24]  Brian J Cole,et al.  Utility of modern arthroscopic simulator training models. , 2014, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.