Arthroscopic proficiency: methods in evaluating competency

BackgroundThe current paradigm of arthroscopic training lacks objective evaluation oftechnical ability and its adequacy is concerning given the acceleratingcomplexity of the field. To combat insufficiencies, emphasis is shiftingtowards skill acquisition outside the operating room and sophisticatedassessment tools. We reviewed (1) the validity of cadaver and surgicalsimulation in arthroscopic training, (2) the role of psychomotor analysisand arthroscopic technical ability, (3) what validated assessment tools areavailable to evaluate technical competency, and (4) the quantification ofarthroscopic proficiency.MethodsThe Medline and Embase databases were searched for published articles in theEnglish literature pertaining to arthroscopic competence, arthroscopicassessment and evaluation and objective measures of arthroscopic technicalskill. Abstracts were independently evaluated and exclusion criteriaincluded articles outside the scope of knee and shoulder arthroscopy as wellas original articles about specific therapies, outcomes and diagnosesleaving 52 articles citied in this review.ResultsSimulated arthroscopic environments exhibit high levels of internal validityand consistency for simple arthroscopic tasks, however the ability totransfer complex skills to the operating room has not yet been established.Instrument and force trajectory data can discriminate between technicalability for basic arthroscopic parameters and may serve as useful adjunctsto more comprehensive techniques. There is a need for arthroscopicassessment tools for standardized evaluation and objective feedback oftechnical skills, yet few comprehensive instruments exist, especially forthe shoulder. Opinion on the required arthroscopic experience to obtainproficiency remains guarded and few governing bodies specify absolutequantities.ConclusionsFurther validation is required to demonstrate the transfer of complexarthroscopic skills from simulated environments to the operating room andprovide objective parameters to base evaluation. There is a deficiency ofvalidated assessment tools for technical competencies and little consensusof what constitutes a sufficient case volume within the arthroscopycommunity.

[1]  M. Swiontkowski,et al.  American Board of Orthopaedic Surgery Practice of the Orthopaedic Surgeon: Part-II, certification examination case mix. , 2006, The Journal of bone and joint surgery. American volume.

[2]  A. Darzi,et al.  Validation of orthopaedic bench models for trauma surgery. , 2008, The Journal of bone and joint surgery. British volume.

[3]  D. O'Boyle,et al.  Effects of a moderate dose of alcohol on simulated laparoscopic surgical performance , 2002, Surgical Endoscopy And Other Interventional Techniques.

[4]  J L Rees,et al.  Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. , 2008, The Journal of bone and joint surgery. British volume.

[5]  S. Horgan,et al.  An objective scoring system for laparoscopic cholecystectomy. , 1999, Journal of the American College of Surgeons.

[6]  Charles Vincent,et al.  Technical and Technological Skills Assessment in Laparoscopic Surgery , 2006, JSLS : Journal of the Society of Laparoendoscopic Surgeons.

[7]  Edward G McFarland,et al.  Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. , 2002, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[8]  M. Bridges,et al.  The financial impact of teaching surgical residents in the operating room. , 1999, American journal of surgery.

[9]  J D Mabrey,et al.  A comparison of operative times in arthroscopic ACL reconstruction between orthopaedic faculty and residents: the financial impact of orthopaedic surgical training in the operating room. , 2001, The Iowa orthopaedic journal.

[10]  A. Darzi,et al.  Assessing operative skill , 1999, BMJ.

[11]  William E. GarrettJr. American Board of Orthopaedic Surgery Practice of the Orthopaedic Surgeon: Part-II, Certification Examination Case Mix , 2006 .

[12]  William E Garrett,et al.  Virtual reality simulation of arthroscopy of the knee. , 2002, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[13]  C. W. Bowen,et al.  Evaluating the competency of gynecology residents in the operating room: validation of a new assessment tool. , 2008, American journal of obstetrics and gynecology.

[14]  J. Zuckerman,et al.  Assessment of arthroscopic training in U.S. orthopedic surgery residency programs--a resident self-assessment. , 2010, Bulletin of the NYU hospital for joint diseases.

[15]  Joseph D Zuckerman,et al.  The early effects of code 405 work rules on attitudes of orthopaedic residents and attending surgeons. , 2005, The Journal of bone and joint surgery. American volume.

[16]  T Khan,et al.  Learning and retaining simulated arthroscopic meniscal repair skills. , 2012, The Journal of bone and joint surgery. American volume.

[17]  J. Sekiya,et al.  Diagnostic knee arthroscopy: a pilot study to evaluate surgical skills. , 2012, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[18]  Abtin Alvand,et al.  Innate arthroscopic skills in medical students and variation in learning curves. , 2011, The Journal of bone and joint surgery. American volume.

[19]  Chetan S Modi,et al.  Computer-simulation training for knee and shoulder arthroscopic surgery. , 2010, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[20]  A McCarthy,et al.  Virtual arthroscopy training: do the "virtual skills" developed match the real skills required? , 1999, Studies in health technology and informatics.

[21]  Andreas H. Gomoll,et al.  Surgical Experience Correlates with Performance on a Virtual Reality Simulator for Shoulder Arthroscopy , 2007, The American journal of sports medicine.

[22]  Mark Sadoski,et al.  A Reliable and Valid Instrument to Assess Competency in Basic Surgical Skills in Second-Year Medical Students , 2007, Southern medical journal.

[23]  R. Aggarwal,et al.  Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery , 2008, The British journal of surgery.

[24]  C. L. Yau,et al.  Determining Standards for Laparoscopic Proficiency Using Virtual Reality , 2005, The American surgeon.

[25]  R. Reznick,et al.  Assessing competency in surgery: where to begin? , 2004, Surgery.

[26]  E. Verdaasdonk,et al.  Objective assessment of technical surgical skills , 2010, The British journal of surgery.

[27]  J. Michelson,et al.  Simulation in orthopaedic education: an overview of theory and practice. , 2006, The Journal of bone and joint surgery. American volume.

[28]  R. Arciero,et al.  The development of an objective model to assess arthroscopic performance. , 2009, The Journal of bone and joint surgery. American volume.

[29]  Brett D Owens,et al.  Arthroscopic basic task performance in shoulder simulator model correlates with similar task performance in cadavers. , 2011, The Journal of bone and joint surgery. American volume.

[30]  Adrian E Park,et al.  A valid method of laparoscopic simulation training and competence assessment. , 2003, The Journal of surgical research.

[31]  S. Ashley,et al.  Surgical residents' perceptions of the effects of the ACGME duty hour requirements 1 year after implementation. , 2005, Surgery.

[32]  George J. Pappas,et al.  Individual Skill Progression on a Virtual Reality Simulator for Shoulder Arthroscopy , 2008, The American journal of sports medicine.

[33]  B. Hannaford,et al.  Force controlled and teleoperated endoscopic grasper for minimally invasive surgery-experimental performance evaluation , 1999, IEEE Transactions on Biomedical Engineering.

[34]  G. Fried,et al.  Proving the Value of Simulation in Laparoscopic Surgery , 2004, Annals of surgery.

[35]  J. Bergfeld Issues with accreditation and certification of orthopaedic surgery fellowships. , 1998, The Journal of bone and joint surgery. American volume.

[36]  D P Wills,et al.  Surgical trainee assessment using a VE knee arthroscopy training system (VE-KATS): experimental results. , 2001, Studies in health technology and informatics.

[37]  Ritchie Wp The measurement of competence. Current plans and future initiatives of the American Board of Surgery. , 2001 .

[38]  Y. Iwamoto,et al.  Evaluation of Skills in Arthroscopic Training Based on Trajectory and Force Data , 2009, Clinical orthopaedics and related research.

[39]  P. Kiely,et al.  Knee arthroscopy: how much training is necessary? A cross-sectional study , 2007, European Journal of Orthopaedic Surgery & Traumatology.

[40]  Tania Gottschalk,et al.  The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education , 2012, Knee Surgery, Sports Traumatology, Arthroscopy.

[41]  C. Ahmad,et al.  Training resources in arthroscopic rotator cuff repair. , 2007, The Journal of bone and joint surgery. American volume.

[43]  Christine Andersen,et al.  Development of simulated arthroscopic skills , 2011, Acta orthopaedica.

[44]  Standards Suggested guidelines for the practice of arthroscopic surgery. , 2002, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[45]  Roger Phillips,et al.  Haptic Feedback Can Provide an Objective Assessment of Arthroscopic Skills , 2008, Clinical orthopaedics and related research.

[46]  J. Doyle,et al.  A universal global rating scale for the evaluation of technical skills in the operating room. , 2007, American journal of surgery.

[47]  Jonathan L Rees,et al.  Motion analysis: a validated method for showing skill levels in arthroscopy. , 2008, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[48]  A. Darzi,et al.  The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. , 2001, Journal of the American College of Surgeons.

[49]  G. Ahlberg,et al.  Does training in a virtual reality simulator improve surgical performance? , 2001, Surgical Endoscopy And Other Interventional Techniques.

[50]  M Schijven,et al.  Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. , 2003, Surgical endoscopy.

[51]  G. Omer Certificates of added qualifications in orthopaedic surgery. A position in support of the certificates. , 1994, The Journal of bone and joint surgery. American volume.

[52]  Reed G. Williams,et al.  Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents. , 2005, Surgery.

[53]  John B Collins,et al.  Validation of a global assessment of arthroscopic skills in a cadaveric knee model. , 2013, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[54]  Robert A Pedowitz,et al.  Evaluation of a virtual reality simulator for arthroscopy skills development. , 2002, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[55]  R. Hendler,et al.  Guidelines for privileges in arthroscopic surgery. , 1993, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[56]  William E Garrett,et al.  Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. , 2006, Clinical orthopaedics and related research.

[57]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[58]  A Darzi,et al.  Early experience and validation work with Procedicus VA--the Prosolvia virtual reality shoulder arthroscopy trainer. , 1999, Studies in health technology and informatics.

[59]  T Khan,et al.  Simple visual parameters for objective assessment of arthroscopic skill. , 2012, The Journal of bone and joint surgery. American volume.

[60]  Sakti Srivastava,et al.  Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. , 2004, Journal of shoulder and elbow surgery.

[61]  Mark W Scerbo,et al.  Determining the efficacy of an immersive trainer for arthroscopy skills. , 2005, Studies in health technology and informatics.

[62]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[63]  T Khan,et al.  Identifying orthopaedic surgeons of the future: the inability of some medical students to achieve competence in basic arthroscopic tasks despite training: a randomised study. , 2011, The Journal of bone and joint surgery. British volume.

[64]  Brett D Owens,et al.  Shoulder arthroscopy simulator performance correlates with resident and shoulder arthroscopy experience. , 2012, The Journal of bone and joint surgery. American volume.

[65]  A. Sarmiento Certificates of added qualifications in orthopaedic surgery. A position against the certificates. , 1994, The Journal of bone and joint surgery. American volume.