Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency

Importance Competency-based assessments of surgical resident performance require metrics of entrustable autonomy. Objectives To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents. Design, Setting, and Participants This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities. Main Outcomes and Measures Differences in mean ratings were assessed across 7 comparison domains. Results Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P < .01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P < .12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2). Conclusions and Relevance Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.

[1]  D. Tyler,et al.  Who did the case? Perceptions on resident operative participation. , 2017, American journal of surgery.

[2]  E. Petrusa,et al.  The Resident-Run Minor Surgery Clinic: A Pilot Study to Safely Increase Operative Autonomy. , 2016, Journal of surgical education.

[3]  A. Borgert,et al.  Do Attending Surgeons and Residents See Eye To Eye? An Evaluation of the Accreditation Council For Graduate Medical Education Milestones in General Surgery Residency. , 2016, Journal of surgical education.

[4]  Lisa Rosenbaum Leaping without Looking--Duty Hours, Autonomy, and the Risks of Research and Practice. , 2016, The New England journal of medicine.

[5]  S. Hamstra,et al.  Entrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment , 2016, Academic medicine : journal of the Association of American Medical Colleges.

[6]  Ross E. Willis,et al.  How do Perceptions of Autonomy Differ in General Surgery Training Between Faculty, Senior Residents, Hospital Administrators, and the General Public? A Multi-Institutional Study. , 2015, Journal of surgical education.

[7]  M. Englesbe,et al.  Resident Surgeons Underrate Their Laparoscopic Skills and Comfort Level When Compared With the Rating by Attending Surgeons. , 2015, Journal of surgical education.

[8]  R. Hirschl The making of a surgeon: 10,000 hours? , 2015, Journal of pediatric surgery.

[9]  C. Ferguson General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. , 2015, Annals of surgery.

[10]  Brian C. George,et al.  Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance. , 2014, Journal of surgical education.

[11]  Brian C. George,et al.  Defining the autonomy gap: when expectations do not meet reality in the operating room. , 2014, Journal of surgical education.

[12]  Paul G Gauger,et al.  Entrustment of general surgery residents in the operating room: factors contributing to provision of resident autonomy. , 2014, Journal of the American College of Surgeons.

[13]  J. Mellinger,et al.  Perceptions of graduating general surgery chief residents: are they confident in their training? , 2014, Journal of the American College of Surgeons.

[14]  F. Lewis,et al.  General surgery residency training issues. , 2013, Advances in surgery.

[15]  R. Bell,et al.  Our trainees' confidence: results from a national survey of 4136 US general surgery residents. , 2011, Archives of surgery.

[16]  Paul Barach,et al.  When Do Supervising Physicians Decide to Entrust Residents With Unsupervised Tasks? , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[17]  S. Peyre,et al.  Resident self-assessment versus faculty assessment of laparoscopic technical skills using a global rating scale , 2010 .

[18]  R. Bell,et al.  Why Johnny cannot operate. , 2009, Surgery.

[19]  Olle ten Cate,et al.  Entrustability of professional activities and competency‐based training , 2005 .