Self-assessment in simulation-based surgical skills training.

BACKGROUND Simulation-based training provides minimal feedback and relies heavily on self-assessment. Research has shown medical trainees are poor self-assessors. The purpose of this study was to examine trainees' ability to self-assess technical skills using a simulation-trainer. METHODS Twenty-one medical students performed 10 repetitions of a simulated task. After each repetition they estimated their time and errors made. These were compared with the simulator data. RESULTS Task time (P < 0.0001) and errors made (P < 0.0001) improved with repetition. Both self-assessment curves reflected their actual performance curves (P < 0.0001). Self-assessment of time did not improve in accuracy (P = 0.26) but error estimation did (P = 0.01) when compared with actual performance. CONCLUSIONS Novices demonstrated improved skill acquisition using simulation. Their estimates of performance and accuracy of error estimation improved with repetition. Clearly, practice enhances technical skill self-assessment. These results support the notion of self-directed skills training and could have significant implications for residency training programs.

[1]  G. Regehr,et al.  Context, Conflict, and Resolution: A New Conceptual Framework for Evaluating Professionalism , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[2]  C D Smith,et al.  Assessing laparoscopic manipulative skills. , 2001, American journal of surgery.

[3]  A. Darzi,et al.  Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. , 1998, Studies in health technology and informatics.

[4]  A. Struthers,et al.  Self-assessment of medical knowledge: do physicians overestimate or underestimate? , 1991, Journal of the Royal College of Physicians of London.

[5]  M. J. Gordon.  A review of the validity and accuracy of self‐assessments in health professions training , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[6]  G. Regehr,et al.  Computer-assisted learning versus a lecture and feedback seminar for teaching a basic surgical technical skill. , 1998, American journal of surgery.

[7]  D. Risucci,et al.  Ratings of surgical residents by self, supervisors and peers. , 1989, Surgery, gynecology & obstetrics.

[8]  A. Gallagher,et al.  Virtual Reality Training in Laparoscopic Surgery: A Preliminary Assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR) , 1999, Endoscopy.

[9]  A discrepancy in objective and subjective measures of knowledge: do some medical students with learning problems delude themselves? , 1986, Medical education.

[10]  Preliminary study at the Medical University of Southern Africa on student self-assessment as a means of evaluation. , 1985, Journal of medical education.

[11]  G. Regehr,et al.  Measuring self‐assessment skills: an innovative relative ranking model , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[12]  D A Rogers,et al.  The impact of external feedback on computer-assisted learning for surgical technical skill training. , 2000, American journal of surgery.