Demystifying Program Evaluation for Surgical Education

In this chapter, we define program evaluation, address its role in evaluating surgical education programs, describe important early steps surgical program evaluators can take to improve the usefulness of program evaluation, discuss common challenges, and offer solutions evaluators can use to overcome these challenges. The chapter is intended for those who are engaging or considering engaging in program evaluation for the first time or are doing so with limited support from a formal program evaluator. Additionally, we have included resources and examples to provide guidance beyond the scope of this chapter.

[1]  D. Kern,et al.  Curriculum Development for Medical Education: A Six-Step Approach , 1998 .

[2]  Chris L. S. Coryn,et al.  Evaluation Theory, Models, and Applications , 2007 .

[3]  D. Kring.  Research and quality improvement: different processes, different evidence. , 2008, Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses.

[4]  Karen Shakman,et al.  Logic Models for Program Design, Implementation, and Evaluation: Workshop Toolkit. REL 2015-057. , 2015 .

[5]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[6]  C. Lovato,et al.  Programme Evaluation: Improving Practice, Influencing Policy and Decision‐Making , 2013 .

[7]  A Cataract Surgery Training Program: 2-Year Outcome After Launching. , 2016, Journal of surgical education.

[8]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[9]  Paul R. Brandon,et al.  Logic Models: A Tool for Designing and Monitoring Program Evaluations. REL 2014-007. , 2014 .

[10]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[11]  Gwenna M. Moss,et al.  They’re Happy, but Did They Make a Difference? Applying Kirkpatrick’s Framework to the Evaluation of a National Leadership Program , 2003, Canadian Journal of Program Evaluation.

[12]  L. Cronbach.  Essentials of psychological testing , 1960 .

[13]  Lyn M. Shulha,et al.  The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users , 2010 .

[14]  Is our residency program successful? Structuring an outcomes assessment system as a component of program evaluation. , 2014, Journal of surgical education.