Realist evaluation as a framework for the assessment of teaching about the improvement of care.

Health professions education researchers continually search for tools to measure, evaluate, and disseminate the findings from educational interventions. Clinical teaching, particularly teaching about the improvement of care and systems, is marked by complexity and is invariably influenced by the context into which the intervention is placed. The traditional research framework states that interventions should be adjudicated through a yes or no decision to determine effectiveness. In reality, educational interventions and the study of the interventions rarely succumb to such a simple yes or no question. The realist evaluation framework from Pawson and Tilley provides an explanatory model that links the context, mechanisms, and outcome patterns that are discovered during implementation of a project. This article describes the unique qualities of the realist evaluation, the basic components and steps in a realist evaluation, and an example that uses this technique to evaluate teaching about improvement of care in a clinical setting.

[1]  L. Headrick,et al.  Understanding the value added to clinical care by educational activities. Value of Education Research Group. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[2]  A. Farmer,et al.  Designing and evaluating complex interventions to improve health care , 2007, BMJ : British Medical Journal.

[3]  Martha Reeves,et al.  Evaluation of Training , 1993 .

[4]  I. Sanderson Is it ‘what works’ that matters? Evaluation and evidence‐based policy‐making , 2003 .

[5]  Nan Cochran,et al.  Integrating Practice-Based Learning and Improvement into Medical Student Learning: Evaluating Complex Curricular Innovations , 2007, Teaching and learning in medicine.

[6]  Lester R. Bittel,et al.  TRAINING AND DEVELOPMENT HANDBOOK. , 1967 .

[7]  Ray Pawson,et al.  Evidence-based policy: a realist perspective. , 2006 .

[8]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[9]  Trisha Greenhalgh,et al.  Realist review to understand the efficacy of school feeding programmes , 2007, British medical journal.

[10]  G. Miller The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[11]  David Richards,et al.  A critical realist rationale for using a combination of quantitative and qualitative methods , 2006 .

[12]  Rosaline Barbour,et al.  A realist study of the mechanisms of cardiac rehabilitation. , 2005, Journal of advanced nursing.