Comparing evaluation activities across multiple theories of practice.

This article compares and contrasts the evaluation activities described in Practical Participatory Evaluation (Cousins & Whitmore, 1998), Values-engaged Evaluation (Greene, 2005), and Emergent Realist Evaluation (Mark, Henry, & Julnes, 1998). Using the logic models developed to depict each of the three evaluation theories (Hansen, Alkin, & Wallace, 2013) as a starting point, both quantitative and qualitative analysis techniques are employed to discuss the similarities and differences across the practice prescriptions. The approaches are then described according to Miller's (2010) standards for empirical examinations of evaluation theory. Specifically, I offer speculation about their operational specificity and feasibility in practice. I argue that none of the models is completely specific, or wholly unique, and they all present challenges of adaptation into the field. However, the models each offer varying degrees of guidance and unique elements through their prescriptions.

[1]  Nick L. Smith,et al.  Improving Evaluation Theory Through The Empirical Study of Evaluation Practice , 1993 .

[2]  Melvin M. Mark,et al.  Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs , 2000 .

[3]  Melvin M. Mark,et al.  Toward an Agenda for Research on Evaluation , 2003 .

[4]  Rebecca J C Luskin,et al.  Comparing the intended consequences of three theories of evaluation. , 2013, Evaluation and program planning.

[5]  Lorna Earl,et al.  The Case for Participatory Evaluation , 1992 .

[6]  J. Greene Evaluation as Advocacy , 1997 .

[7]  Melvin M. Mark,et al.  A realist theory of evaluation practice , 1998 .

[8]  Christina A. Christie What Guides Evaluation? A Study of How Evaluation Practice Maps onto Evaluation Theory , 2003 .

[9]  Gary T. Henry,et al.  Values and realist evaluation , 1998 .

[10]  Jean A. King The challenge of studying evalutation theory , 2003 .

[11]  J. Greene ArticlesEvaluation as advocacy , 1997 .

[12]  J. Bradley Cousins,et al.  Framing participatory evaluation , 1998 .

[13]  Mark Hansen,et al.  Depicting the logic of three evaluation theories. , 2013, Evaluation and program planning.

[14]  R. T. Torres,et al.  Communicating and Reporting: Practices and Concerns of Internal and External Evaluators , 1997 .

[15]  William R. Shadish,et al.  Evaluation Theory is Who We Are , 1998 .

[16]  Melvin M. Mark,et al.  Toward an Integrative Framework for Evaluation Practice , 1999 .

[17]  Jennifer Caroline Greene,et al.  A value‐engaged approach for evaluating the Bunche–Da Vinci Learning Academy , 2005 .

[18]  S. Mathison,et al.  Advantages and Challenges of Using Inclusive Evaluation Approaches in Evaluation Practice , 1998 .

[19]  M. Mark,et al.  CHA P TER 6 Building a Better Evidence Base for Evaluation Theory Beyond General Calls to a Framework of Types of Research on Evaluation , 2022 .

[20]  Anne T. Vo,et al.  Visualizing context through theory deconstruction: a content analysis of three bodies of evaluation theory literature. , 2013, Evaluation and program planning.

[21]  R. Miller,et al.  Developing Standards for Empirical Examinations of Evaluation Theory , 2010 .

[22]  J. Greene Evaluation Extrapolations , 2001 .

[23]  D. Julian,et al.  Citizen Participation—Lessons from a Local United Way Planning Process , 1997 .

[24]  M. Mark,et al.  Toward More Effective Stakeholder Dialogue: Applying Theories of Negotiation to Policy and Program Evaluation , 2006 .