Evaluability Assessment: A Systematic Approach to Deciding Whether and How to Evaluate Programmes and Policies

Evaluability assessment (EA) is a systematic approach to planning evaluation projects. It involves structured engagement by researchers with stakeholders to clarify intervention goals and how they are expected to be achieved, the development and evaluation of a logic model or theory of change, and provision of advice on whether or not an evaluation can be carried out at reasonable cost, and what methods should be used. To date, EA has been relatively little used in the UK, but it has begun to attract attention as a way of balancing the growing demand for evaluation with the limited resource available. As well as providing a sound basis for making decisions about whether and how to evaluate before resources are committed, EA can improve the translation of research into practice by ensuring that policy-makers and practitioners are involved from the beginning in developing and appraising evaluation options. Two EAs have recently been conducted in Scotland, which provide a model that can be applied to a wide range of interventions, programmes and policies at national, regional and local levels. What Works Scotland is keen to work with Community Planning Partnerships (CPPs) to identify opportunities for EA.

[1]  Nicola Dawkins,et al.  Results of evaluability assessments of local wellness policies in 6 US school districts. , 2011, The Journal of school health.

[2]  J. FisherRonald,et al.  The Role of Evaluability Assessment in Mental Health program Evaluation , 1985 .

[3]  M. Trevisan Evaluability Assessment From 1986 to 2006 , 2007 .

[4]  Debra Rog,et al.  Evaluability assessment to improve public health policies, programs, and practices. , 2010, Annual review of public health.

[5]  Jan Youtie,et al.  Using an evaluability assessment to select methods for evaluating state technology development programs: the case of the Georgia Research Alliance , 1999 .

[6]  J. Wholey,et al.  Evaluability assessment: from theory to practice in the Department of Health and Human Services. , 1983, Public administration review.

[7]  S. Onyeiwu,et al.  A Welfare-Based Evaluability Assessment of Structural Adjustment Programs in Africa , 1997 .

[8]  L. Potvin,et al.  A socio-political framework for evaluability assessment of participatory evaluations of partnerships: Making sense of the power differentials in programs that involve the state and civil society , 2012 .

[9]  M. Petticrew,et al.  The Public Health Responsibility Deal: how should such a complex public health policy be evaluated? , 2013, Journal of public health.

[10]  Janet Quint,et al.  An Evaluability Assessment of the Toyota Families in Schools Program Prepared for the National Center for Family Literacy , 2001 .

[11]  Wayne N Welsh,et al.  Reducing Overrepresentation of Minorities in Juvenile Justice: Development of Community-Based Programs in Pennsylvania , 1996 .

[12]  Wilfreda E Thurston,et al.  Evaluability Assessment , 2003, Evaluation & the health professions.

[13]  C. Osorio-de-Castro,et al.  Logic models from an evaluability assessment of pharmaceutical services for people living with HIV/AIDS. , 2011, Ciencia & saude coletiva.

[14]  Joseph S. Wholey,et al.  Evaluability assessment: Developing program theory , 1987 .

[15]  Beth A. Covitt,et al.  Insights From an Evaluability Assessment of the U.S. Forest Service More Kids in the Woods Initiative , 2011 .

[16]  Peter R. Jones,et al.  The Significance of Definitions of Success in Program Evaluation , 2000, Evaluation review.

[17]  C. Dagenais,et al.  An evaluability assessment of a West Africa based Non-Governmental Organization's (NGO) progressive evaluation strategy. , 2013, Evaluation and program planning.

[18]  Peter Dahler-Larsen Evaluation as a situational or a universal good? Why evaluability assessment for evaluation systems is a good idea, what it might look like in practice, and why it is not fashionable , 2012 .

[19]  Darlene Russ-Eft Evaluability assessment of the adult education program (AEP): The results and their use , 1986 .

[20]  R. Davies,et al.  Planning evaluability assessments: A synthesis of the literature with recommendations. DFID Working Paper 40. , 2013 .

[21]  M. F. Smith Evaluability assessment: Reflections on the process , 1990 .

[22]  James O. Finckenauer,et al.  Evaluability Assessment in Juvenile Justice , 2005 .

[23]  Steven Cummins,et al.  Assessing the evaluability of complex public health interventions: Five questions for researchers, funders and policymakers , 2011, Journal of Epidemiology & Community Health.

[24]  T. Rees,et al.  Maximizing children's physical activity: an evaluability assessment to plan a community-based, multi-strategy approach in an ethno-racially and socio-economically diverse city. , 2003, Health promotion international.

[25]  V. Nguyen,et al.  Evaluability Assessment of an immunization improvement strategy in rural Burkina Faso: intervention theory versus reality, information need and evaluations. , 2011, Evaluation and program planning.

[26]  N. L. Smith Evaluability Assessment: A Retrospective Illustration and Review. , 1981 .

[27]  A. Piquero Applying an Evaluability Assessment Tool to Community-Based Programs in Pittsburgh , 1998 .

[28]  An evaluability assessment of a nutrition promotion project for newly arrived refugees. , 2007, Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals.

[29]  Edward J. Latessa,et al.  Making the Next Step: Using Evaluability Assessment to Improve Correctional Programming , 2001 .

[30]  L. Potvin,et al.  Evaluability Assessment: A Tool for Incorporating Evaluation in Social Change Programmes , 2003 .

[31]  Lyle McKinney Evaluability Assessment: Laying the Foundation for Effective Evaluation of a Community College Retention Program , 2010 .

[32]  Michael S. Trevisan,et al.  Evaluability assessment: A primer , 2002 .

[33]  L. Leviton,et al.  Teaching Evaluation Using Evaluability Assessment , 1998 .

[34]  A B Cohen,et al.  Evaluation readiness: improved evaluation planning using a data inventory framework. , 1985, Evaluation and program planning.

[35]  Pamela Collins,et al.  Roles of the state asthma program in implementing multicomponent, school-based asthma interventions. , 2013, The Journal of school health.

[36]  Van Johncox Evaluability Assessment of Staff Training in Special Care Units for Persons with Dementia: Strategic Issues , 2001, Canadian Journal of Program Evaluation.

[37]  David C. Stapleton,et al.  An Evaluability Assessment of Responsible Fatherhood Programs. Final Report. , 1997 .

[38]  T. Guetterman,et al.  Evaluability Assessment: Clarifying Organizational Support and Data Availability , 2014, Journal of MultiDisciplinary Evaluation.

[39]  A. Stinchcombe,et al.  Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane? , 2010, Canadian Journal of Program Evaluation.