Insights on Using Developmental Evaluation for Innovating

This article contributes to research on evaluation by examining the capacity and contribution of developmental evaluation for innovating. This case study describes the preformative development of an educational program (from conceptualization to pilot implementation) and analyzes the processes of innovation within a developmental evaluation framework. Developmental evaluation enhanced innovation by (a) identifying and infusing data primarily within an informing process toward resolving the uncertainty associated with innovation and (b) facilitating program cocreation between the clients and the developmental evaluator. Analysis into the demands of innovation revealed the pervasiveness of uncertainty throughout development and how the rendering of evaluative data helped resolve uncertainty and propelled development forward. Developmental evaluation enabled a nonlinear, coevolutionary program development process that centered on six foci—definition, delineation, collaboration, prototyping, illumination, and reality testing. This article concludes by encouraging evaluators to understand the demands of innovation and the value of design thinking when innovating.

[1]  S. Glouberman Complicated and Complex Systems: What Would Successful Reform of Medicare Look Like? , 2002 .

[2]  S Hassfeld,et al.  EVALUATION OF MODELS , 2002, Biomedizinische Technik. Biomedical engineering.

[3]  W. Shadish,et al.  Foundations of Program Evaluation: Theories of Practice , 1990 .

[4]  Dale T. Miller,et al.  Rediscovering Social Innovation , 2008 .

[5]  Hallie Preskill,et al.  Reframing Evaluation Through Appreciative Inquiry , 2006 .

[6]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..

[7]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[8]  C. Poth,et al.  Addressing the Challenges Encountered during a Developmental Evaluation: Implications for Evaluation Practice , 2011 .

[9]  Michael Quinn Patton,et al.  Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use , 2010 .

[10]  Henk van de Graaf,et al.  Implementation research and policy design: problem tractability, policy theory, and feasibility testing , 1987 .

[11]  Patricia J. Rogers,et al.  Purposeful Program Theory: Effective Use of Theories of Change and Logic Models , 2011 .

[12]  Giuseppe Moro,et al.  Evaluating social innovation , 2015 .

[13]  P. Drucker The Age of Social Transformation , 1994 .

[14]  Lyn M. Shulha,et al.  The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users , 2010 .

[15]  Claudia Fonseca,et al.  The interpretation of cultures: selected essays , 2007 .

[16]  Tim Brown,et al.  Design Thinking for Social Innovation , 2010 .

[17]  Lynn Westbrook,et al.  Utilization-focused evaluation , 1998 .

[18]  Nick L. Smith Introduction to the Forum: Advances in Evaluating Evaluation Theory , 2010 .

[19]  Christina A. Christie Advancing Empirical Scholarship to Further Develop Evaluation Theory and Practice , 2011, Canadian Journal of Program Evaluation.

[20]  R. Yin,et al.  Case Study Research: Design and Methods (4th ed. , 2009 .

[21]  Melvin M. Mark,et al.  Toward an Agenda for Research on Evaluation , 2003 .

[22]  Natasha Blanchet-Cohen,et al.  The Art of the Nudge: Five Practices for Developmental Evaluators , 2012, Canadian Journal of Program Evaluation.

[23]  S. Merriam Qualitative Case Studies , 2010 .

[24]  Bob Wood Systems Concepts in Action: A Practitioner's Toolkit, B. Williams, R. Hummelbrunner. Stanford University Press (2010), ISBN: 978-0804770620 , 2011, Int. J. Inf. Manag..

[25]  Clayton M. Christensen The Innovator's Dilemma: When New Technologies Cause Great Firms to Fail , 2013 .

[26]  Huey-Tsyh Chen,et al.  Practical Program Evaluation , 2005 .

[27]  Nick L. Smith,et al.  Improving Evaluation Theory Through The Empirical Study of Evaluation Practice , 1993 .

[28]  Jonathan Stacks,et al.  Developmental Evaluation , 2011, Health promotion practice.

[29]  Anton Hart Getting to Maybe: How the World Is Changed , 2008 .

[30]  Nitin Nohria,et al.  Motivación de los empleados: un poderoso modelo nuevo , 2008 .

[31]  Robert E. Stake,et al.  Qualitative Research: Studying How Things Work , 2010 .