Promoting evaluation capacity building in a complex adaptive system.

This study provides results from an NSF funded, four year, case study about evaluation capacity building in a complex adaptive system, the Nanoscale Informal Science Education Network (NISE Net). The results of the Complex Adaptive Systems as a Model for Network Evaluations (CASNET) project indicate that complex adaptive system concepts help to explain evaluation capacity building in a network. The NISE Network was found to be a complex learning system that was supportive of evaluation capacity building through feedback loops that provided for information sharing and interaction. Participants in the system had different levels of and sources of evaluation knowledge. To be successful at building capacity, the system needed to have a balance between both centralized and decentralized control, coherence, redundancy, and diversity. Embeddedness of individuals within the system also provided support and moved the capacity of the system forward. Finally, success depended on attention being paid to the control of resources. Implications of these findings are discussed.

[1]  Boris B. Volkov,et al.  A framework for building evaluation capacity based on the experiences of three organizations , 2005 .

[2]  J. Cousins,et al.  Multiple Case Study Methods and Findings , 2014 .

[3]  Nora H. Sabelli,et al.  Complex Systems and Educational Change: Towards a new research agenda , 2008 .

[4]  Brent Davis,et al.  Complexity and Education: Inquiries Into Learning, Teaching, and Research , 2006 .

[5]  Beverly A. Parsons.  Evaluative Inquiry: Using Evaluation To Promote Student Success. , 2002 .

[6]  Laura C. Leviton.  Some Underexamined Aspects of Evaluation Capacity Building , 2014 .

[7]  Hallie Preskill,et al.  Evaluative Inquiry for Learning in Organizations , 1998 .

[8]  Glenda H. Eoyang,et al.  Evaluation in a Complex Adaptive System , 1998 .

[9]  Melissa Dark,et al.  A comparison of linear and systems thinking approaches for program evaluation illustrated using the Indiana Interdisciplinary GK-12. , 2009, Evaluation and program planning.

[10]  D. Compton,et al.  Toward a definition of the ECB process: A conversation with the ECB literature , 2002 .

[11]  Frances P Lawrenz,et al.  A Collaborative Immersio Approach to Evaluation Capacity Building , 2008 .

[12]  Marilyn Cochran-Smith,et al.  Inquiry as Stance: Practitioner Research for the Next Generation. Practitioners Inquiry. , 2009 .

[13]  Kimberly A. Fredericks,et al.  Evaluation Capacity and Nonprofit Organizations , 2010 .

[14]  S. Loucks-Horsley.  Designing Professional Development for Teachers of Science and Mathematics , 1997 .

[15]  J. Horn.  Human Research and Complexity Theory , 2008 .

[16]  Melanie Mitchell,et al.  Complexity - A Guided Tour , 2009 .

[17]  Susan N. Labin,et al.  Developing Common Measures in Evaluation Capacity Building , 2014 .

[18]  G. Anderson,et al.  The Action Research Dissertation: A Guide for Students and Faculty , 2005 .

[19]  J. King.  Making sense of participatory evaluation practice , 1998 .

[20]  M. Mason.  What Is Complexity Theory and What Are Its Implications for Educational Change? , 2008 .

[21]  Hallie Preskill,et al.  A Multidisciplinary Model of Evaluation Capacity Building , 2008 .

[22]  Abraham Wandersman,et al.  A Research Synthesis of the Evaluation Capacity Building Literature , 2012 .