Putting Theory-Oriented Evaluation Into Practice

Evaluations of gaming simulations and business games as teaching devices are typically end-state driven. This emphasis fails to detect how the simulation being evaluated does or does not bring about its desired consequences. This paper advances the use of a logic model approach, which possesses a holistic perspective that aims at including all elements associated with the situation created by a game. The use of the logic model approach is illustrated as applied to SIMGAME, a board game created for secondary school level business education in six European Union countries.

[1]  Diane Carr,et al.  Contexts, gaming pleasures, and gendered preferences , 2005 .

[2]  Huey-Tsyh Chen,et al.  Practical program evaluation : assessing and improving planning, implementation, and effectiveness , 2005 .

[3]  Svetlana Yampolskaya,et al.  Using Concept Mapping to Develop a Logic Model and Articulate a Program Theory: A Case Example , 2004 .

[4]  John Washbush,et al.  A Review of Scholarship on Assessing Experiential Learning Effectiveness , 2004 .

[5]  Geert Vissers,et al.  A Simple Classification Model for Debriefing Simulation Games , 2004 .

[6]  Nicoletta Stame,et al.  Theory-Based Evaluation and Types of Complexity , 2004 .

[7]  J. Raths,et al.  What counts as knowledge in teacher education , 2004 .

[8]  Willy Christian Kriz,et al.  Creating Effective Learning Environments and Learning Organizations through Gaming Simulation Design , 2003 .

[9]  Stewart I. Donaldson,et al.  Theory-driven Evaluation in Action: Lessons from a $20 Million Statewide Work and Health Initiative , 2003 .

[10]  F. Leeuw,et al.  Reconstructing Program Theories: Methods Available and Problems to be Solved , 2003 .

[11]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[12]  Hugh M. Cannon,et al.  Constructs of Simulation Evaluation , 2002 .

[13]  Kevin Hindle.  A Grounded Theory for Teaching Entrepreneurship Using Simulation Games , 2002 .

[14]  Hartmut Ditton.  Unterrichtsqualität - Konzeptionen, methodische Überlegungen und Perspektiven , 2002 .

[15]  J. Michael Spector,et al.  Models and simulations for learning in complex domains: using causal loop diagrams for assessment and evaluation , 2001, Comput. Hum. Behav..

[16]  F. Hesse,et al.  A Framework for Designing and Evaluating Virtual Seminars , 2001 .

[17]  A. J. Faria.  The Changing Nature of Business Simulation/ Gaming Research: A Brief History , 2001 .

[18]  J. Michael Spector,et al.  System Dynamics and Interactive Learning Environments: Lessons Learned and Implications for the Future , 2000 .

[19]  Carol H. Weiss,et al.  Which links in which theories shall we evaluate? , 2000 .

[20]  Tracy A. Huebner,et al.  Theory‐based evaluation: Gaining a shared understanding between school staff and evaluators , 2000 .

[21]  E. Davidson,et al.  Ascertaining causality in theory‐based evaluation , 2000 .

[22]  Anthony Petrosino,et al.  Whether and why? The potential benefits of including program theory evaluation in meta‐analysis , 2000 .

[23]  Patricia J. Rogers,et al.  Program theory evaluation: Practice, promise, and problems , 2000 .

[24]  Michael Scriven,et al.  Evaluation Models: Viewpoints on Educational and Human Services Evaluation , 2000 .

[25]  M. Hennessy,et al.  Bringing It All Together: Modeling Intervention Processes Using Structural Equation Modeling , 1999 .

[26]  Margaret Honey,et al.  Girl games and technological desire , 1998 .

[27]  A. Reynolds.  Confirmatory Program Evaluation: A Method for Strengthening Causal Inference: , 1998 .

[28]  David Crookall,et al.  Developing a Scientific Knowledge of Simulation/Gaming , 1998 .

[29]  Carol H. Weiss,et al.  Theory‐based evaluation: Past, present, and future , 1997 .

[30]  Joseph Wolfe,et al.  The Effectiveness of Business Games in Strategic Management Course Work , 1997 .

[31]  Sandra P. Horn,et al.  Teacher and Classroom Context Effects on Student Achievement: Implications for Teacher Evaluation , 1997 .

[32]  William R. Shadish,et al.  Evaluation for the 21st century: A handbook. , 1997 .

[33]  Joop J. Hox,et al.  Applied Multilevel Analysis. , 1995 .

[34]  H. Walberg,et al.  Toward a Knowledge Base for School Learning , 1993 .

[35]  E. Cohen.  Restructuring the Classroom: Conditions for Productive Small Groups , 1994 .

[36]  Philip H. Anderson,et al.  A Survey of Methods Used for Evaluating Student Performance on Business Simulations , 1992 .

[37]  Sivasailam Thiagarajan.  Using Games for Debriefing , 1992 .

[38]  W. Shadish,et al.  Foundations of Program Evaluation: Theories of Practice , 1990 .

[39]  J. Wolfe,et al.  The Role of Management Games and Simulations in Education and Research , 1990 .

[40]  R. Slavin.  Cooperative Learning: Theory, Research and Practice , 1990 .

[41]  Huey-tsyh Chen.  Theory-driven evaluations , 1990 .

[42]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[43]  D. Dorn.  Simulation Games: One More Tool on the Pedagogical Shelf. , 1989 .

[44]  G. Salomon,et al.  When teams do not function the way they ought to , 1989 .

[45]  R. Slavin.  Educational Psychology: Theory and Practice , 1986 .

[46]  J. Brophy.  Teacher behavior and student achievement , 1984 .

[47]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[48]  Peter H. Rossi,et al.  Evaluating With Sense , 1983 .

[49]  J. Millman,et al.  Toward Reform of Program Evaluation , 1981 .

[50]  William Remus,et al.  Experimental Designs for Analyzing Data On Games , 1981 .

[51]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[52]  J. Wholey.  Evaluation--promise and performance , 1979 .

[53]  L. Cronbach,et al.  Aptitudes and instructional methods: A handbook for research on interactions , 1977 .

[54]  B. Bloom.  Human Characteristics and School Learning , 1979 .

[55]  P. S. Greenlaw,et al.  The Teaching Effectiveness of Games in Collegiate Business Courses , 1973 .