Assessment in Simulations

Simulations are employed widely as teaching tools in political science, yet evidence of their pedagogical effectiveness, in comparison to other methods of instruction, is mixed. The assessment of learning outcomes is often a secondary concern in simulation design, and the qualitative and quantitative methods used to evaluate outcomes are frequently based on faulty paradigms of the learning process and inappropriate indicators. Correctly incorporating assessment into simulation design requires that an instructor identify whether a simulation should produce positive changes in students' substantive knowledge, skills, and/or affective characteristics. The simulation must then be assessed in ways that accurately measure whether these goals have been achieved. Proper assessment can help demonstrate that simulations are productive tools for learning and that their popularity in the classroom is justified.

[1]  H. Gardner.  Reflections on Multiple Intelligences: Myths and Messages. , 1995 .

[2]  Leanne C. Powner,et al.  Evaluating Hypotheses about Active Learning , 2008 .

[3]  J. Stice.  Using Kolb's Learning Cycle to Improve Student Learning. , 1987 .

[4]  Markku S. Hannula,et al.  Motivation in Mathematics: Goals Reflected in Emotions , 2006 .

[5]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[6]  J. Mitchell O'Toole,et al.  The Impact of Blended Learning on Student Outcomes: is there room on the horse for two? , 2003 .

[7]  Simon Usherwood,et al.  Enhancing Student Immersion in Negotiation-based Learning Environments , 2009 .

[8]  J. McCarthy,et al.  Active Learning Techniques Versus Traditional Teaching Styles: Two Experiments from History and Political Science , 1999 .

[9]  Sara de Freitas,et al.  Using games and simulations for supporting learning , 2006 .

[10]  David H. Sacko,et al.  Synergy Across the Curriculum: Simulating the Institution of Postwar Iraqi Government , 2006 .

[11]  Christian Kaunert,et al.  The European Union Simulation: From Problem-Based Learning (PBL) to Student Interest , 2009 .

[12]  B. Weiner.  History of motivational research in education , 1990 .

[13]  Heidi H. Hobbs,et al.  Simulating Globalization: Oil in Chad , 2004 .

[14]  One for All and All for One: Using Multiple Identification Theory Simulations to Build Cooperative Attitudes and Behaviors in a Middle Eastern Conflict Scenario , 2010 .

[15]  Brian Frederking.  Simulations and Student Learning , 2005 .

[16]  David Tonks,et al.  Using Marketing Simulations for Teaching and Learning , 2002 .

[17]  M. Bredemeier,et al.  The Educational Effectiveness of Simulation Games , 1981 .

[18]  D. Hancock.  Influencing Postsecondary Students' Motivation to Learn in the Classroom , 2002 .

[19]  Daniel T. Willingham,et al.  Why Don't Students Like School?: A Cognitive Scientist Answers Questions About How the Mind Works and What It Means for the Classroom , 2009 .

[20]  David S. Kirk,et al.  Savannah: mobile gaming and learning? , 2004, J. Comput. Assist. Learn..

[21]  Anne E. Zald,et al.  Instruction and program design through assessment , 2008 .

[22]  Rebecca W. Black,et al.  Three Levels of Learning in Simulations: Participating, Debriefing, and Journal Writing , 1992 .

[23]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[24]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[25]  Jeffrey Chin,et al.  Assessment in Simulation and Gaming , 2009 .

[26]  Lynne Outhred,et al.  An evaluation of the , 2001 .

[27]  Charles F. Petranek.  Written Debriefing: The Next Vital Step in Learning with Simulations , 2000 .

[28]  Jeffrey S. Lantis,et al.  Building Knowledge? Evaluating the Effectiveness of the Global Problems Summit Simulation , 2006 .

[29]  Steven J. Condly,et al.  A Preliminary Study of Classroom Motivators and De-motivators from a Motivation-hygiene Perspective , 2009 .

[30]  Lantis.  Simulations and Experiential Learning in the International Relations Classroom , 1998 .

[31]  T. Stafford,et al.  Expectancy confirmation in attitude learning: A connectionist account , 2008 .

[32]  William B. Borgers.  DEMOCRACY AND EDUCATION. , 1919 .

[33]  Simon Egenfeldt-Nielsen,et al.  Beyond Edutainment: Exploring the Educational Potential of Computer Games , 2011 .

[34]  Gernot von Collani,et al.  Hindsight bias, conjunctive explanations and causal attribution. , 2008 .

[35]  David C. Lane,et al.  On a Resurgence of Management Simulations and Games , 1995 .

[36]  Bruce W. Tuckman,et al.  The Relative Effectiveness of Incentive Motivation and Prescribed Learning Strategy in Improving College Students' Course Performance. , 1996 .

[37]  Amy M. Masnick,et al.  Evaluating Scientific Research in the Context of Prior Belief: Hindsight Bias or Confirmation Bias? , 2009 .

[38]  Christopher Marsh,et al.  Negotiating Russian Federalism: A Simulation for Comparative Politics , 2002 .

[39]  K. Thompson.  Cognitive and Analytical Psychology Howard Gardner .Frames of Mind: The Theory of Multiple Intelligences. New York, Basic Books, 1983. , 1985 .

[40]  Peter Williams,et al.  Quality and Standards in Higher Education. , 2010 .

[41]  Cedric Linder,et al.  Equipment issues regarding the collection of video data for research. , 2005 .

[42]  Yana van der Meulen Rodgers,et al.  A Role-Playing Exercise for Development and International Economics Courses. , 1996 .

[43]  S. Lei,et al.  Intrinsic and Extrinsic Motivation: Evaluating Benefits and Drawbacks from College Instructors' Perspectives. , 2010 .

[44]  Katherine K. Perkins,et al.  Assessing the Effectiveness of a Computer Simulation in Introductory Undergraduate Environments , 2007 .

[45]  Katy A. Crossley-Frolick.  Beyond Model UN: Simulating Multi-Level, Multi-Actor Diplomacy Using the Millennium Development Goals , 2010 .

[46]  Robert Mandel.  An Evaluation of the “Balance of Power” Simulation , 1987 .

[47]  Chad Raymond,et al.  Do Role-Playing Simulations Generate Measurable and Meaningful Outcomes? A Simulation’s Effect on Exam Scores and Teaching Evaluations , 2010 .

[48]  Michael Baranowski.  Single Session Simulations: The Effectiveness of Short Congressional Simulations in Introductory American Government Classes , 2006 .

[49]  S. Marcia,et al.  Simulation and Games. , 1969 .

[50]  M. McDaniel,et al.  Learning Styles , 2008, Psychological science in the public interest : a journal of the American Psychological Society.

[51]  Diane Ebert-May,et al.  Disciplinary Research Strategies for Assessment of Learning , 2003 .

[52]  Elizabeth L. Blake,et al.  Simulation in International Relations Education , 2001 .

[53]  Mark A. Boyer,et al.  Designing In-Class Simulations , 1996, PS: Political Science & Politics.

[54]  P. Wilcox,et al.  AIP Conference Proceedings , 2012 .

[55]  Judith A. Gillespie.  Designing Simulation/Games in Social Studies: The Game Doesn't End with Winning. , 1973 .

[56]  N. T. Basuray.  The Learning Style Inventory Debate Revisited; an Empirical Assessment of the Construct Validity Issue Related to Experiential Learning Theory , 1982 .

[57]  Stephen A. Stumpf,et al.  Learning Style Theory: Less than Meets the Eye , 1980 .

[58]  Igor S. Mayer,et al.  The Gaming of Policy and the Politics of Gaming: A Review , 2009 .

[59]  D. Laurillard.  The processes of student learning , 1979 .

[60]  K. Ecclestone,et al.  Learning styles and pedagogy in post-16 learning , 2004 .

[61]  Noah S. Podolefsky,et al.  When learning about the real world is better done virtually: A study of substituting computer simulations for laboratory equipment , 2005 .

[62]  Harold Guetzkow,et al.  Research Activities on Simulated International Processes , 1966 .

[63]  Light Greg,et al.  Learning and teaching in higher education , 2001 .

[64]  David Kirk,et al.  Savannah: experiential learning through mobile gaming , 2004 .

[65]  Beth K. Dougherty.  Byzantine Politics: Using Simulations to Make Sense of the Middle East , 2003, PS: Political Science & Politics.

[66]  D. Dorn.  Simulation Games: One More Tool on the Pedagogical Shelf. , 1989 .

[67]  Jonathan D. Moizer,et al.  Simulations and games , 2009 .

[68]  R. Oxford,et al.  Cognition Plus: Correlates Of Language Learning Success , 1995 .

[69]  Timothy D. Wilson,et al.  The accuracy of verbal reports about the effects of stimuli on evaluations and behavior , 1978 .

[70]  Rajiv Vaidyanathan,et al.  An Exploratory Investigation of Computer Simulations, Student Preferences, and Performance , 1998 .

[71]  Darrell R. Lewis,et al.  An Evaluation of the Use of the Marketplace Game in Junior College Economics , 1975 .

[72]  Juan R. Burciaga,et al.  Teaching Physics with the Physics Suite , 2004 .

[73]  F. Coffield.  Learning styles and pedagogy in post-16 learning: a systematic and critical review , 2004 .

[74]  Peter Knight,et al.  Summative Assessment in Higher Education: Practices in disarray , 2002 .

[75]  Janet Thomas Simons,et al.  Engaging Students Through Extended Simulations , 2008 .

[76]  S. J. Stroessner,et al.  All the World's a Stage? Consequences of a Role-Playing Pedagogy on Psychological Factors and Writing and Rhetorical Skill in College Undergraduates , 2009 .

[77]  P. Chasek,et al.  Power Politics, Diplomacy and Role Playing: Simulating the UN Security Council’s Response to Terrorism , 2005 .

[78]  A. Enterline,et al.  Chinazambia and Boliviafranca: A Simulation of Domestic Politics and Foreign Policy , 2009 .

[79]  May Lin Wee,et al.  Investigating the Effect of 3D Simulation Based Learning on the Motivation and Performance of Engineering Students , 2010 .

[80]  Kathy L. Brock,et al.  Enlivening Political Science Courses with Kolb's Learning Preference Model , 1999 .