The Design and Development of Serious Games Using Iterative Evaluation

In this article, we report on a serious game development approach, characterized by combining theory-based design with an iterative development strategy guided by experimental test and evaluation. We describe two serious games that teach the mitigation of cognitive biases (human tendencies to commit systematic errors in thinking that lead to irrational judgments). Cognitive biases tend to be deeply ingrained and early attempts to reduce biases with training have met with little success. We address this training challenge using bias mitigation theory derived from the literature and an instructional framework to establish the educational content of each game. The mitigation effects of the games were measured through multiple experiment cycles, and multiple play-testing campaigns were conducted to inform instructional model and game design revisions. The final game versions achieved a medium-to-large training effect following a single play session.

[1]  Julian Togelius,et al.  Towards Player Adaptivity in a Serious Game for Conflict Resolution , 2011, 2011 Third International Conference on Games and Virtual Worlds for Serious Applications.

[2]  Irene Scopelliti,et al.  Bias Blind Spot: Structure, Measurement, and Consequences , 2015, Manag. Sci..

[3]  S. Cole,et al.  Improvement in cancer-related knowledge following use of a psychoeducational video game for adolescents and young adults with cancer. , 2007, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[4]  Carey K. Morewedge,et al.  Debiasing Decisions , 2015 .

[5]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[6]  Mary Magee Quinn,et al.  Methodology for playtesting serious games A case study using a mixed method approach , 2013, 2013 IEEE International Games Innovation Conference (IGIC).

[7]  Stacy Marsella,et al.  Serious Games for Language Learning: How Much Game, How Much AI? , 2005, AIED.

[8]  Carey K. Morewedge,et al.  Missing: A Serious Game for the Mitigation of Cognitive Biases , 2014 .

[9]  Jonathan Evans Hypothetical Thinking: Dual Processes in Reasoning and Judgement , 2007 .

[10]  Pat Croskerry,et al.  Cognitive debiasing 2: impediments to and strategies for change , 2013, BMJ quality & safety.

[11]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[12]  V. A. Harris,et al.  The Attribution of Attitudes , 1967 .

[13]  J. Krueger,et al.  Social Projection to Ingroups and Outgroups: A Review and Meta-Analysis , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[14]  Carey K. Morewedge,et al.  Associative processes in intuitive judgment , 2010, Trends in Cognitive Sciences.

[15]  Carey K. Morewedge,et al.  The Use of Theory in Designing a Serious Game for the Reduction of Cognitive Biases , 2016, DiGRA Conference.

[16]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[17]  D. Kahneman Thinking, Fast and Slow , 2011 .

[18]  M. Knowles The adult learner : a neglected species , 1979 .

[19]  Carey K. Morewedge,et al.  Perspective taking in children and adults: Equivalent egocentrism but differential correction , 2004 .

[20]  Clint A. Bowers,et al.  Serious Games Usability Testing: How to Ensure Proper Usability, Playability, and Effectiveness , 2011, HCI.

[21]  Ralph L. Rosnow,et al.  Essentials of Behavioral Research: Methods and Data Analysis , 1984 .

[22]  W. Lewis Johnson,et al.  Serious Use of a Serious Game for Language Learning , 2007, AIED.