Serious Assessments in Serious Games

In the past decade the serious games initiative has produced a number of games being used today as adjuncts to institutional training. Many of the games produced through the serious games initiative do not incorporate adaptive assessment to assure the acquisition of real-world skills from virtual training. Detailed performance assessment techniques are often lacking. Successful performance assessment in virtual training requires that students are placed into multiple simulated contexts and are challenged with different tasks to perform under various conditions, to specified standards. The aggregate of training situations must adequately cover the space of real-world situations. This article discusses important concepts related to virtual training performance assessment including critical tasks, performance criteria, forward recommendation, errors of commission, red screen alerts, reusable competency definitions, ill-structured domains, violent domains, and other game design templating. By integrating these concepts into serious game design, trainers can develop sufficiently varying simulated tasks to ensure that serious games meet real-world adaptive needs.

[1]  Eduardo Salas,et al.  Making decisions under stress: Implications for individual and team training. , 1998 .

[2]  Jeroen S. Lemmens,et al.  The Effects of Pathological Gaming on Aggressive Behavior , 2010, Journal of youth and adolescence.

[3]  Kurt Debattista,et al.  Level of Realism for Serious Games , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[4]  Marina Krcmar,et al.  The Influences of Video Gaming on US Children's Moral Reasoning About Violence , 2011 .

[5]  Paul N Kizakevich,et al.  Chemical agent simulator for emergency preparedness training. , 2004, Studies in health technology and informatics.

[6]  Curry I. Guinn,et al.  Augmented transition networks (ATNs) for dialog control: A longitudinal study , 2006, Computational Intelligence.

[7]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[8]  Paul N. Kizakevich,et al.  Virtual Simulation-Enhanced Triage Training for Iraqi Medical Personnel , 2007, MMVR.

[9]  Robert C. Hubal,et al.  How do varied populations interact with embodied conversational agents? Findings from inner-city adolescents and prisoners , 2008, Comput. Hum. Behav..

[10]  B. Allaouchiche,et al.  Noise in the postanaesthesia care unit. , 2002, British journal of anaesthesia.

[11]  Robert Michael Young,et al.  Narrative Planning: Balancing Plot and Character , 2010, J. Artif. Intell. Res..

[12]  N. McLatchie,et al.  Denying Humanness to Others , 2011, Psychological science.

[13]  Robert Hubal Design and Usability of Military Maintenance Skills Simulation Training Systems , 2005 .

[14]  Geoffrey Frank,et al.  Linking Reusable Competency Definitions to Learning Activities , 2005 .

[15]  D. Simons,et al.  The effects of video game playing on attention, memory, and executive control. , 2008, Acta psychologica.

[16]  Curry Guinn,et al.  Virtual simulated patients for bioterrorism preparedness training. , 2003, Studies in health technology and informatics.

[17]  Vimla L. Patel,et al.  Medical error: is the solution medical or cognitive? , 2002, Journal of the American Medical Informatics Association : JAMIA.

[18]  S. Dreyfus,et al.  A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition , 1980 .

[19]  M Topf,et al.  Noise-induced stress as a predictor of burnout in critical care nurses. , 1988, Heart & lung : the journal of critical care.

[20]  Changchun Liu,et al.  Dynamic Difficulty Adjustment in Computer Games Through Real-Time Anxiety-Based Affective Feedback , 2009, Int. J. Hum. Comput. Interact..

[21]  Jonathan P. Rowe,et al.  Integrating Learning and Engagement in Narrative-Centered Learning Environments , 2010, Intelligent Tutoring Systems.

[22]  Itiel Dror,et al.  A novel approach to minimize error in the medical domain: Cognitive neuroscientific insights into training , 2011, Medical teacher.

[23]  Kait Clark,et al.  Enhanced change detection performance reveals improved strategy use in avid action video game players. , 2011, Acta psychologica.

[24]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[25]  Linda Pierce,et al.  Improving Multicultural Teamwork to Combat Terrorism , 2006 .

[26]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[27]  Geoffrey Frank,et al.  Using Competency Definitions to Adapt Training for Mission Success , 2007 .