Learners' Assessment and Evaluation in Serious Games: Approaches and Techniques Review

Recently, there has been growing interest in the use of Serious Games (SG), as they provide a more powerful means of knowledge transfer in almost every application domain especially in the crisis management field. With this increasing adoption of SG, designing novel techniques for learners’ assessment and evaluation has become of paramount importance to improve learning results and thus to maintain players’ motivation. This paper focuses on the learners’ assessment and evaluation in SG. After defining assessment and evaluation, we distinguish two main approaches: implicit and explicit. For each of these approaches, we present some techniques currently used in some existing games. Then we compare these different approaches and techniques. This synthesis is expected to help researchers and games creators working in this area and identifying benefits and limitations of these techniques in order to develop a new comprehensive technique that outperforms all existing ones.

[1]  Theo van Ruijven,et al.  Multidisciplinary coordination of on-scene command teams in virtual emergency exercises , 2014, Int. J. Crit. Infrastructure Prot..

[2]  Monica Divitini,et al.  Collaborative Serious Games for Crisis Management: An Overview , 2012, 2012 IEEE 21st International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[3]  Jean-Marc Labat,et al.  How to Evaluate Competencies in Game-Based Learning Systems Automatically? , 2012, ITS.

[4]  Denis Havlik,et al.  Crowdsourcing and crowdtasking in crisis management: Lessons learned from a field experiment simulating a flooding in the city of the Hague , 2016, 2016 3rd International Conference on Information and Communication Technologies for Disaster Management (ICT-DM).

[5]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[6]  C. Lage Rebello da Motta,et al.  STOP DISASTERS: SERIOUS GAMES WITH ELEMENTARY SCHOOL STUDENTS IN RIO DE JANEIRO , 2014 .

[7]  Sébastien Fournier,et al.  Improving Players' Assessment in Crisis Management Serious Games: The SIMFOR Project , 2015, ISCRAM-med.

[8]  Jozef Ristvej,et al.  Data mining and machine learning in the context of disaster and crisis management , 2013 .

[9]  Warren E. Walker,et al.  Training and learning for crisis management using a virtual simulation/gaming environment , 2011, Cognition, Technology & Work.

[10]  Nicole C. Krämer,et al.  Training disaster communication by means of serious games in virtual environments , 2011, Entertain. Comput..

[11]  V. Shute SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[12]  Monica Divitini,et al.  Supporting Debriefing with Sensor Data: A Reflective Approach to Crisis Training , 2014, ISCRAM-med.

[13]  Riccardo Berta,et al.  Assessment in and of Serious Games: An Overview , 2013, Adv. Hum. Comput. Interact..

[14]  Carole Adam,et al.  SPRITE - Participatory Simulation for Raising Awareness About Coastal Flood Risk on the Oleron Island , 2016, ISCRAM-med.