Validation of Game scenarios for the assessment of professional competence: Development of a serious game for system managers in training

Serious games hold potential for fostering the acquisition of more complex problem solving skills in professional practice. However, until now the empirical evidence on these workplace learning effects of serious games has remained rather scarce. Therefore such games have hardly been adopted for assessment purposes. This article argues why a validation method is needed that points out and controls what and where learners are learning from games. The core of the method entails mapping the learning activities on the performance indicators and outputs, as derived from the formal attainment levels in vocational education. In this study we have elaborated and applied a validation method for the development of a scenario-based assessment game for system managers in (secondary vocational) education. The method provides a general procedure, practical guidelines, and assessment forms, that can be used beyond this educational context and domain by those interested in more dynamic and motivating ways to assess the acquisition of complex skills in workplace learning.

[1]  Jeffrey Chin,et al.  Assessment in Simulation and Gaming , 2009 .

[2]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[3]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[4]  C. V. D. van der Vleuten,et al.  A model for programmatic assessment fit for purpose , 2012, Medical teacher.

[5]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[6]  Rob Nadolski,et al.  EMERGO: methodology and toolkit for efficient development of serious games in higher education , 2007 .

[7]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[8]  Carlos Delgado Kloos,et al.  21st Century Learning for 21st Century Skills , 2012, Lecture Notes in Computer Science.

[9]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[10]  Yves Punie,et al.  eAssessment for 21st Century Learning and Skills , 2012, EC-TEL.

[11]  Kiavash Bahreini,et al.  Towards multimodal emotion recognition in e-learning environments , 2016, Interact. Learn. Environ..

[12]  Dirk Ifenthaler,et al.  Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives , 2012 .

[13]  D. Borsboom Educational Measurement (4th ed.) , 2009 .

[14]  James Paul Gee,et al.  Looking where the light is bad: Video games and the future of assessment , 2010 .

[15]  Liesbeth Baartman ‘Assessing the assessment’ : Development and use of quality criteria for Competence Assessment Programmes , 2008 .