Towards a methodological framework for the cognitive-behavioural evaluation of educational e-games

The proposed methodological framework reviews and uses knowledge from the field of cognitive psychology in order to evaluate aspects of educational games. In particular, we concentrate on two components of human cognition that play a central role in learning, namely memory and motivation. After having reviewed theories in the field, we created a questionnaire in order to evaluate educational games. The questionnaire incorporates different experimental findings of cognitive psychology. In particular, we have applied Maslow|s motivation theory, behavioural findings on reinforcement, experimental findings about attention and memory. We present the results obtained from the evaluation of three games, Angry Birds, PAC-MAN and Mega Jump. The results confirmed the user ratings of the three games, showing that there seem to be cognitive reasons for the success/failure of different games. Finally, a list of guidelines for developers is included.

[1]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[2]  Marina Papastergiou,et al.  Exploring the potential of computer and video games for health and physical education: A literature review , 2009, Comput. Educ..

[3]  Deena Skolnick Weisberg,et al.  The Seductive Allure of Neuroscience Explanations , 2008, Journal of Cognitive Neuroscience.

[4]  Janet C. Read,et al.  User-oriented design and tangible interaction for kindergarten children , 2009, IDC.

[5]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[6]  Miguel de Aguilera,et al.  Video games and education: (Education in the Face of a “Parallel School”) , 2003, CIE.

[7]  Ginger S. Watson,et al.  The design of an electronic self-regulation skill notebook for the development of meta-cognitive strategies and self-assessment in digital game-based learning environments , 2008, SpringSim '08.

[8]  Mark Solms,et al.  The Mind-Brain Relationship , 2020 .

[9]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[10]  Eileen Wood,et al.  Encouraging Mindful Use of Prior Knowledge: Attempting to Construct Explanatory Answers Facilitates Learning , 1992 .

[11]  Wong Seng Yue,et al.  Usability evaluation for history educational games , 2009, ICIS.

[12]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[13]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[14]  Lewis Elton,et al.  Strategies to enhance student motivation: A conceptual analysis , 1996 .

[15]  Michele D. Dickey.  "Ninja Looting" for instructional design: the design challenges of creating a game-based learning environment , 2006, SIGGRAPH '06.

[16]  Pierre Jouvelot,et al.  Motivation-driven educational game design: applying best practices to music education , 2005, ACE '05.

[17]  A. Baddeley.  Human Memory: Theory and Practice, Revised Edition , 1990 .

[18]  Piotr Bogorodzki,et al.  The effect of motivation on working memory: An fMRI and SEM study , 2008, Neurobiology of Learning and Memory.

[19]  Roseli de Deus Lopes,et al.  Three-dimensional digital enviroments and computer graphics influencing K-12 individuals' digital literacy development and interdisciplinary lifelong learning , 2009, SIGGRAPH ASIA '09.

[20]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[21]  Kurt Squire,et al.  Game-based learning : present and future state of the field , 2005 .

[22]  Jettie Hoonhout,et al.  TagTiles: optimal challenge in educational electronics , 2007, TEI.

[23]  Vincent Aleven,et al.  Toward a Framework for the Analysis and Design of Educational Games , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[24]  Wolmet Barendregt,et al.  A Structured Expert Evaluation Method for the Evaluation of Children's Computer Games , 2005, INTERACT.

[25]  Tsung-Yen Chuang,et al.  The Effect of Computer-Based Video Games on Young Children: A Literature Review , 2005 .

[26]  J. Gee,et al.  Video Games and the Future of Learning , 2005 .

[27]  Sue Blackman,et al.  Serious games...and less! , 2005, COMG.

[28]  Ryan Pedela,et al.  Immersive chemistry video game , 2006, SIGGRAPH '06.

[29]  M. Lepper,et al.  Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. , 1996 .

[30]  M. Lepper,et al.  A desire to be taught: Instructional consequences of intrinsic motivation , 1992 .

[31]  Elina M. I. Koivisto,et al.  Playability heuristics for mobile games , 2006, Mobile HCI.

[32]  Ángel García-Crespo,et al.  MAS: learning support software platform for people with disabilities , 2009, MSIADU '09.

[33]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[34]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[35]  Atsusi Hirumi,et al.  Examining the pedagogical foundations of modern educational computer games , 2008, Comput. Educ..

[36]  Jan H. G. Klabbers.  The gaming landscape: a taxonomy for classifying games and simulations , 2003, DiGRA Conference.

[37]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[38]  Gregory D. Abowd,et al.  Human-Computer Interaction (3rd Edition) , 2003 .

[39]  Craig A. Lindley,et al.  Game Play Schemas: From Player Analysis to Adaptive Game Mechanics , 2008, Int. J. Comput. Games Technol..

[40]  George Lepouras,et al.  REFLECTIONS ON MOBILE AND LIFE LONG LEARNING: MUSEUMS AS APPLICATION FIELDS , 2008 .

[41]  Giorgos Lepouras,et al.  Virtual museums for all: employing game technology for edutainment , 2004, Virtual Reality.

[42]  Eric Carson,et al.  Creativity in video game design as pedagogy , 2009, SIGGRAPH '09.

[43]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[44]  Jayne Gackenbach,et al.  Cognitive evaluation of video games: players' perceptions , 2009, Future Play.

[45]  David W. Brooks,et al.  Working Memory, Motivation, and Teacher-Initiated Learning , 2006 .

[46]  J. Huizinga.  Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[47]  Mizuko Ito.  Engineering Play: A Cultural History of Children's Software , 2009 .

[48]  A. Maslow.  Motivation and Personality , 1954 .

[49]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.