Tracking the UFO's Paths: Using Eye-Tracking for the Evaluation of Serious Games

Computer games are undoubtedly an enormously successful genre. Over the past years, a continuously growing community of researchers and practitioners made the idea of using the potential of computer games for serious, primarily educational purposes equally popular. However, the present hype over serious games is not reflected in sound evidence for the effectiveness and efficiency of such games and also indicators for the quality of learner-game interaction is lacking. In this paper we look into those questions, investigating a geography learning game prototype. A strong focus of the investigation was on relating the assessed variables with gaze data, in particular gaze paths and interaction strategies in specific game situations. The results show that there a distinct gender differences in the interaction style with different game elements, depending on the demands on spatial abilities (navigating in the threedimensional spaces versus controlling rather two-dimensional features of the game) as well as distinct differences between high and low performers.

[1]  Richard N. Van Eck.  Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. , 2006 .

[2]  Yasmin B. Kafai,et al.  How computer games help children learn , 2008 .

[3]  Elke E. Mattheiss,et al.  A Psycho-Pedagogical Framework for Multi-Adaptive Educational Games , 2011, Int. J. Game Based Learn..

[4]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[5]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, Advances in Computer Entertainment Technology.

[6]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[7]  Andreas Holzinger,et al.  HCI and Usability for Education and Work, 4th Symposium of the WG HCI&UE of the OCG Austrian Computer Society, USAB 2008, LNCS 5298 , 2008 .

[8]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, ETRA.

[9]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[10]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[11]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[12]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[13]  James Paul Gee,et al.  Learning by Design: Good Video Games as Learning Machines , 2005 .

[14]  Dietrich Albert,et al.  Challenges in the Development and Evaluation of Immersive Digital Educational Games , 2008, USAB.

[15]  Diana G. Oblinger.  Games and Learning. , 2006 .

[16]  S. Freitas.  Learning in immersive worlds: A review of game-based learning , 2006 .

[17]  Stephan Weibelzahl,et al.  Advantages, Opportunities and Limits of Empirical Evaluations: Evaluating Adaptive Systems , 2002, Künstliche Intell..

[18]  Dietrich Albert,et al.  Micro-adaptivity: protecting immersion in didactically adaptive digital educational games , 2010, J. Comput. Assist. Learn..

[19]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[20]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[21]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[22]  S. Wilson.  What Video Games Have to Teach Us about Learning and Literacy , 2006 .

[23]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..