Measurement and Analysis of Learner’s Motivation in Game-Based E-Learning

Computer games started to be integrated in the learning process in order to bridge the gap between the new learner generation and the traditional learning process. However, today’s game-based e-learning environments do not provide different types of adaptation, with learners receiving mostly “one size fits all” educational games despite the existing differences between them in terms of learner knowledge, motivation, etc. In this context, game-based e-learning can lead to demotivated learners. Therefore, there is a need for adaptation strategies. In order to make adaptation possible, real-time assessment of the game-play process as well as of the learning process is needed. Since learner motivation plays an important role in both the learning and the gaming process, and can easily change, new techniques for automated assessment of learner motivation are needed. This chapter presents current trends in game-based e-learning assessment in general focusing on the assessment of learner motivation in particular. Methods for gathering information on player/learner motivation are also presented. Information on learner motivation can be gathered (1) through dialog-based interaction, (2) through game-play-based interaction and/or (3) through additional equipment. This chapter also proposes four generic metrics for the measurement and analysis of motivation in game-based e-learning based on metrics that were used in e-learning. Each metric is presented and its usage and interpretation in gaming-based e-learning are discussed.

[1]  Guy Gouardères,et al.  Proceedings of the 6th International Conference on Intelligent Tutoring Systems , 2002 .

[2]  Alexandra Poulovassilis,et al.  Learning as immersive experiences: Using the four-dimensional framework for designing and evaluating immersive learning experiences in a virtual world , 2010, Br. J. Educ. Technol..

[3]  James Paul Gee,et al.  Looking where the light is bad: Video games and the future of assessment , 2010 .

[4]  Baltasar Fernández-Manjón,et al.  Experiences in using a MUVE for enhancing motivation in engineering education , 2010, IEEE EDUCON 2010 Conference.

[5]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[6]  James C. Lester,et al.  Modeling self-efficacy in intelligent tutoring systems: An inductive approach , 2008, User Modeling and User-Adapted Interaction.

[7]  Helen Pain,et al.  Informing the Detection of the Students' Motivational State: An Empirical Study , 2002, Intelligent Tutoring Systems.

[8]  Frank M. Pajares,et al.  Self-efficacy beliefs of adolescents , 2006 .

[9]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[10]  Abdennour El Rhalibi,et al.  Introduction to Games-Based Learning , 2009 .

[11]  Claude Frasson,et al.  Prediction of Players Motivational States Using Electrophysiological Measures during Serious Game Play , 2010, 2010 10th IEEE International Conference on Advanced Learning Technologies.

[12]  Arnon Hershkovitz,et al.  Developing a Log-based Motivation Measuring Tool , 2008, EDM.

[13]  Claude Frasson,et al.  A Theoretical and Empirical Approach in Assessing Motivational Factors: From Serious Games To an ITS , 2011, FLAIRS.

[14]  Jari Takatalo,et al.  Measuring user experience in digital gaming: theoretical and methodological issues , 2007, Electronic Imaging.

[15]  J. Keller.  Development and use of the ARCS model of instructional design , 1987 .

[16]  Hakan Tüzün,et al.  The effects of computer games on primary school students' achievement and motivation in geography learning , 2009, Comput. Educ..

[17]  Regina Bernhaupt,et al.  Evaluating User Experience in Games - Concepts and Methods , 2010, Human-Computer Interaction Series.

[18]  Shu Wang,et al.  Learning and motivational impacts of a multimedia science game , 2011, Comput. Educ..

[19]  Kasia Muldner,et al.  The Effect of Motivational Learning Companions on Low Achieving Students and Students with Disabilities , 2010, Intelligent Tutoring Systems.

[20]  Mihaela Cocea,et al.  Disengagement Detection in Online Learning: Validation Studies and Perspectives , 2011, IEEE Transactions on Learning Technologies.

[21]  Suzana Ahmad,et al.  Usability testing for educational computer game using observation method , 2010, 2010 International Conference on Information Retrieval & Knowledge Management (CAMP).

[22]  Moffat Mathews,et al.  Detecting Gaming the System in Constraint-Based Tutors , 2010, UMAP.

[23]  Baltasar Fernández-Manjón,et al.  Application of a low-cost web-based simulation to improve students' practical skills in medical education , 2010, Int. J. Medical Informatics.

[24]  A Min Tjoa,et al.  Integrated Approach for the Detection of Learning Styles & Affective States , 2009 .

[25]  D. Monk,et al.  A Comparative Case Study , 2005 .

[26]  Jari Takatalo,et al.  User Experience in Digital Games , 2011 .

[27]  Constance Steinkuehler,et al.  Digital literacies for the disengaged: creating after school contexts to support boys' game‐based literacy skills , 2009 .

[28]  Dietrich Albert,et al.  Approaches to detect discouraged learners: Assessment of motivation in educational computer games , 2010 .

[29]  Cristina Hava Muntean,et al.  Assessment of motivation in games based e-learning , 2010 .

[30]  A Min Tjoa,et al.  An approach for identifying affective states through behavioral patterns in web-based learning management systems , 2009, iiWAS.

[31]  Danielle Levac,et al.  Exploring children's movement characteristics during virtual reality video game play. , 2010, Human movement science.

[32]  Henny van der Meijden,et al.  Effects of constructing versus playing an educational game on student motivation and deep learning strategy use , 2011, Comput. Educ..

[33]  A. Bandura.  GUIDE FOR CONSTRUCTING SELF-EFFICACY SCALES , 2006 .

[34]  Chin-Laung Lei,et al.  Online game QoE evaluation using paired comparisons , 2010, 2010 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR 2010).

[35]  F. Bica,et al.  Towards Cognitive Modeling of Students’ Self-Efficacy , 2006 .

[36]  T. Renshaw,et al.  Towards understanding engagement in games: an eye‐tracking study , 2009 .

[37]  Ning Wang,et al.  Using Learner Focus of Attention to Detect Learner Motivation Factors , 2005, User Modeling.

[38]  Wong Seng Yue,et al.  Usability evaluation for history educational games , 2009, ICIS.

[39]  Carlos Delgado Kloos,et al.  Student Behavior and Interaction Patterns With an LMS as Motivation Predictors in E-Learning Settings , 2010, IEEE Transactions on Education.

[40]  Tsung-Yu Liu,et al.  Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation , 2010, Comput. Educ..

[41]  Tom Lunney,et al.  An emotional student model for game-play adaptation , 2011, Entertain. Comput..

[42]  Fernando A. Kuipers,et al.  Techniques for Measuring Quality of Experience , 2010, WWIC.

[43]  A. Bandura.  Self-efficacy. I: V. S. Ramachandran (red.), Encyclopedia of human behavior (vol. s. ). New York: Academic Press. , 1994 .

[44]  Terri Gullickson,et al.  Encyclopedia of human behavior , 1995 .

[45]  Thomas Connolly,et al.  From E-Learning to Games-Based E-Learning , 2009 .

[46]  Zhi-Hong Chen,et al.  Learning by Substitutive Competition: Nurturing My-Pet for Game Competition Based on Open Learner Model , 2008, 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[47]  Owen Conlan,et al.  Dynamically Adjusting Digital Educational Games Towards Learning Objectives , 2010 .

[48]  Beverly Park Woolf,et al.  Repairing Disengagement With Non-Invasive Interventions , 2007, AIED.

[49]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[50]  H. Gardner,et al.  Learning: Peering Backward and Looking Forward in the Digital Era , 2009 .

[51]  Marina Papastergiou,et al.  Exploring the potential of computer and video games for health and physical education: A literature review , 2009, Comput. Educ..

[52]  A Min Tjoa,et al.  Implementation of Affective States and Learning Styles Tactics in Web-Based Learning Management Systems , 2010, 2010 10th IEEE International Conference on Advanced Learning Technologies.

[53]  Sara de Freitas,et al.  An Empirical Examination of the Relation Between Attention and Motivation in Computer-Based Education: a Modeling Approach , 2010, FLAIRS.

[54]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[55]  Michael D. Kickmeier-Rust,et al.  Realtime Knowledge Space Skill Assessment for Personalized Digital Educational Games , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[56]  Dirk Ifenthaler,et al.  Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives , 2012 .

[57]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[58]  Vincent Aleven,et al.  Toward a Framework for the Analysis and Design of Educational Games , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[59]  Jon-Chao Hong,et al.  Assessing the educational values of digital games , 2009, J. Comput. Assist. Learn..

[60]  P. Vorderer,et al.  Serious games : mechanisms and effects , 2009 .

[61]  Ju-Ling Shih,et al.  The influence of collaboration styles to children's cognitive performance in digital problem-solving game "William Adventure": A comparative case study , 2010, Comput. Educ..

[62]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[63]  Jari Takatalo,et al.  Presence, Involvement, and Flow in Digital Games , 2010, Evaluating User Experience in Games.

[64]  Mark Stansfield,et al.  An alternate reality game for language learning: ARGuing for multilingual motivation , 2011, Comput. Educ..

[65]  Cristina Conati,et al.  Modeling User Affect from Causes and Effects , 2009, UMAP.

[66]  Beverly Park Woolf,et al.  A Dynamic Mixture Model to Detect Student Motivation and Proficiency , 2006, AAAI.

[67]  Rob Koper,et al.  Building adaptive game-based learning resources: The integration of IMS Learning Design and , 2008 .

[68]  A de Vicente.  Towards tutoring systems that detect students' motivation: an investigation , 2003 .

[69]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[70]  Mark Stansfield,et al.  Journal of Information Technology Education Using Games-based Elearning Technologies in Overcoming Difficulties in Teaching Information Systems Game-based Technologies in Overcoming Difficulties in Teaching Information Systems Educational Issues Game-based Technologies in Overcoming Difficulties in , 2022 .

[71]  Mihaela Cocea,et al.  Log file analysis for disengagement detection in e-Learning environments , 2009, User Modeling and User-Adapted Interaction.

[72]  Kara L. Orvis,et al.  Relationships Between Game Attributes and Learning Outcomes , 2009 .

[73]  Pierluigi Ritrovato,et al.  A Novel Approach for Attention Management in E-learning Systems , 2010, DMS.

[74]  James C. Lester,et al.  Affective Transitions in Narrative-Centered Learning Environments , 2008, J. Educ. Technol. Soc..

[75]  Gary Bente,et al.  Why so serious? On the relation of serious games and learning , 2010, Eludamos: Journal for Computer Game Culture.

[76]  Chih-Yu Wang,et al.  Improving online game performance over IEEE 802.11n networks , 2010, 2010 9th Annual Workshop on Network and Systems Support for Games.

[77]  Valerie J. Shute,et al.  Conceptual Framework for Modeling , Assessing and Supporting Competencies within Game Environments , 2010 .

[78]  Wen-Hao Huang,et al.  Sustaining iterative game playing processes in DGBL: The relationship between motivational processing and outcome processing , 2010, Comput. Educ..