Codifying Game‑Based Learning: Development and Application of LEAGUÊ Framework for Learning Games

Educational games are now seen as effective learning tools. However, there is a gap in the literature regarding the core dimensions of Game-based learning (GBL) for comprehensive design, analysis, and evaluation due to inconsistent use of elements. The literature on GBL reports an extensive diversity of elements used for the design and evaluation of GBL without any categorization of micro and macro-level elements. Hardly any studies systematically decompose these aspects to derivate factors/sub-factors, obstructing identification of any clear pattern. The problem is not the scarcity of GBL research but inconsistency in terminology, scope, definition, and usage of elements leading to the absence of a holistic view of GBL for effective design and evaluation. This study bridges the gap by outlining terminology and scope with four conceptual levels and then systematically categorizing GBL elements by scope, definition, and usage. The methodology used is directed content analysis of GBL literature collected through a previous systematic literature review. Dimensionalization of GBL and further decomposition into factor/sub-factors based on theoretical constructs, has resulted in a consistent and clear pattern delineating the structure of the educational game design, analysis, and evaluation. Further codifying metrics and mapping the relationship among GBL dimensions deduce into a conceptual framework (called LEAGUÊ) that facilitates greater insight into the process of learning with educational games, where to focus and what to evaluate. The LEAGUÊ framework can be applied for the analysis, design and evaluation of learning games. The framework is put in practice by utilizing the framework components (dimensions, factors/sub-factors and relations) to develop three items: 1) an analysis instrument, 2)a card-based ideation and design toolkit, and 3) an evaluation guide that can assist educational game designers, researchers, educators and evaluators for the analysis, design and evaluation of learning games respectively. This paper exemplifies the application of framework for the analysis of learning games using the analysis instrument (developed using LEAGUÊ framework) with one case study as an example.

[1]  Azizah Jaafar,et al.  Educational games (EG) design framework: Combination of game design, pedagogy and content modeling , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[2]  Susan Spiggle.  Analysis and Interpretation of Qualitative Data in Consumer Research , 1994 .

[3]  Alain Abran,et al.  ANALYZING , MEASURING & ASSESSING SOFTWARE QUALITY WITHIN A LOGIC-BASED GRAPHICAL FRAMEWORK , 2001 .

[4]  Pauline Rooney,et al.  A Theoretical Framework for Serious Game Design: Exploring Pedagogy, Play and Fidelity and their Implications for the Design Process , 2012, Int. J. Game Based Learn..

[5]  Vincent Aleven,et al.  Toward a Framework for the Analysis and Design of Educational Games , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[6]  Thrasyvoulos Tsiatsos,et al.  Panic in the gallery: An online educational game for art history: Design and evaluation of a matching game , 2015, 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA).

[7]  Dirk Ifenthaler,et al.  Serious Games Analytics: Theoretical Framework , 2015 .

[8]  Kristian Kiili,et al.  Flow experience in game based learning - a systematic literature review , 2017, Int. J. Serious Games.

[9]  Valeria Negovan.  Dimensions of students’ psychosocial well-being and their measurement: Validation of a students’ Psychosocial Well Being Inventory , 2010 .

[10]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[11]  Christiane Gresse von Wangenheim,et al.  How to Evaluate Educational Games: a Systematic Literature Review , 2016, J. Univers. Comput. Sci..

[12]  Azizah Jaafar,et al.  Quantitive analysis in a heuristic evaluation for usability of Educational Computer Game (UsaECG) , 2012, 2012 International Conference on Information Retrieval & Knowledge Management.

[13]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[14]  Maria Virvou,et al.  On the usability and likeability of virtual reality games for education: The case of VR-ENGAGE , 2008, Comput. Educ..

[15]  Lennart E. Nacke,et al.  Contextual influences on mobile player experience - A game user experience model , 2013, Entertain. Comput..

[16]  Mifrah Ahmad,et al.  Towards an Effective Modelling and Development of Educational Games with Subject-Matter: A Multi-Domain Framework , 2015, 2015 5th International Conference on IT Convergence and Security (ICITCS).

[17]  Michail N. Giannakos,et al.  Design Principles for Serious Video Games in Mathematics Education: From Theory to Practice , 2014, Int. J. Serious Games.

[18]  Choo-Yee Ting,et al.  Adaptive digital game-based learning framework , 2007, DIMEA.

[19]  Ju-Ling Shih,et al.  Game Factors and Game-Based Learning Design Model , 2015, Int. J. Comput. Games Technol..

[20]  Michail N. Giannakos,et al.  Enjoy and learn with educational games: Examining factors affecting learning performance , 2013, Comput. Educ..

[21]  Claudio Dondi,et al.  A methodological proposal for learning games selection and quality assessment , 2007, Br. J. Educ. Technol..

[22]  Norshuhada Shiratuddin,et al.  Heuristics Evaluation Strategy for Mobile Game-Based Learning , 2010, 2010 6th IEEE International Conference on Wireless, Mobile, and Ubiquitous Technologies in Education.

[23]  Wong Seng Yue,et al.  Usability evaluation for history educational games , 2009, ICIS.

[24]  K. Kiili.  Digital game-based learning: Towards an experiential gaming model , 2005, Internet High. Educ..

[25]  Chung-Ho Su,et al.  Rough Set Theory Based Fuzzy TOPSIS on Serious Game Design Evaluation Framework , 2013 .

[26]  Hussein Karam Hussein Abd El-Sattar,et al.  Learning Islamic Principles with Serious Games , 2016, ACE.

[27]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[28]  Sherry Y. Chen,et al.  Interface Evaluation of a Game-Based Learning System: Experts vs. Novices , 2015, 2015 IIAI 4th International Congress on Advanced Applied Informatics.

[29]  Thomas Connolly,et al.  Games-Based Learning Advancements for Multi-Sensory Human Computer Interfaces: Techniques and Effective Practices , 2009 .

[30]  Marco Taisch,et al.  Serious Games in Manufacturing Education: Evaluation of Learners' Engagement , 2012, VS-GAMES.

[31]  Konstantin Mitgutsch,et al.  Purposeful by design?: a serious game design assessment framework , 2012, FDG.

[32]  Dimitra Pappa,et al.  Effective Design and Evaluation of Serious Games: The Case of the e-VITA Project , 2010, WSKS.

[33]  Yi Hsuan Liao,et al.  Heuristic Evaluation of Digital Game Based Learning: A Case Study , 2012, 2012 IEEE Fourth International Conference On Digital Game And Intelligent Toy Enhanced Learning.

[34]  Leonardo Cunha de Miranda,et al.  Evaluating Multiple Aspects of Educational Computer Games: Literature Review and Case Study , 2014, Int. J. Comput. Games Technol..

[35]  Hsien-Sheng Hsiao,et al.  The implementation and evaluation of educational online gaming system , 2005, ITRE 2005. 3rd International Conference on Information Technology: Research and Education, 2005..

[36]  Jean-Marc Lavest,et al.  Towards a Learning Game Evaluation Methodology in a Training Context: a Literature Review , 2014 .

[37]  Mark Stansfield,et al.  Towards the Development of a Games-Based Learning Evaluation Framework , 2009 .

[38]  Hao-feng Zhang,et al.  Research on the design and evaluation of educational games based on the RETAIN model , 2010, 2010 Third International Symposium on Knowledge Acquisition and Modeling.

[39]  Barbara M. Wildemuth,et al.  Applications of Social Research Methods to Questions in Information and Library Science , 2009 .

[40]  Riccardo Berta,et al.  Assessment in and of Serious Games: An Overview , 2013, Adv. Hum. Comput. Interact..

[41]  Christiane Gresse von Wangenheim,et al.  How games for computing education are evaluated? A systematic literature review , 2017, Comput. Educ..

[42]  Leonard A. Annetta.  The “I's” Have It: A Framework for Serious Educational Game Design , 2010 .

[43]  Mary E. W. Dankbaar,et al.  The game-based learning evaluation model GEM: measuring the effectiveness of serious games using a standardised method , 2015 .

[44]  André de Lima Salgado,et al.  Evaluation of the user experience and intrinsic motivation with educational and mainstream digital games , 2015, CLIHC.

[45]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[46]  Alan Amory,et al.  Game object model version II: a theoretical framework for educational game development , 2007 .

[47]  Azizah Jaafar,et al.  Conceptual Framework for a Heuristics Based Methodology for Interface Evaluation of Educational Games , 2010, Comput. Inf. Sci..

[48]  Timo Lainema,et al.  Flow framework for analyzing the quality of educational games , 2014, Entertain. Comput..