Theoretical Considerations for Game-Based e-Learning Analytics

In an interactive digital game or gamified e-learning experience, mapping a learner’s progress, problem-solving attempts, self-expressions and social communications can entail highly detailed and time-sensitive computer-based traces that capture the context, actions, processes and products. New educational measurement and analysis considerations are needed to address the challenges of finding patterns and making inferences concerning what someone knows and can do. Methods based in data-mining, machine learning, model-building and complexity theory are discussed as theoretical foundations for dealing with time sensitivity, spatial relationships, multiple layers of aggregations at different scales, and the dynamics of complex performance spaces. Examples of these considerations in game-based learning analytics are presented and discussed in the hope of making a contribution to the development and refinement of theoretical approaches to measurement.

[1]  Randy Elliot Bennett,et al.  Problem Solving in Technology-Rich Environments. A Report from the NAEP Technology-Based Assessment Project, Research and Development Series. NCES 2007-466. , 2007 .

[2]  Jody Clarke-Midura,et al.  Some Psychometric and Design Implications of Game Based Learning Analytics , 2015 .

[3]  Will M. Bennis,et al.  Fast and frugal heuristics in sports. , 2006 .

[4]  J. Michael Spector,et al.  Highly integrated model assessment technology and tools , 2010, CELDA 2008.

[5]  Nahil Sharkasi.  The Doctor Will Be You Now: A Case Study on Medical Ethics and Role-Play , 2011 .

[6]  Robert J. Mislevy,et al.  Evidence-Centered Design of Epistemic Games: Measurement Principles for Complex Learning Environments. , 2010 .

[7]  Robert J. Mislevy,et al.  Three Things Game Designers Need to Know About Assessment , 2012 .

[8]  Kathleen D. Vohs,et al.  Encyclopedia of social psychology , 2007 .

[9]  Randy Elliot Bennett,et al.  How the Internet Will Help Large-Scale Assessment Reinvent Itself , 2001 .

[10]  Jody Clarke-Midura,et al.  Technology-Based Assessments for 21st Century Skills: Theoretical and Practical Implications from Modern Research. Current Perspectives on Cognition, Learning and Instruction. , 2012 .

[11]  Michael D. Schmidt,et al.  Symbolic Regression of Implicit Equations , 2010 .

[12]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[13]  Susan M. Land,et al.  From Practice Fields to Communities of Practice , 2014 .

[14]  Athanasios V. Vasilakos,et al.  Big data: From beginning to future , 2016, Int. J. Inf. Manag..

[15]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[16]  Rodney A. Brooks,et al.  Cambrian Intelligence: The Early History of the New AI , 1999 .

[17]  Dirk Ifenthaler,et al.  Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives , 2012 .

[18]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[19]  David Gibson,et al.  Game Changers for Teacher Education , 2011 .

[20]  L. M. Laosa,et al.  Segregation of Children Who Migrate to the U.S. From Puerto Rico , 2001 .

[21]  David Gibson,et al.  Data Challenges of Leveraging a Simulation to Assess Learning. , 2013 .

[22]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[23]  J. D. Fletcher,et al.  Computer Games and Instruction. , 2011 .

[24]  Jörg Rieskamp,et al.  Fast and frugal heuristics , 2007 .

[25]  Chris Dede,et al.  Assessment, Technology, and Change , 2010 .

[26]  J. Michael Spector,et al.  E-Learning Systems, Environments and Approaches: Theory and Implementation , 2015 .

[27]  Jody Clarke‐Midura,et al.  Technology Based Assessment for 21st Century Skills: Theoretical and Practical Implications from Modern Research , 2012 .

[28]  I. Prigogine,et al.  Exploring Complexity: An Introduction , 1989 .

[29]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[30]  Jodi L. Davenport,et al.  21st Century Dynamic Assessment , 2012 .

[31]  Jody Clarke,et al.  Measuring inquiry: new methods, promises & challenges , 2010, ICLS.

[32]  Paul K. Feyerabend.  Problems of empiricism , 1981 .

[33]  Martha Koch,et al.  Rethinking validation in complex high-stakes assessment contexts , 2012 .

[34]  Angelo Cangelosi,et al.  Computersimulation:anewscientific Approachtothestudyoflanguageevolution Anewapproachtothestudyoflanguage Evolution:computersimulation , 2001 .

[35]  John H. Holland,et al.  Hidden Order: How Adaptation Builds Complexity , 1995 .