Evaluating the effectiveness of a game-based rational number training - In-game metrics as learning indicators

Abstract It was argued recently that number line based training supports the development of conceptual rational number knowledge. To test this hypothesis, we evaluated training effects of a digital game based on the measurement interpretation of rational numbers. Ninety-five fourth graders were assigned to either a game-based training group (n = 54) who played a digital rational number game for five 30-min sessions or a control group (n = 41) who attended regular math curriculum. Conceptual rational number knowledge was assessed in a pre- and posttest session. Additionally, the game groups' playing behavior was evaluated. Results indicated that the game-based training group improved their conceptual rational number knowledge significantly more strongly than the control group. In particular, improvement of the game-based training group was driven by significant performance increases in number magnitude estimation and ordering tasks. Moreover, results revealed that in-game metrics, such as overall game performance and maximum level achieved provided valid information about students’ conceptual rational number knowledge at posttest. Therefore, results of the current study not only suggest that aspects of conceptual rational number knowledge can be improved by a game-based training but also that in-game metrics provide crucial indicators for learning.

[1]  Ian Dunwell,et al.  Four-dimensional consideration of feedback in serious games , 2011 .

[2]  Korbinian Moeller,et al.  On the Relation between the Mental Number Line and Arithmetic Competencies , 2014, Quarterly journal of experimental psychology.

[3]  S. Vosniadou,et al.  How Many Decimals Are There Between Two Fractions? Aspects of Secondary School Students’ Understanding of Rational Numbers and Their Notation , 2010 .

[4]  Lynn S. Fuchs,et al.  Effects of Intervention to Improve At-Risk Fourth Graders’ Understanding, Calculations, and Word Problems with Fractions , 2016, The Elementary School Journal.

[5]  R. Siegler,et al.  Early Predictors of High School Mathematics Achievement , 2012, Psychological science.

[6]  Korbinian Moeller,et al.  Walk the number line – An embodied training of numerical concepts , 2013, Trends in Neuroscience and Education.

[7]  Jari Multisilta,et al.  Editorial: is Game-Based Math Learning Finally Coming of Age? , 2015, Int. J. Serious Games.

[8]  Michelle Riconscente,et al.  Results From a Controlled Study of the iPad Fractions Game Motion Math , 2013, Games Cult..

[9]  Nancy C. Jordan,et al.  Identifying learning difficulties with fractions: A longitudinal study of student growth from third through sixth grade , 2017 .

[10]  L. Verschaffel,et al.  Unraveling the gap between natural and rational numbers , 2015 .

[11]  Xenia Vamvakoussi.  The development of rational number knowledge: Old topic, new insights , 2015 .

[12]  Jannicke Baalsrud Hauge,et al.  Learning Analytics Architecture to Scaffold Learning Experience through Technology-based Methods , 2015, Int. J. Serious Games.

[13]  Florence Gabriel,et al.  Developing Children’s Understanding of Fractions : An Intervention Study , 2012 .

[14]  Gerd Gigerenzer,et al.  Calculated Risks: How to Know When Numbers Deceive You , 2002 .

[15]  Qing Li,et al.  A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning , 2010 .

[16]  Kelley Durkin,et al.  Diagnosing misconceptions: Revealing changing decimal fraction knowledge. , 2015 .

[17]  Kristian Kiili,et al.  Assessing fraction knowledge by a digital game , 2017, Comput. Hum. Behav..

[18]  Keith Devlin,et al.  Mathematics Education for a New Era: Video Games as a Medium for Learning , 2011 .

[19]  John Bynner,et al.  Does Numeracy Matter More , 2006 .

[20]  Clarissa A. Thompson,et al.  An integrated theory of whole number and fractions development , 2011, Cognitive Psychology.

[21]  S. Vosniadou,et al.  The development of students’ understanding of the numerical value of fractions , 2004 .

[22]  Michael Schneider,et al.  The developmental relations between conceptual and procedural knowledge: a multimethod approach. , 2010, Developmental psychology.

[23]  Lieven Verschaffel,et al.  Are secondary school students still hampered by the natural number bias? A reaction time study on fraction comparison tasks , 2013 .

[24]  S. Pickering,et al.  Working memory and education , 2006 .

[25]  Yoon Jeon Kim,et al.  Formative and Stealth Assessment , 2014 .

[26]  Lisa K. Fazio,et al.  Improving Children’s Knowledge of Fraction Magnitudes , 2016, PloS one.

[27]  Yujing Ni,et al.  Teaching and Learning Fraction and Rational Numbers: The Origins and Implications of Whole Number Bias , 2005 .

[28]  Robert S. Siegler,et al.  Bridging the Gap: Fraction Understanding Is Central to Mathematics Achievement in Students from Three Different Continents. , 2015 .

[29]  Fengfeng Ke,et al.  A case study of computer gaming for math: Engaged learning from gameplay? , 2008, Comput. Educ..

[30]  Robert S. Siegler,et al.  Fractions: the new frontier for theories of numerical development , 2013, Trends in Cognitive Sciences.

[31]  Geetha B. Ramani,et al.  Playing linear numerical board games promotes low-income children's numerical development. , 2008, Developmental science.

[32]  Stella Vosniadou,et al.  The representation of fraction magnitudes and the whole number bias reconsidered. , 2015 .

[33]  R. Siegler,et al.  The Development of Numerical Estimation , 2003, Psychological science.

[34]  Ton de Jong,et al.  Computer game-based mathematics education : Embedded faded worked examples facilitate knowledge acquisition , 2017 .

[35]  B. Rittle-Johnson,et al.  Conceptual and procedural knowledge of mathematics: Does one lead to the other? , 1999 .

[36]  Clarissa A. Thompson,et al.  Numerical landmarks are useful--except when they're not. , 2014, Journal of experimental child psychology.

[37]  Steven A Hecht,et al.  Sources of Group and Individual Differences in Emerging Fraction Skills. , 2010, Journal of educational psychology.

[38]  E. Capitani,et al.  Sex differences in spatial memory: A reanalysis of block tapping long-term memory according to the short-term memory level , 1991, The Italian Journal of Neurological Sciences.

[39]  Lieven De Marez,et al.  Improving arithmetic skills through gameplay: Assessment of the effectiveness of an educational game in terms of cognitive and affective learning outcomes , 2014, Inf. Sci..

[40]  Harri Ketamo,et al.  Evaluating Cognitive and Affective Outcomes of a Digital Game-Based Math Test , 2018, IEEE Transactions on Learning Technologies.

[41]  M. Alibali,et al.  Variability in the natural number bias: Who, when, how, and why , 2015 .

[42]  Julie L. Booth,et al.  Developmental and individual differences in pure numerical estimation. , 2006, Developmental psychology.

[43]  Lynn S. Fuchs,et al.  Does working memory moderate the effects of fraction intervention? An aptitude–treatment interaction. , 2014 .

[44]  Jeffrey Earp,et al.  An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games , 2016, Comput. Educ..

[45]  Kristian Kiili,et al.  A Game-Based Approach to Examining Students' Conceptual Knowledge of Fractions , 2016, GALA.

[46]  Erno Lehtinen,et al.  Modeling the developmental trajectories of rational number concept(s) , 2015 .

[47]  Lynn S. Fuchs,et al.  Improving At-Risk Learners' Understanding of Fractions , 2013 .

[48]  S. Gathercole,et al.  Working memory in children with reading disabilities. , 2006, Journal of experimental child psychology.

[49]  Alexander Robitzsch,et al.  Effects of playing mathematics computer games on primary school students' multiplicative reasoning ability , 2015 .