Evaluation of the Pedagogical Quality of Mobile Math Games in App Marketplaces

The number of available educational games has enormously grown and it is difficult for users to identify which games are pedagogically effective among the multitude of options in app marketplaces. Recent studies on math games have highlighted the importance of (1) linking learning attributes and gameplay and (2) game design that supports students' deliberate practise. Using these as a measure for pedagogical quality, we investigated 109 math games found on Google Play Store (n=61) and iOS App Store (n=48). Furthermore, monetization solutions, data use permissions, target age group and type of mathematical content were retrieved from the apps. The analysis showed that only 11,0% of the games integrated learning attributes with gameplay and 12,0% of the games contained tasks which support learners' deliberate practice. The most commonly featured math subject was arithmetic and the games were targeted mostly to early childhood (6–12 years). Finally, games following curricula content and recommended design principles were difficult to locate using the search tools of the app marketplaces.

[1]  Koen Veermans,et al.  Developing Adaptive Number Knowledge with the Number Navigation Game-Based Learning Environment , 2015 .

[2]  Priya Mishra,et al.  Search Rank Fraud and Malware Detection in Google Play , 2018 .

[3]  Ian Dunwell,et al.  Essential features of serious games design in higher education: Linking learning attributes to game mechanics , 2017, Br. J. Educ. Technol..

[4]  Daphne Bavelier,et al.  Differential development of visual attention skills in school-age children , 2010, Vision Research.

[5]  Bih ni Lee,et al.  Students' algebraic thinking and attitudes towards algebra: the effects of game-based learning using Dragonbox 12 + app , 2016 .

[6]  D. Clements,et al.  STEM Starts Early: Grounding Science, Technology, Engineering, and Math Education in Early Childhood. Executive Summary. , 2017 .

[7]  K. A. Ericsson,et al.  Deliberate practice and acquisition of expert performance: a general overview. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[8]  Michael F. Young,et al.  Our Princess Is in Another Castle , 2012 .

[9]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2009, Journal of clinical epidemiology.

[10]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[11]  Timo Knuutila,et al.  App Store, Marketplace, Play! An Analysis of Multi-Homing in Mobile Software Ecosystems , 2012, IWSECO@ICSOB.

[12]  P. Wouters,et al.  A meta-analysis of the cognitive and motivational effects of serious games , 2013 .

[13]  E. Lehtinen,et al.  Understanding students’ game experiences throughout the developmental process of the number navigation game , 2020, Educational Technology Research and Development.

[14]  T. Bouffard,et al.  When quantity is not enough: Disentangling the roles of practice time, self-regulation and deliberate practice in musical achievement , 2015 .

[15]  Koen Veermans,et al.  Adaptive number knowledge and its relation to arithmetic and pre-algebra knowledge , 2017 .

[16]  M. Rollo,et al.  A review of pregnancy apps freely available in the Google Play Store. , 2020, Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals.

[17]  Neil Gordon,et al.  Maximising Gain for Minimal Pain: Utilising Natural Game Mechanics , 2013 .

[18]  Teemu Henrikki Laine,et al.  Mobile Educational Augmented Reality Games: A Systematic Literature Review and Two Case Studies , 2018, Comput..

[19]  SalasEduardo,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[20]  R. A. R. A. U. Ritterfeld.  Classifying Serious Games , 2009 .

[21]  Helen Crompton,et al.  The use of mobile learning in PK-12 education: A systematic review , 2017, Comput. Educ..

[22]  H. Schweingruber,et al.  Mathematics learning in early childhood : paths toward excellence and equity , 2009 .

[23]  Robin Kay.  Developing a Framework to Help Educators Select and Use Mobile Apps in the Classroom , 2018 .

[24]  Gifford Cheung,et al.  Masters of Control: Behavioral Patterns of Simultaneous Unit Group Manipulation in StarCraft 2 , 2015, CHI.

[25]  Ivan Martinovic,et al.  Short Paper: A Longitudinal Study of Financial Apps in the Google Play Store , 2017, Financial Cryptography.

[26]  Ashish Joshi,et al.  Evaluating the Dietary and Nutritional Apps in the Google Play Store , 2018, Healthcare informatics research.

[27]  Abdulmotaleb El-Saddik,et al.  An Overview of Serious Games , 2014, Int. J. Comput. Games Technol..

[28]  T. Suddendorf,et al.  Understanding deliberate practice in preschool-aged children , 2016, Quarterly journal of experimental psychology.

[29]  Todd S. Cherner,et al.  Cleaning up That Mess: A Framework for Classifying Educational Apps. , 2014 .

[30]  Amanda Wilson,et al.  A systematic literature review of games-based learning empirical evidence in primary education , 2016, Comput. Educ..

[31]  Lieven De Marez,et al.  Cognitive abilities, digital games and arithmetic performance enhancement: A study comparing the effects of a math game and paper exercises , 2015, Comput. Educ..

[32]  C. Douglas Wetzel,et al.  The Effectiveness of Games for Educational Purposes: A Review of Recent Research , 1992 .

[33]  Muneera Bano,et al.  Mobile learning for science and mathematics school education: A systematic review of empirical evidence , 2018, Comput. Educ..

[34]  Samuli Laato,et al.  The Effects Playing Pokémon GO has on Physical Activity -A Systematic Literature Review , 2020, HICSS.

[35]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[36]  K. Kiili.  Digital game-based learning: Towards an experiential gaming model , 2005, Internet High. Educ..

[37]  Anissa All,et al.  Assessing the effectiveness of digital game-based learning: Best practices , 2016, Comput. Educ..

[38]  Albert D. Ritzhaupt,et al.  A synthesis on digital games in education: What the research literature says from 2000 to 2010 , 2014 .

[39]  B. DiSalvo.  Pink Boxes and Chocolate-dipped Broccoli: Bad Game Design Providing Justifications for Reluctant Learners , 2016 .

[40]  Alessandro De Gloria,et al.  Mapping learning and game mechanics for serious games analysis , 2015, Br. J. Educ. Technol..

[41]  Tae-Sun Chung,et al.  A survey of adaptive context-aware learning environments , 2019, J. Ambient Intell. Smart Environ..

[42]  Erkki Sutinen,et al.  Identifying Factors for Integrating Math and Music Education at Primary Schools in Namibia , 2019, 2019 IEEE International Conference on Engineering, Technology and Education (TALE).

[43]  Emmanuel Guardiola.  The Gameplay Loop: a Player Activity Model for Game Design and Analysis , 2016, ACE.

[44]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[45]  André Czauderna.  The Gameplay Loop Methodology as a Tool for Educational Game Design , 2019, Electronic Journal of e-Learning.

[46]  Erno Lehtinen,et al.  Cultivating mathematical skills: from drill-and-practice to deliberate practice , 2017 .

[47]  Valerie J. Shute,et al.  Games, Learning, and Assessment , 2012 .

[48]  Erno Lehtinen,et al.  Effects of a mathematics game-based learning environment on primary school students' adaptive number knowledge , 2019, Comput. Educ..

[49]  Robert S. Siegler,et al.  Distinguishing adaptive from routine expertise with rational number arithmetic , 2020 .

[50]  Julia Shaftel,et al.  Math Games for Adolescents , 2005 .