The effect of individualized digital practice at home on math skills-Evidence from a two-stage experiment on whether and why it works

Abstract This paper analyses an experiment on the effect of an individualized, digital practice tool on numeracy skills for 337 seventh grade students. The first stage of the experiment shows that offering students the opportunity to practice numeracy digitally at home (intent-to-treat) leads to a substantial and significant increase in numeracy performance growth. The second stage reveals that the effectiveness of the tool mainly stems from its individualized nature. With good implementation prospects and relatively low costs, the consequences are discussed to be potentially large.

[1]  Geoffrey D. Borman,et al.  A Randomized Field Trial of the Fast ForWord Language Computer-Based Training Program , 2009 .

[2]  S. Machin,et al.  New Technology in Schools: Is There a Payoff? , 2006, SSRN Electronic Journal.

[3]  Jeffrey D. Karpicke,et al.  The Power of Testing Memory Basic Research and Implications for Educational Practice , 2006 .

[4]  Olga Pilli,et al.  The effects of computer-assisted instruction on the achievement, attitudes and retention of fourth grade mathematics students in North Cyprus , 2013, Comput. Educ..

[5]  M. Burns,et al.  Effect of a Computer-Delivered Math Fact Intervention as a Supplemental Intervention for Math in Third and Fourth Grades , 2012 .

[6]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[7]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[8]  Carol Ann Tomlinson,et al.  Teach Me, Teach My Brain: A Call for Differentiated Classrooms. , 1998 .

[9]  Carla Haelermans,et al.  The effectiveness of a computer-assisted math learning program , 2015, J. Comput. Assist. Learn..

[10]  Jeffrey M. Wooldridge,et al.  Solutions Manual and Supplementary Materials for Econometric Analysis of Cross Section and Panel Data , 2003 .

[11]  Carolyn J. Heinrich,et al.  Improving the Implementation and Effectiveness of Out‐of‐School‐Time Tutoring , 2014 .

[12]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[13]  Lisa Barrow,et al.  Technology's Edge: The Educational Benefits of Computer-Aided Instruction , 2008 .

[14]  Jesus Rodriguez.  Skills Outlook 2013: first results from the survey of adult skills , 2014 .

[15]  Douglas L. Miller,et al.  Bootstrap-Based Improvements for Inference with Clustered Errors , 2007 .

[16]  B. Chiswick,et al.  Schooling, Literacy, Numeracy and Labour Market Success , 2002 .

[17]  Beverly Park Woolf,et al.  Improving Math Learning through Intelligent Tutoring and Basic Skills Training , 2010, Intelligent Tutoring Systems.

[18]  Mark W. Lipsey,et al.  Empirical Benchmarks for Interpreting Effect Sizes in Research , 2008 .

[19]  F. Biagi,et al.  Measuring ICT Use and Learning Outcomes: Evidence from Recent Econometric Studies , 2013 .

[20]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[21]  Robert E. Slavin,et al.  How features of educational technology applications affect student reading outcomes: A meta-analysis , 2012 .

[22]  Spss,et al.  Discovering Statistics (4th Edition ed. , 2013 .

[23]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[24]  Y. L. Lee.  Literacy, numeracy and labour market success , 2000 .

[25]  Gert Rijlaarsdam,et al.  Over de drempels met taal en rekenen: hoofdrapport van de expertgroep Doorlopende Leerlijnen Taal en Rekenen , 2008 .

[26]  Mikael Lindahl,et al.  The Effect of Extra Funding for Disadvantaged Pupils on Achievement , 2004, The Review of Economics and Statistics.

[27]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[28]  Silvia Micheletta.  John Hattie, Visible Learning. A synthesis of over 800 meta-analyses relating to achievement. London & New York: Routledge (2009). John Hattie, Visible Learning for teachers. Maximizing impact on learning. London & New York: Routledge (2012). , 2013 .

[29]  Ó. Marcenaro-Gutierrez,et al.  The value of basic skills in the British labour market. Research report, October 2008 , 2007 .

[30]  E. Hanushek,et al.  Returns to Skills Around the World: Evidence from PIAAC , 2013, SSRN Electronic Journal.

[31]  Alan B. Krueger,et al.  Putting Computerized Instruction to the Test: A Randomized Evaluation of a "Scientifically-Based" Reading Program , 2004 .

[32]  J. Angrist,et al.  New Evidence on Classroom Computers and Pupil Learning , 1999, SSRN Electronic Journal.

[33]  H. Brink,et al.  The Differential Effect of Basic Mathematics Skills Homework via a Web-Based Intelligent Tutoring System across Achievement Subgroups and Mathematics Domains: A Randomized Field Experiment. , 2016 .