The effectiveness of a computer-assisted math learning program

Computer-assisted instruction CAI programs are considered as a way to improve learning outcomes of students. However, little is known on the schools who implement such programs as well as on the effectiveness of similar information and communication technology programs. We provide a literature review that pays special attention to the existing causal evidence of computer-assisted programs on learning outcomes. The paper relies on a rich data set consisting of i pupil-level information on the use of a Dutch computer-assisted program and ii detailed school-level information on, among others, outcomes on national exams. The results suggest that schools with lower educational attainments use more frequently CAI programs. This suggests that they use CAI programs to catch up on learning outcomes. Moreover, using an instrumental variable design, we argue that given the participation in the CAI program, making more exercises leads to higher test results. Working with a CAI program seems therefore effective.

[1]  Vincenzo Spiezia,et al.  Does Computer Use Increase Educational Achievements? Student-level Evidence from PISA , 2011 .

[2]  Abdullah Topcu,et al.  Effect of Cabri-assisted instruction on secondary school students’ misconceptions about graphs of quadratic functions , 2012 .

[3]  Yung-Ming Cheng,et al.  Antecedents and consequences of e‐learning acceptance , 2011, Inf. Syst. J..

[4]  Hsiu-Li Liao,et al.  Impact of media richness and flow on e-learning technology acceptance , 2009, Comput. Educ..

[5]  Rae Condie,et al.  The impact of ICT in schools - a landscape review , 2007 .

[6]  H. Doerr,et al.  You have printed the following article : Creating Meaning for and with the Graphing Calculator , 2008 .

[7]  M. Cox,et al.  ICT and attainment: a review of the research literature , 2003 .

[8]  S. Hennessy,et al.  Teacher perspectives on integrating ICT into subject teaching: commitment, constraints, caution, and change , 2005 .

[9]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[10]  Beverly Park Woolf,et al.  Evaluation of AnimalWatch: An Intelligent Tutoring System for Arithmetic and Fractions , 2010 .

[11]  Harold H. Wenglinsky.  Does It Compute? The Relationship between Educational Technology and Student Achievement in Mathematics. , 1998 .

[12]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[13]  Edwin P. Christmann,et al.  The comparative effectiveness of CAI on collegiate academic performance , 2000, J. Comput. High. Educ..

[14]  M. E. Otter,et al.  Computer-Assisted Instruction in Support of Beginning Reading Instruction: A Review , 2002 .

[15]  Anna Potocki,et al.  Effects of computer-assisted comprehension training in less skilled comprehenders in second grade: A one-year follow-up study , 2013, Comput. Educ..

[16]  Richard D. Johnson,et al.  The Multilevel and Multifaceted Character of Computer Self-Efficacy: Toward Clarification of the Construct and an Integrative Framework for Research , 1998, Inf. Syst. Res..

[17]  B F SKINNER,et al.  Teaching Machines , 1962 .

[18]  Milan Kubiatko,et al.  THE RELATIONSHIP BETWEEN ICT USE AND SCIENCE KNOWLEDGE FOR CZECH STUDENTS: A SECONDARY ANALYSIS OF PISA 2006 , 2010 .

[19]  Mikael Lindahl,et al.  The Effect of Extra Funding for Disadvantaged Pupils on Achievement , 2004, The Review of Economics and Statistics.

[20]  Sol Saporta.  Book Reviews: Toeplitz Forms and Their Applications , 1958 .

[21]  Edwin P. Christmann,et al.  A Meta-Analytic Comparison of the Effects of Computer-Assisted Instruction on Elementary Students' , 2003 .

[22]  Charlie C. Chen,et al.  An Integrative Model to Predict the Continuance Use of Electronic Learning Systems: Hints for Teaching , 2006 .

[23]  S. Machin,et al.  New Technology in Schools: Is There a Payoff? , 2006, SSRN Electronic Journal.

[24]  Kristof De Witte,et al.  Public expenditures, educational outcomes and grade inflation: theory and evidence from a policy intervention in the Netherlands , 2012 .

[25]  J. Macdonald,et al.  Developing competent e‐learners: the role of assessment , 2004 .

[26]  Emily C. Bouck,et al.  Assistive Technology and Mathematics: What is There and Where Can We Go in Special Education , 2009 .

[27]  Margaret J. Cox,et al.  Effects of ICT: Do we know what we should know? , 2007, Education and Information Technologies.

[28]  J. Arbaugh.  Managing the on-line classroom , 2002 .

[29]  Keenan A. Pituch,et al.  The influence of system characteristics on e-learning use , 2006, Comput. Educ..

[30]  Zhi-Jin Zhong,et al.  From access to usage: The divide of self-reported digital skills among adolescents , 2011, Comput. Educ..

[31]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[32]  C. Steinfield,et al.  A Social Influence Model of Technology use , 1990 .

[33]  B. Skinner.  The science of learning and the art of teaching. , 1954 .

[34]  Ludger Woessmann,et al.  Computers and Student Learning: Bivariate and Multivariate Evidence on the Availability and Use of Computers at Home and at School , 2004, SSRN Electronic Journal.

[35]  Patricia S. Moyer,et al.  Third Graders Learn about Fractions Using Virtual Manipulatives: A Classroom study , 2005 .

[36]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[37]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[38]  David V. Thiel,et al.  Fine tuning the teaching methods used for second year university mathematics , 2012 .

[39]  F. Biagi,et al.  Measuring ICT Use and Learning Outcomes: Evidence from Recent Econometric Studies , 2013 .

[40]  Jörg Wittwer,et al.  Is students' computer use at home related to their mathematical performance at school? , 2008, Comput. Educ..

[41]  Neil T. Heffernan,et al.  A Quasi-Experimental Evaluation of An On-Line Formative Assessment and Tutoring System , 2010 .

[42]  William R. Penuel,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort , 2007 .

[43]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[44]  Glenn K. Baggott,et al.  COMPUTER-BASED AND COMPUTER-ASSISTED TESTS TO ASSESS PROCEDURAL AND CONCEPTUAL KNOWLEDGE , 2004 .

[45]  J. Merriënboer,et al.  Research on cognitive load theory and its design implications for e-learning , 2005 .

[46]  Louise Quinn,et al.  Student teachers' attitudes to and use of computers to teach mathematics in the primary classroom , 2005 .

[47]  Gert Rijlaarsdam,et al.  Over de drempels met taal en rekenen: hoofdrapport van de expertgroep Doorlopende Leerlijnen Taal en Rekenen , 2008 .

[48]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[49]  Marylène Gagné,et al.  Understanding e-learning continuance intention in the workplace: A self-determination theory perspective , 2008, Comput. Hum. Behav..

[50]  M. Honey,et al.  Perspectives on Technology and Education Research: Lessons from the Past and Present , 2000 .

[51]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[52]  Jeremy Roschelle,et al.  Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics , 2010 .

[53]  M MarakasGeorge,et al.  The Multilevel and Multifaceted Character of Computer Self-Efficacy , 1998 .

[54]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[55]  Gerbert Kraaykamp,et al.  Home media and science performance: a cross-national study , 2009 .

[56]  Steven Hornik,et al.  An empirical examination of factors contributing to the creation of successful e-learning environments , 2008, Int. J. Hum. Comput. Stud..

[57]  J. Piaget.  Science of education and the psychology of the child , 1970 .

[58]  Amie Goldberg,et al.  The Effect of Computers on Student Writing: A Meta-analysis of Studies from 1992 to 2002 , 2003 .

[59]  King Luu,et al.  An analysis of the relationship between information and communication technology (ICT) and scientific literacy in Canada and Australia , 2011, Comput. Educ..

[60]  Alan B. Krueger,et al.  Putting Computerized Instruction to the Test: A Randomized Evaluation of a "Scientifically-Based" Reading Program , 2004 .

[61]  Shivraj Kanungo,et al.  Appropriate media choice for e-learning effectiveness: Role of learning domain and learning style , 2014, Comput. Educ..

[62]  J. Angrist,et al.  New Evidence on Classroom Computers and Pupil Learning , 1999, SSRN Electronic Journal.

[63]  Olga Pilli,et al.  The effects of computer-assisted instruction on the achievement, attitudes and retention of fourth grade mathematics students in North Cyprus , 2013, Comput. Educ..

[64]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[65]  J. Schacter.  The Impact of Education Technology on Student Achievement: What the Most Current Research Has To Say. , 1999 .