The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE).

The present review examines research on the effects of educational technology applications on mathematics achievement in K-12 classrooms. Unlike previous reviews, this review applies consistent inclusion standards to focus on studies that met high methodological standards. In addition, methodological and substantive features of the studies are investigated to examine the relationship between educational technology applications and study features. A total of 74 qualified studies were included in our final analysis with a total sample size of 56,886 K-12 students: 45 elementary studies (N = 31,555) and 29 secondary studies (N = 25,331). Consistent with the more recent reviews, the findings suggest that educational technology applications generally produced a positive, though modest, effect (ES = +0.15) in comparison to traditional methods. However, the effects may vary by educational technology type. Among the three types of educational technology applications, supplemental CAI had the largest effect with an effect size of +0.18. The other two interventions, computer-management learning and comprehensive programs, had a much smaller effect size, +0.08 and +0.07, respectively. Differential impacts by various study and methodological features are also discussed.

[1]  William M. Borton.  The effects of computer managed mastery learning on mathematics test scores in the elementary school , 1988 .

[2]  Robert E. Slavin,et al.  The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education , 2009 .

[3]  Terri J. Gaeddert,et al.  Using Accelerated Math To Enhance Student Achievement in High School Mathematics Courses. , 2001 .

[4]  Kim Stubblefield Mintz,et al.  A comparison of computerized and traditional instruction in elementary mathematics , 2000 .

[5]  Lisa Markman,et al.  Technology's Edge: The Educational Benefits of Computer-Aided Instruction , 2007 .

[6]  Lisa Barrow,et al.  Technology's Edge: The Educational Benefits of Computer-Aided Instruction. NBER Working Paper No. 14240. , 2008 .

[7]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[8]  Catherine Alifrangis.  An integrated learning system in an elementary school: implementation, attitudes, and results , 1991 .

[9]  Jennifer M. Suh,et al.  Examining Technology Uses in the Classroom: Developing Fraction Sense Using Virtual Manipulative Concept Tutorials , 2005 .

[10]  A. Su,et al.  The National Council of Teachers of Mathematics , 1932, The Mathematical Gazette.

[11]  Herbert J. Walberg,et al.  Comparative Effects of Computer-Assisted Instruction: A Synthesis of Reviews , 1987 .

[12]  George Bass,et al.  Teaching Basic Skills through Microcomputer Assisted Instruction , 1986 .

[13]  Edwin P. Christmann,et al.  A Meta-Analytic Comparison of the Effects of Computer-Assisted Instruction on Elementary Students' , 2003 .

[14]  Robert E. Slavin,et al.  Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis , 2007 .

[15]  J. Easton.  A Multisite Cluster Randomized Trial of the Effects of CompassLearning Odyssey® Math on the Math Achievement of Selected Grade 4 Students in the Mid-Atlantic Region , 2009 .

[16]  David W. Brooks,et al.  The Impact of Virtual Manipulatives on First Grade Geometry Instruction and Learning , 2006 .

[17]  Barbara Ann Easterling,et al.  The Effects of Computer Assisted Instruction as a Supplement to Classroom Instruction in Reading Comprehension and Arithmetic , 1982 .

[18]  Patricia S. Moyer,et al.  Third Graders Learn about Fractions Using Virtual Manipulatives: A Classroom study , 2005 .

[19]  Ralph A. Van Dusseldorp,et al.  How Effective Is CAI? A Review of the Research , 1975 .

[20]  Nancy A. Madden,et al.  Measures Inherent to Treatments in Program Effectiveness Reviews , 2011 .

[21]  Richard Spicuzza,et al.  Effects of a Learning Information System on Mathematics Achievement and Classroom Structure , 2003 .

[22]  Ronghua Ouyang,et al.  A meta-analysis: effectiveness of computer-assisted instruction at the level of elementary education (k--6) , 1993 .

[23]  D. Bolt,et al.  Effect of Technology-Enhanced Continuous Progress Monitoring on Math Achievement , 2007 .

[24]  Laurel Cooley,et al.  Evaluating student understanding in a calculus course enhanced by a computer algebra system , 1997 .

[25]  Barbara McGregor Moore,et al.  Achievement in Basic Math Skills for Low Performing Students: A Study of Teachers' Affect and CAI. , 1988 .

[26]  Michael E. Martinez,et al.  Spatial Temporal Mathematics at Scale: An Innovative and Fully Developed Paradigm to Boost Math Achievement among All Learners , 2010 .

[27]  J. Kulik,et al.  Effects of Computer-Based Teaching on Secondary School Students. , 1983 .

[28]  Qing Li,et al.  A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning , 2010 .

[29]  J. Ysseldyke,et al.  Effects of Curriculum-Based Monitoring on Classroom Instruction and Math Achievement , 2001 .

[30]  Susan Louise Quest Manuel.  THE RELATIONSHIP BETWEEN SUPPLEMENTAL COMPUTER ASSISTED MATHEMATICS INSTRUCTION AND STUDENT ACHIEVEMENT , 1987 .

[31]  Patrick Suppes,et al.  THE EFFECTIVENESS OF ALTERNATIVE INSTRUCTIONAL MEDIA: A SURVEY* , 1973 .

[32]  Boya Ma,et al.  Comparative Effectiveness of Carnegie Learning's "Cognitive Tutor Bridge to Algebra" Curriculum: A Report of a Randomized Experiment in the Maui School District. Research Report. , 2007 .

[33]  In-Sue Oh,et al.  Fixed- versus random-effects models in meta-analysis: model properties and an empirical comparison of differences in results. , 2009, The British journal of mathematical and statistical psychology.

[34]  Philip C. Abrami,et al.  Research on Distance Education: In defense of field experiments , 2006 .

[35]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[36]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[37]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[38]  Thomas A. Brush,et al.  The effects on student achievement and attitudes when using integrated learning systems with cooperative pairs , 1997 .

[39]  Stephen R. Hotard,et al.  Computer Assisted Instruction as an Enhancer of Remediation. , 1983 .

[40]  Thomas R. Post,et al.  Using Microcomputers With Fourth-Grade Students to Reinforce Arithmetic Skills. , 1985 .

[41]  Yuen-kuang Cliff Liao,et al.  Effects of Hypermedia Versus Traditional Instruction on Students’ Achievement , 1998 .

[42]  Cheryl D. Roddick.  DIFFERENCES IN LEARNING OUTCOMES: CALCULUS & MATHEMATICA VS. TRADITIONAL CALCULUS , 2001 .

[43]  M. Schork.  Publication bias and meta analysis. , 2003, Journal of hypertension.

[44]  Richard E. Clark,et al.  Confounding in Educational Computing Research , 1985 .

[45]  John Thayer.  The effect of the use of computer assisted instruction (CAI) on attitudes and computational scores of developmental mathematics students at two inner city schools with predominantly Black enrollment , 1992 .

[46]  A. Ellington.  A Meta-Analysis of the Effects of Calculators on Students' Achievement and Attitude Levels in Precollege Mathematics Classes , 2003 .

[47]  Yuen-kuang Cliff Liao,et al.  Effects of computer-assisted instruction on students' achievement in Taiwan: A meta-analysis , 2007, Comput. Educ..

[48]  T. E. Bailey.  The effect of computer-assisted instruction in improving mathematics performance of low-achieving ninth-grade students , 1991 .

[49]  Wen-Cheng Lee,et al.  The effectiveness of computer-assisted instruction and computer programming in elementary and secondary mathematics : a meta-analysis , 1990 .

[50]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041. , 2009 .

[51]  Robert E. Slavin,et al.  Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis , 2008 .

[52]  Richard E. Ferdig,et al.  The Effects of Technology on Reading Performance in the Middle-School Grades: A Meta-Analysis With Recommendations for Policy. , 2005 .

[53]  Patrick Suppes,et al.  The Effectiveness of Alternative Instructional Media: A Survey1 , 1974 .

[54]  R. Kozma.  Will media influence learning? Reframing the debate , 1994 .

[55]  Y. Sankar,et al.  Evaluation of Computer‐Assisted Instruction , 1988 .

[56]  Effects of Computer-Assisted Instruction on Attitudes and Achievement of Fourth Grade Students in Reading and Mathematics , 1985 .

[57]  Mitchell J. Nathan,et al.  Considerations of Learning and Learning Research: Revisiting the "Media Effects" Debate , 2001 .

[58]  Karen Hollebrands,et al.  The Role of a Dynamic Software Program for Geometry in the Strategies High School Mathematics Students Employ , 2007 .

[59]  Khalili Ahmad,et al.  The Effectiveness of Computer Applications , 1994 .

[60]  P. A. Meyer.  A comparative analysis of the value of intrinsic motivation in computer software on the math achievement, attitudes, attendance, and depth-of-involvement of underachieving students (cai) , 1986 .

[61]  Marjorie Ragosta,et al.  Computer-Assisted Instruction and Compensatory Education: A Longitudinal Analysis. , 1983 .

[62]  Henry Jay Becker,et al.  Computer-Based Integrated Learning Systems in the Elementary and Middle Grades: A Critical Review and Synthesis of Evaluation Reports , 1992 .

[63]  R. Hembree,et al.  Effects of Hand-Held Calculators in Precollege Mathematics Education: A Meta-Analysis. , 1986 .

[64]  Karen Hollebrands,et al.  High school students’ understandings of geometric transformations in the context of a technological environment , 2003 .

[65]  William R. Penuel,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort , 2007 .

[66]  Joseph H. Birch.  The effects of the Delaware Challenge Grant Program on the standardized reading and mathematics test scores of second and third graders in the Caesar Rodney School District , 2002 .

[67]  H. Patricia Spencer,et al.  The effects of computerized instruction on the improvement and transfer of writing skills for low-skilled and below-average-skilled sophomore students, considering student gender, ethnicity, and learning style preferences , 1993 .

[68]  Erica N. Walker,et al.  Student and faculty experiences using computer algebra systems in undergraduate mathematics classrooms , 2009 .

[69]  James E. Ysseldyke,et al.  Using a Curriculum-Based Instructional Management System to Enhance Math Achievement in Urban Schools , 2003 .

[70]  The relationship of computer-assisted instruction to mathematics achievement, student cognitive styles, and student and teacher attitudes , 1990 .

[71]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-Based Education in Secondary Schools. , 1985 .

[72]  Charles Funkhouser,et al.  The Effects of Computer-Augmented Geometry Instruction on Student Performance and Attitudes , 2002 .

[73]  Maggie B. McGatha,et al.  Methods of Instructional Improvement in Algebra , 2010 .

[74]  Pamela L. Eddy.  COLLEGE ' OF WILLIAM AND MARY , 2004 .

[75]  Y. Liao.  Effects of hypermedia on students' achievement: a meta-analysis , 1999 .

[76]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[77]  David E. Hawley,et al.  Costs, Effects, and Utility of Microcomputer Assisted Instruction in the Classroom , 1990 .

[78]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[79]  Z. Mevarech.  The effectiveness of individualized versus cooperative computer-based integrated learning systems , 1994 .

[80]  John Edwin Smith,et al.  THE EFFECT OF THE CARNEGIE ALGEBRA TUTOR ON STUDENT ACHIEVEMENT AND ATTITUDE IN INTRODUCTORY HIGH SCHOOL ALGEBRA , 2001 .

[81]  John F. Vinsonhaler,et al.  A Summary of Ten Major Studies on CAI Drill and Practice. , 1972 .

[82]  Daniel F. McCaffrey,et al.  An Experiment to Evaluate the Efficacy of Cognitive Tutor Geometry , 2010 .

[83]  Robert E. Slavin,et al.  The Effectiveness of Education Technology for Enhancing Reading Achievement: A Meta-Analysis. , 2011 .

[84]  Stephen E. Fienberg,et al.  Assessing Evaluation Studies: The Case of Bilingual Education Strategies. , 1992 .

[85]  Alice W. Ryan.  Meta-Analysis of Achievement Effects of Microcomputer Applications in Elementary Schools , 1991 .

[86]  S. Choi-koh,et al.  A Student's Learning of Geometry Using the Computer , 1999 .

[87]  Thomas E. Dellario.  The Effects of Computer Assisted Instruction in Basic Skills Courses on High-Risk Ninth Grade Students , 1987 .

[88]  Henry Jay Becker,et al.  Mindless or mindful use of integrated learning systems , 1994 .

[89]  Richard Niemiec,et al.  The Effects of Computer Based Instruction in Elementary Schools: A Quantitative Synthesis. , 1987 .

[90]  Claire M. Fletcher-Flinn,et al.  The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis , 1995 .

[91]  Chen-Lin C. Kulik,et al.  Review of recent research literature on computer-based instruction , 1987 .

[92]  Michael B. Eisenberg,et al.  Computer Skills for Information Problem-Solving: Learning and Teaching Technology in Context. ERIC Digest. , 1996 .

[93]  L. Hedges,et al.  Vote-counting methods in research synthesis. , 1980 .

[94]  G. Gigerenzer,et al.  Do studies of statistical power have an effect on the power of studies , 1989 .

[95]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[96]  Edwin P. Christmann,et al.  The effectiveness of computer-assisted instruction on the academic achievement of secondary students: a meta-analytic comparison between urban, suburban, and rural educational settings , 1997 .

[97]  J. Atkins,et al.  The association between the use of accelerated math and students' math achievement , 2005 .

[98]  Marley W. Watkins,et al.  Microcomputer-Based Math Instruction with First-Grade Students , 1986 .

[99]  Jeremy Roschelle,et al.  Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics , 2010 .

[100]  E. Vockell,et al.  An Investigation of the Relationship between Integrated Learning Systems and Academic Achievement , 1999 .

[101]  H. Miller.  Quantitative analyses of student outcome measures , 1997 .

[102]  Robert D. Hess,et al.  School-Relevant Effects of Educational Uses of Microcomputers in Kindergarten Classrooms and Homes , 1987 .

[103]  Blaine R. Worthen,et al.  Can Integrated Instructional Technology Transform the Classroom , 1995 .

[104]  Steven M. Ross,et al.  The Effect of School Renaissance on Student Achievement in Two Mississippi School Districts. , 2005 .

[105]  T. Sterling.  Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa , 1959 .