Technology’s effect on achievement in higher education: a Stage I meta-analysis of classroom applications

This paper reports the findings of a Stage I meta-analysis exploring the achievement effects of computer-based technology use in higher education classrooms (non-distance education). An extensive literature search revealed more than 6,000 potentially relevant primary empirical studies. Analysis of a representative sample of 231 studies (k = 310) yielded a weighted average effect size of 0.28 surrounded by wide variability. A mixed effects model was adopted to explore coded moderators of effect size. Research design was found to be not significant across true, quasi- and pre-experimental designs, so the designs were combined. The variable “degree of technology use” (i.e., low, medium, and high) was found to be significant, with low and medium use performing significantly higher than high use. For the variable “type of use” (i.e., cognitive support tools, presentational tools, and multiple uses), cognitive support (g+ = 0.40) was greater than presentational and multiple uses.

[1]  Roger Azevedo,et al.  A Meta-Analysis of the Effects of Feedback in Computer-Based Instruction , 1995 .

[2]  C. Erik Timmerman,et al.  Computer-Assisted Instruction, Media Richness, and College Student Performance , 2006 .

[3]  Nada Dabbagh,et al.  Using Web-based Pedagogical Tools as Scaffolds for Self-regulated Learning , 2005 .

[4]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[5]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[6]  R. Clark.  Media will never influence learning , 1994 .

[7]  N. Wiebe,et al.  Effective Methods for Teaching Information Literacy Skills to Undergraduate Students: A Systematic Review and Meta-analysis , 2006 .

[8]  Yung-Chen Hsu,et al.  The effectiveness of computer-assisted instruction in statistics education: a meta-analysis , 2003 .

[9]  Richard E. Clark,et al.  An Analysis of the Failure of Electronic Media and Discovery‐Based Learning , 2010 .

[10]  Tom Cobb,et al.  Cognitive efficiency: Toward a revised theory of media , 1997 .

[11]  R. Kozma.  Will media influence learning? Reframing the debate , 1994 .

[12]  Philip C. Abrami,et al.  Media and Pedagogy in Undergraduate Distance Education: A Theory-Based Meta-Analysis of Empirical Literature , 2006 .

[13]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[14]  G. Salomon,et al.  The Differential Learning Achievements of Constructivist Technology-Intensive Learning Environments as Compared with Traditional Ones: A Meta-Analysis , 2007 .

[15]  Kevin Knight,et al.  Measuring Inconsistency , 2002, J. Philos. Log..

[16]  Rana Tamim,et al.  Effects of technology on students' achievement: A second-order meta-analysis , 2009 .

[17]  Claire M. Fletcher-Flinn,et al.  The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis , 1995 .

[18]  Robert M. Bernard,et al.  How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature , 2004 .

[19]  Y. Lou,et al.  Small Group and Individual Learning with Technology: A Meta-Analysis , 2001 .

[20]  Richard E. Clark,et al.  8 An Analysis of the Failure of Electronic Media and Discovery-Based Learning: Evidence for the Performance Benefits of Guided Training Methods 263 , 2009 .

[21]  R. Azevedo.  Using Hypermedia as a Metacognitive Tool for Enhancing Student Learning? The Role of Self-Regulated Learning , 2005 .

[22]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[23]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[24]  David H. Jonassen,et al.  Learning to Solve Problems with Technology: A Constructivist Perspective , 2002 .

[25]  Richard E. Clark,et al.  Evidence for the Performance Benefits of Guided Training Methods , 2009 .

[26]  Shawn M. Fitzgerald,et al.  The Effectiveness of Technology Use in Statistics Instruction in Higher Education: A Meta-Analysis , 2008 .

[27]  Georgette M. Michko.  A meta -analysis of the effects of teaching and learning with technology on student outcomes in undergraduate engineering education , 2007 .

[28]  Richard E. Clark,et al.  An Analysis of the Failure of Electronic Media and Discovery‐Based Learning , 2010 .

[29]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[30]  Robert M. Bernard,et al.  A Meta-Analysis of Three Types of Interaction Treatments in Distance Education , 2009 .

[31]  Larry V. Hedges,et al.  A Practical Guide to Modern Methods of Meta-Analysis. , 1989 .

[32]  Philip C. Abrami,et al.  Research on Distance Education: In defense of field experiments , 2006 .

[33]  Peter A. Cohen,et al.  Computer-Based Instruction and Health Professions Education , 1992 .

[34]  Edwin P. Christmann,et al.  The comparative effectiveness of CAI on collegiate academic performance , 2000, J. Comput. High. Educ..