Examining the Relationship between Students' Mathematics Test Scores and Computer Use at Home and at School.

Over the past decade, standardized test results have become the primary tool used to judge the effectiveness of schools and educational programs, and today, standardized testing serves as the keystone for educational policy at the state and federal levels. This paper examines the relationship between fourth grade mathematics achievement and technology use at home and at school. Using item level achievement data, individual student’s state test scores on the Massachusetts Comprehensive Assessment System (MCAS), and student and teacher responses to detailed technology-use surveys, this study examines the relationship between technology-use and mathematics performance among 986 regular students, from 55 intact fourth grade classrooms in 25 schools across 9 school districts in Massachusetts. The findings from this study suggest that various uses of technology are differentially related to student outcomes and that in general, student and teacher technology uses are weakly related to mathematics achievement on the MCAS. Implications for improving methods for examining the relationship between technology use and standardized test scores are presented.

[1]  Harold F. O'Neil,et al.  Meta-analytic studies of findings on computer-based instruction. , 1994 .

[2]  W. S. Robinson.  Ecological correlations and the behavior of individuals. , 1950, International journal of epidemiology.

[3]  H. Goldstein.  Multilevel Statistical Models , 2006 .

[4]  Elaine Chapman,et al.  Alternative Approaches to Assessing Student Engagement Rates , 2003 .

[5]  Harold H. Wenglinsky.  Does It Compute? The Relationship between Educational Technology and Student Achievement in Mathematics. , 1998 .

[6]  Harold F. O'Neil,et al.  Technology assessment in education and training , 1994 .

[7]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[8]  J. Angrist,et al.  New Evidence on Classroom Computers and Pupil Learning , 1999, SSRN Electronic Journal.

[9]  Laura M. O’Dwyer,et al.  Measuring Teachers’ Technology Uses , 2004 .

[10]  Georgette M. Michko,et al.  A Meta-Analysis of the Effectiveness of Teaching and Learning With Technology on Student Outcomes December 2003 , 2003 .

[11]  Laura M. O’Dwyer,et al.  Identifying Teacher, School and District Characteristics Associated with Elementary Teachers' Use of Technology:A Multilevel Perspective , 2004 .

[12]  L. Poundie Burstein.  Chapter 4: The Analysis of Multilevel Data in Educational Research and Evaluation , 1980 .

[13]  Amie Goldberg,et al.  The Effect of Computers on Student Writing: A Meta-analysis of Studies from 1992 to 2002 , 2003 .

[14]  Jonathan D. Becker,et al.  West Virginia Story: Achievement Gains from a Statewide Comprehensive Instructional Technology Program , 1999 .

[15]  Michael Russell,et al.  Examining the Relationship between Home and School Computer Use and Students' English/Language Arts Test Scores. , 2005 .

[16]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[17]  William R. Penuel,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort , 2007 .

[18]  Ellen R. Bialo,et al.  Report on the effectiveness of technology in schools , 1994 .

[19]  John Cradler,et al.  Computers and Classrooms: The Status of Technology in U.S. Schools. Policy Information Report. , 1997 .

[20]  Larry Cuban.  Oversold and Underused , 2001 .

[21]  Larry V. Hedges,et al.  Computer use and its relation to academic achievement in mathematics, reading, and writing , 2000 .

[22]  Claire M. Fletcher-Flinn,et al.  The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis , 1995 .

[23]  Lee J. Cronbach,et al.  Research on Classrooms and Schools: Formulation of Questions, Design and Analysis. , 1976 .