An Experiment to Evaluate the Efficacy of Cognitive Tutor Geometry

Abstract This randomized, controlled field trial estimated the causal impact of a technology-based geometry curriculum on students’ geometry achievement, as well as their attitudes toward mathematics and technology. The curriculum combines learner-centered classroom pedagogy with individualized, computer-based student instruction. Conducted over a 3-year period in eight high schools within an urban fringe district, the study found that students assigned to the treatment curriculum scored 19% of a standard deviation lower on the geometry posttest than their counterparts assigned to the district's standard curriculum, but found no statistically significant impact on students’ attitudes toward mathematics and technology. Researchers also collected observation and interview data on teachers’ instructional practices. These data suggest that many teachers had difficulty implementing the treatment curriculum's learner-centered pedagogy. In fact, observed levels of learner-centered practices were only modestly higher in treatment classes than in control classes. In both treatment and control classes, however, higher levels of learner-centered pedagogy were associated with higher student achievement in geometry.

[1]  Participating states,et al.  Trends in International Mathematics and Science Study (TIMSS) , 2007 .

[2]  Harold H. Wenglinsky Does It Compute? The Relationship between Educational Technology and Student Achievement in Mathematics. , 1998 .

[3]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041. , 2009 .

[4]  Peter Z. Schochet Do Typical RCTs of Education Interventions Have Sufficient Statistical Power for Linking Impacts on Teacher Practice and Student Achievement Outcomes? , 2009 .

[5]  J. Schacter The Impact of Education Technology on Student Achievement: What the Most Current Research Has To Say. , 1999 .

[6]  William R. Penuel,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort , 2007 .

[7]  B. McCombs What Do We Know About Learners and Learning? The Learner-Centered Framework: Bringing the Educational System into Balance , 2001 .

[8]  Deborah R. Herget,et al.  Highlights from PISA 2006: Performance of U.S. 15-Year-Old Students in Science and Mathematics Literacy in an International Context. NCES 2008-016. , 2007 .

[9]  Steven Ritter,et al.  What Evidence Matters? A randomized field trial of Cognitive Tutor Algebra I , 2007, ICCE.

[10]  A. Su,et al.  The National Council of Teachers of Mathematics , 1932, The Mathematical Gazette.

[11]  E. Fennema,et al.  Fennema-Sherman Mathematics Attitudes Scales: Instruments Designed to Measure Attitudes Toward the Learning of Mathematics by Females and Males. , 1976 .

[12]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[13]  J. Gill Hierarchical Linear Models , 2005 .