An Efficacy Study of a Digital Core Curriculum for Grade 5 Mathematics

The Math Curriculum Impact Study was a large-scale randomized controlled trial (RCT) to test the efficacy of a digital core curriculum for Grade 5 mathematics. Reasoning Mind’s Grade 5 Common Core Curriculum was a comprehensive, adaptive, blended learning approach that schools in the treatment group implemented for an entire school year. Schools in the control group implemented their business-as-usual mathematics curriculum. The study was completed in 46 schools throughout West Virginia, resulting in achievement data from 1,919 students. It also included exploratory investigations of teacher practice and student engagement. The main experimental finding was a null result; achievement was similar in both experimental groups. The exploratory investigations help clarify interpretation of this result. As educational leaders throughout the United States adopt digital mathematics curricula and adaptive, blended approaches, our findings provide a relevant caution. However, our findings are not generalizable to all digital offerings, and there is a continuing need for refined theory, study of implementation, and rigorous experimentation to advise schools.

[1]  Elizabeth R. Kazakoff,et al.  Elementary school–wide implementation of a blended learning program for reading intervention , 2018 .

[2]  Caitlin C. Farrell,et al.  What Research District Leaders Find Useful , 2018 .

[3]  John F. Pane,et al.  How Does Personalized Learning Affect Student Achievement , 2017 .

[4]  Vincent Aleven,et al.  Instruction Based on Adaptive Learning Technologies , 2016 .

[5]  Mingyu Feng,et al.  Online Mathematics Homework Increases Student Achievement , 2016 .

[6]  Neil Seftor,et al.  What Does It Mean When a Study Finds No Effects? REL 2017-265. , 2016 .

[7]  Jeremy Roschelle,et al.  Designing for Consistent Implementation of a 5th Grade Digital Math Curriculum , 2016 .

[8]  Morgan S. Polikoff.  Evaluating the Instructional Sensitivity of Four States' Student Achievement Tests , 2016 .

[9]  M. Blanton,et al.  Build an early foundation for algebra success , 2016 .

[10]  Murat Akkuş.  The Common Core State Standards for Mathematics , 2015 .

[11]  John Watson,et al.  Blending Learning: The Evolution of Online and Face-to-Face Education from 2008-2015. Promising Practices in Blended and Online Learning Series. , 2015 .

[12]  Edward Clement Bethel,et al.  A Systematic Review of One-to-One Access to Laptop Computing in K-12 Classrooms: An Investigation of Factors That Influence Program Impact , 2015 .

[13]  Lyn D. English,et al.  STEM: Challenges and opportunities for mathematics education , 2015 .

[14]  Jeremy Roschelle,et al.  Strength of Research for Reasoning Mind , 2015 .

[15]  George A. Khachatryan,et al.  Reasoning Mind Genie 2: An Intelligent Tutoring System as a Vehicle for International Transfer of Instructional Methods in Mathematics , 2014, International Journal of Artificial Intelligence in Education.

[16]  Daniel F. McCaffrey,et al.  Effectiveness of Cognitive Tutor Algebra I at Scale , 2014 .

[17]  F. Dochy,et al.  A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? , 2013 .

[18]  Clayton M. Christensen,et al.  Is K-12 Blended Learning Disruptive? An Introduction to the Theory of Hybrids. , 2013 .

[19]  Hye Sook Shin,et al.  Classroom connectivity in Algebra I classrooms: results of a randomized control trial , 2012 .

[20]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[21]  David S. Cordray,et al.  A Procedure for Assessing Intervention Fidelity in Experiments Testing Educational and Behavioral Interventions , 2012, The Journal of Behavioral Health Services & Research.

[22]  R. Siegler,et al.  Early Predictors of High School Mathematics Achievement , 2012, Psychological science.

[23]  Yigal Rosen,et al.  Intertwining Digital Content and a One-To-One Laptop Environment in Teaching and Learning , 2012 .

[24]  Neal M. Kingston,et al.  Formative Assessment: A Meta-Analysis and a Call for Research , 2011 .

[25]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[26]  Constantine Frangakis,et al.  Multiple imputation by chained equations: what is it and how does it work? , 2011, International journal of methods in psychiatric research.

[27]  What Works Clearinghouse: Procedures and Standards Handbook (Version 2.1) , 2011 .

[28]  Haiwen Wang,et al.  A Randomized Controlled Trial of Two Online Mathematics Curricula. , 2011 .

[29]  Jeremy Roschelle,et al.  Integration of Technology, Curriculum, and Professional Development for Advancing Middle School Mathematics , 2010 .

[30]  Miguel Nussbaum,et al.  Scaffolding group explanation and feedback with handheld technology: impact on students’ mathematics learning , 2010 .

[31]  Larry V. Hedges,et al.  Statistical Power Analysis in Education Research. NCSER 2010-3006. , 2010 .

[32]  B. Vogeli,et al.  Russian Mathematics Education : History and World Significance , 2010 .

[33]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[34]  Roberto Agodini,et al.  Achievement Effects of Four Early Elementary School Math Curricula: Findings from First Graders in 39 Schools. NCEE 2009-4052. , 2009 .

[35]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings From Two Student Cohorts. NCEE 2009-4041. , 2009 .

[36]  Sally Atkins-Burnett,et al.  Achievement Effects of Four Early Elementary School Math Curricula: Findings from First Graders in 39 Schools. Princeton, NJ: Mathematica Policy Research , 2009 .

[37]  A. Collins,et al.  Commentary on the Final Report of the National Mathematics Advisory Panel , 2008 .

[38]  Julie Sarama,et al.  Experimental Evaluation of the Effects of a Research-Based Preschool Mathematics Curriculum , 2008 .

[39]  Carol L. O'Donnell.  Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research , 2008 .

[40]  Beryl Lieff Benderly,et al.  Rising Above "The Gathering Storm" , 2007 .

[41]  V. Shute.  Focus on Formative Feedback , 2007 .

[42]  Robert E. Slavin,et al.  Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis , 2007 .

[43]  Barry Fishman,et al.  Algorithm-Guided Individualized Reading Instruction , 2007, Science.

[44]  Jay P. Heubert,et al.  Accelerating Mathematics Achievement Using Heterogeneous Grouping , 2006 .

[45]  N. Augustine.  Rising Above The Gathering Storm: Energizing and Employing America for a Brighter Economic Future , 2006 .

[46]  Talbot Bielefeldt,et al.  Computers and Student Learning: Interpreting the Multivariate Analysis of PISA 2000. , 2005 .

[47]  W. Schmidt,et al.  Curriculum coherence: an examination of US mathematics and science content standards from an international perspective , 2005 .

[48]  Charles R. Graham.  BLENDED LEARNING SYSTEMS: DEFINITION, CURRENT TRENDS, AND FUTURE DIRECTIONS , 2005 .

[49]  P. Black,et al.  Teachers developing assessment for learning: impact on student achievement , 2004 .

[50]  Jay P. Heubert,et al.  Math Acceleration for All. , 2004 .

[51]  S. Guerrero,et al.  Technology in Support of Middle Grade Mathematics: What Have We Learned?. , 2004 .

[52]  Tonya R. Moon,et al.  Differentiating Instruction in Response to Student Readiness, Interest, and Learning Profile in Academically Diverse Classrooms: A Review of Literature , 2003 .

[53]  R. Shavelson,et al.  On the evaluation of systemic science education reform: Searching for instructional sensitivity , 2002 .

[54]  J. Angrist,et al.  New Evidence on Classroom Computers and Pupil Learning , 1999, SSRN Electronic Journal.

[55]  M. Honey,et al.  Perspectives on Technology and Education Research: Lessons from the Past and Present , 2000 .

[56]  M. Lipsey.  Design sensitivity: Statistical power for applied experimental research. , 1998 .

[57]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[58]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[59]  Mark W. Lipsey,et al.  Design Sensitivity: Statistical Power for Experimental Research. , 1989 .

[60]  H. Levin.  New Schools for the Disadvantaged. , 1987 .

[61]  M. Futrell.  Career Ladders: An NEA Perspective. , 1986 .

[62]  Thomas R. Guskey,et al.  Synthesis of Research on the Effects of Mastery Learning in Elementary and Secondary Classrooms , 1986 .

[63]  Jane A. Stallings.  Allocated Academic Learning Time Revisited, or Beyond Time on Task , 1980 .

[64]  J. Sansoni.  [Mastery learning]. , 1980, Professioni infermieristiche.

[65]  James H. Block,et al.  1: Mastery Learning , 1976 .