Cognition Research in Practice: Engineering and Evaluating a Middle School Math Curriculum

Abstract How can research findings from cognitive and learning sciences be meaningfully applied in authentic settings to improve student learning outcomes in mathematics? Decades of basic research on how people learn has implications for the design of curriculum, instruction, and assessment. However, bringing research to practice involves simultaneously applying multiple design principles and raises pragmatic challenges of classroom contexts. Our project used research-based recommendations to systematically revise a widely used middle school mathematics curriculum and investigated whether the revised curriculum improved student learning in mathematics. In this article, we detail a replicable process for operationalizing and implementing multiple research-based principles and report findings from a large-scale experimental evaluation of this approach to estimate the potential impact on student learning.

[1]  Henry May,et al.  Rethinking Connections Between Research and Practice in Education: A Conceptual Framework , 2018 .

[2]  C. Schunn,et al.  Using principles of cognitive science to improve science learning in middle school: What works when and for whom? , 2018 .

[3]  L. Hedges.  Challenges in Building Usable Knowledge in Education , 2018 .

[4]  Susan McKenney,et al.  How Can the Learning Sciences (Better) Impact Policy and Practice? , 2018 .

[5]  J. Easton.  Improvement Not Evaluation: Using RCTs to Build Usable Knowledge in Education , 2018 .

[6]  P. Kirschner,et al.  There is more variation within than across domains: an interview with Paul A. Kirschner about applying cognitive psychology-based instructional design principles in mathematics teaching and learning , 2017 .

[7]  Arjen E. J. Wals,et al.  Utilization of design principles for hybrid learning configurations by interprofessional design teams , 2017 .

[8]  Karen B. Givvin,et al.  Online Learning as a Wind Tunnel for Improving Teaching , 2017 .

[9]  Julie L. Booth,et al.  Support for Struggling Students in Algebra: Contributions of Incorrect Worked Examples. , 2016 .

[10]  J. Kochanek,et al.  Mapping the collaborative research process , 2015 .

[11]  Julie L. Booth,et al.  Simple Practice Doesn’t Always Make Perfect , 2015 .

[12]  Fethi A. Inan,et al.  Examining the Impact of Adaptively Faded Worked Examples on Student Learning Outcomes , 2014 .

[13]  Julie L. Booth,et al.  Instructional Complexity and the Science to Constrain It , 2013, Science.

[14]  Mark W. Lipsey,et al.  Translating the Statistical Representation of the Effects of Education Interventions Into More Readily Interpretable Forms , 2012 .

[15]  Laura R. Novick,et al.  Inference Is Bliss: Using Evolutionary Relationship to Guide Categorical Inferences , 2011, Cogn. Sci..

[16]  Li Cai,et al.  A Two-Tier Full-Information Item Factor Analysis Model with Applications , 2010 .

[17]  Ernest C. D. M. van Lieshout,et al.  The effect of illustrations in arithmetic problem-solving: Effects of increased cognitive load , 2009 .

[18]  F. Paas,et al.  Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design , 2009 .

[19]  Kenneth R. Koedinger,et al.  When do diagrams enhance learning? A framework for designing relevant representations , 2008, ICLS.

[20]  Alexander Renkl,et al.  Finding and fixing errors in worked examples: Can this foster learning outcomes? ☆ , 2007 .

[21]  Arthur C. Graesser,et al.  Organizing Instruction and Study to Improve Student Learning. IES Practice Guide. NCER 2007-2004. , 2007 .

[22]  Doug Rohrer,et al.  The shuffling of mathematics problems improves learning , 2007 .

[23]  Henry L. Roediger,et al.  Generalizing test-enhanced learning from the laboratory to the classroom , 2007, Psychonomic bulletin & review.

[24]  Paul Ginns.  Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects , 2006 .

[25]  Yael Kali,et al.  Collaborative knowledge building using the Design Principles Database , 2006, Int. J. Comput. Support. Collab. Learn..

[26]  S. Ainsworth.  DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[27]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[28]  J. Sweller.  The worked example effect and human cognition , 2006 .

[29]  B. Rittle-Johnson,et al.  Promoting transfer: effects of self-explanation and direct instruction. , 2006, Child development.

[30]  David Foster,et al.  The Mathematics Assessment Collaborative: Performance Testing to Improve Instruction , 2004 .

[31]  R. Atkinson,et al.  Transitioning From Studying Examples to Solving Problems: Effects of Self-Explanation Prompts and Fading Worked-Out Steps. , 2003 .

[32]  R. Shavelson,et al.  On the evaluation of systemic science education reform: Searching for instructional sensitivity , 2002 .

[33]  R. Siegler.  Microgenetic Studies of Self-Explanation , 2002 .

[34]  Margaret S. Smith.  Balancing Old and New: An Experienced Middle School Teacher's Learning in the Context of Mathematics Instructional Reform , 2000, The Elementary School Journal.

[35]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[36]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[37]  R. Mayer,et al.  How Seductive Details Do Their Damage: A Theory of Cognitive Interest in Science Learning , 1998 .

[38]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[39]  S. Raudenbush,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[40]  Joan K. Gallini,et al.  When Is an Illustration Worth Ten Thousand Words , 1990 .

[41]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[42]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[43]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[44]  Jodi L. Davenport,et al.  Evidence for Cognitive Science Principles that Impact Learning in Mathematics. , 2017 .

[45]  Dedre Gentner,et al.  Rapid Learning in a Children's Museum via Analogical Comparison , 2016, Cogn. Sci..

[46]  Jodi L. Davenport,et al.  Testing Cognitive Science Principles in a Middle School Mathematics Curriculum , 2014, CogSci.

[47]  What Works Clearinghouse Procedures and Standards Handbook Version 3.0 , 2014 .

[48]  Michael Schneider,et al.  The developmental relations between conceptual and procedural knowledge: a multimethod approach. , 2010, Developmental psychology.

[49]  M. Stein,et al.  What’s the evidence on districts’ use of evidence? , 2009 .

[50]  Reprints and permission: , 2009 .

[51]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[52]  Beatriz Chu Clewell,et al.  REVIEW OF EVALUATION STUDIES OF MATHEMATICS AND SCIENCE CURRICULA AND PROFESSIONAL DEVELOPMENT MODELS , 2004 .

[53]  R. Mayer,et al.  Multimedia learning: Are we asking the right questions? , 1997 .

[54]  John F. LeBlanc,et al.  National Council of Teachers of Mathematics , 1982 .

[55]  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Increasing Retention Without Increasing Study Time , 2022 .