From Theory to Data: The Process of Refining Learning Progressions

Learning progressions (LPs) are theoretical models of how learners develop expertise in a domain over extended periods of time. Recent policy reports have touted LPs as a promising approach to aligning standards, curriculum, and assessment. However, the scholarship on LPs is relatively sparse, and the jury is still out on the theoretical and practical value of this approach. To realize any potential of LPs researchers need to systematically refine these hypothetical models in real-world contexts. Such refinement efforts are challenging, as they require the coordination of messy empirical data with often underspecified theoretical models. Many of the current reports involving the empirical refinement and validation of LPs do not sufficiently explicate the process of how one goes about making modifications to the LP based on empirical data. In this article we present heuristics for facilitating the coordination of data and LP models. Using an illustrative example of a genetics LP and data from a 2-year longitudinal study of this LP, we demonstrate the use of these heuristics to refine the hypothesized levels of the LP. We also discuss the process we used to identify contingencies (relationships) between the constructs of this LP. We conclude with a discussion of implications of the refinement process for the alignment of curriculum, instruction, and assessment.

[1]  R. Duschl,et al.  Learning progressions and teaching sequences: a review and analysis , 2011 .

[2]  David F. Treagust,et al.  Exploring Conceptual Change in Genetics Using a Multidimensional Interpretive Framework. , 1998 .

[3]  Marianne Wiser,et al.  Learning Progressions as Tools For Curriculum Development , 2012 .

[4]  Aaron Rogat,et al.  Learning Progressions in Science: An Evidence-Based Approach to Reform. CPRE Research Report # RR-63. , 2009 .

[5]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[6]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .

[7]  Julia D. Plummer,et al.  Building a learning progression for celestial motion: An exploration of students' reasoning about the seasons , 2014 .

[8]  Charles W. Anderson,et al.  Developing a multi-year learning progression for carbon cycling in socio-ecological systems , 2009 .

[9]  Ravit Golan Duncan,et al.  Promoting Middle School Students’ Understandings of Molecular Genetics , 2011 .

[10]  B. Reiser,et al.  Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners , 2009 .

[11]  Jeffrey T. Steedle,et al.  Supporting valid interpretations of learning progression level diagnoses , 2009 .

[12]  Jeffrey T. Steedle,et al.  Developing and assessing a force and motion learning progression , 2009 .

[13]  Cindy E. Hmelo-Silver,et al.  Learning progressions: Aligning curriculum, instruction, and assessment , 2009 .

[14]  Richard J. Shavelson,et al.  Reflections on Learning Progressions , 2012 .

[15]  Joseph Krajcik,et al.  Building a learning progression for celestial motion: Elementary levels from an earth‐based perspective , 2010 .

[16]  C. W. Anderson,et al.  FOCUS ARTICLE: Implications of Research on Children's Learning for Standards and Assessment: A Proposed Learning Progression for Matter and the Atomic-Molecular Theory , 2006 .

[17]  Ravit Golan Duncan,et al.  A Learning Progression for Deepening Students' Understandings of Modern Genetics across the 5th-10th Grades. , 2009 .

[18]  Jodi Asbell-Clarke,et al.  LEARNING PROGRESSIONS AS TOOL FOR CURRICULUM DEVELOPMENT: LESSONS FROM THE INQUIRY PROJECT , 2009 .

[19]  R. G. Duncan,et al.  Designing project-based instruction to foster generative and mechanistic understandings in genetics , 2011 .

[20]  Ben Kelcey,et al.  How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity , 2009 .

[21]  David Hammer,et al.  A critique of how learning progressions research conceptualizes sophistication and progress , 2010, ICLS.

[22]  Marcia C. Linn,et al.  Science Education: Integrating Views of Learning and Instruction , 2006 .

[23]  Systems of Coherence and Resonance: Assessment for Education and Assessment of Education , 2005 .

[24]  Hee-Sun Lee,et al.  Assessing learning progression of energy concepts across middle school grades: The knowledge integration perspective , 2010 .

[25]  Kenneth T. V. Grattan,et al.  Introduction to special issue on measurement and instrumentation science , 1994 .

[26]  Jenny M. Lewis,et al.  Traits, genes, particles and information: re‐visiting students’ understandings of genetics , 2004 .

[27]  A. J. Waarlo,et al.  Modelling Molecular Mechanisms: A Framework of Scientific Reasoning to Construct Molecular-Level Explanations for Cellular Behaviour , 2011, Science & Education.

[28]  Mark Wilson,et al.  Constructing Measures: An Item Response Modeling Approach , 2004 .

[29]  Jennifer L. Cartier,et al.  Developing Understanding Through Model-Based Inquiry , 2007 .

[30]  Richard Lehrer,et al.  Tracing a Prospective Learning Progression for Developing Understanding of Evolution , 2005 .

[31]  Mark Wilson,et al.  Measuring Progressions: Assessment Structures Underlying a Learning Progression , 2009 .

[32]  Meryl W. Bertenthal,et al.  Systems for state science assessment , 2005 .

[33]  Helen R. Quinn,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2013 .

[34]  Katherine L. McNeill,et al.  A learning progression for scientific argumentation: Understanding student work and designing supportive instructional contexts , 2010 .

[35]  Shawn Y. Stevens,et al.  Developing a Hypothetical Multi-Dimensional Learning Progression for the Nature of Matter. , 2009 .

[36]  Brian J. Reiser,et al.  Reasoning across Ontologically Distinct Levels: Students' Understandings of Molecular Genetics. , 2007 .

[37]  Richard Lehrer,et al.  Images of learning, images of progress , 2009 .