Assessing learning progression of energy concepts across middle school grades: The knowledge integration perspective

We use a construct-based assessment approach to measure learning progression of energy concepts across physical, life, and earth science contexts in middle school grades. We model the knowledge integration construct in six levels in terms of the numbers of ideas and links used in student-generated explanations. For this study, we selected 10 items addressing energy source, transformation, and conservation from published standardized tests and administered them to a status quo sample of 2688 middle school students taught by 29 teachers in 12 schools across 5 states. Results based on a Rasch partial credit model analysis indicate that conservation items are associated with the highest knowledge integration levels, followed by transformation and source items. Comparisons across three middle school grades and across physical, life, and earth science contexts reveal that the mean knowledge integration level of eighth-grade students is significantly higher than that of sixth- or seventh-grade students, and that the mean knowledge integration level of students who took a physical science course is significantly higher than that of students who took a life or earth science course. We discuss implications for research on learning progressions. © 2009 Wiley Periodicals, Inc. Sci Ed94:665–688, 2010

[1]  Gaalen Erickson.  Children's viewpoints of heat: A second look , 1980 .

[2]  David F. Treagust,et al.  Investigating a grade 11 student's evolving conceptions of heat and temperature , 1999 .

[3]  Joseph Krajcik,et al.  Supporting Students' Construction of Scientific Explanations by Fading Scaffolds in Instructional Materials , 2006 .

[4]  Martin Goedhart,et al.  'Forms of Energy', an intermediary language on the road to thermodynamics? Part I , 2002 .

[5]  Don McLaughlin,et al.  Mapping State Proficiency Standards Onto NAEP Scales: 2005-2007. Research and Development Report. NCES 2010-456. , 2009 .

[6]  R. Trumper.  Energy and a constructivist way of teaching , 1990 .

[7]  N. Papadouris,et al.  Students' use of the energy model to account for changes in physical systems , 2008 .

[8]  Judith Barak,et al.  Understanding of energy in biology and vitalistic conceptions , 1997 .

[9]  J. Shea.  National Science Education Standards , 1995 .

[10]  Robert Glaser,et al.  Investigating the Cognitive Complexity of Science Assessments , 1998 .

[11]  Kenneth E. Vogler,et al.  Comparing the Impact of Accountability Examinations on Mississippi and Tennessee Social Studies Teachers' Instructional Practices , 2008 .

[12]  Piet Lijnse,et al.  Energy between the life‐world of pupils and the world of physics , 1990 .

[13]  Gary L. Marco,et al.  Item characteristic curve solutions to three intractable testing problems. , 1977 .

[14]  William A. Sandoval,et al.  Conceptual and Epistemic Aspects of Students' Scientific Explanations , 2003 .

[15]  Stuart S. Yeh.  Tests Worth Teaching To: Constructing State-Mandated Tests That Emphasize Critical Thinking , 2001 .

[16]  Mark Wilson,et al.  Constructing Measures: An Item Response Modeling Approach , 2004 .

[17]  R. Driver,et al.  Students' use of the principle of energy conservation in problem situations , 1985 .

[18]  J W Warren,et al.  Energy and Its Carriers: A Critical Analysis. , 1983 .

[19]  M. Linn,et al.  Heat energy and temperature concepts of adolescents, adults, and experts: Implications for curricular improvements , 1994 .

[20]  Jeffrey T. Steedle,et al.  Developing and assessing a force and motion learning progression , 2009 .

[21]  Richard Lehrer,et al.  Tracing a Prospective Learning Progression for Developing Understanding of Evolution , 2005 .

[22]  Anne McKeough,et al.  Developmental growth in students' concept of energy: Analysis of selected items from the TIMSS database , 2005 .

[23]  G. Masters,et al.  Rating scale analysis , 1982 .

[24]  James W. Pellegrino,et al.  Knowing What Students Know. , 2003 .

[25]  R. Brennan,et al.  Test Equating, Scaling, and Linking , 2004 .

[26]  J. Bliss,et al.  Children's choices of uses of energy , 1985 .

[27]  H Goldring,et al.  Students' difficulties with energy and related concepts , 1994 .

[28]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[29]  N. Heath.  Heating and working man's club , 1983 .

[30]  Ravit Golan Duncan,et al.  A Learning Progression for Deepening Students' Understandings of Modern Genetics across the 5th-10th Grades. , 2009 .

[31]  R. Trumper.  Being constructive: an alternative approach to the teaching of the energy concept‐‐part one , 1990 .

[32]  Marcia C. Linn,et al.  The Knowledge Integration Perspective on Learning and Instruction , 2005 .

[33]  F. Stylianidou.  Analysis of science textbook pictures about energy and pupils' readings of them , 2002 .

[34]  R. Sexl,et al.  Some Observations Concerning the Teaching of the Energy Concept , 1981 .

[35]  Wendy Van de Kerckhove,et al.  Trends in International Mathematics and Science Study (TIMSS) 2003. Nonresponse Bias Analysis. Technical Report. NCES 2007-044. , 2006 .

[36]  J. Millman.  Strategies for Identifying Research Topic in Educational Measurement , 2005 .

[37]  Robert Bruce Lindsay.  Energy: Historical Development of the Concept , 1976 .

[38]  R. Pintó,et al.  Students' reading of innovative images of energy at secondary school level , 2002 .

[39]  Elizabeth Engel Clough,et al.  Secondary Students' Conceptions of the Conduction of Heat: Bringing Together Scientific and Personal Views. , 1985 .

[40]  J. Solomon.  Teaching the conservation of energy , 1985 .

[41]  G. Bruno Schmid,et al.  Energy and its carriers , 1982 .

[42]  Derek C. Briggs,et al.  Diagnostic Assessment With Ordered Multiple-Choice Items , 2006 .

[43]  R. Brennan,et al.  Test Equating, Scaling, and Linking: Methods and Practices , 2004 .

[44]  Marcia C. Linn,et al.  Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items , 2011 .

[45]  E. Chaisson.  Cosmic Evolution: The Rise of Complexity in Nature , 2001 .

[46]  Jeffrey T. Steedle,et al.  Supporting valid interpretations of learning progression level diagnoses , 2009 .

[47]  M. Linn,et al.  Assessing Knowledge Integration in Science: Construct, Measures, and Evidence , 2008 .

[48]  Reinders Duit,et al.  Students' understanding of basic ideas of the second law of thermodynamics , 1988 .

[49]  D. M. Watts,et al.  Some alternative views of energy , 1983 .

[50]  Ben Kelcey,et al.  How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity , 2009 .

[51]  Chen‐Yung Lin,et al.  Students' understanding of energy flow and matter cycling in the context of the food chain, photosynthesis, and respiration , 2003 .

[52]  Marcia C. Linn,et al.  Science Education: Integrating Views of Learning and Instruction , 2006 .

[53]  Mike Summers,et al.  Surveys of english primary teachers' conceptions of force, energy, and materials , 1992 .

[54]  C. W. Anderson,et al.  FOCUS ARTICLE: Implications of Research on Children's Learning for Standards and Assessment: A Proposed Learning Progression for Matter and the Atomic-Molecular Theory , 2006 .

[55]  Mark Wilson,et al.  Measuring Progressions: Assessment Structures Underlying a Learning Progression , 2009 .

[56]  Xiufeng Liu,et al.  Structural characteristics of university engineering students' conceptions of energy* , 2002 .

[57]  A. Tiberghien,et al.  Integrating experiments into the teaching of energy , 1998 .

[58]  Mark Ellse.  Transferring Not Transforming Energy. , 1988 .

[59]  Reinders Duit,et al.  Learning the Energy Concept in School--Empirical Results from the Philippines and West Germany. , 1984 .

[60]  G. Erickson.  Children's conceptions of heat and temperature , 1979 .

[61]  R. Trumper.  Being Constructive: An Alternative to the Teaching of the Energy Concept-Part Two. , 1991 .

[62]  Dana L. Kelly,et al.  International Association for the Evaluation of Educational Achievement , 1998 .