Modeling-Oriented Assessment in K-12 Science Education: A synthesis of research from 1980 to 2013 and new directions

Scientific modeling has been advocated as one of the core practices in recent science education policy initiatives. In modeling-based instruction (MBI), students use, construct, and revise models to gain scientific knowledge and inquiry skills. Oftentimes, the benefits of MBI have been documented using assessments targeting students’ conceptual understanding or affective domains. Fewer studies have used assessments directly built on the ideas of modeling. The purpose of this study is to synthesize and examine modeling-oriented assessments (MOA) in the last three decades and propose new directions for research in this area. The study uses a collection of 30 empirical research articles that report MOA from an initial library of 153 articles focusing on MBI in K-12 science education from 1980 to 2013. The findings include the variety of themes within each of the three MOA dimensions (modeling products, modeling practices, and meta-modeling knowledge) and the areas of MOA still in need of much work. Based on the review, three guiding principles are proposed for future work in MOA: (a) framing MOA in an ecology of assessment, (b) providing authentic modeling contexts for assessment, and (c) spelling out the connections between MOA items and the essential aspects of modeling to be assessed.

[1]  Susan Rodrigues,et al.  Using analytical frameworks for classroom research : collecting data and analysing narrative , 2010 .

[2]  Randy L. Bell,et al.  Computer Simulations to Support Science Instruction and Learning: A critical review of the literature , 2012 .

[3]  David F. Treagust,et al.  A typology of school science models , 2000 .

[4]  Ngss Lead States.  Next generation science standards : for states, by states , 2013 .

[5]  Susan A. Yoon,et al.  Teaching Complex Dynamic Systems to Young Students with StarLogo , 2005 .

[6]  Elwin R. Savelsbergh,et al.  The Relation between Students’ Epistemological Understanding of Computer Models and their Cognitive Processing on a Modelling Task , 2009 .

[7]  Peter Maurer,et al.  The Cambridge Handbook of the Learning Sciences , 2022 .

[8]  J. Gobert.  A typology of causal models for plate tectonics: Inferential power and barriers to understanding , 2000 .

[9]  Richard Lehrer,et al.  Developing model-based reasoning in mathematics and science , 2000 .

[10]  Barbara C. Buckley.  Interactive multimedia and model-based learning in biology , 2000 .

[11]  B. White,et al.  Metamodeling Knowledge: Developing Students' Understanding of Scientific Modeling , 2005 .

[12]  P. Shawn Irvin,et al.  Student learning in science simulations: Design features that promote learning gains† , 2011 .

[13]  Zacharias C. Zacharia,et al.  Modeling-based learning in science education: cognitive, metacognitive, social, material and epistemological contributions , 2012 .

[14]  Shawn Y. Stevens,et al.  Tracking student learning over time using construct-centred design , 2010 .

[15]  Marios Papaevripidou,et al.  Modeling complex marine ecosystems: an investigation of two teaching approaches with fifth graders , 2007, J. Comput. Assist. Learn..

[16]  Luli Stern,et al.  The Effect of a Computerized Simulation on Middle School Students’ Understanding of the Kinetic Molecular Theory , 2008 .

[17]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[18]  Carol L. Smith,et al.  Understanding models and their use in science: Conceptions of middle and high school students and experts , 1991 .

[19]  John K. Gilbert,et al.  Positioning Models in Science Education and in Design and Technology Education , 2000 .

[20]  Marida Ergazaki,et al.  Comparing computer-supported dynamic modeling and 'paper & pencil' concept mapping technique in students' collaborative activity , 2007, Comput. Educ..

[21]  Helen R. Quinn,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2013 .

[22]  Nancy J. Nersessian,et al.  How Do Engineering Scientists Think? Model-Based Simulation in Biomedical Engineering Research Laboratories , 2009, Top. Cogn. Sci..

[23]  Constantinos P. Constantinou,et al.  Objects, Entities, Behaviors, and Interactions: A Typology of Student-Constructed Computer-Based Models of Physical Phenomena , 2011 .

[24]  Edys S. Quellmalz,et al.  Supporting and Assessing Complex Biology Learning with Computer-Based Simulations and Representations , 2013 .

[25]  Uri Wilensky,et al.  Crossing Levels and Representations: The Connected Chemistry (CC1) Curriculum , 2009 .

[26]  Chris Dede,et al.  Model-Based Teaching and Learning with BioLogica™: What Do They Learn? How Do They Learn? How Do We Know? , 2004 .

[27]  Abigail Jurist Levy,et al.  Inquiry-based science instruction—what is it and does it matter? Results from a research synthesis years 1984 to 2002 , 2010 .

[28]  J. Confrey,et al.  Justifying Alternative Models in Learning Astronomy: A study of K–8 science teachers’ understanding of frames of reference , 2010 .

[29]  Uri Wilensky,et al.  Students’ Learning with the Connected Chemistry (CC1) Curriculum: Navigating the Complexities of the Particulate World , 2009 .

[30]  Miri Barak,et al.  Integrating Model-Based Learning and Animations for Enhancing Students’ Understanding of Proteins Structure and Function , 2013 .

[31]  Ravit Golan Duncan,et al.  Learners' Epistemic Criteria for Good Scientific Models. , 2011 .

[32]  Barbara A. Crawford,et al.  Supporting prospective teachers' conceptions of modelling in science , 2004 .

[33]  Daner Sun,et al.  Designing a Web-Based Science Learning Environment for Model-Based Collaborative Inquiry , 2013 .

[34]  James W. Pellegrino,et al.  Developing Assessments for the Next Generation Science Standards. , 2014 .

[35]  Gillian Smith,et al.  Affordances and Constraints of Computers in Science Education , 1996 .

[36]  Yehudit Judy Dori,et al.  High-School Chemistry Students' Performance and Gender Differences in a Computerized Molecular Modeling Learning Environment , 1999 .

[37]  C. Fazio,et al.  Modelling Mechanical Wave Propagation: Guidelines and experimentation of a teaching–learning sequence , 2008 .

[38]  Joseph Krajcik,et al.  An Investigation of Software Scaffolds Supporting Modeling Practices , 2002 .

[39]  Yehudit Judy Dori,et al.  Assessing high school chemistry students’ modeling sub-skills in a computerized molecular modeling learning environment , 2011, Instructional Science.

[40]  Janice D. Gobert,et al.  From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining , 2013, Journal of the Learning Sciences.

[41]  Marida Ergazaki,et al.  Analysing students' shared activity while modeling a biological process in a computer-supported educational environment , 2007, J. Comput. Assist. Learn..

[42]  A. Pilot,et al.  Students’ Involvement in Authentic Modelling Practices as Contexts in Chemistry Education , 2009 .

[43]  Amy Pallant,et al.  Reasoning with Atomic-Scale Molecular Dynamic Models , 2004 .

[44]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[45]  Hsin-Kai Wu,et al.  Modelling a Complex System: Using novice‐expert analysis for developing an effective technology‐enhanced learning environment , 2010 .

[46]  Ji Shen,et al.  Technology-Enhanced, Modeling-Based Instruction (TMBI) in Science Education , 2014 .

[47]  Hsin-Kai Wu,et al.  A Novice-Expert Study of Modeling Skills and Knowledge Structures about Air Quality , 2012 .

[48]  Teaching strategies and conceptual change in a professional development program for science teachers of K--8 , 2006 .

[49]  D. Hestenes,et al.  Force concept inventory , 1992 .

[50]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[51]  D. Hestenes.  Toward a modeling theory of physics instruction , 1987 .

[52]  Nancy J. Nersessian,et al.  Creating Scientific Concepts , 2008 .

[53]  A research‐based teaching sequence for teaching the concept of modelling to seventh‐grade students , 2003 .

[54]  Kathleen Hogan,et al.  Cognitive Comparisons of Students' Systems Modeling in Ecology , 2001 .

[55]  Xiufeng Liu,et al.  Developing Computer Model-Based Assessment of Chemical Reasoning: A Feasibility Study. , 2012 .

[56]  Marcelo Resende Thielo,et al.  Students modelling environmental issues , 1997, J. Comput. Assist. Learn..

[57]  W. Popham.  Classroom Assessment: What Teachers Need to Know , 1995 .

[58]  Richard Lehrer,et al.  From Physical Models to Biomechanics: A Design-Based Modeling Approach. , 1998 .

[59]  Yehudit Judy Dori,et al.  Question Posing, Inquiry, and Modeling Skills of Chemistry Students in the Case-Based Computerized Laboratory Environment , 2009 .

[60]  Hasret Nuhoglu,et al.  Modeling Spring Mass System with System Dynamics Approach in Middle School Education. , 2008 .

[61]  Theodore J. Kopcha,et al.  Instructional Design Models , 2014 .

[62]  Per Morten Kind,et al.  An empirical-mathematical modelling approach to upper secondary physics , 2008 .

[63]  J. Gilbert,et al.  Developing Models in Science Education , 2000 .

[64]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[65]  Joseph Krajcik,et al.  Secondary Students' Dynamic Modeling Processes: Analyzing, Reasoning About, Synthesizing, and Testing Models of Stream Ecosystems , 1997 .

[66]  Ann E. Rivet,et al.  Developing a Construct-Based Assessment to Examine Students' Analogical Reasoning around Physical Models in Earth Science. , 2012 .

[67]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[68]  J. Confrey,et al.  From conceptual change to transformative modeling: A case study of an elementary teacher in learning astronomy , 2007 .

[69]  Ton de Jong,et al.  Using Co-Lab to build System Dynamics models: Students' actions and on-line tutorial advice , 2009, Comput. Educ..

[70]  A. Johnstone,et al.  Pupils' response to a model for water transport , 1981 .

[71]  Amy Pallant,et al.  Fostering Students' Epistemologies of Models via Authentic Model-Based Tasks , 2004 .

[72]  B. Reiser,et al.  Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners , 2009 .

[73]  David C. Webb,et al.  Mr. Vetro: A Collective Simulation for teaching health science , 2010, Int. J. Comput. Support. Collab. Learn..

[74]  Ton de Jong,et al.  Collaborative versus individual use of regulative software scaffolds during scientific inquiry learning , 2009, Interact. Learn. Environ..

[75]  David F. Treagust,et al.  Students' understanding of the role of scientific models in learning science , 2002 .

[76]  Xiufeng Liu,et al.  Effects of Combined Hands-on Laboratory and Computer Modeling on Student Learning of Gas Laws: A Quasi-Experimental Study , 2006 .

[77]  Joseph Krajcik,et al.  The impact of designing and evaluating molecular animations on how well middle school students understand the particulate nature of matter , 2009 .

[78]  David E. Brown,et al.  Conceptual Resources in Self‐developed Explanatory Models: The importance of integrating conscious and intuitive knowledge , 2010 .

[79]  J. Frederiksen,et al.  Inquiry, Modeling, and Metacognition: Making Science Accessible to All Students , 1998 .

[80]  David F. Treagust,et al.  Students' Understanding of the Descriptive and Predictive Nature of Teaching Models in Organic Chemistry , 2004 .

[81]  S. Vosniadou.  Capturing and modeling the process of conceptual change. , 1994 .

[82]  Michael J. Timms,et al.  Research Article Science Assessments for All: Integrating Science Simulations Into Balanced State Science Assessment Systems , 2012 .

[83]  Janice D. Gobert,et al.  Introduction to model-based teaching and learning in science education , 2000 .

[84]  Ton de Jong,et al.  What Can Be Learned from Computer Modeling? Comparing Expository and Modeling Approaches to Teaching Dynamic Systems Behavior , 2012 .

[85]  Constantinos P. Constantinou,et al.  In Quest of Productive Modeling-Based Learning Discourse in Elementary School Science , 2011 .

[86]  Ard W. Lazonder,et al.  Finding Out How They Find It Out: An empirical analysis of inquiry learners’ need for support , 2010 .

[87]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .