The Development of a Conceptual Framework and Tools to Assess Undergraduates' Principled Use of Models in Cellular Biology

Recent science education reform has been marked by a shift away from a focus on facts toward deep, rich, conceptual understanding. This requires assessment that also focuses on conceptual understanding rather than recall of facts. This study outlines our development of a new assessment framework and tool—a taxonomy— which, unlike existing frameworks and tools, is grounded firmly in a framework that considers the critical role that models play in science. It also provides instructors a resource for assessing students' ability to reason about models that are central to the organization of key scientific concepts. We describe preliminary data arising from the application of our tool to exam questions used by instructors of a large-enrollment cell and molecular biology course over a 5-yr period during which time our framework and the assessment tool were increasingly used. Students were increasingly able to describe and manipulate models of the processes and systems being studied in this course as measured by assessment items. However, their ability to apply these models in new contexts did not improve. Finally, we discuss the implications of our results and the future directions for our research.

[1]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[2]  Division on Earth BIO2010: Transforming Undergraduate Education for Future Research Biologists , 2003 .

[3]  渋江 靖弘,et al.  Science for All Americans , 1990 .

[4]  Ricardo Nemirovsky,et al.  Everyday Matters in Science and Mathematics: Studies of Complex Classroom Events. , 2005 .

[5]  G. Norman,et al.  Development and Evaluation of the Conceptual Inventory of Natural Selection , 2002 .

[6]  Jennifer K Knight,et al.  The Genetics Concept Assessment: a new concept inventory for gauging student understanding of genetics. , 2008, CBE life sciences education.

[7]  Lorenzo Magnani,et al.  Model-Based Reasoning in Scientific Discovery , 1999, Springer US.

[8]  J. Bransford How people learn , 2000 .

[9]  H. Charles Romesburg,et al.  Cluster analysis for researchers , 1984 .

[10]  Kathy Garvin-Doxas,et al.  Understanding randomness and its impact on student learning: lessons learned from building the Biology Concept Inventory (BCI). , 2008, CBE life sciences education.

[11]  J. Gilbert,et al.  Developing Models in Science Education , 2000 .

[12]  Carol L. Smith,et al.  Understanding models and their use in science: Conceptions of middle and high school students and experts , 1991 .

[13]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[14]  Peter J. Denning,et al.  A nation at risk: the imperative for educational reform , 1983, CACM.

[15]  E. Seymour,et al.  Talking About Leaving: Why Undergraduates Leave The Sciences , 1997 .

[16]  J. Lagowski National Science Education Standards , 1995 .

[17]  Stephen M. Downes,et al.  The Importance of Models in Theorizing: A Deflationary Semantic View , 1992, PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[18]  Alison Crowe,et al.  Biology in bloom: implementing Bloom's Taxonomy to enhance student learning in biology. , 2008, CBE life sciences education.

[19]  J. Lemke Textual Politics: Discourse And Social Dynamics , 1995 .

[20]  Jennifer Cartier Using a Modeling Approach To Explore Scientific Epistemology with High School Biology Students. Research Report. , 2000 .

[21]  Jennifer Cartier Assessment of Explanatory Models in Genetics: Insights into Students' Conceptions of Scientific Models. Research Report. , 2000 .

[22]  Lillian C. McDermott,et al.  Millikan Lecture 1990: What we teach and what is learned—Closing the gap , 1991 .

[23]  Lorenzo Magnani,et al.  Model-Based Reasoning , 2002 .

[24]  Va Arlington National Science Board. , 2010 .

[25]  S. Salthe Evolving Hierarchical Systems: Their Structure and Representation , 1985 .

[26]  Mantz Yorke Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice , 2003 .

[27]  C. Brewer Near Real-Time Assessment of Student Learning and Understanding in Biology Courses , 2004 .

[28]  D. Allen,et al.  Approaches to cell biology teaching: a primer on standards. , 2002, Cell biology education.

[29]  J. Lemke Talking Science: Language, Learning, and Values , 1990 .

[30]  Andrew Pickering,et al.  The mangle of practice : time, agency, and science , 1997 .

[31]  Jane E Caldwell,et al.  Clickers in the large classroom: current research and best-practice tips. , 2007, CBE life sciences education.

[32]  Julia Khodor,et al.  A hierarchical biology concept framework: a tool for course design. , 2004, Cell biology education.

[33]  A. diSessa Toward an Epistemology of Physics , 1993 .

[34]  J. Shea National Science Education Standards , 1995 .

[35]  Thomas A. Romberg,et al.  Understanding mathematics and science matters , 2005 .

[36]  Kathy Garvin-Doxas,et al.  Recognizing Student Misconceptions through Ed's Tools and the Biology Concept Inventory , 2008, PLoS biology.

[37]  R. Giere How Models Are Used to Represent Reality , 2004, Philosophy of Science.

[38]  David F. Treagust,et al.  Investigation of secondary school, undergraduate, and graduate learners' mental models of ionic bonding , 2003 .

[39]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[40]  Edward F. Redish,et al.  A Theoretical Framework for Physics Education Research: Modeling student thinking , 2004 .

[41]  D. Hestenes,et al.  Force concept inventory , 1992 .

[42]  Pierre Van Rysselberghe,et al.  Introduction to Thermodynamics of Irreversible Processes. , 1956 .

[43]  Joseph T Rouse,et al.  Knowledge and Power: Toward a Political Philosophy of Science , 1987 .

[44]  S. Gilbert Model building and a definition of science , 1991 .

[45]  David F. Treagust,et al.  Students' understanding of the role of scientific models in learning science , 2002 .

[46]  Kimberly Tanner,et al.  The Problem of Revealing How Students Think: Concept Inventories and Beyond , 2010, CBE life sciences education.

[47]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[48]  John E. Merrill,et al.  Assessing students' ability to trace matter in dynamic systems in cell biology. , 2006, CBE life sciences education.

[49]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[50]  Kenneth A. Strike,et al.  A revisionist theory of conceptual change , 1992 .

[51]  Ronald N. Giere,et al.  Understanding Scientific Reasoning , 1979 .

[52]  C. Atman,et al.  How people learn. , 1985, Hospital topics.

[53]  J. Gilbert,et al.  Explanations with Models in Science Education , 2000 .

[54]  Richard A. Duschl,et al.  Philosophy of science, cognitive psychology, and educational theory and practice , 1992 .

[55]  Robert J. Marzano,et al.  Designing a New Taxonomy of Educational Objectives , 2000 .

[56]  James L. Fitch,et al.  Student feedback in the college classroom: A technology solution , 2004 .

[57]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[58]  P. Hewson,et al.  Accommodation of a scientific conception: Toward a theory of conceptual change , 1982 .

[59]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[60]  Deborah Allen,et al.  Approaches to biology teaching and learning: understanding the wrong answers--teaching toward conceptual change. , 2005, Cell biology education.

[61]  E. Mazur,et al.  Peer Instruction: A User’s Manual , 1999 .

[62]  Herbert S. Lin,et al.  They’re Not Dumb, They’re Different: Stalking the Second Tier , 1991 .