The Problem of Revealing How Students Think: Concept Inventories and Beyond

A common refrain heard from many college and university biology instructors is that undergraduate science students do not seem to possess the same scientific habits of mind as their instructors, nor do they seem to have command of fundamental principles and concepts that structure the expertise of their instructors (Hestenes et al., 1992 ; Khodor et al., 2004 ; Wilson et al., 2006 ; Michael, 2007 ; D'Avanzo, 2008 ). In short, even our advanced undergraduate students do not seem to be scientifically literate—they cannot “ask and answer their own biologically relevant questions” (Wright, 2005 ). If we as university biology instructors are to make progress on the challenge of transforming our novice undergraduates into expert biological thinkers who are scientifically literate, then we all need tools that can aid us in revealing student thinking and in analyzing what we do in the classroom that supports or hinders the development of this scientific literacy in students. This is where classroom assessment—gathering evidence on students' thinking—is a key part of teaching at any level (Angelo and Cross, 1993 ; Atkin et al., 2001 ; Black and Wiliam, 1998 ; Huba and Freed, 2000 ; Sundberg, 2002 ; Tanner and Allen, 2004 ). However, there are a myriad of approaches to collecting assessment evidence from students: minute papers to gain quick insight into student thinking, reflective journal writing to promote metacognition and reveal confusions, and concept mapping to examine the structure of students' knowledge, to name just a few. Each of these many assessment approaches to monitor student thinking has its advantages and drawbacks, and some tools seem to work best for some topics or in the hands of some instructors. Here, we give an introduction to a relatively recent addition to the assessment tools in biology—the concept inventory—address its promising attributes and potential drawbacks, and raise the question of what concept inventories may actually measure. Finally, we consider potential alternative approaches to gaining insight into how students think about biology that come from the chemistry education and physics education research literatures.

[1]  Jenny McFarland,et al.  The second Conceptual Assessment in the Biological Sciences workshop. , 2008, Advances in physiology education.

[2]  Joel A. Michael,et al.  One-on-One Tutoring by Humans and Computers , 2006 .

[3]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[4]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[5]  Robin Wright,et al.  Points of view: content versus process: is this a fair choice? Undergraduate biology courses for nonscientists: toward a lived curriculum. , 2005, Cell biology education.

[6]  Edward F. Redish,et al.  Discipline-Based Education and Education Research: The Case of Physics , 2000 .

[7]  N. Nersessian Should Physicists Preach What They Practice , 1995 .

[8]  Barbara Y. White,et al.  Dynamic mental models in learning science : The importance of constructing derivational linkages among models , 1999 .

[9]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[10]  Douglas Huffman,et al.  Interpreting the force concept inventory: A reply to Hestenes and Halloun , 1995 .

[11]  Janet Coffey,et al.  Everyday Assessment in the Science Classroom. , 2003 .

[12]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[13]  D. Allen,et al.  Putting the horse back in front of the cart: using visions and decisions about high-quality learning experiences to drive course design. , 2007, CBE life sciences education.

[14]  Catherine H. Crouch,et al.  Reducing the gender gap in the physics classroom , 2006 .

[15]  P. Tamir An Alternative Approach to The Construction of Multiple Choice Test Items , 1971 .

[16]  B. White ThinkerTools: Causal Models, Conceptual Change, and Science Education , 1993 .

[17]  R. Hake Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses , 1998 .

[18]  Joel A. Michael,et al.  Active Learning in Secondary and College Science Classrooms: A Working Model for Helping the Learner to Learn , 2005 .

[19]  Lei Bao Concentration Analysis : A Quantitative Assessment of Student States , 2000 .

[20]  Joel Michael,et al.  Conceptual assessment in the biological sciences: a National Science Foundation-sponsored workshop. , 2007, Advances in physiology education.

[21]  J A Michael,et al.  The Predictions Table: a tool for assessing students' knowledge. , 1992, The American journal of physiology.

[22]  Jann E. Freed,et al.  Learner-Centered Assessment on College Campuses: Shifting the Focus from Teaching to Learning , 1999 .

[23]  C. Huether,et al.  Genetic Literacy of Undergraduate Non–Science Majors and the Impact of Introductory Biology and Genetics Courses , 2008 .

[24]  Julia Khodor,et al.  A hierarchical biology concept framework: a tool for course design. , 2004, Cell biology education.

[25]  J A Michael,et al.  Undergraduate students' misconceptions about respiratory physiology. , 1999, The American journal of physiology.

[26]  Kathy Garvin-Doxas,et al.  Building, using, and maximizing the impact of concept inventories in the biological sciences: report on a National Science Foundation sponsored conference on the construction of concept inventories in the biological sciences. , 2007, CBE life sciences education.

[27]  David Hestenes,et al.  Interpreting the force concept inventory: A response to March 1995 critique by Huffman and Heller , 1995 .

[28]  G. Norman,et al.  Development and Evaluation of the Conceptual Inventory of Natural Selection , 2002 .

[29]  Michelene T. H. Chi,et al.  Laboratory Methods for Assessing Experts' and Novices' Knowledge , 2006 .

[30]  Ronald K. Thornton,et al.  Assessing student learning of Newton’s laws: The Force and Motion Conceptual Evaluation and the Evaluation of Active Learning Laboratory and Lecture Curricula , 1998 .

[31]  Paul H. Williams,et al.  A Novel Strategy for Assessing the Effects of Curriculum Reform on Student Competence. , 1998 .

[32]  D. Treagust Development and use of diagnostic tests to evaluate students’ misconceptions in science , 1988 .

[33]  Ron Good,et al.  Problem solving and classical genetics: Successful versus unsuccessful performance† , 1984 .

[34]  Jennifer K Knight,et al.  The Genetics Concept Assessment: a new concept inventory for gauging student understanding of genetics. , 2008, CBE life sciences education.

[35]  Charlene D'Avanzo,et al.  Biology Concept Inventories: Overview, Status, and Next Steps , 2008 .

[36]  Christine L. Moskalik,et al.  Development and Evaluation of a Genetics Literacy Assessment Instrument for Undergraduates , 2008, Genetics.

[37]  M. Sundberg,et al.  Assessing student learning. , 2002, Cell biology education.

[38]  M. Klymkowsky,et al.  Bioliteracy and teaching efficacy: what biologists can learn from physicists. , 2003, Cell biology education.

[39]  William Cliff,et al.  Undergraduates' understanding of cardiovascular phenomena. , 2002, Advances in physiology education.

[40]  Lei Bao,et al.  Model Analysis: Representing and Assessing the Dynamics of Student Learning. , 2006 .

[41]  Deborah Allen,et al.  Approaches to biology teaching and learning: from assays to assessments--on collecting evidence in science teaching. , 2004, Cell biology education.

[42]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[43]  P. Black,et al.  Classroom Assessment and the National Science Education Standards. , 2001 .

[44]  E. Mazur,et al.  Peer Instruction: A User’s Manual , 1999 .

[45]  Douglas Huffman,et al.  What does the force concept inventory actually measure , 1995 .

[46]  D. Hestenes,et al.  Force concept inventory , 1992 .

[47]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[48]  David P Maloney,et al.  Surveying students’ conceptual knowledge of electricity and magnetism , 2001 .

[49]  John E. Merrill,et al.  Assessing students' ability to trace matter in dynamic systems in cell biology. , 2006, CBE life sciences education.

[50]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[51]  G. Wiggins,et al.  Understanding by Design , 1998 .