How Students Think about Experimental Design: Novel Conceptions Revealed by in-Class Activities

Experimental design is a fundamental skill for scientists, but it is often not explicitly taught in large introductory biology classes. We have designed two pencil-and-paper in-class activities to increase student understanding of experimental design: an analyze activity, in which students are asked to evaluate data, and a design activity, in which students are asked to propose a novel experiment. We found that students who completed the design activity but not the analyze activity performed significantly better on the Expanded Experimental Design Ability Tool (E-EDAT) than did students who attended a didactic lecture about experimental design. By using grounded theory on student responses on the in-class activities, we have identified a novel set of accurate and inaccurate conceptions focused on two aspects of experimental design: sample size and the repetition of experiments. These findings can be used to help guide science majors through mastering the fundamental skill of designing rigorous experiments.

[1]  C. Nelson Teaching evolution (and all of biology) more effectively: Strategies for engagement, critical reasoning, and confronting misconceptions. , 2008, Integrative and comparative biology.

[2]  J. T. Zuckerman Accurate and Inaccurate Conceptions about Osmosis That Accompanied Meaningful Problem Solving. , 1994 .

[3]  R. Millar,et al.  Reasoning from data: How students collect and interpret data in science investigations , 2004 .

[4]  Clarissa Dirks,et al.  Teaching the Process of Science: Faculty Perceptions and an Effective Methodology , 2010, CBE life sciences education.

[5]  John D. Coley,et al.  Common Origins of Diverse Misconceptions: Cognitive Principles and the Development of Biology Thinking , 2012, CBE life sciences education.

[6]  Edmund A. Marek,et al.  Is Oklahoma really OK? A regional study of the prevalence of biological evolution-related misconceptions held by introductory biology teachers , 2013, Evolution: Education and Outreach.

[7]  Karen Sirum,et al.  The Experimental Design Ability Test (EDAT) , 2011 .

[8]  Franz X. Bogner,et al.  Cognitive Load and Alternative Conceptions in Learning Genetics: Effects from Provoking Confusion , 2013 .

[9]  P. Brickman,et al.  Developing a Test of Scientific Literacy Skills (TOSLS): Measuring Undergraduates’ Evaluation of Scientific Information and Arguments , 2012, CBE life sciences education.

[10]  Migdalisel Colon-Berlingeri,et al.  Teaching Biology through Statistics: Application of Statistical Methods in Genetics and Zoology Courses , 2011, CBE life sciences education.

[11]  R. Beichner The Student-Centered Activities for Large Enrollment Undergraduate Programs (SCALE-UP) Project , 2007 .

[12]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[13]  R. Hake Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses , 1998 .

[14]  Ravit Golan Duncan,et al.  Science Learning Progressions , 2013, Science.

[15]  Xiaodong Lin,et al.  Supporting Learning of Variable Control in a Computer-Based Biology Environment: Effects of Prompting College Students to Reflect on Their Own Thinking , 1999 .

[16]  Ben Kelcey,et al.  How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity , 2009 .

[17]  D. Klahr,et al.  All other things being equal: acquisition and transfer of the control of variables strategy. , 1999, Child development.

[18]  Alison Crowe,et al.  Biology in bloom: implementing Bloom's Taxonomy to enhance student learning in biology. , 2008, CBE life sciences education.

[19]  Michael W. Klymkowsky,et al.  Revealing Student Thinking about Experimental Design and the Roles of Control Experiments , 2011 .

[20]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[21]  Alexia E. Pollack Exploring the Complexities of Experimental Design: Using an On-line Reaction Time Program as a Teaching Tool for Diverse Student Populations , 2010, Journal of undergraduate neuroscience education : JUNE : a publication of FUN, Faculty for Undergraduate Neuroscience.

[22]  Scott Freeman,et al.  How should we teach tree-thinking? An experimental test of two hypotheses , 2013, Evolution: Education and Outreach.

[23]  Elizabeth Hayes,et al.  The use of interrupted case studies to enhance critical thinking skills in biology. , 2009, Journal of microbiology & biology education.

[24]  Sara M Hiebert,et al.  Teaching simple experimental design to undergraduates: do your students understand the basics? , 2007, Advances in physiology education.

[25]  D. Yip,et al.  Alternative Conceptions in Biology-Related Topics of Integrated Science Teachers and Implications for Teacher Education , 1999 .

[26]  A. Ryan,et al.  Students' Preconceptions about the Epistemology of Science , 1992 .

[27]  Kenneth A. Strike,et al.  A revisionist theory of conceptual change , 1992 .

[28]  Scott Freeman,et al.  Increased Course Structure Improves Performance in Introductory Biology , 2011, CBE life sciences education.

[29]  S. Kalinowski,et al.  Active Learning Not Associated with Student Learning in a Random Sample of College Biology Courses , 2011, CBE life sciences education.

[30]  Ellen F. Potter,et al.  Using Descriptive Drawings as a Conceptual Change Strategy in Elementary Science , 2003 .

[31]  Clarissa Dirks,et al.  Enhancing diversity in science: is teaching science process skills the answer? , 2006, CBE life sciences education.

[32]  Amelia Wenk Gotwals,et al.  Learning Progressions in Science , 2012 .

[33]  R. Giere How Models Are Used to Represent Reality , 2004, Philosophy of Science.

[34]  Student Understanding of Control of Variables: Deciding Whether or Not a Variable Influences the Behavior of a System , 2008 .

[35]  Mark A. Schlueter,et al.  Scaffolded Instruction Improves Student Understanding of the Scientific Method & Experimental Design , 2013 .

[36]  J. Clement,et al.  Not all preconceptions are misconceptions: finding ‘anchoring conceptions’ for grounding instruction on students’ intuitions , 1989 .

[37]  Sara E. Brownell,et al.  Research and Teaching. Effects of a Research-Based Ecology Lab Course: A Study of Nonvolunteer Achievement, Self-Confidence, and Perception of Lab Course Purpose. , 2013 .