Context Matters: Volunteer Bias, Small Sample Size, and the Value of Comparison Groups in the Assessment of Research-Based Undergraduate Introductory Biology Lab Courses

The shift from cookbook to authentic research-based lab courses in undergraduate biology necessitates the need for evaluation and assessment of these novel courses. Although the biology education community has made progress in this area, it is important that we interpret the effectiveness of these courses with caution and remain mindful of inherent limitations to our study designs that may impact internal and external validity. The specific context of a research study can have a dramatic impact on the conclusions. We present a case study of our own three-year investigation of the impact of a research-based introductory lab course, highlighting how volunteer students, a lack of a comparison group, and small sample sizes can be limitations of a study design that can affect the interpretation of the effectiveness of a course.

[1]  Diane Ebert-May,et al.  Learner-Centered Inquiry in Undergraduate Biology: Positive Relationships with Long-Term Student Achievement , 2010, CBE life sciences education.

[2]  Kenneth A. Feldman,et al.  The perceived instructional effectiveness of college teachers as related to their personality and attitudinal characteristics: A review and synthesis , 1986 .

[3]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[4]  Steven C Cunningham,et al.  Beverage-agarose gel electrophoresis: an inquiry-based laboratory exercise with virtual adaptation. , 2006, CBE life sciences education.

[5]  Sara E. Brownell,et al.  Integrating Teaching and Research in Undergraduate Biology Laboratory Education , 2011, PLoS biology.

[6]  L. Shulman.  Those Who Understand: Knowledge Growth in Teaching , 1986 .

[7]  L. C. Robinson,et al.  A molecular genetics laboratory course applying bioinformatics and cell biology in the context of original research. , 2008, CBE life sciences education.

[8]  Y. Lincoln,et al.  Scientific Research in Education , 2004 .

[9]  Sara E. Brownell,et al.  Research and Teaching. Effects of a Research-Based Ecology Lab Course: A Study of Nonvolunteer Achievement, Self-Confidence, and Perception of Lab Course Purpose. , 2013 .

[10]  Julie Gess-Newsome.  Pedagogical Content Knowledge: An Introduction and Orientation , 1999 .

[11]  R. Rosenthal,et al.  The Volunteer Subject , 1965 .

[12]  L. Shulman,et al.  Teachers of Substance: Subject Matter Knowledge for Teaching , 2005 .

[13]  Norman G. Lederman,et al.  Examining Pedagogical Content Knowledge: The Construct and its Implications for Science Education , 2001 .

[14]  D. Allen,et al.  Approaches to biology teaching and learning: learning styles and the problem of instructional selection--engaging all students in science courses. , 2004, Cell biology education.

[15]  B. Aronson,et al.  From genes to proteins to behavior: a laboratory project that enhances student understanding in cell and molecular biology. , 2009, CBE life sciences education.

[16]  E. William Wischusen,et al.  A REAPPRAISAL OF THE STATUS OF Introductory Biology Laboratory Education in U.S. Colleges & Universities , 2005 .

[17]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[18]  Merri Lynn Casem,et al.  Student perspectives on curricular change: lessons from an undergraduate lower-division biology core. , 2006, CBE life sciences education.

[19]  S. DiBartolomeis,et al.  A Semester-Long Project for Teaching Basic Techniques in Molecular Biology Such as Restriction Fragment Length Polymorphism Analysis to Undergraduate and Graduate Students , 2011, CBE life sciences education.

[20]  Mary Lee S. Ledbetter,et al.  Vision and Change in Undergraduate Biology Education: A Call to Action Presentation to Faculty for Undergraduate Neuroscience, July 2011 , 2012, Journal of undergraduate neuroscience education : JUNE : a publication of FUN, Faculty for Undergraduate Neuroscience.

[21]  Pamela A. Moss,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[22]  J. Krajcik,et al.  Nature, Sources, and Development of Pedagogical Content Knowledge for Science Teaching , 1999 .

[23]  Todd Kent,et al.  The Complex Nature and Sources of Teachers’ Pedagogical Knowledge , 1999 .

[24]  Karen Sirum,et al.  The Experimental Design Ability Test (EDAT) , 2011 .

[25]  W. McComas.  Laboratory Instruction in the Service of Science Teaching and Learning: Reinventing and Reinvigorating the Laboratory Experience. , 2005 .

[26]  Derek C. Briggs,et al.  Impact of Undergraduate Science Course Innovations on Learning , 2011, Science.

[27]  Robert Rosenthal,et al.  The Volunteer Subject , 1976 .

[28]  B. Schneider,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[29]  P. Brickman,et al.  Developing a Test of Scientific Literacy Skills (TOSLS): Measuring Undergraduates’ Evaluation of Scientific Information and Arguments , 2012, CBE life sciences education.

[30]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[31]  M. A. Richard,et al.  Teacher's Myers-Briggs personality profiles: Identifying effective teacher personality traits , 2007 .

[32]  Tadashi Fukami.  Integrating Inquiry-Based Teaching with Faculty Research , 2013, Science.

[33]  Jeremy D. Glasner,et al.  Using Comparative Genomics for Inquiry-Based Learning to Dissect Virulence of Escherichia coli O157:H7 and Yersinia pestis , 2012, CBE life sciences education.

[34]  Janet M. Batzli,et al.  Studying Human Disease Genes in Caenorhabditis elegans: A Molecular Genetics Laboratory Project , 2012, CBE life sciences education.

[35]  David DeMatteo,et al.  Essentials of research design and methodology , 2005 .

[36]  T. Derting,et al.  Education research: set a high bar. , 2011, Science.

[37]  Sara E. Brownell,et al.  Undergraduate Biology Lab Courses: Comparing the Impact of Traditionally Based "Cookbook" and Authentic Research-Based Courses on Student Lab Experiences , 2012 .