Development, Evaluation and Use of a Student Experience Survey in Undergraduate Science Laboratories: The Advancing Science by Enhancing Learning in the Laboratory Student Laboratory Learning Experience Survey

Student experience surveys have become increasingly popular to probe various aspects of processes and outcomes in higher education, such as measuring student perceptions of the learning environment and identifying aspects that could be improved. This paper reports on a particular survey for evaluating individual experiments that has been developed over some 15 years as part of a large national Australian study pertaining to the area of undergraduate laboratories—Advancing Science by Enhancing Learning in the Laboratory. This paper reports on the development of the survey instrument and the evaluation of the survey using student responses to experiments from different institutions in Australia, New Zealand and the USA. A total of 3153 student responses have been analysed using factor analysis. Three factors, motivation, assessment and resources, have been identified as contributing to improved student attitudes to laboratory activities. A central focus of the survey is to provide feedback to practitioners to iteratively improve experiments. Implications for practitioners and researchers are also discussed.

[1]  M. Bartlett.  TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1950 .

[2]  Avi Hofstein,et al.  The Role of the Laboratory in Science Teaching: Neglected Aspects of Research , 1982 .

[3]  H. Kaiser.  A second generation little jiffy , 1970 .

[4]  Manjula D. Sharma,et al.  A methodological framework for understanding and describing discipline‐based scholarship of teaching in higher education through design‐based research , 2008 .

[5]  Ronald L. Miller,et al.  Using A Delphi Study To Identify The Most Difficult Concepts For Students To Master In Thermal And Transport Sciences , 2003 .

[6]  John Settlage,et al.  Demythologizing Science Teacher Education: Conquering the False Ideal of Open Inquiry , 2007 .

[7]  K. Ann Renninger,et al.  Interest, a motivational variable that combines affective and cognitive functioning. , 2004 .

[8]  George M. Bodner,et al.  Action research: Overcoming the Sports Mentality Approach to Assessment/Evaluation , 1999 .

[9]  Daniel S. Domin,et al.  A Review of Laboratory Instruction Styles , 1999 .

[10]  M. Albanese,et al.  Problem‐based Learning: A Review of Literature on Its Outcomes and Implementation Issues , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[11]  Elizabeth Hegarty-Hazel.  The Student laboratory and the science curriculum , 1990 .

[12]  C. Dziuban,et al.  When is a correlation matrix appropriate for factor analysis? Some decision rules. , 1974 .

[13]  Campbell J. McRobbie,et al.  Science Laboratory Classroom Environments at Schools and Universities: A Cross‐National Study∗ , 1995 .

[14]  Manjula D. Sharma,et al.  The Advancing Science by Enhancing Learning in the Laboratory (ASELL) Project: The first Australian multidisciplinary workshop , 2011 .

[15]  Dawn Del Carlo,et al.  High School Students' Perceptions of Their Laboratory Classroom and the Copying of Laboratory Work , 2006 .

[16]  Robert W. Lissitz,et al.  Estimating the Impact of Instructional Practices on Student Achievement in Science , 1999 .

[17]  Michael J. Prince,et al.  Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases , 2006 .

[18]  Mark A. Buntine,et al.  APCELL: The Australian Physical Chemistry Enhanced Laboratory Learning Project , 2001 .

[19]  Rachel Mamlok-Naaman,et al.  The laboratory in science education: the state of the art , 2007 .

[20]  Peter H. Sneddon,et al.  The perceptions, views and opinions of university students about physics learning during undergraduate laboratory work , 2008 .

[21]  Arnold B. Arons,et al.  Guiding Insight and Inquiry in the Introductory Physics Laboratory. , 1993 .

[22]  A. Johnstone.  Chemistry Teaching - Science or Alchemy? 1996 Brasted Lecture , 1997 .

[23]  George M. Bodner,et al.  Students' perceptions of academic dishonesty in the chemistry classroom laboratory , 2004 .

[24]  Stacey Lowery Bretz,et al.  A Rubric to Guide Curriculum Development of Undergraduate Chemistry Laboratory: Focus on Inquiry , 2009 .

[25]  John P. Rice,et al.  Tertiary science education in the 21st century , 2009 .

[26]  Michelle Perry,et al.  Learning in the Laboratory. , 1986 .

[27]  Sara E. Brownell,et al.  Undergraduate Biology Lab Courses: Comparing the Impact of Traditionally Based "Cookbook" and Authentic Research-Based Courses on Student Lab Experiences , 2012 .

[28]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[29]  Richard T. White,et al.  The link between the laboratory and learning , 1996 .

[30]  William J. Green,et al.  "Prompted" Inquiry-Based Learning in the Introductory Chemistry Laboratory , 2004 .

[31]  Gary M. Shulman,et al.  “What's in it for me?”: Increasing content relevance to enhance students' motivation , 1995 .

[32]  Rachel Mamlok-Naaman,et al.  The meaning of ‘relevance’ in science education and its implications for the science curriculum , 2013 .

[33]  B. Fraser,et al.  Development and cross-national validation of a laboratory classroom environment instrument for senior high school science , 1993 .

[34]  T. Blanksby,et al.  Assessing first year biology student practical skills: benchmarking across the landscape , 2012 .

[35]  Stacey Lowery Bretz,et al.  A rubric to characterize inquiry in the undergraduate chemistry laboratory , 2007 .

[36]  Miles Pickering,et al.  A physical chemist looks at organic chemistry lab , 1988 .

[37]  Erica McWilliam,et al.  W(h)ither practitioner research? , 2004 .

[38]  Vincent N. Lunetta,et al.  The Laboratory in Science Education: Foundations for the Twenty-First Century , 2004 .

[39]  Mary B. Nakhleh,et al.  What Defines Effective Chemistry Laboratory Instruction? Teaching Assistant and Student Perspectives , 2003 .

[40]  Gerald H. Krockover,et al.  Action-based Research Teams: Collaborating To Improve Science Instruction. Injecting Energy into Science Education. , 2001 .

[41]  H. Kaiser.  The varimax criterion for analytic rotation in factor analysis , 1958 .

[42]  Gerald H. Krockover,et al.  Reforming and Assessing Undergraduate Science Instruction Using Collaborative Action-Based Research Teams. , 2002 .

[43]  Hugh McKenna,et al.  Research guidelines for the Delphi survey technique: Delphi survey technique , 2000 .

[44]  S. Hidi,et al.  Student Interest and Achievement: Developmental Issues Raised by a Case Study , 2002 .

[45]  F. Hasson,et al.  Research guidelines for the Delphi survey technique. , 2000, Journal of advanced nursing.

[46]  S. Simon,et al.  Attitudes towards science: A review of the literature and its implications , 2003 .

[47]  M. J. Myers,et al.  Inquiry-based laboratory course improves students' ability to design experiments and interpret data. , 2003, Advances in physiology education.

[48]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[49]  David H. Palmer.  Student interest generated during an inquiry skills lesson , 2009 .

[50]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[51]  Impact of biology laboratory courses on students' science performance and views about laboratory courses in general: innovative measurements and analyses , 2012 .

[52]  Stacey Lowery Bretz.  Navigating the Landscape of Assessment , 2012 .

[53]  Hans Niedderer,et al.  Teaching and learning in the science laboratory , 2003 .

[54]  David F. Treagust,et al.  Inquiry in science education: International perspectives , 2004 .

[55]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[56]  N. Reid,et al.  The role of laboratory work in university chemistry , 2007 .

[57]  M. Marshall.  Teaching in laboratories , 1973, Journal of medical education.

[58]  Kelly Morgan Deters,et al.  Student opinions regarding inquiry-based labs , 2005 .

[59]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[60]  R. Bybee.  Learning Science and the Science of Learning , 2002 .

[61]  Christopher Beck,et al.  Promoting Inquiry-Based Teaching in Laboratory Courses: Are We Meeting the Grade? , 2014, CBE life sciences education.

[62]  Rodney Boyer.  Concepts and skills in the biochemistry/molecular biology lab , 2003 .