Measuring Changes in Interest in Science and Technology at the College Level in Response to Two Instructional Interventions

Improving interest in science, technology, engineering, and mathematics (STEM) is crucial to widening participation and success in STEM studies at the college level. To understand how classroom and extracurricular interventions affect interest, it is necessary to have appropriate measurement tools. We describe the adaptation and revalidation of a previously existing multidimensional instrument to the end of measuring interest in environmental science and technology in college nonscience majors. We demonstrate the revised instrument’s ability to detect change in this group over an 8-week time period. While collection of demographic information was not part of the study design, participating students were similar in that they hailed from three environmental science nonmajor classes sharing a common syllabus and instructional delivery method. Change in interest was measured in response to two types of scientific literature-based learning approaches: a scientific practice approach and a traditional, quiz-driven approach. We found that both approaches led to moderate gains in interest in learning environmental science and careers in environmental science across an 8-week time period. Interest in using technology for learning increased among students using the scientific practice approach; in contrast, the same measure decreased among students using the reading/quiz approach. This result invites the possibility that interest in using technology as a learning tool may relate to technological literacy, which must be taught explicitly in the context of authentic inquiry experiences.

[1]  H. Swaminathan,et al.  Detecting Differential Item Functioning Using Logistic Regression Procedures , 1990 .

[2]  Tanya K. Altmann Attitude: a concept analysis. , 2008, Nursing forum.

[3]  G. Masters,et al.  Item Discrimination: When More Is Worse , 1988 .

[4]  J. Shea National Science Education Standards , 1995 .

[5]  Sheila Tobias,et al.  They're Not Dumb, They're Different: Stalking the Second Tier , 1991 .

[6]  Ghali Hassan,et al.  Attitudes toward science among Australian tertiary and secondary school students , 2008 .

[7]  Troy D. Sadler,et al.  Learning Science through Research Apprenticeships: A Critical Review of the Literature. , 2009 .

[8]  S. Glynn,et al.  Attitudinal and Motivational Constructs in Science Learning , 2013 .

[9]  Douglas B. McLeod,et al.  Affect and Mathematical Problem Solving , 1989 .

[10]  David F. Treagust,et al.  Development and application of a two-tier multiple choice diagnostic instrument to assess high school students' understanding of inorganic chemistry qualitative analysis , 2002 .

[11]  Donald Hedeker,et al.  Application of random-efiects pattern-mixture models for miss-ing data in longitudinal studies , 1997 .

[12]  Sandra K. Abell,et al.  The Design, Enactment, and Experience of Inquiry-Based Instruction in Undergraduate Science Education: A Case Study. , 2008 .

[13]  C. Kardash,et al.  The Perceptions of Science Classes Survey: What Undergraduate Science Reform Efforts Really Need To Address. , 2001 .

[14]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[15]  P. Silvia Exploring the Psychology of Interest , 2006 .

[16]  J. Dewey,et al.  Interest and Effort in Education , 1975 .

[17]  Ronald D. Simpson,et al.  Defining attitude for science educators , 1988 .

[18]  Patricia A. Alexander,et al.  The role of importance and interest in the processing of text , 1996 .

[19]  Douglas B. McLeod,et al.  Affect and mathematical problem solving : a new perspective , 1989 .

[20]  Adam V. Maltese,et al.  Pipeline persistence: Examining the association of educational experiences with earned degrees in STEM among U.S. students , 2011 .

[21]  Barry J. Fraser,et al.  Development of a test of science‐related attitudes , 1978 .

[22]  Miriam Ossevoort,et al.  Introducing Pre-university Students to Primary Scientific Literature Through Argumentation Analysis , 2013 .

[23]  M. Kenward,et al.  Small sample inference for fixed effects from restricted maximum likelihood. , 1997, Biometrics.

[24]  Chris S. Hulleman,et al.  Promoting Interest and Performance in High School Science Classes , 2009, Science.

[25]  William L. Romine,et al.  Exploring Secondary Students' Knowledge and Misconceptions about Influenza: Development, validation, and implementation of a multiple-choice influenza knowledge scale , 2013 .

[26]  B. Wright Reasonable mean-square fit values , 1994 .

[27]  Harvey F Lodish,et al.  Points of view: lectures: can't learn with them, can't learn without them. , 2004, Cell biology education.

[28]  R. Engle Wald, likelihood ratio, and Lagrange multiplier tests in econometrics , 1984 .

[29]  Nedjeljko Frančula The National Academies Press , 2013 .

[30]  Joanne Gainen,et al.  Barriers to Success in Quantitative Gatekeeper Courses. , 1995 .

[31]  Ulrich Schiefele,et al.  Interest as a predictor of academic achievement: A meta-analysis of research. , 1992 .

[32]  S. Ball Motivation in Education , 1977 .

[33]  Martina Nieswandt,et al.  Student affect and conceptual understanding in learning chemistry , 2007 .

[34]  S. Hidi,et al.  The Role Of Interest In Learning And Development , 1994 .

[35]  B. Wright,et al.  Best test design , 1979 .

[36]  Diane Ebert-May,et al.  Innovation in large lectures—teaching for active learning , 1997 .

[37]  Anne-Barrie Hunter,et al.  Becoming a scientist: The role of undergraduate research in students' cognitive, personal, and professional development , 2007 .

[38]  Joan S. Bennett,et al.  Alumni Perceptions Used to Assess Undergraduate Research Experience , 2003 .

[39]  Patricia A. Alexander,et al.  Interrelationship of Knowledge, Interest, and Recall: Assessing a Model of Domain Learning , 1995 .

[40]  John M. Linacre Rasch Measurement Transactions, Part 1. , 1995 .

[41]  William L. Romine,et al.  STUDENT INTEREST IN TECHNOLOGY AND SCIENCE (SITS) SURVEY: DEVELOPMENT, VALIDATION, AND USE OF A NEW INSTRUMENT , 2014 .

[42]  T. Lacey,et al.  Occupational Employment Projections to 2018 , 2009 .

[43]  W. McComas Benchmarks for Science Literacy , 2014 .

[44]  Division on Earth BIO2010: Transforming Undergraduate Education for Future Research Biologists , 2003 .

[45]  Herbert S. Lin,et al.  They’re Not Dumb, They’re Different: Stalking the Second Tier , 1991 .

[46]  Sherry A. Southerland,et al.  Educational Reform, Personal Practical Theories, and Dissatisfaction: The Anatomy of Change in College Science Teaching , 2003 .

[47]  Helen L. Gibson,et al.  Longitudinal impact of an inquiry‐based science program on middle school students' attitudes toward science , 2002 .

[48]  Wan Ng,et al.  Students' Perceptions of the Effectiveness of the World Wide Web as a Research and Teaching Tool in Science Learning , 2002 .

[49]  P. Pintrich,et al.  Motivation in Education: Theory, Research, and Applications , 1995 .

[50]  Diana Voss Points of View: PowerPoint in the Classroom PowerPoint in the Classroom, Is it Really Necessary? , 2004 .

[51]  Dana L. Zeidler,et al.  Moral issues and social policy in science education: Closing the literacy gap , 1984 .

[52]  K. E. Barron,et al.  Predicting Success in College: A Longitudinal Study of Achievement Goals and Ability Measures as Predictors of Interest and Performance From Freshman Year Through Graduation , 2002 .

[53]  A. Wald Tests of statistical hypotheses concerning several parameters when the number of observations is large , 1943 .

[54]  Kim McDonald Points of View: PowerPoint in the Classroom Examining PowerPointlessness , 2004 .

[55]  Troy D. Sadler,et al.  Scientific Research for Undergraduate Students: A Review of the Literature. , 2010 .

[56]  Sarah N. Gatson,et al.  Integrating research and education at research-extensive universities with research-intensive communities. , 2008, Advances in physiology education.

[57]  Leonard A. Annetta,et al.  MEASURING SCIENCE INTEREST: RASCH VALIDATION OF THE SCIENCE INTEREST SURVEY , 2012 .

[58]  P. Ehrlich,et al.  Can a collapse of global civilization be avoided? , 2013, Proceedings of the Royal Society B: Biological Sciences.

[59]  R. Duschl,et al.  Retention and attrition of science talent: a longitudinal study of Westinghouse Science Talent Search winners , 1993 .

[60]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[61]  Norman G. Lederman,et al.  Handbook of Research on Science Education , 2023 .