STUDENT INTEREST IN TECHNOLOGY AND SCIENCE (SITS) SURVEY: DEVELOPMENT, VALIDATION, AND USE OF A NEW INSTRUMENT

This study presents the systematic development, validation, and use of a new instrument for measuring student interest in science and technology. The Student Interest in Technology and Science (SITS) survey is composed of 5 sub-sections assessing the following dimensions: interest in learning science, using technology to learn science, science careers, technology careers, and attitudes toward biotechnology. Our development process included review of existing instrumentation, pilot testing, and expert panel review. The resulting instrument was administered before and after implementation of a biotechnology intervention which used a computer-based game to engage learners in the use of biotechnology to address a societal issue. We employed item response theory (IRT) to explore instrument validity and precision. Results of the psychometric analyses suggest that the SITS survey has a well-defined structure and meets IRT assumptions. Difficulty and discrimination parameters as well as reliability analyses indicate that SITS items provide useful measures of student interest. Finally, we use the SITS to explore the extent to which the intervention used in this study supports changes in student interest and association between students’ interest and related content knowledge. Implications for the future use of this instrument are discussed.

[1]  E. Allen Bame,et al.  Pupils' Attitudes toward Technology--PATT-USA. , 1993 .

[2]  Ghali Hassan,et al.  Attitudes toward science among Australian tertiary and secondary school students , 2008 .

[3]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[4]  P. Silvia.  Exploring the Psychology of Interest , 2006 .

[5]  Thomas A. Keenan.  Computers and education , 1964, CACM.

[6]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[7]  Ronald D. Simpson,et al.  Defining attitude for science educators , 1988 .

[8]  F. Samejima.  A General Model for Free Response Data. , 1972 .

[9]  Patricia A. Alexander,et al.  The role of importance and interest in the processing of text , 1996 .

[10]  Andrew Ortony,et al.  Activity matters: Understanding student interest in school science , 2012 .

[11]  Molly H. Weinburgh,et al.  The Modified Attitudes toward Science Inventory: Developing an Instrument to Be Used with Fifth Grade Urban Students. , 2000 .

[12]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[13]  Martina Nieswandt,et al.  Student affect and conceptual understanding in learning chemistry , 2007 .

[14]  Tanja Klop,et al.  An Exploration of Attitudes towards Modern Biotechnology: A study among Dutch secondary school students , 2007 .

[15]  Tanya K. Altmann.  Attitude: a concept analysis. , 2008, Nursing forum.

[16]  P. Silvia.  Interest and Interests: The Psychology of Constructive Capriciousness , 2001 .

[17]  P. Bentler,et al.  Evaluating model fit. , 1995 .

[18]  Paul J. Germann,et al.  Development of the attitude toward science in school assessment and its use to investigate the relationship between science achievement and attitude toward science in school , 1988 .

[19]  J. Dewey,et al.  Interest and Effort in Education , 1975 .

[20]  J. Gee,et al.  How Computer Games Help Children Learn , 2006 .

[21]  Troy D. Sadler,et al.  Teachers' implementation of a game-based biotechnology curriculum , 2013, Comput. Educ..

[22]  John Raffan,et al.  Biotechnology: student's knowledge and attitudes in the LJK and Taiwan , 1999 .

[23]  William L. Romine,et al.  Game-Based Curricula in Biology Classes: Differential Effects among Varying Academic Levels , 2013 .

[24]  Norman G. Lederman,et al.  Handbook of Research on Science Education , 2023 .

[25]  Ulrich Schiefele,et al.  Interest, Learning, and Motivation , 1991 .

[26]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[27]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[28]  R. Sternberg,et al.  Motivation, emotion, and cognition: integrative perspectives on intellectual functioning and development , 2004 .

[29]  Richard W. Moore,et al.  The scientific attitude inventory: A revision (SAI II) , 1997 .

[30]  S. Tobias.  Interest, Prior Knowledge, and Learning , 1994 .

[31]  Barry J. Fraser,et al.  Development of a test of science‐related attitudes , 1978 .

[32]  Gregory Schraw,et al.  Situational Interest: A Review of the Literature and Directions for Future Research , 2001 .

[33]  S. Barab,et al.  Relating Narrative, Inquiry, and Inscriptions: Supporting Consequential Play , 2007 .

[34]  Kurt Squire,et al.  Video Games and Learning: Teaching and Participatory Culture in the Digital Age , 2011 .

[35]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[36]  Brian C. Nelson,et al.  A multi-user virtual environment for building and assessing higher order inquiry skills in science , 2010, Br. J. Educ. Technol..

[37]  Neil Selwyn,et al.  Students' attitudes toward computers: Validation of a computer attitude scale for 16-19 education , 1997, Comput. Educ..

[38]  Ulrich Schiefele,et al.  Interest as a predictor of academic achievement: A meta-analysis of research. , 1992 .

[39]  Mark A. McDaniel,et al.  The effects of text-based interest on attention and recall. , 2000 .

[40]  S. Hidi,et al.  The Role Of Interest In Learning And Development , 1994 .

[41]  R. Kay.  An exploration of theoretical and practical foundations for assessing attitudes toward computers: The Computer Attitude Measure (CAM) , 1993 .

[42]  Dana L. Zeidler,et al.  THIRTY STUDIES INVOLVING THE "SCIENTIFIC ATTITUDE INVENTORY": WHAT CONFIDENCE CAN WE HAVE IN THIS INSTRUMENT? , 1984 .

[43]  Svein Sjøberg,et al.  How Do Learners in Different Cultures Related to Science and Technology? Results and Perspectives from the Project Rose (The Relevance of Science Education). , 2005 .

[44]  M. Ranney,et al.  Developing the changes in attitude about the relevance of science (CARS) questionnaire and assessing two high school science classes , 2003 .

[45]  Tandra Tyler-Wood,et al.  Instruments for Assessing Interest in STEM Content and Careers , 2010 .

[46]  R. Garner,et al.  "Seductive details" and learning from text. , 1992 .

[47]  Shawn Y. Holmes,et al.  Assessing twenty‐first century skills through a teacher created video game for high school biology students , 2010 .

[48]  Douglas B. McLeod,et al.  Affect and Mathematical Problem Solving , 1989 .

[49]  S. Glynn,et al.  Attitudinal and Motivational Constructs in Science Learning , 2013 .

[50]  Karen Jones,et al.  Developing Attitudes towards Science Measures , 2007 .

[51]  Leonard A. Annetta,et al.  MEASURING SCIENCE INTEREST: RASCH VALIDATION OF THE SCIENCE INTEREST SURVEY , 2012 .