An analysis of four ways of assessing student beliefs about sts topics

The study investigated the degree of ambiguity harbored by four different response modes used to monitor student beliefs about science-technology-society topics: Likert-type, written paragraph, semistrue tured interview, and empirically developed multiple choice. The study also explored the sources of those beliefs. Grade-12 students in a Canadian urban setting responded, in each of the four modes, to statements from Views on Science-Technology-Society. It was discovered that TV had far more influence on what students believed about science and its social, technological context than did numerous science courses. The challenge to science educators is to use the media effectively in combating naive views about science. Regarding ambiguity in student assessment, the Likert-type responses were the most inaccurate, offering only a guess at student beliefs. Such guesswork calls into question the use of Likert-type standardized tests that claim to assess student views about science. Student paragraph responses contained significant ambiguities in about 50% of the cases. The empirically developed multiple choices, however, reduced the ambiguity to the 20% level. Predictably, the semistructured interview was the least ambiguous of all four response modes, but it required the most time to administer. These findings encourage researchers to develop instruments grounded in the empirical data of student viewpoints, rather than relying solely on instruments structured by the philosophical stances of science educators.

[1]  M. E. Shaw,et al.  Scales for the measurement of attitudes , 1967 .

[2]  L. E. Klopfer,et al.  Science, society, and science education , 1980 .

[3]  George Basalla,et al.  Pop Science: The Depiction of Science in Popular Culture , 1976 .

[4]  Alan G. Ryan High-School Graduates' Beliefs about Science-Technology-Society. IV. The Characteristics of Scientists. , 1987 .

[5]  L. West,et al.  Cognitive Structure and Conceptual Change , 1985 .

[6]  Dorothy L. Gabel,et al.  Research interests of secondary science teachers , 1986 .

[7]  Reg Fleming,et al.  Adolescent reasoning in socio‐scientific issues, part I: Social cognition , 1986 .

[8]  A. M. Lucas,et al.  Scientific Literacy and Informal Learning , 1983 .

[9]  Roger Fellows,et al.  Images of Science , 1988 .

[10]  P. Gardner,et al.  Attitudes to Science : A Review , 1975 .

[11]  H. Munby The place of teachers' beliefs in research on teacher thinking and decision making, and an alternative methodology , 1982 .

[12]  K. Howe,et al.  Two Dogmas of Educational Research , 1985 .

[13]  Hugh Munby,et al.  Thirty studies involving the “scientific attitude inventory”: What confidence can we have in this instrument? , 1983 .

[14]  Renato Schibeci,et al.  Images of science and scientists and science education , 1986 .

[15]  Alan G. Ryan,et al.  High‐school graduates' beliefs about science‐technology‐society. I. methods and issues in monitoring student views , 1987 .

[16]  Reg Fleming High‐school graduates' beliefs about science‐technology‐society. II. the interaction among science, technology and society , 1987 .

[17]  John W. Renner,et al.  The Importance of the Form of Student Acquisition of Data in Physics Learning Cycles. , 1985 .