Why Students Answer TIMSS Science Test Items the Way They Do

The purpose of this study was to explore how Year 8 students answered Third International Mathematics and Science Study (TIMSS) questions and whether the test questions represented the scientific understanding of these students. One hundred and seventy-seven students were tested using written test questions taken from the science test used in the Third International Mathematics and Science Study. The degree to which a sample of 38 children represented their understanding of the topics in a written test compared to the level of understanding that could be elicited by an interview is presented in this paper. In exploring student responses in the interview situation this study hoped to gain some insight into the science knowledge that students held and whether or not the test items had been able to elicit this knowledge successfully. We question the usefulness and quality of data from large-scale summative assessments on their own to represent student scientific understanding and conclude that large scale written test items, such as TIMSS, on their own are not a valid way of exploring students' understanding of scientific concepts. Considerable caution is therefore needed in exploiting the outcomes of international achievement testing when considering educational policy changes or using TIMSS data on their own to represent student understanding.

[1]  Paul Black.  Assessment and Feedback in Science Education. , 1995 .

[2]  Paul Black,et al.  Policy Perils of International Comparisons: The TIMSS Case. , 1997 .

[3]  P. Tamir,et al.  Growth patterns in students' ability to supply scientific explanations : findings from the Third International Mathematics and Science Study in Israel , 1999 .

[4]  Carl Angell,et al.  Exploring Students Responses on Free-Response Science Items in TIMSS , 2000 .

[5]  D. X. Freedman.  Implications for research. , 1968, JAMA.

[6]  P. Murphy.  Sources of Inequity: understanding students' responses to assessment , 1995 .

[7]  Anne Qualter,et al.  The Teaching of Science in Primary Schools , 2000 .

[8]  S. Messick.  Meaning and Values in Test Validation: The Science and Ethics of Assessment , 1989 .

[9]  Bonnie Shapiro,et al.  What Children Bring to Light: A Constructivist Perspective on Children's Learning in Science. Ways of Knowing in Science Series. , 1994 .

[10]  R. Osborne,et al.  Learning in science : the implications of children's science , 1985 .

[11]  P. Murphy.  The IEA Assessment of Science Achievement , 1996 .

[12]  C. Gipps.  Beyond Testing: Towards a Theory of Educational Assessment , 1994 .

[13]  A comparison of primary school pupils' ability to express procedural understanding in science through speech and writing , 1999 .

[14]  Wynne Harlen,et al.  Purposes and Procedures for Assessing Science Process Skills , 1999 .

[15]  P. Fensham.  Student response to the TIMSS test , 1998 .