What Makes the Finnish Different in Science? Assessing and Comparing Students' Science Learning in Three Countries

This manuscript details our efforts to assess and compare students' learning about electricity in three countries. As our world is increasingly driven by technological advancements, the education of future citizens in science becomes one important resource for economic productivity. Not surprisingly international large-scale assessments are viewed as significant sources of information about the effectiveness of science education. However, these assessments do not provide information about the reasons for particular effectiveness—or more importantly a lack thereof—as these assessments are based on one-time measurements of student achievement. In order to identify reasons for the effectiveness of science education, it is necessary to investigate students' learning as a result of science instruction. In this manuscript we report about the development of an instrument to assess students' learning in the field of electricity and the use of this instrument to collect data from N = 2,193 middle school students in Finland, Germany and Switzerland prior to and after instruction on the topic of electricity. Our findings indicate that the differences in students' science achievement as observed in large-scale assessments are a result of differences in students' science learning. And our findings suggest that these differences are more likely to stem from differences in science instruction than from systemic differences: a result that needs to be further explored by analyzing instruction in the three countries and its effect on students' learning.

[1]  David P Maloney,et al.  Surveying students’ conceptual knowledge of electricity and magnetism , 2001 .

[2]  Christoph von Rhöneck,et al.  A Study of Students' Understanding of Electricity in Five European Countries. , 1988 .

[3]  Knut Neumann,et al.  FROM PISA TO EDUCATIONAL STANDARDS: THE IMPACT OF LARGE-SCALE ASSESSMENTS ON SCIENCE EDUCATION IN GERMANY , 2010 .

[4]  I. Mullis,et al.  Third International Mathematics and Science Study (TIMSS) , 2014 .

[5]  Jeffrey T. Steedle,et al.  Developing and assessing a force and motion learning progression , 2009 .

[6]  Mark Wilson,et al.  Constructing Measures: An Item Response Modeling Approach , 2004 .

[7]  P. Hewson,et al.  Accommodation of a scientific conception: Toward a theory of conceptual change , 1982 .

[8]  R. Osborne,et al.  Learning science: A generative process , 1983 .

[9]  J. Lavonen,et al.  Context of teaching and learning school science in Finland: Reflections on PISA 2006 results , 2009 .

[10]  K. Fischer A theory of cognitive development: The control and construction of hierarchies of skills. , 1980 .

[11]  J. Baumert,et al.  Trendanalysen in PISA: Wie haben sich die Kompetenzen in Deutschland zwischen PISA 2000 und PISA 2006 entwickelt? , 2009 .

[12]  Hee-Sun Lee,et al.  Assessing learning progression of energy concepts across middle school grades: The knowledge integration perspective , 2010 .

[13]  Anton Béguin Applications of Rasch Measurement in Science Education , 2009 .

[14]  R. Brennan,et al.  Test Equating, Scaling, and Linking , 2004 .

[15]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[16]  Sascha Bernholt,et al.  Assessing the complexity of students' knowledge in chemistry , 2011 .

[17]  Xiufeng Liu,et al.  Using Data Mining to Predict K-12 Students' Performance on Large-Scale Assessment Items Related to Energy. , 2008 .

[18]  Xiufeng Liu,et al.  Using and Developing Measurement Instruments in Science Education: A Rasch Modeling Approach , 2010 .

[19]  A. Beaton Mathematics Achievement in the Primary School Years. IEA's Third International Mathematics and Science Study (TIMSS). , 1996 .

[20]  William F. McComas,et al.  Programme for International Student Assessment (PISA) , 2014 .

[21]  Robert J. Beichner,et al.  Students’ understanding of direct current resistive electrical circuits , 2004 .

[22]  Stella Vosniadou,et al.  International handbook of research on conceptual change , 2013 .

[23]  Roger Osborne,et al.  Towards Modifying Children's Ideas about Electric Current , 1983 .

[24]  Knut Neumann,et al.  Towards a learning progression of energy , 2013 .

[25]  André A. Rupp,et al.  An NCME Instructional Module on Booklet Designs in Large‐Scale Assessments of Student Achievement: Theory and Practice , 2009 .

[26]  M. Shayer,et al.  Accelerating the development of formal thinking in middle and high school students III: Testing the permanency of effects , 1992 .

[27]  M. Linn,et al.  Assessing Knowledge Integration in Science: Construct, Measures, and Evidence , 2008 .

[28]  H. Aebli,et al.  Denken, das Ordnen des Tuns , 1980 .

[29]  Jeannie Oakes,et al.  Multiplying Inequalities: The Effects of Race, Social Class, and Tracking on Opportunities to Learn Mathematics and Science , 1990 .

[30]  Nancy Law,et al.  Explorations in promoting conceptual change in electrical concepts via ontological category shift , 2001 .

[31]  Anne McKeough,et al.  Developmental growth in students' concept of energy: Analysis of selected items from the TIMSS database , 2005 .

[32]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[33]  J. Bortz,et al.  Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler , 2006 .

[34]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[35]  Hannu Simola,et al.  The Finnish miracle of PISA: historical and sociological remarks on teaching and teacher education , 2005 .

[36]  Michelle M. LaMar,et al.  Using and developing measurement instruments in science education: A Rasch modeling approach , 2012 .

[37]  Cindy E. Hmelo-Silver,et al.  Learning progressions: Aligning curriculum, instruction, and assessment , 2009 .

[38]  Robert M. Gagné,et al.  Memory Structures and Learning Outcomes , 1978 .

[39]  M. Shayer,et al.  Accelerating the development of formal thinking in middle and high school students II: Postproject effects on science achievement , 1992 .

[40]  Rodger W. Bybee,et al.  PISA 2006: An Assessment of Scientific Literacy. , 2009 .

[41]  J. Piaget,et al.  The equilibration of cognitive structures : the central problem of intellectual development , 1985 .

[42]  J. Baumert TIMSS : Mathematisch-naturwissenschaftlicher Unterricht im internationalen Vergleich , 1997 .

[43]  M. Commons,et al.  Presenting the Formal Theory of Hierarchical Complexity , 2008 .

[44]  M. Linn,et al.  How do students' views of science influence knowledge integration? , 1991 .

[45]  Thomas R. Boucher,et al.  Test Equating, Scaling, and Linking: Methods and Practices , 2007 .

[46]  S. Vosniadou Capturing and modeling the process of conceptual change. , 1994 .

[47]  R. Nehm,et al.  Evaluating Instrument Quality in Science Education: Rasch‐based analyses of a Nature of Science test , 2011 .

[48]  Michael Shayer,et al.  Accelerating the development of formal thinking in middle and high school students , 1990 .

[49]  B. Andersson Pupils' Conceptions of Matter and its Transformations (age 12-16) , 1990 .

[50]  M. R. Espejo Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2004 .

[51]  David Eichelberger,et al.  Handbook Of Psychological Testing , 2016 .

[52]  F. Chapin Design of the study. , 1991, Occasional paper.

[53]  Adrián Zancajo Villa OECD (2010): Education at a glance 2010: OECD indicators , 2011 .

[54]  Johannes Hartig,et al.  PISA 2009. Bilanz nach einem Jahrzehnt , 2010 .

[55]  G. DeBoer The globalization of science education , 2011 .

[56]  P. Kline The handbook of psychological testing, 2nd ed. , 1993 .

[57]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[58]  Derek C. Briggs,et al.  Diagnostic Assessment With Ordered Multiple-Choice Items , 2006 .

[59]  R. Brennan,et al.  Test Equating, Scaling, and Linking: Methods and Practices , 2004 .

[60]  Hans E. Fischer,et al.  Development of Meaning during Physics Instruction: Case Studies in View of the Paradigm of Constructivism. , 1993 .