Scenario Evaluation with Relevance and Interest (SERI): Development and Validation of a Scenario Measurement Tool for Context-Based Learning

Context-based learning (CBL) approaches have been recommended and expanded in science education to make science more relevant to students by connecting science content with students’ daily life. Subsequently, in order to implement CBL at school, a group of scenarios has been produced by several stakeholders. However, there is a lack of resources to measure effectively what makes a good scenario. Thus, this study aims to develop and validate a scenario evaluation instrument to examine students’ perspectives on science career-related scenarios through the lens of relevance and interest. For this purpose, 25 science career-related scenarios and a measurement tool, Scenario Evaluation with Relevance and Interest (SERI), were developed by a team of researchers for the EU funded MultiCO project. Then, lower secondary school students from three different countries, Estonia, Finland, and the UK, were asked to respond to the newly developed instrument after reading the scenarios, and their responses were analyzed by factor analyses and multivariate analysis of variance. According to the result, this instrument has good construct validity and reliability. However, it indicates one issue of discriminant validity between two factors, individual dimension and societal dimension. Also, significant gender differences were found in the Estonian sample regarding students’ perspectives on the scenarios. Possible interpretations of the results and implications of the suggested measurement tool are discussed.

[1]  Judith Bennett,et al.  Context-Based Approaches to the Teaching of Chemistry: What are They and What Are Their Effects? , 2002 .

[2]  Robert H. Tai,et al.  Planning Early for Careers in Science , 2006, Science.

[3]  Shirley Simon,et al.  Students' attitudes to science , 2010 .

[4]  Joke Van Aalsvoort.  Activity theory as a tool to address the problem of chemistry's lack of relevance in secondary school chemical education , 2004 .

[5]  J. Gilbert.  On the Nature of “Context” in Chemical Education , 2006 .

[6]  Patricia A. Alexander,et al.  A model of domain learning: Reinterpreting expertise as a multidimensional, multistage process. , 2004 .

[7]  Donna King.  New perspectives on context-based chemistry education: using a dialectical sociocultural approach to view teaching and learning , 2012 .

[8]  Andreas Krapp,et al.  An educational–psychological conceptualisation of interest , 2007 .

[9]  S. Hidi,et al.  The Four-Phase Model of Interest Development , 2006 .

[10]  Peter M. Bentler,et al.  Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic , 2008, Psychometrika.

[11]  Camilla Schreiner,et al.  Sowing the seeds of ROSE : background, rationale, questionnaire development and data collection for ROSE (The Relevance of Science Education) : a comparative study of students’ views of science and science education , 2004 .

[12]  Sirpa Kärkkäinen,et al.  Career-related instruction promoting students’ career awareness and interest towards science learning , 2018 .

[13]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[14]  Joke Van Aalsvoort.  Logical positivism as a tool to analyse the problem of chemistry's lack of relevance in secondary school chemical education , 2004 .

[15]  Jichuan Wang,et al.  Structural Equation Modeling: Applications Using Mplus , 2012 .

[16]  Ingrid Schoon,et al.  Teenage job aspirations and career attainment in adulthood: A 17-year follow-up study of teenagers who aspired to become scientists, health professionals, or engineers , 2001 .

[17]  Chris S. Hulleman,et al.  Promoting Interest and Performance in High School Science Classes , 2009, Science.

[18]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[19]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[20]  Anu Hartikainen-Ahia,et al.  Quality of SSI Scenarios Designed by Science Teachers , 2017 .

[21]  Daniel J. Mundfrom,et al.  Minimum Sample Size Recommendations for Conducting Factor Analyses , 2005 .

[22]  Miia Rannikmäe,et al.  Popularity and Relevance of Science Education and Scientific Literacy: - The PARSEL Project in Europe , 2009 .

[23]  Susan Haag,et al.  Barriers and Supports for Continuing in Mathematics and Science: Gender and Educational Level Differences ☆ , 2010 .

[24]  P. Silvia.  Interest and Interests: The Psychology of Constructive Capriciousness , 2001 .

[25]  Douglas P. Newton.  Relevance and science education , 1988 .

[26]  J. Hair.  Multivariate data analysis , 1972 .

[27]  Miia Rannikmäe,et al.  INCREASING THE RELEVANCE OF SCIENCE EDUCATION – STUDENT PREFERENCES FOR DIFFERENT TYPES OF TEACHING SCENARIOS , 2003 .

[28]  Richard G. Netemeyer,et al.  Scaling Procedures: Issues and Applications , 2003 .

[29]  Miia Rannikmäe,et al.  A THEORY-BASED INSTRUMENT TO EVALUATE MOTIVATIONAL TRIGGERS PERCEIVED BY STUDENTS IN STEM CAREER-RELATED SCENARIOS , 2017 .

[30]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[31]  Judith Bennett,et al.  Bringing science to life: A synthesis of the research evidence on the effects of context‐based and STS approaches to science teaching , 2007 .

[32]  R Ruurd Taconis,et al.  Teachers creating context-based learning environments in science , 2016 .

[33]  Andreas Schleicher,et al.  PISA 2006: Science Competencies for Tomorrow's World , 2007 .

[34]  Patrice Potvin,et al.  Interest, motivation and attitude towards science and technology at K-12 levels: a systematic review of 12 years of educational research , 2014 .

[35]  Rachel Mamlok-Naaman,et al.  The meaning of ‘relevance’ in science education and its implications for the science curriculum , 2013 .

[36]  Tuula Keinonen,et al.  The effect of inquiry-based learning experiences on adolescents’ science-related career aspiration in the Finnish context , 2017 .

[37]  A. Krapp.  An educational-psychological theory of interest and its relation to SDT. , 2002 .

[38]  B. Everitt.  Multivariate Analysis: The Need for Data, and other Problems , 1975, British Journal of Psychiatry.

[39]  Albert Pilot,et al.  The Use of “Contexts” as a Challenge for the Chemistry Curriculum: Its successes and the need for further development and understanding , 2006 .