High school students’ evaluations, plausibility (re) appraisals, and knowledge about topics in Earth science

Department of Teaching& Learning, Temple University, Philadelphia, PA, USA Correspondence DougLombardi,DepartmentofTeaching&Learning, 450RitterHall, 1301Cecil B.MooreAv., Philadelphia, PA19122,USA. Email: doug.lombardi@temple.edu Abstract Evaluation is an important aspect of science and is receiving increasing attention in science education. The present study investigated (1) changes to plausibility judgments and knowledge as a result of a series of instructional scaffolds, called model–evidence link activities, that facilitated evaluation of scientific and alternative models in four different Earth science topics (climate change, fracking and earthquakes, wetlands and land use, and the formation of Earth’s Moon) and (2) relations between evaluation, plausibility reappraisal, and knowledge. Repeated measure multivariate analyses of variance (MANOVAs) showed that participants’ plausibility judgments shifted toward scientifically accepted explanations and increased their knowledge about relevant Earth science topics after participating in the activities. Structural equation modeling revealed that 10% of the postinstructional knowledge scores were related to participants’ evaluations, above and beyond background knowledge, which accounted for 26% of the variance. The activities used in this study may help students develop their critical thinking skills by facilitating evaluation of the validity of explanations based on evidence, a scientific practice that is key to understanding both scientific content and science as a process. However, results from the studyweremodest and suggest that additional research, from both theoretical and empirical perspectives, may bewarranted.

[1]  Janice,et al.  Reconceptalizing change in the cognitive construction of knowledge , 1998 .

[2]  Wynne W. Chin,et al.  Handbook of Partial Least Squares , 2010 .

[3]  E. Michael Nussbaum,et al.  Plausibility reappraisals and shifts in middle school students' climate change conceptions , 2013 .

[4]  E. Nussbaum,et al.  Argumentation, Dialogue Theory, and Probability Modeling: Alternative Frameworks for Argumentation Research in Education , 2011 .

[5]  Gaby Odekerken-Schröder,et al.  Using PLS path modeling for assessing hierarchial construct models: guidelines and impirical illustration , 2009 .

[6]  J. Eastwood,et al.  Effects of an Interdisciplinary Program on Students’ Reasoning with Socioscientific Issues and Perceptions of Their Learning Experiences , 2011 .

[7]  Erin E. Peters.  The effect of nature of science metacognitive prompts on science students' content and nature of science knowledge, metacognition, and self -regulatory efficacy , 2010 .

[8]  Jörg Henseler,et al.  Handbook of Partial Least Squares: Concepts, Methods and Applications , 2010 .

[9]  P. Hewson,et al.  Accommodation of a scientific conception: Toward a theory of conceptual change , 1982 .

[10]  Martin Stanisstreet,et al.  The ‘Greenhouse Effect’: children's perceptions of causes, consequences and cures , 1993 .

[11]  J. Osborne,et al.  Beyond Construction: Five arguments for the role and value of critique in learning science , 2015 .

[12]  D. Pruneau,et al.  Experimentation with a socio-constructivist process for climate change education , 2003 .

[13]  N. Oreskes,et al.  Consensus on consensus: a synthesis of consensus estimates on human-caused global warming , 2016 .

[14]  David A. Gillam,et al.  A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas , 2012 .

[15]  Michel Tenenhaus,et al.  PLS path modeling , 2005, Comput. Stat. Data Anal..

[16]  Jonathan Osborne,et al.  The science classroom as a site of epistemic talk: a case study of a teacher's attempts to teach science based on argument , 2014 .

[17]  Jason W. Osbourne,et al.  Four Assumptions of Multiple Regression That Researchers Should Always Test. , 2002 .

[18]  C. Spearman.  CORRELATION CALCULATED FROM FAULTY DATA , 1910 .

[19]  Norman G. Lederman,et al.  Inventing Creativity: An Exploration of the Pedagogy of Ingenuity in Science Classrooms , 2013 .

[20]  Erin E. Peters.  Developing Content Knowledge in Students Through Explicit Teaching of the Nature of Science: Influences of Goal Setting and Self-Monitoring , 2012 .

[21]  E. Michael Nussbaum,et al.  Plausibility Judgments in Conceptual Change and Epistemic Cognition , 2016 .

[23]  Anne Kuefer,et al.  Explaining Science A Cognitive Approach , 2016 .

[24]  P. Scott,et al.  Constructing Scientific Knowledge in the Classroom , 1994 .

[25]  D. Kuhn,et al.  Developmental Origins of Scientific Thinking , 2000 .

[26]  Yongqiang Liu,et al.  Contributions of open crop straw burning emissions to PM2.5 concentrations in China , 2016 .

[27]  Sibel Erduran,et al.  Reconceptualizing the Nature of Science for Science Education , 2014 .

[28]  B. Zimmerman.  Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[29]  Sharon Bailin,et al.  Critical Thinking and Science Education , 2002 .

[30]  J. Osborne,et al.  Supporting and Promoting Argumentation Discourse in Science Education , 2002 .

[31]  David Stroupe,et al.  Students Modeling Molecule Movement Science Theater , 2014 .

[32]  D. Allchin.  Evaluating Knowledge of the Nature of (Whole) Science , 2011 .

[33]  Claudia van Oppen,et al.  USING PLS PATH MODELING FOR ASSESSING HIERARCHICAL CONSTRUCT MODELS : GUIDELINES AND EMPIRICAL , 2022 .

[34]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[35]  W. Salmon.  Causality without Counterfactuals , 1994, Philosophy of Science.

[36]  Daniel P. Shepardson,et al.  Seventh grade students' mental models of the greenhouse effect , 2011 .

[37]  Suzanne H. Broughton,et al.  Bridging Reading Comprehension and Conceptual Change in Science Education: The Promise of Refutation Text , 2011 .

[38]  William K. Hartmann,et al.  Satellite-Sized Planetesimals and Lunar Origin , 1975 .

[39]  G. Sinatra,et al.  Emotions about Teaching about Human-Induced Climate Change , 2013 .

[40]  Joseph Krajcik,et al.  Supporting Students' Construction of Scientific Explanations by Fading Scaffolds in Instructional Materials , 2006 .

[41]  Robert W. Danielson,et al.  A plausible connection: Models examining the relations between evaluation, plausibility, and the refutation text effect , 2016 .

[42]  R. Baker,et al.  Operationalizing and Detecting Disengagement Within Online Science Microworlds , 2015 .

[43]  G. Sinatra,et al.  College Students’ Perceptions About the Plausibility of Human-Induced Climate Change , 2012 .

[44]  J. Osborne.  Teaching Critical Thinking? New Directions in Science Education. , 2014 .

[45]  Norman G. Lederman.  Students' and teachers' conceptions of the nature of science: A review of the research , 1992 .

[46]  William F. Brewer,et al.  Explanation in Scientists and Children , 1998, Minds and Machines.

[47]  Ngss Lead States.  Next generation science standards : for states, by states , 2013 .

[48]  M. J. Ford,et al.  Educational Implications of Choosing “Practice” to Describe Science in the Next Generation Science Standards , 2015 .

[49]  Kathleen Hogan,et al.  Comparing the Epistemological Underpinnings of Students' and Scientists' Reasoning about Conclusions. , 2001 .

[50]  V. E. Vinzi,et al.  A global Goodness – of – Fit index for PLS structural equation modelling 1 , 2004 .

[51]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[52]  K. Stanovich,et al.  Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions , 2008 .

[53]  Jim Garrison,et al.  Realism, Deweyan Pragmatism, and Educational Research , 1994 .

[54]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[55]  W. Brown.  SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES1 , 1910 .

[56]  Benjamin C. Heddy,et al.  The Challenges of Defining and Measuring Student Engagement in Science , 2015 .

[57]  Avi Kaplan,et al.  Students’ Needs, Teachers’ Support, and Motivation for Doing Homework: A Cross-Sectional Study , 2009 .

[58]  Chia-Yu Wang,et al.  Scaffolding Middle School Students’ Construction of Scientific Explanations: Comparing a cognitive versus a metacognitive evaluation approach , 2015 .

[59]  Richard A. Duschl,et al.  Quality Argumentation and Epistemic Criteria , 2007 .

[60]  G. Sinatra,et al.  Addressing Challenges to Public Understanding of Science: Epistemic Cognition, Motivated Reasoning, and Conceptual Change , 2014 .

[61]  B. Zimmerman.  Academic studing and the development of personal skill: A self-regulatory perspective , 1998 .

[62]  M. Windschitl,et al.  Working toward a stronger conceptualization of scientific explanation for science education , 2011 .

[63]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[64]  William A. Sandoval,et al.  Science Education's Need for a Theory of Epistemological Development , 2014 .

[65]  Carol B. Brandt,et al.  Students’ evaluations about climate change , 2016 .

[66]  Martin S. Hagger,et al.  Perceived autonomy support and autonomous motivation toward mathematics activities in educational and out-of-school contexts is related to mathematics homework behavior and attainment , 2015 .

[67]  Clark A. Chinn,et al.  Model-Based Instruction , 2012 .

[68]  G. Sinatra,et al.  Source Effects and Plausibility Judgments When Reading About Climate Change , 2014 .

[69]  E. Michael Nussbaum,et al.  Critical Questions and Argument Stratagems: A Framework for Enhancing and Analyzing Students' Reasoning Practices , 2011 .

[70]  R. Hackett.  Young People's Images of Science , 1996 .

[71]  W. Reinartz,et al.  An Empirical Comparison of the Efficacy of Covariance-Based and Variance-Based SEM , 2009 .

[72]  Ned Kock,et al.  Lateral Collinearity and Misleading Results in Variance-Based SEM: An Illustration and Recommendations , 2012, J. Assoc. Inf. Syst..

[73]  P. Pintrich,et al.  Beyond Cold Conceptual Change: The Role of Motivational Beliefs and Classroom Contextual Factors in the Process of Conceptual Change , 1993 .