Assessing epistemological beliefs of experts and novices via practices in authentic science inquiry

BackgroundAchieving science literacy requires learning disciplinary knowledge, science practices, and development of sophisticated epistemological beliefs about the nature of science and science knowledge. Although sophisticated epistemological beliefs about science are important for attaining science literacy, students’ beliefs are difficult to assess. Previous work suggested that students’ epistemological beliefs about science are best assessed in the context of engagement in science practices, such as argumentation or inquiry.ResultsIn this paper, we propose a novel method for examining students’ epistemological beliefs about science situated in authentic science inquiry or their Epistemology in Authentic Science Inquiry (EASI). As a first step towards developing this assessment, we performed a novice/expert study to characterize practices within a simulated authentic science inquiry experience provided by Science Classroom Inquiry (SCI) simulations. Our analyses indicated that experts and novices, as defined by their experience with authentic science practices, had distinct practices in SCI simulations. For example, experts, as compared to novices, spent much of their investigations seeking outside information, which is consistent with novice/expert studies in engineering. We also observed that novice practices existed on a continuum, with some appearing more-or less expert-like. Furthermore, pre-test performance on established metrics of nature of science was predictive of practices within the simulation.ConclusionsSince performance on pre-test metrics of nature of science was predictive of practices, and since there were distinct expert or novice-like practices, it may be possible to use practices in simulated authentic science inquiry as a proxy for student’s epistemological beliefs. Given than novices existed on a continuum, this could facilitate the development of targeted science curriculum tailored to the needs of a particular group of students. This study indicates how educational technologies, such as simulated authentic science inquiry, can be harnessed to examine difficult to assess, but important, constructs such as epistemology.

[1]  Melanie E. Peffer,et al.  Simulations as Scaffolds in Science Education , 2015 .

[2]  Fang-Ying Yang,et al.  THE EFFECTS OF EPISTEMIC BELIEFS IN SCIENCE AND GENDER DIFFERENCE ON UNIVERSITY STUDENTS’ SCIENCE-TEXT READING: AN EYE-TRACKING STUDY , 2016 .

[3]  Norman G. Lederman,et al.  What Scientists Say: Scientists’ views of nature of science and relation to science context , 2008 .

[4]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[5]  Chin-Chung Tsai,et al.  Students' views of the nature of science: A critical review of research , 2011 .

[6]  W. Sandoval,et al.  Understanding and Promoting Thinking About Knowledge , 2016 .

[7]  Karen Littleton,et al.  Epistemology, Assessment, Pedagogy: Where Learning Meets Analytics in the Middle Space , 2014, J. Learn. Anal..

[8]  Kristopher Kyle,et al.  Assessment of language in authentic science inquiry reveals putative differences in epistemology , 2017, LAK.

[9]  Ngss Lead States Next generation science standards : for states, by states , 2013 .

[10]  Melanie E. Peffer,et al.  Influence of Affective Factors on Practices in Simulated Authentic Science Inquiry , 2018, International Conference of the Learning Sciences.

[11]  M. J. Ford,et al.  Educational Implications of Choosing “Practice” to Describe Science in the Next Generation Science Standards , 2015 .

[12]  Ioanna Vekiri,et al.  Changes in epistemological beliefs in elementary science students , 2004 .

[13]  S. Vosniadou,et al.  Exploring the relationship between physics-related epistemological beliefs and physics understanding , 2007 .

[14]  Elizabeth J. K. H. Redman,et al.  The Contextual Nature of Scientists’ Views of Theories, Experimentation, and Their Coordination , 2015 .

[15]  R. Pedwell,et al.  Do We Need to Design Course-Based Undergraduate Research Experiences for Authenticity? , 2016, CBE life sciences education.

[16]  Andrew Elby,et al.  Epistemic cognition in science , 2016 .

[17]  T. Cullen,et al.  Experienced Teachers’ Strategies for Assessing Nature of Science Conceptions in the Elementary Classroom , 2010 .

[18]  Hsin Ning Jessie Ho,et al.  Scientific epistemic beliefs, conceptions of learning science and self-efficacy of learning science among high school students , 2011 .

[19]  J. Osborne Scientific Practices and Inquiry in the Science Classroom , 2014 .

[20]  Phil Seok Oh,et al.  Discursive Modes and Their Pedagogical Functions in Model-Based Inquiry (MBI) Classrooms , 2012 .

[21]  S. Croker,et al.  Teaching the control-of-variables strategy: A meta-analysis , 2016 .

[22]  G. Stamou,et al.  Nature of Science or Nature of the Sciences , 2016 .

[23]  Ronald W. Rinehart,et al.  Epistemic cognition and evaluating information: Applying the AIR model of epistemic cognition. , 2014 .

[24]  N. S. Rebello,et al.  Shifting College Students' Epistemological Framing Using Hypothetical Debate Problems. , 2014 .

[25]  David Schmidtz,et al.  What Do We Need , 2006 .

[26]  Gregory Schraw,et al.  Conceptual Integration and Measurement of Epistemological and Ontological Beliefs in Educational Research , 2013 .

[27]  Cynthia J. Atman,et al.  Engineering Design Processes: A Comparison of Students and Expert Practitioners , 2007 .

[28]  B. Sodian,et al.  Testing primary-school children's understanding of the nature of science. , 2015, The British journal of developmental psychology.

[29]  Stephan Schwan,et al.  Understanding and Engagement in Places of Science Experience: Science Museums, Science Centers, Zoos, and Aquariums , 2014 .

[30]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[31]  M. W. van Someren,et al.  The think aloud method: a practical approach to modelling cognitive processes , 1994 .

[32]  D. Hanauer,et al.  Active Assessment: Assessing Scientific Inquiry , 2009 .

[33]  Jessica Thompson,et al.  Beyond the scientific method: Model‐based inquiry as a new paradigm of preference for school science investigations , 2008 .

[34]  William A. Sandoval,et al.  Handbook of Epistemic Cognition , 2016 .

[35]  Marcelo Worsley,et al.  Analyzing Engineering Design through the Lens of Computation , 2014, J. Learn. Anal..

[36]  Randy L. Bell,et al.  Views of nature of science questionnaire: Toward valid and meaningful assessment of learners' conceptions of nature of science , 2002 .

[37]  P. Pintrich,et al.  The Development of Epistemological Theories: Beliefs About Knowledge and Knowing and Their Relation to Learning , 1997 .

[38]  F. Abd‐El‐Khalick Examining the Sources for our Understandings about Science: Enduring conflations and critical issues in research on nature of science in science education , 2012 .

[39]  Maggie Renken,et al.  Science Classroom Inquiry (SCI) Simulations: A Novel Method to Scaffold Science Learning , 2015, PloS one.

[40]  James M. Murphy Beyond Scientific Method , 2004 .

[41]  Erin L. Dolan,et al.  Modeling Course-Based Undergraduate Research Experiences: An Agenda for Future Research and Evaluation , 2015, CBE life sciences education.

[42]  Sarit Barzilai,et al.  Epistemic Thinking in Action: Evaluating and Integrating Online Sources , 2012 .

[43]  F. Abd‐El‐Khalick,et al.  Scientific reasoning and epistemological commitments: Coordination of theory and evidence among college science students , 2010 .

[44]  Norman G. Lederman,et al.  Meaningful assessment of learners' understandings about scientific inquiry—The views about scientific inquiry (VASI) questionnaire , 2014 .

[45]  W. Sandoval Understanding Students' Practical Epistemologies and Their Influence on Learning Through Inquiry , 2005 .

[46]  Norman G. Lederman,et al.  Teachers' knowledge structures for nature of science and scientific inquiry: Conceptions and classroom practice , 2014 .

[47]  C. Chinn,et al.  Epistemologically Authentic Inquiry in Schools: A Theoretical Framework for Evaluating Inquiry Tasks , 2002 .

[48]  Pratibha Varma-Nelson,et al.  Assessment of Course-Based Undergraduate Research Experiences: A Meeting Report , 2014, CBE life sciences education.

[49]  Nicola Ariasi,et al.  Epistemic beliefs in action: Spontaneous reflections about knowledge and knowing during online information searching and their influence on learning , 2011 .

[50]  Jonathan Osborne,et al.  Teaching Scientific Practices: Meeting the Challenge of Change , 2014 .