Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks

In two experiments, undergraduates’ evaluation and use of multiple Internet sources during a science inquiry task were examined. In Experiment 1, undergraduates had the task of explaining what caused the eruption of Mt. St. Helens using the results of an Internet search. Multiple regression analyses indicated that source evaluation significantly predicted learning outcomes, with more successful learners better able to discriminate scientifically reliable from unreliable information. In Experiment 2, an instructional unit (SEEK) taught undergraduates how to evaluate the reliability of information sources. Undergraduates who used SEEK while working on an inquiry task about the Atkins low-carbohydrate diet displayed greater differentiation in their reliability judgments of information sources than a comparison group. Both groups then participated in the Mt. St. Helens task. Undergraduates in the SEEK conditions demonstrated better learning from the volcano task. The current studies indicate that the evaluation of information sources is critical to successful learning from Internet-based inquiry and amenable to improvement through instruction.

[1]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[2]  Marcia C. Linn,et al.  Internet Environments for Science Education , 2004 .

[3]  D. Thompson,et al.  Misconceptions and Conceptual Changes concerning Continental Drift and Plate Tectonics among Portuguese Students Aged 16‐17 , 1997 .

[4]  A. King.  Discourse patterns for mediating peer learning. , 1999 .

[5]  J. Frederiksen,et al.  A Theoretical Framework and Approach for Fostering Metacognitive Development , 2005 .

[6]  Alan E. Farstrup,et al.  What Research Has to Say about Reading Instruction, Third Edition , 2011 .

[7]  H. Simon,et al.  Situated Learning and Education1 , 1996 .

[8]  Jennifer Wiley,et al.  The Cambridge Handbook of Expertise and Expert Performance: Expertise in History , 2006 .

[9]  A. Graesser,et al.  Question Asking During Tutoring , 1994 .

[10]  L. Yore,et al.  Examining the literacy component of science literacy: 25 years of language arts and science research , 2003 .

[11]  T. Trabasso,et al.  Causal thinking and the representation of narrative events , 1985 .

[12]  Jennifer Wiley,et al.  Metacognitive Monitoring During and After Reading , 2009 .

[13]  B. Hofer.  Epistemological Understanding as a Metacognitive Process: Thinking Aloud During Online Searching , 2004 .

[14]  W. Kintsch,et al.  Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning From Text , 1996 .

[15]  Douglas J. Hacker,et al.  Metacognition in educational theory and practice. , 1998 .

[16]  Ann L. Brown,et al.  Psychological theory and the design of innovative learning environments: On procedures, principles, and systems. , 1996 .

[17]  M. A. Britt,et al.  Using multiple sources of evidence to reason about history. , 1996 .

[18]  M. A. Britt,et al.  Toward a theory of documents representation. , 1999 .

[19]  Connie A. Korpan,et al.  University Students' Interpretation of Media Reports of Science and its Relationship to Background Knowledge, Interest, and Reading Difficulty , 2003 .

[20]  Stephen Marshak,et al.  Earth: Portrait of a Planet , 2001 .

[21]  Jennifer Wiley,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning of History , 2005 .

[22]  Jennifer Wiley,et al.  Do argumentation tasks promote conceptual change about volcanoes? , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[23]  B. Zimmerman,et al.  Self-regulated learning and academic achievement : theoretical perspectives , 2001 .

[24]  D. Janick-Buckner.  Getting Undergraduates To Critically Read and Discuss Primary Literature. , 1997 .

[25]  Jennifer Wiley,et al.  Supporting Understanding Through Task and Browser Design , 2001 .

[26]  Scotty D. Craig,et al.  The Deep-Level-Reasoning-Question Effect: The Role of Dialogue and Deep-Level-Reasoning Questions During Vicarious Learning , 2006 .

[27]  B. Rosenshine,et al.  Teaching Students to Generate Questions: A Review of the Intervention Studies , 1996 .

[28]  D. McNamara,et al.  The Impact of Science Knowledge, Reading Skill, and Reading Strategy Knowledge on More Traditional “High-Stakes” Measures of High School Students’ Science Achievement , 2007 .

[29]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[30]  Leona Schauble,et al.  Innovations in learning : new environments for education , 1996 .

[31]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994, Psychological review.

[32]  Jennifer Wiley,et al.  Constructing arguments from multiple sources: Tasks that promote understanding and not just memory for text. , 1999 .

[33]  Beau Jones,et al.  Dimensions of thinking and cognitive instruction , 1990 .

[34]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[35]  Joseph Krajcik,et al.  Science on the Web: Students Online in a Sixth-Grade Classroom , 2000 .

[36]  Joseph P. Magliano,et al.  Assessing Reading Skill With a Think-Aloud Procedure and Latent Semantic Analysis , 2003 .

[37]  H. Oostendorp,et al.  The Construction of Mental Representations During Reading , 1998 .

[38]  J. Wiley,et al.  An examination of the seductive details effect in terms of working memory capacity , 2006, Memory & cognition.

[39]  John Airey,et al.  A disciplinary discourse perspective on university science learning: Achieving fluency in a critical constellation of modes , 2009 .

[40]  C. Bazerman.  Physicists Reading Physics , 1985 .

[41]  Earthquake Knowledge and Experiences of Introductory Geology Students. , 1996 .

[42]  Steve Jones.  The Internet Goes to College: How Students Are Living in the Future with Today's Technology. , 2002 .

[43]  Sarah K. Brem,et al.  Science on the Web: Student Evaluations of Scientific Arguments , 2001 .

[44]  Peter B. Mosenthal,et al.  Understanding the strategies of document literacy and their conditions of use. , 1996 .

[45]  Arthur C. Graesser,et al.  The Construction of Causal Inferences While Reading Expository Texts on Science and Technology , 1998 .

[46]  Jeffrey Bisanz,et al.  Assessing literacy in science: evaluation of scientific news briefs , 1997 .

[47]  M. Linn,et al.  Scientific arguments as learning artifacts: designing for learning from the web with KIE , 2000 .

[48]  Larry D. Yore,et al.  The reading–science learning–writing connection: Breakthroughs, barriers, and promises , 1994 .

[49]  Philip H. Winne,et al.  Self-regulated learning viewed from models of information processing. , 2001 .

[50]  Thomas D. Griffin,et al.  Individual differences, rereading, and self-explanation: Concurrent processing and cue validity as constraints on metacomprehension accuracy , 2008, Memory & cognition.

[51]  Jerome L. Myers,et al.  Availability and Accessibility of Information and Causal Inferences From Scientific Text , 2003 .

[52]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[53]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[54]  W. Sandoval,et al.  Explanation-Driven Inquiry: Integrating Conceptual and Epistemic Scaffolds for Scientific Inquiry , 2004 .

[55]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[56]  J. Slotta,et al.  The Knowledge Integration Environment: Helping students use the Internet effectively. , 2000 .

[57]  Michael J. Baker,et al.  Arguing to Learn: Confronting Cognitions in Computer-Supported Collaborative Learning Environments , 2003 .

[58]  J. Gobert.  A typology of causal models for plate tectonics: Inferential power and barriers to understanding , 2000 .

[59]  Michael Pressley,et al.  Self-Regulated Learning: Monitoring Learning From Text , 1990 .

[60]  Arthur C. Graesser,et al.  SEEK Web tutor: fostering a critical stance while exploring the causes of volcanic eruption , 2007 .

[61]  D. McNamara.  SERT: Self-Explanation Reading Training , 2004 .

[62]  Jennifer Wiley,et al.  Putting the Comprehension in Metacomprehension , 2005 .

[63]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[64]  Michael J. Jacobson,et al.  Innovations in Science and Mathematics Education: Advanced Designs for Technologies of Learning. , 2000 .

[65]  Patricia A. Alexander,et al.  Beliefs About Text and Instruction with Text , 1994 .

[66]  Joseph Krajcik,et al.  A Framework for Supporting Metacognitive Aspects of Online Inquiry Through Software-Based Scaffolding , 2005 .

[67]  Stuart Greene,et al.  The problems of learning to think like a historian: Writing history in the culture of the classroom , 1994 .

[68]  Arthur C. Graesser,et al.  The Time-Course of Constructing Knowledge-Based Inferences for Scientific Texts , 1994 .

[69]  R. Glaser.  Advances in Instructional Psychology , 1978 .

[70]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[71]  M. A. Britt,et al.  Studying and Using Multiple Documents in History: Effects of Discipline Expertise , 1997 .

[72]  Isabel L. Beck,et al.  Teaching and learning in history , 1994 .

[73]  Susan R. Goldman,et al.  Students making sense of informational text: Relations between processing and representation , 1998 .

[74]  John T. Guthrie,et al.  Locating Information in Documents: Examination of a Cognitive Model. , 1988 .

[75]  Michael Pressley,et al.  Metacognition and Self-Regulated Comprehension , 2004 .

[76]  Brent A. Olde,et al.  How does one know whether a person understands a device? The quality of the questions the person asks when the device breaks down. , 2003 .

[77]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[78]  Jennifer Wiley,et al.  Poor Metacomprehension Accuracy as a Result of Inappropriate Cue Use , 2010 .

[79]  James F. Voss,et al.  Learning From History Text: The Interaction of Knowledge and Comprehension Skill with Text Structure , 1996 .

[80]  S. Paris,et al.  How metacognition can promote academic learning and instruction. , 1990 .

[81]  Ann L. Brown,et al.  Reciprocal Teaching of Comprehension-Fostering and Comprehension-Monitoring Activities , 1984 .

[82]  Arthur C. Graesser,et al.  Organizing Instruction and Study to Improve Student Learning. IES Practice Guide. NCER 2007-2004. , 2007 .

[83]  Peter N. Stearns,et al.  Knowing, teaching, and learning history : national and international perspectives , 2000 .

[84]  C. Berkenkotter,et al.  Genre Knowledge in Disciplinary Communication: Cognition/culture/power , 1994 .

[85]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[86]  C. Chinn,et al.  Epistemologically Authentic Inquiry in Schools: A Theoretical Framework for Evaluating Inquiry Tasks , 2002 .

[87]  Annemarie Sullivan Palincsar,et al.  The interplay of first-hand and second-hand investigations to model and support the development of scientific knowledge and reasoning , 2001 .

[88]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[89]  Rainer Bromme,et al.  Dealing with multiple documents on the WWW: The role of metacognition in the formation of documents models , 2007, Int. J. Comput. Support. Collab. Learn..

[90]  D. Kuhn.  Science as argument : Implications for teaching and learning scientific thinking , 1993 .

[91]  Jean-François Rouet,et al.  The Skills of Document Use: From Text Comprehension to Web-Based Learning , 2006 .

[92]  Angela M. O'Donnell,et al.  Cognitive Perspectives on Peer Learning , 1999 .

[93]  Michael B. W. Wolfe,et al.  Relations Between Adolescents' Text Processing and Reasoning , 2005 .

[94]  M. A. Britt,et al.  Improving Students' Ability to Identify and Use Source Information , 2002 .

[95]  P. David Pearson,et al.  Effective Practices for Developing Reading Comprehension , 2009 .

[96]  David J. Therriault,et al.  Accuracy of metacognitive monitoring affects learning of texts. , 2003 .

[97]  Anat Yarden,et al.  Primary literature as a basis for a high-school biology curriculum , 2001 .