Assessing Metacognitive Components in Self-Regulated Reading of Science Texts in E-Based Environments

The boom in Internet and communication technology has accelerated change in information delivery channels from paper to networked, digital displaying devices. Reading electronically has altered the cognitive and metacognitive processes readers use to approach science texts. Assessing reading in a digitized environment also opens up opportunities to examine the recursive process of self-regulated learning. However, a systematic analysis in this area across paper- and e-based environments is lacking. This study explores methods of assessing metacognition in reading informational science texts to address this gap. A total of 55 studies in 47 articles published from 1990 to 2016 investigating effects of metacognition on science reading are reviewed. The analysis reveals frequently applied methods, including self-report questionnaires for measuring metacognitive knowledge, event-based assessment for metacognitive skills, and questionnaires or interviews for metacognitive experiences. Community acceptable instruments are presented and illustrated. E-based environment has potential to support comprehensive and complicated measurement of metacognition. Future research may further the investigation of interactions among metacognitive components by designing sequential tasks and combining multiple assessment methods. Finally, triangulation of findings from various methods is essential in assessing metacognition involved in self-regulated reading.

[1]  Katharina Scheiter,et al.  Learning with hypermedia: The influence of representational formats and different levels of learner control on performance and learning behavior , 2009, Comput. Hum. Behav..

[2]  Hsiao-Ching She,et al.  Web-based undergraduate chemistry problem-solving: The interplay of task performance, domain knowledge and web-searching strategies , 2012, Comput. Educ..

[3]  E. Stine-Morrow,et al.  Adult age differences in self-regulated learning from reading sentences. , 2004, Psychology and aging.

[4]  B. Zimmerman.  Attaining self-regulation: A social cognitive perspective. , 2000 .

[5]  Steven J Durning,et al.  Exploring clinical reasoning in novices: a self-regulated learning microanalytic assessment approach , 2014, Medical education.

[6]  P. Pintrich.  The role of goal orientation in self-regulated learning. , 2000 .

[7]  D. Kostons,et al.  Effectiveness of learning strategy instruction on academic performance: A meta-analysis , 2014 .

[8]  Ismail Sahin,et al.  Literature Review on Metacognition and its Measurement , 2011 .

[9]  Tova Michalsky.  Integrating Skills and Wills Instruction in Self-Regulated Science Text Reading for Secondary Students , 2013 .

[10]  Fernando Justicia,et al.  The effects of question-generation training on metacognitive knowledge, self regulation and learning approaches in science. , 2014, Psicothema.

[11]  Shin-Feng Chen,et al.  Exploring Mediating Effect of Metacognitive Awareness on Comprehension of Science Texts through Structural Equation Modeling Analysis. , 2014 .

[12]  Sufen Chen,et al.  CONTENT ANALYSIS OF 1998–2012 EMPIRICAL STUDIES IN SCIENCE READING USING A SELF-REGULATED LEARNING LENS , 2016 .

[13]  Gregory Schraw,et al.  Assessing metacognitive awareness , 1994 .

[14]  Nebila Dhieb-Henia,et al.  Evaluating the effectiveness of metacognitive strategy training for reading research articles in an ESP context , 2003 .

[15]  Chris Quintana,et al.  Scaffolding strategies for supporting middle school students' online inquiry processes , 2012, Comput. Educ..

[16]  Yi Pan,et al.  Exploring relations among college students' prior knowledge, implicit theories of intelligence, and self-regulated learning in a hypermedia environment , 2010, Comput. Educ..

[17]  Marcel V. J. Veenman,et al.  Assessing Metacognitive Skills in Computerized Learning Environments , 2013 .

[18]  Daniel C. Moos,et al.  Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and Challenges , 2010 .

[19]  Yvonne Kammerer,et al.  Reading science texts online: Does source information influence the identification of contradictions within texts? , 2015, Comput. Educ..

[20]  Roger Azevedo,et al.  Self-efficacy and prior domain knowledge: to what extent does monitoring mediate their relationship with hypermedia learning? , 2009 .

[21]  B. Zimmerman,et al.  Construct and predictive validity of microanalytic measures of students' self-regulation of science learning , 2013 .

[22]  Duane F. Shell,et al.  The Impact of Computer Supported Collaborative Learning Communities on High School Students' Knowledge Building, Strategic Learning, and Perceptions of the Classroom , 2005 .

[23]  Z. Mevarech,et al.  Elementary School Children Reading Scientific Texts: Effects of Metacognitive Instruction , 2009 .

[24]  A. Efklides.  Metacognition and Affect: What Can Metacognitive Experiences Tell Us about the Learning Process?. , 2006 .

[25]  Fielding I. Winters,et al.  Self-Regulation of Learning within Computer-based Learning Environments: A Critical Analysis , 2008 .

[26]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[27]  A. Brown.  Metacognition, executive control, self-regulation, and other more mysterious mechanisms , 1987 .

[28]  David Palmer,et al.  Investigating the relationship between refutational text and conceptual change , 2003 .

[29]  David J. Therriault,et al.  Metacomprehension effects situated within an anchoring and adjustment framework , 2008 .

[30]  D. McNamara,et al.  The effect of metacomprehension judgment task on comprehension monitoring and metacognitive accuracy , 2012, Metacognition and Learning.

[31]  S. Kitagami,et al.  THE EFFECT OF WORKING MEMORY CAPACITY AND MENTAL EFFORT ON MONITORING ACCURACY IN TEXT COMPREHENSION , 2012 .

[32]  Annelies Raes,et al.  Scaffolding information problem solving in web-based collaborative inquiry learning , 2012, Comput. Educ..

[33]  Zhi-Hong Chen,et al.  Exploring students' behaviors in a competition-driven educational game , 2014, Comput. Hum. Behav..

[34]  Julie Coiro,et al.  Exploring the Online Reading Comprehension Strategies Used by Sixth-Grade Skilled Readers to Search for and Locate Information on the Internet. , 2007 .

[35]  Pasana Chularut,et al.  The influence of concept mapping on achievement, self-regulation, and self-efficacy in students of English as a second language , 2004 .

[36]  Lucia Mason,et al.  Epistemic evaluation and comprehension of web-source information on controversial science-related topics: Effects of a short-term instructional intervention , 2014, Comput. Educ..

[37]  R. Azevedo.  Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion , 2009 .

[38]  S. Paris,et al.  Children's Metacognition About Reading: issues in Definition, Measurement, and Instruction , 1987 .

[39]  Gregory Schraw.  Promoting general metacognitive awareness , 1998 .

[40]  Roger Azevedo,et al.  Exploring differences between gifted and grade-level students' use of self-regulatory learning processes with hypermedia , 2006, Comput. Educ..

[41]  A. Zohar,et al.  A review of research on metacognition in science education: current and future directions , 2013 .

[42]  Ingrid Hsieh-Yee,et al.  Self-evaluative intrusive thoughts impede successful searching on the Internet , 2004, Comput. Hum. Behav..

[43]  Rakefet Ackerman,et al.  Overcoming screen inferiority in learning and calibration , 2014, Comput. Hum. Behav..

[44]  Shin-Feng Chen,et al.  Comparison of Taiwanese and Canadian Students' Metacognitive Awareness of Science Reading, Text, and Strategies , 2014 .

[45]  E. Stahl,et al.  Epistemological beliefs and self-regulated learning with hypertext , 2008 .

[46]  Gregory Schraw.  A conceptual analysis of five measures of metacognitive monitoring , 2009 .

[47]  A. Koriat,et al.  Conscious and Unconscious Metacognition: A Rejoinder , 2000, Consciousness and Cognition.

[48]  B. Kramarski,et al.  Preparing Preservice Teachers for Self-Regulated Learning in the Context of Technological Pedagogical Content Knowledge. , 2010 .

[49]  J. Elshout,et al.  Changes in the relation between cognitive and metacognitive skills during the acquisition of expertise , 1999 .

[50]  Candice Burkett,et al.  The effect of multimedia discrepancies on metacognitive judgments , 2012, Comput. Hum. Behav..

[51]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[52]  Chin-Chung Tsai,et al.  Eighth graders' web searching strategies and outcomes: The role of task types, web experiences and epistemological beliefs , 2008, Comput. Educ..

[53]  Tamara Sumner,et al.  Self-Directed Learning and the Sensemaking Paradox , 2011, Hum. Comput. Interact..

[54]  Robert K. Atkinson,et al.  Using animations and visual cueing to support learning of scientific concepts and processes , 2011, Comput. Educ..

[55]  M. Bannert,et al.  Scaffolding Hypermedia Learning Through Metacognitive Prompts , 2013 .

[56]  Daniel L. Dinsmore,et al.  What are confidence judgments made of? Students' explanations for their confidence ratings and what that means for calibration , 2013 .

[57]  Madge T. Craig,et al.  Index of Science Reading Awareness: An Interactive-Constructive Model, Test Verification, and Grades 4-8 Results. , 1998 .

[58]  Xihui Wang,et al.  Examining the influences of epistemic beliefs and knowledge representations on cognitive processing and conceptual change when learning physics , 2012 .

[59]  Rakefet Ackerman,et al.  Metacognitive regulation of text learning: on screen versus on paper. , 2011, Journal of experimental psychology. Applied.

[60]  José Otero,et al.  The influence of the length of causal chains on question asking and on the comprehensibility of scientific texts , 2004 .

[61]  Chia-Yu Wang,et al.  Scaffolding Middle School Students’ Construction of Scientific Explanations: Comparing a cognitive versus a metacognitive evaluation approach , 2015 .

[62]  Alexander Renkl,et al.  Learning Strategies Assessed by Journal Writing: Prediction of Learning Outcomes by Quantity, Quality, and Combinations of Learning Strategies , 2012 .

[63]  F. Paas,et al.  Uncovering the problem-solving process: cued retrospective reporting versus concurrent and retrospective reporting. , 2005, Journal of experimental psychology. Applied.

[64]  Philip H. Winne,et al.  Measuring Self-Regulated Learning , 2000 .