Note-taking within MetaTutor: interactions between an intelligent tutoring system and prior knowledge on note-taking and learning

AbstractHypermedia learning environments (HLE) unevenly present new challenges and opportunities to learning processes and outcomes depending on learner characteristics and instructional supports. In this experimental study, we examined how one such HLE—MetaTutor, an intelligent, multi-agent tutoring system designed to scaffold cognitive and metacognitive self-regulated learning (SRL) processes—interacts with learner’s prior domain knowledge to affect their note-taking activities and subsequent learning outcomes. Sixty (N = 60) college students studied with MetaTutor for 120 min and took notes on hypermedia content of the human circulatory system. Log-files and screen recordings of learner-system interactions were used to analyze notes for several quantitative and qualitative variables. Results show that most note-taking was a verbatim copy of instructional content, which negatively related to the post-test measure of learning. There was an interaction between prior knowledge and pedagogical agent scaffolding, such that low prior knowledge students took a greater quantity of notes compared to their high prior knowledge counterparts, but only in the absence of MetaTutor SRL scaffolding; when agent SRL scaffolding was present, the note-taking activities of low prior knowledge students were statistically equivalent to the number of notes taken by their high prior knowledge counterparts. Theoretical and instructional design implications are discussed.

[1]  Philip H. Winne,et al.  A Cognitive and Metacognitive Analysis of Self-Regulated Learning , 2011 .

[2]  B. Zimmerman,et al.  Motivation and Self-Regulated Learning: Theory, Research, and Applications , 2009 .

[3]  M. Chi.  Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[4]  M. Pressley,et al.  Cognition, Teaching, and Assessment , 1995 .

[5]  Arthur C. Graesser,et al.  Agent Technologies Designed to Facilitate Interactive Knowledge Construction , 2008 .

[6]  R. Azevedo,et al.  The Role of Self-Regulated Learning in Fostering Students' Conceptual Understanding of Complex Systems with Hypermedia , 2004 .

[7]  Roger Azevedo,et al.  A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system☆☆☆ , 2009 .

[8]  G. Clarebout,et al.  Do pedagogical agents make a difference to student motivation and learning , 2011 .

[9]  Candice Burkett,et al.  Self-regulated Learning with MetaTutor: Advancing the Science of Learning with MetaCognitive Tools , 2010 .

[10]  Alfred Joseph Lizzio,et al.  University Students' Perceptions of the Learning Environment and Academic Outcomes: Implications for theory and practice , 2002 .

[11]  Stephen L. Benton,et al.  The relationship between information-processing ability and notetaking , 1988 .

[12]  Richard T. Vacca,et al.  Content Area Reading: Literacy and Learning Across the Curriculum , 1998 .

[13]  Roger Azevedo,et al.  Exploring differences between gifted and grade-level students' use of self-regulatory learning processes with hypermedia , 2006, Comput. Educ..

[14]  Daniel C. Moos,et al.  Self-regulated learning with hypermedia : The role of prior domain knowledge , 2008 .

[15]  Roger Azevedo,et al.  The Dynamics of Self-regulatory Processes within Self-and Externally Regulated Learning Episodes During Complex Science Learning with Hypermedia , 2008, Intelligent Tutoring Systems.

[16]  Susan M. Land,et al.  Theoretical Foundations of Learning Environments. , 1999 .

[17]  Roger Azevedo,et al.  The effect of a human agent’s external regulation upon college students’ hypermedia learning , 2007 .

[18]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[19]  Krista R. Muis,et al.  To master or perform? Exploring relations between achievement goals and conceptual change learning. , 2013, The British journal of educational psychology.

[20]  J. C. Smart,et al.  Higher Education: Handbook of Theory and Research , 2001, Higher Education: Handbook of Theory and Research.

[21]  Daniel C. Moos.  Note-taking while learning hypermedia: Cognitive and motivational considerations , 2009, Comput. Hum. Behav..

[22]  M. Bannert,et al.  Scaffolding Hypermedia Learning Through Metacognitive Prompts , 2013 .

[23]  Susan M. Land,et al.  Metacognition and Self-Regulated Learning in Student-Centered Learning Environments , 2012 .

[24]  Roger Azevedo,et al.  Advances in scaffolding learning with hypertext and hypermedia: theoretical, empirical, and design issues , 2008 .

[25]  V. Aleven,et al.  International Handbook of Metacognition and Learning Technologies , 2013 .

[26]  Roger Azevedo,et al.  Why Is Externally-Regulated Learning More Effective Than Self-Regulated Learning with Hypermedia? , 2005, AIED.

[27]  P.R.J. Simons,et al.  How we should control time on task—or should we? , 1983 .

[28]  R. Azevedo.  Computer Environments as Metacognitive Tools for Enhancing Learning , 2005 .

[29]  P. V. Meter,et al.  College Students' Theory of Note-Taking Derived From Their Perceptions of Note-Taking , 1994 .

[30]  R. T. Kellogg,et al.  Cognitive effort during note taking , 2005 .

[31]  Gautam Biswas,et al.  Investigating Self-Regulated Learning in Teachable Agent Environments , 2013 .

[32]  Kenneth A. Kiewra.  Investigating Notetaking and Review: A Depth of Processing Alternative , 1985 .

[33]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[34]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[35]  Candice Burkett,et al.  MetaTutor: A MetaCognitive Tool for Enhancing Self-Regulated Learning , 2009, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[36]  B. Zimmerman,et al.  Handbook of Self-Regulation of Learning and Performance , 2011 .

[37]  Susanne P. Lajoie,et al.  Proceedings of the 9th international conference on Intelligent Tutoring Systems , 2008 .

[38]  T. Gary Waller,et al.  Mathemagenic Behaviours and Efficiency in Learning from Prose Materials: Review, Critique and Recommendations , 1976 .

[39]  Barbara A. Greene,et al.  Influences on achievement : Goals, perceived ability, and cognitive engagement , 1996 .

[40]  Jonathan P. Rowe,et al.  Supporting Self-Regulated Science Learning in Narrative-Centered Learning Environments , 2013 .

[41]  Daniel C. Moos,et al.  Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? , 2008 .

[42]  Katharina Scheiter,et al.  Hypermedia and Self-Regulation: An Interplay in Both Directions , 2013 .

[43]  William G. Holliday,et al.  How college science students engage in note‐taking strategies , 2006 .

[44]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[45]  Kristy Elizabeth Boyer,et al.  Balancing Cognitive and Motivational Scaffolding in Tutorial Dialogue , 2008, Intelligent Tutoring Systems.

[46]  Cathy Collins Block,et al.  Comprehension Instruction: Research-Based Best Practices , 2001 .

[47]  Jason M. Harley,et al.  Using Trace Data to Examine the Complex Roles of Cognitive, Metacognitive, and Emotional Self-Regulatory Processes During Learning with Multi-agent Systems , 2013 .

[48]  D. Leutner,et al.  Metacognitive Knowledge About and Metacognitive Regulation of Strategy Use in Self-Regulated Scientific Discovery Learning: New Methods of Assessment in Computer-Based Learning Environments , 2013 .

[49]  Philip H. Winne,et al.  The weave of motivation and self-regulated learning. , 2008 .

[50]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[51]  Francis J. Di Vesta,et al.  Listening and Note Taking: II. Immediate and Delayed Recall as Functions of Variations in Thematic Continuity, Note Taking, and Length of Listening-Review Intervals. , 1973 .

[52]  Elizabeth R. Peterson,et al.  Conceptions of Learning and Knowledge in Higher Education: Relationships with Study Behaviour and Influences of Learning Environments. , 2004 .

[53]  Amy M. Shapiro,et al.  Hypermedia design as learner scaffolding , 2008 .

[54]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[55]  Joel Myerson,et al.  Note-taking with computers: Exploring alternative strategies for improved recall. , 2013 .

[56]  Arthur C. Graesser,et al.  Self-Regulated Learning in Learning Environments With Pedagogical Agents That Interact in Natural Language , 2010 .