Workshop on Metacognition and Self-Regulated Learning in ITSs

In this paper, we discuss lessons learned from an evaluation of the EACoach, an Intelligent Tutoring System that aims to foster meta-cognitive skills during analogical problem solving. The evaluation of the EA-Coach demonstrated that overall, it is effective in its pedagogical approach, but that there are instances where its scaffolding for meta-cognition is too subtle. We discuss implications of this finding in terms of refining the system’s support.

[1]  R. Azevedo,et al.  The Role of Self-Regulated Learning in Fostering Students' Conceptual Understanding of Complex Systems with Hypermedia , 2004 .

[2]  B. Zimmerman,et al.  Influencing Children's Self-Efficacy and Self-Regulation of Reading and Writing Through Modeling , 2007 .

[3]  B. Bloom.  The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[4]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[5]  N. Sommers.  Revision Strategies of Student Writers and Experienced Adult Writers , 1980, College Composition & Communication.

[6]  R. Mayer,et al.  Animations need narrations : an experimental test of a dual-coding hypothesis , 1991 .

[7]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[8]  K. VanLehn,et al.  Cognitive skill acquisition. , 1996, Annual review of psychology.

[9]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[10]  Roger Azevedo,et al.  The effect of a human agent’s external regulation upon college students’ hypermedia learning , 2007 .

[11]  J. Hedberg.  The Cambridge handbook of multimedia learning , 2007 .

[12]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[13]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[14]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[15]  J. Bennett,et al.  Intercultural communication training in cultural self-awareness for study abroad , 1985 .

[16]  Roland Brünken,et al.  The impact of intrinsic cognitive load on the effectiveness of graphical help for coherence formation , 2007, Comput. Hum. Behav..

[17]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[18]  Vincent Aleven,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006, Int. J. Artif. Intell. Educ..

[19]  Shelby A. Wolf,et al.  Engaging teachers in assessment of their students' narrative writing: The role of subject matter knowledge , 1994 .

[20]  Milton J. Bennett.  Towards Ethnorelativism: A Developmental Model of Intercultural Sensitivity , 1993 .

[21]  Margaret D. Pusch.  Multicultural Education: A Cross-Cultural Training Approach , 2000 .

[22]  R. Azevedo.  Using Hypermedia as a Metacognitive Tool for Enhancing Student Learning? The Role of Self-Regulated Learning , 2005 .

[23]  R. Wiseman,et al.  Measuring intercultural sensitivity: The intercultural development inventory , 2003 .

[24]  Joseph P. Magliano,et al.  Collaborative dialogue patterns in naturalistic one-to-one tutoring , 1995 .

[25]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[26]  S. Graham,et al.  Improving the writing performance, knowledge, and self-efficacy of struggling young writers: The effects of self-regulated strategy development , 2005 .

[27]  Roger Azevedo,et al.  Self-Regulation of Learning with Multiple Representations in Hypermedia , 2005, AIED.

[28]  Vincent Aleven,et al.  Evaluating the Effectiveness of a Tutorial Dialogue System for Self-Explanation , 2004, Intelligent Tutoring Systems.

[29]  B. Zimmerman.  A social cognitive view of self-regulated academic learning. , 1989 .

[30]  Patricia Charlton,et al.  Conference on Artificial Intelligence in Education , 2009 .

[31]  Joan G. DeJaeghere,et al.  Assessing intercultural sensitivity: an empirical analysis of the Hammer and Bennett Intercultural Development Inventory , 2003 .

[32]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[33]  Kurt VanLehn,et al.  Rule-Learning Events in the Acquisition of a Complex Skill: An Evaluation of Cascade , 1999 .

[34]  Stacy Marsella,et al.  Serious Games for Language Learning: How Much Game, How Much AI? , 2005, AIED.

[35]  Randall W. Hill,et al.  Pedagogically Structured Game-Based Training: Development of the Elect BiLAT Simulation , 2006 .

[36]  Vincent Aleven,et al.  Toward Tutoring Help Seeking: Applying Cognitive Modeling to Meta-cognitive Skills , 2004, Intelligent Tutoring Systems.

[37]  Antonija Mitrovic.  Supporting Self-Explanation in a Data Normalization Tutor , 2003 .

[38]  Wang Xiang,et al.  Encouraging self-monitoring in writing by Chinese students , 2004 .

[39]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[40]  Elaine M. Raybourn,et al.  Applying simulation experience design methods to creating serious game-based adaptive training systems , 2007, Interact. Comput..

[41]  Daniel L. Schwartz,et al.  Do Learning by Teaching Environments with Metacognitive Support Help Students Develop Better Learning Behaviors , 2007 .

[42]  Robert Michael Young,et al.  Towards an architecture for intelligent control of narrative in interactive virtual worlds , 2003, IUI '03.

[43]  Shaaron Ainsworth,et al.  The functions of multiple representations , 1999, Comput. Educ..

[44]  G. Kelly.  A theory of personality : the psychology of personal constructs , 1963 .

[45]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[46]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[47]  Kurt VanLehn,et al.  Analogy Events: How Examples are Used During Problem Solving , 1998, Cogn. Sci..

[48]  B. Zimmerman,et al.  Social Origins of Self-Regulatory Competence , 1997 .

[49]  Stephen K. Reed,et al.  Use of examples and procedures in problem solving , 1991 .

[50]  Robert J. Bracewell,et al.  The Development of Audience Awareness in Writing. , 1978 .

[51]  Christian D. Schunn,et al.  Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives , 2006 .

[52]  Günter K. Stahl,et al.  Evaluation studies of cross-cultural training programs : a review of the literature from 1988-2000 , 2004 .

[53]  P. Pintrich.  The Role of Metacognitive Knowledge in Learning, Teaching, and Assessing , 2002 .

[54]  S. Graham,et al.  Self-Regulated Strategy Development: Helping Students with Learning Problems Develop as Writers , 1993, The Elementary School Journal.

[55]  Lester Faigley,et al.  Topical Focus in Technical Writing , 2019, New Essays in Technical and Scientific Communication.

[56]  Vincent Aleven,et al.  The Help Tutor: Does Metacognitive Feedback Improve Students' Help-Seeking Actions, Skills and Learning? , 2006, Intelligent Tutoring Systems.

[57]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[58]  Daniel Bodemer,et al.  External and mental referencing of multiple representations , 2006, Comput. Hum. Behav..

[59]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[60]  Kasia Muldner,et al.  From Example Studying to Problem Solving via Tailored Computer-Based Meta-Cognitive Scaffolding: Hypotheses and Design , 2006 .

[61]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[62]  M. Chi.  Constructing Self-Explanations and Scaffolded Explanations in Tutoring , 1996 .

[63]  H. Chad Lane,et al.  Teaching Negotiation Skills through Practice and Reflection with Virtual Humans , 2006, Simul..

[64]  Andy Cresswell,et al.  Self-monitoring in student writing: developing learner responsibility , 2000 .

[65]  Amy Ogan.  Culture in the Classroom : Challenges for Assessment in Ill-Defined Domains , 2006 .

[66]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[67]  Kurt VanLehn,et al.  Scaffolding Problem Solving with Annotated, Worked-Out Examples to Promote Deep Learning , 2006, Intelligent Tutoring Systems.

[68]  Kenneth D. Forbus.  Qualitative Process Theory , 1984, Artif. Intell..

[69]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[70]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[71]  Gautam Biswas,et al.  Technology support for complex problem solving: from SAD environments to AI , 2001 .

[72]  Roger Azevedo,et al.  The Dynamic Nature of Self-Regulatory Behavior in Self-Regulated Learning and Externally-Regulated Learning Episodes , 2007, AIED.

[73]  Kathryn Ley,et al.  Instructional principles for self-regulation , 2001 .

[74]  Tina Seufert.  Supporting Coherence Formation in Learning from Multiple Representations , 2003 .

[75]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[76]  Barry J. Zimmerman,et al.  Becoming a Self-Regulated Writer: A Social Cognitive Perspective , 1997 .

[77]  Roger Azevedo,et al.  Adaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia , 2005 .

[78]  Choo-Yee Ting,et al.  A Decision-Theoretic Approach to Scientific Inquiry Exploratory Learning Environment , 2006, Intelligent Tutoring Systems.

[79]  A. Brown.  Metacognition, executive control, self-regulation, and other more mysterious mechanisms , 1987 .

[80]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[81]  C. Haviland,et al.  Teaching writing and thinking skills. , 1984, Nursing outlook.

[82]  Kasia Muldner,et al.  Evaluating a Decision-Theoretic Approach to Tailored Example Selection , 2007, IJCAI.

[83]  R. Mayer,et al.  A generative theory of textbook design: Using annotated illustrations to foster meaningful learning of science text , 1995 .

[84]  Stephen K. Reed,et al.  Usefulness of analogous solutions for solving algebra word problems , 1985 .

[85]  Gautam Biswas,et al.  Feedback for Metacognitive Support in Learning by Teaching Environments , 2006 .

[86]  Judith D. Wilson,et al.  Artificial Intelligence and Tutoring Systems , 1990 .