What cognitive and affective states should technology monitor to support learning?

This paper discusses self-efficacy, curiosity, and reflectivity as cognitive and affective states that are critical to learning but are overlooked in the context of affect-aware technology for learning. This discussion sits within the opportunities offered by the weDRAW project aiming at an embodied approach to the design of technology to support exploration and learning of mathematical concepts. We first review existing literature to clarify how the three states facilitate learning and how, if not supported, they may instead hinder learning. We then review the literature to understand how bodily expressions communicate these states and how technology could be used to monitor them. We conclude by presenting initial movement cues currently explored in the context of weDRAW.

[1]  G. Loewenstein.  The psychology of curiosity: A review and reinterpretation. , 1994 .

[2]  Ryan Shaun Joazeiro de Baker,et al.  Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms , 2016, TIIS.

[3]  Ryan Shaun Joazeiro de Baker,et al.  Coarse-grained detection of student frustration in an introductory programming course , 2009, ICER '09.

[4]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[5]  W. E. Jeffrey,et al.  Reflective and impulsive children: strategies of information processing underlying differences in problem solving. , 1976, Monographs of the Society for Research in Child Development.

[6]  J F Keogh,et al.  Observer perceptions of movement confidence. , 1981, Research quarterly for exercise and sport.

[7]  Mijung Kim,et al.  CHILDREN’S GESTURES AND THE EMBODIED KNOWLEDGE OF GEOMETRY , 2011 .

[8]  Radoslaw Niewiadomski,et al.  Designing Multimodal Interactive Systems using EyesWeb XMI , 2016, SERVE@AVI.

[9]  P. Rozencwajg,et al.  Cognitive Processes in the Reflective-Impulsive Cognitive Style , 2005, The Journal of genetic psychology.

[10]  Wolff‐Michael Roth.  Gestures: Their Role in Teaching and Learning , 2001 .

[11]  D. Schunk.  Modeling and attributional effects on children's achievement: A self-efficacy analysis. , 1981 .

[12]  A. Bandura.  Toward a unifying theory of behavioral change , 1977 .

[13]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[14]  Paul R. Pintrich,et al.  THE ROLE OF SELF-EFFICACY BELIEFS INSTUDENT ENGAGEMENT AND LEARNING INTHECLASSROOM , 2003 .

[15]  J I Navarro,et al.  Relationship of Arithmetic Problem Solving and Reflective—Impulsive Cognitive Styles in Third-Grade Students , 1999, Psychological reports.

[16]  Michael Lewis,et al.  Shame and Pride and their Effects on Student Achievement , 2014 .

[17]  Shuji Hashimoto,et al.  EyesWeb: Toward Gesture and Affect Recognition in Interactive Dance and Music Systems , 2000, Computer Music Journal.

[18]  Rafael A. Calvo,et al.  Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[19]  Samuel M. McClure,et al.  The Wick in the Candle of Learning , 2009, Psychological science.

[20]  K. Fiedler,et al.  International handbook of emotions in education. , 2014 .

[21]  Jordan A. Litman,et al.  Epistemic curiosity, feeling-of-knowing, and exploratory behaviour , 2005 .

[22]  Kristy Elizabeth Boyer,et al.  Modeling Self-Efficacy Across Age Groups with Automatically Tracked Facial Expression , 2015, AIED.

[23]  Antonio Camurri,et al.  A serious games platform for validating sonification of human full-body movement qualities , 2016, MOCO.

[24]  B. Gelder,et al.  Why bodies? Twelve reasons for including bodily expressions in affective neuroscience , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  Hubert Ripoll,et al.  Reflective-Impulsive Style and Conceptual Tempo in a Gross Motor Task , 2001, Perceptual and motor skills.

[26]  James C. Lester,et al.  Modeling self-efficacy in intelligent tutoring systems: An inductive approach , 2008, User Modeling and User-Adapted Interaction.

[27]  S. Goldin-Meadow,et al.  The role of gesture in communication and thinking , 1999, Trends in Cognitive Sciences.

[28]  Bert Arnrich,et al.  Towards an Emotional Engagement Model: Can Affective States of a Learner be Automatically Detected in a 1: 1 Learning Scenario? , 2016, UMAP.

[29]  Paul A. Schutz,et al.  Introduction: Emotions in Education , 2002 .