Towards a Learning Companion that Recognizes Affect

This paper reports work in progress to build a Learning Companion, a computerized system sensitive to the affective aspects of learning, which facilitates the child’s own efforts at learning. Learning related to science, math, engineering, and technology naturally involves failure and a host of associated affective responses. This article describes techniques and tools being developed to recognize affective states important in the interplay between emotions and learning.

[1]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[2]  R. Plutchik.  A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[3]  C. Leong,et al.  Computer Speech in Reading Research, Instruction, and Remediation , 1989 .

[4]  K. Leidelmeijer,et al.  Emotions : an experimental approach , 1991 .

[5]  P. Ekman.  Are there basic emotions? , 1992, Psychological review.

[6]  Teresa Del Soldato.  Motivation in tutoring systems , 1993 .

[7]  Jean-Claude Latombe,et al.  Planning motions with intentions , 1994, SIGGRAPH.

[8]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[9]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Claude Frasson,et al.  Proceedings of the Third International Conference on Intelligent Tutoring Systems , 1996 .

[11]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[12]  Rosalind W. Picard.  Affective Computing , 1997 .

[13]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  L. de Silva,et al.  Facial emotion recognition using multi-modal information , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[15]  Tsutomu Miyasato,et al.  Multimodal human emotion/expression recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[16]  Jonathan T. Klein,et al.  Computer response to user frustration , 1998 .

[17]  S. LaValle.  Rapidly-exploring random trees : a new tool for path planning , 1998 .

[18]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Helen Pain,et al.  Motivation self-report in ITS , 1999 .

[20]  Rosalind W. Picard,et al.  Expression glasses: a wearable device for facial expression recognition , 1999, CHI Extended Abstracts.

[21]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[22]  Irfan A. Essa,et al.  Detecting and tracking eyes by using their physiological properties, dynamics, and appearance , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[24]  Rosalind W. Picard.  Toward computers that recognize and respond to user emotion , 2000, IBM Syst. J..

[25]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[28]  Kwan-Liu Ma,et al.  A new form of traditional art: visual simulation of Chinese shadow play , 2003, SIGGRAPH '03.