A Dual-Modal System that Evaluates User's Emotions in Virtual Learning Environments and Responds Affectively

Endowing learning systems with emotion awareness features (capture user's affective state and provide affective feedback), seems quite promising. This paper describes a system implementation that provides emotion awareness, both explicitly, by self-reporting of emotions through a usable web tool, and implicitly, via sentiment analysis. Prominent theories, models and techniques of emotion, emotion learning, emotion detection and affective feedback are reviewed. We also present findings from our experiment with university students, validating the explicit mechanism in real education settings. Finally, we set open issues for future experimentation, contributing to the research agenda.

[1]  P. Schutz,et al.  Educational Psychology Perspectives on Teachers’ Emotions , 2009 .

[2]  Joost Broekens,et al.  AffectButton: Towards a standard for dynamic affective user feedback , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[3]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[4]  David Masip,et al.  Enabling Automatic Just-in-time Evaluation of In-class Discussions in On-line Collaborative Learning Practices , 2009, J. Digit. Inf. Manag..

[5]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[6]  Jordi Conesa,et al.  Design of an emotion aware e-learning system , 2012, Int. J. Knowl. Learn..

[7]  James C. Lester,et al.  Evaluating the consequences of affective feedback in intelligent tutoring systems , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[8]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[9]  J. Russell.  A circumplex model of affect. , 1980 .

[10]  R. Pekrun.  The impact of emotions on learning and achievement : towards a theory of cognitive/motivational mediators , 1992 .

[11]  Marc Fabri,et al.  Emotionally expressive avatars for collaborative virtual environments , 2006 .

[12]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[13]  P. Zimmermann.  Beyond usability: measuring aspects of user experience , 2008 .

[14]  Ning Wang,et al.  The politeness effect: Pedagogical agents and learning outcomes , 2008, Int. J. Hum. Comput. Stud..

[15]  Maria Wong,et al.  Emotion Assessment in Evaluation of Aective Interfaces , 2006 .

[16]  Rafael A. Calvoa,et al.  Two approaches for the design of affective computing environments for education , 2009 .

[17]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[18]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.

[19]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..

[20]  M. Boekaerts,et al.  Being Concerned With Well-Being and With Learning , 1993 .

[21]  Paul Dourish,et al.  How emotion is made and measured , 2007, Int. J. Hum. Comput. Stud..

[22]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[23]  Xavier Carreras,et al.  FreeLing: An Open-Source Suite of Language Analyzers , 2004, LREC.

[24]  Ivon Arroyo,et al.  Emotional intelligence for computer tutors , 2008 .

[25]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[26]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[27]  Joseph Kaye,et al.  Understanding how bloggers feel: recognizing affect in blog posts , 2006, CHI Extended Abstracts.

[28]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[29]  T. Hascher.  Learning and Emotion: Perspectives for Theory and Research , 2010 .

[30]  Bettina Davou,et al.  Interaction of Emotion and Cognition in the Processing of Textual Material , 2007 .

[31]  Arthur C. Graesser,et al.  Multimethod assessment of affective experience and expression during deep learning , 2009, Int. J. Learn. Technol..

[32]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[33]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[34]  M. Feidakis,et al.  Responding affectively in online learning situations , 2012, 2012 International Symposium on Computers in Education (SIIE).

[35]  Thanasis Daradoumis,et al.  Endowing e-Learning Systems with Emotion Awareness , 2011, 2011 Third International Conference on Intelligent Networking and Collaborative Systems.

[36]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[37]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[38]  Carlo Strapparava,et al.  Developing Affective Lexical Resources , 2004, PsychNology J..

[39]  R. Plutchik.  The Nature of Emotions , 2001 .

[40]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[41]  Thanasis Daradoumis,et al.  Emotion Measurement in Intelligent Tutoring Systems: What, When and How to Measure , 2011, 2011 Third International Conference on Intelligent Networking and Collaborative Systems.

[42]  Peter D. Turney.  Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[43]  Arthur C. Graesser,et al.  Automatic detection of learner’s affect from conversational cues , 2008, User Modeling and User-Adapted Interaction.