Natural affect data — Collection & annotation in a learning context

Automatic inference of affect relies on representative data. For viable applications of such technology the use of naturalistic over posed data has been increasingly emphasised. Creating a repository of naturalistic data is however a massively challenging task. We report results from a data collection exercise in one of the most significant application areas of affective computing, namely computer-based learning environments. The conceptual and methodological issues encountered during the process are discussed, and problems with labelling and annotation are identified. A comparison of the compiled database with some standard databases is also presented.

[1]  R. Skemp.  The psychology of learning mathematics , 1979 .

[2]  Rana El Kaliouby,et al.  Eliciting, capturing and tagging spontaneous facialaffect in autism spectrum disorder , 2007, ICMI '07.

[3]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[4]  EmoTV 1 : Annotation of Real-life Emotions for the Specification of Multimodal Affective Interfaces , 2005 .

[5]  Philip Smith.  Roger Bakeman John M. Gottman , 1987, Animal Behaviour.

[6]  Wade Junek,et al.  Mind Reading: The Interactive Guide to Emotions , 2007 .

[7]  Roddy Cowie,et al.  Beyond emotion archetypes: Databases for emotion modelling using neural networks , 2005, Neural Networks.

[8]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[9]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[10]  Scotty D. Craig,et al.  Integrating Affect Sensors in an Intelligent Tutoring System , 2004 .

[11]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[12]  Elmar Nöth,et al.  How to find trouble in communication , 2003, Speech Commun..

[13]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[14]  Patrik N. Juslin,et al.  Technical issues in recording nonverbal behavior , 2005 .

[15]  J. Russell,et al.  The psychology of facial expression: Frontmatter , 1997 .

[16]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Minna Isomursu,et al.  Experimental evaluation of five methods for collecting emotions in field settings with mobile applications , 2007, Int. J. Hum. Comput. Stud..

[18]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[19]  Peter Robinson,et al.  Intentional affect: an alternative notion of affective interaction with a machine , 2009, BCS HCI.

[20]  V. Manusov.  The sourcebook of nonverbal measures : going beyond words , 2004 .