Grounding affect recognition on a low-level description of body posture

The research presented in this thesis is centred in the rapidly growing field of affective computing and focuses on the automatic recognition of affect. Numerous diverse technologies have become part of working and social life, hence it is crucial to understand whether recognising the affective state of the user may be added to increase the technologies' effectiveness. The contributions made are the investigation of a low-level description of body posture, the proposal of a method for creating benchmarks for evaluating affective posture recognition models, and providing an understanding of how posture is used to communicate affect. Using a low-level posture description approach, this research aims to create automatic recognition models that may be easily adapted to different application contexts. These recognition models would be able to map low-level descriptions of postural configurations into discrete affective states and levels of affective dimensions. The feasibility of this approach is tested using an incremental procedure with three studies. The first study (acted postures), investigates the feasibility of recognising basic emotions and affective dimensions from acted, i.e., stereotypical, exaggerated expressions. The second study (non-acted postures), aims at recognising subtle affective states and affective dimensions from non-acted body postures in the context of a video game. In both studies, the results showed above chance level agreement and reliable consistency between human observers for the discrete affective states and valence and arousal dimensions. A feature analysis showed that specific low-level features are predictive of affect. The automatic recognition models achieved recognition rates similar to or better than the benchmarks computed. Extending the non-acted postures study, the third study focuses on how the affective posture recognition system performs when applied to sequences of non-acted static postures that have not been manually preselected, as if in a runtime situation. An automatic modelling technique was combined with a decision rule defined in this research. The results indicate that posture sequences can be recognised at well above chance level.

[1]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[2]  Alan J. Dix,et al.  Using frustration in the design of adaptive videogames , 2004, ACE '04.

[3]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[4]  A. Mehrabian,et al.  A measure of emotional empathy. , 1972, Journal of personality.

[5]  R. Thayer.  The biopsychology of mood and arousal , 1989 .

[6]  F. Pollick,et al.  A motion capture library for the study of identity, gender, and emotion perception from biological motion , 2006, Behavior research methods.

[7]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  B. Gelder.  Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[9]  Peter Robinson,et al.  Detecting Affect from Non-stylised Body Motions , 2007, ACII.

[10]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[11]  N. Lazzaro.  Why we Play Games: Four Keys to More Emotion without Story , 2004 .

[12]  P. Ekman.  What emotion categories or dimensions can observers judge from facial behavior , 1982 .

[13]  Chung-Lin Huang,et al.  Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification , 1997, J. Vis. Commun. Image Represent..

[14]  R. Plutchik.  A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[15]  M. Zuckerman,et al.  Normative Data for the Multiple Affect Adjective Check List , 1965, Psychological reports.

[16]  Anna Wierzbicka,et al.  Emotions Across Languages and Cultures: Diversity and Universals: Emotional universals , 1999 .

[17]  Rosalind W. Picard.  Toward Agents that Recognize Emotion , 1998 .

[18]  P. Ekman,et al.  Detecting deception from the body or face. , 1974 .

[19]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[20]  S. Tomkins.  Illuminating and Stimulating. (Book Reviews: Affect, Imagery, Consciousness. vol. 1, The Positive Affects) , 1963 .

[21]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[22]  Elizabeth A. Crane,et al.  Motion Capture and Emotion: Affect Detection in Whole Body Movement , 2007, ACII.

[23]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[24]  M. Bond,et al.  Universality and Distinctiveness in Dimensions of Japanese Person Perception , 1975 .

[25]  J. Decety,et al.  Neural mechanisms subserving the perception of human actions , 1999, Trends in Cognitive Sciences.

[26]  Andrea Kleinsmith,et al.  Cross-cultural differences in recognizing affect from body posture , 2006, Interact. Comput..

[27]  L. F. Barrett.  Valence is a basic building block of emotional life , 2006 .

[28]  Pc,et al.  An Introduction to Social Psychology , 1920, Nature.

[29]  Bernard M. Finifter.  The Generation of Confidence: Evaluating Research Findings by Random Subsample Replication , 1972 .

[30]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  P. Ekman,et al.  Unmasking the Face: A Guide to Recognizing Emotions From Facial Expressions , 1975 .

[32]  Hillary Anger Elfenbein,et al.  Cross-cultural patterns in emotion recognition: highlighting design and analytical techniques. , 2002, Emotion.

[33]  N. Amir,et al.  Is there a dominant channel in perception of emotions? , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[34]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[35]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[36]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[37]  B. de Gelder.  Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. , 2009, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  T. Shipley,et al.  Markerless motion-capture for point-light displays , 2003 .

[39]  W. Friesen,et al.  Cultural differences in facial expressions in a social situation: An experimental test on the concept of display rules. , 1973 .

[40]  Shihoko Kamisato,et al.  Extraction of Motion Characteristics Corresponding to Sensitivity Information Using Dance Movement , 2004, J. Adv. Comput. Intell. Intell. Informatics.

[41]  Gary S. Katz,et al.  Bimodal expression of emotion by face and voice , 1998, MULTIMEDIA '98.

[42]  Jennifer S. Beer,et al.  Facial expression of emotion. , 2003 .

[43]  J. Gray.  The neuropsychology of anxiety. , 1985, Issues in mental health nursing.

[44]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[45]  Antonio Camurri,et al.  Multimodal Analysis of Expressive Gesture in Music and Dance Performances , 2003, Gesture Workshop.

[46]  Hatice Gunes,et al.  Bi-modal emotion recognition from expressive face and body gestures , 2007, J. Netw. Comput. Appl..

[47]  A. Mehrabian.  Inference of attitudes from the posture, orientation, and distance of a communicator. , 1968, Journal of consulting and clinical psychology.

[48]  Ronald Poppe,et al.  Person or Puppet? The Role of Stimulus Realism in Attributing Emotion to Static Body Postures , 2007, ACII.

[49]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[50]  Woontack Woo,et al.  Emotion Recognition from Dance Image Sequences Using Contour Approximation , 2004, SSPR/SPR.

[51]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[52]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[53]  A. Atkinson,et al.  Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures , 2007, Cognition.

[54]  Peter Robinson,et al.  Natural affect data — Collection & annotation in a learning context , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[55]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[56]  David Matsumoto,et al.  Cultural similarities and differences in the semantic dimensions of body postures , 1987 .

[57]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[58]  B. de Gelder,et al.  Body expressions influence recognition of emotions in the face and voice. , 2007, Emotion.

[59]  Nicu Sebe,et al.  Emotion Recognition Based on Joint Visual and Audio Cues , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[60]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[61]  Rudolf von Laban,et al.  Modern Educational Dance , 1948 .

[62]  Peter Robinson,et al.  Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[63]  F. Pollick,et al.  The Role of Velocity in Affect Discrimination , 2001 .

[64]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[65]  K. Hiraki,et al.  The relative importance of spatial versus temporal structure in the perception of biological motion: An event-related potential study , 2006, Cognition.

[66]  Lisa Feldman Barrett,et al.  Feelings or words? Understanding the content in self-report ratings of experienced emotion. , 2004, Journal of personality and social psychology.

[67]  Miriam Kienast,et al.  Acoustical analysis of spectral and temporal changes in emotional speech , 2000 .

[68]  Yuri Ivanov,et al.  Probabilistic combination of multiple modalities to detect interest , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[69]  Garrison W. Cottrell,et al.  Representing Face Images for Emotion Classification , 1996, NIPS.

[70]  Karl Verfaillie,et al.  Perception of biological motion: A stimulus set of human point-light actions , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[71]  Roddy Cowie,et al.  Emotional speech: Towards a new generation of databases , 2003, Speech Commun..

[72]  Nadia Bianchi-Berthouze,et al.  An incremental and interactive affective posture recognition system , 2005 .

[73]  Andrea Kleinsmith,et al.  A categorical approach to affective gesture recognition , 2003, Connect. Sci..

[74]  C. Izard,et al.  Self-Organization of Discrete Emotions, Emotion Patterns, and Emotion-Cognition Relations , 2000 .

[75]  Roddy Cowie,et al.  Beyond emotion archetypes: Databases for emotion modelling using neural networks , 2005, Neural Networks.

[76]  R. Lazarus.  Emotion and Adaptation , 1991 .

[77]  P. Dario,et al.  Design strategies to improve patient motivation during robot-aided rehabilitation , 2007, Journal of NeuroEngineering and Rehabilitation.

[78]  Frank E. Pollick,et al.  Combining faces and movements to recognize affect , 2004 .

[79]  EmoTV 1 : Annotation of Real-life Emotions for the Specification of Multimodal Affective Interfaces , 2005 .

[80]  M. D. Meijer.  The contribution of general features of body movement to the attribution of emotions , 1989 .

[81]  P. Rozin,et al.  High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans. , 2003, Emotion.

[82]  Frank Dellaert,et al.  Recognizing emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[83]  J. Russell,et al.  Concept of Emotion Viewed From a Prototype Perspective , 1984 .

[84]  Nadia Bianchi-Berthouze,et al.  Towards Bi-Directional Affective Human Interaction , 2003 .

[85]  M. Banerjee,et al.  Beyond kappa: A review of interrater agreement measures , 1999 .

[86]  H. Kaiser.  The Application of Electronic Computers to Factor Analysis , 1960 .

[87]  R. Lazarus.  Thoughts on the relations between emotion and cognition. , 1982 .

[88]  R. Adolphs.  Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[89]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[90]  Jaak Panksepp,et al.  Toward a general psychobiological theory of emotions , 1982, Behavioral and Brain Sciences.

[91]  Georgios N. Yannakakis.  Preference learning for affective modeling , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[92]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[93]  David L. Verbyla,et al.  Resampling methods for evaluating classification accuracy of wildlife habitat models , 1989 .

[94]  C. Izard.  The face of emotion , 1971 .

[95]  Maja Pantic,et al.  MMI Face Database , 2005 .

[96]  Murray S. Miron,et al.  Cross-Cultural Universals of Affective Meaning , 1975 .

[97]  Batja Mesquita,et al.  Emotions as dynamic cultural phenomena , 2003 .

[98]  D. Matsumoto,et al.  Cross-cultural examination of the semantic dimensions of body postures. , 1985, Journal of personality and social psychology.

[99]  Valery A. Petrushin,et al.  EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS , 1999 .

[100]  P. Ekman,et al.  Head and body cues in the judgment of emotion: a reformulation. , 1967, Perceptual and motor skills.

[101]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[102]  Nicu Sebe,et al.  Towards authentic emotion recognition , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[103]  P. Johnson-Laird,et al.  Towards a Cognitive Theory of Emotions , 1987 .

[104]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[105]  J. A. Russel.  .nto faces: Resurrecting a dimensional-contextual perspective , 2007 .

[106]  Peter F. Driessen,et al.  Gesture-Based Affective Computing on Motion Capture Data , 2005, ACII.

[107]  G. Fricchione.  Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[108]  M. Landau.  Acoustical Properties of Speech as Indicators of Depression and Suicidal Risk , 2008 .

[109]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[110]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[111]  Mann Oo. Hay.  Emotion recognition in human-computer interaction , 2012 .

[112]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[113]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[114]  J. Russell.  Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[115]  Robert Rosenthal,et al.  Physicians' H]ead and Body Positions as Determinants of Perceived Rapport , 1983 .

[116]  Anton Nijholt,et al.  Movement-Based Sports Video Games: Investigating Motivation and Gaming Experience , 2009, Entertain. Comput..

[117]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[118]  R. Rozensky,et al.  Notation systems for coding nonverbal behavior: A review , 1982 .

[119]  I. Linnankoski,et al.  Expression or emotional-motivational connotations with a one-word utterance. , 1997, The Journal of the Acoustical Society of America.

[120]  David Matsumoto,et al.  CULTURE AND NONVERBAL BEHAVIOR , 2006 .

[121]  el Kaliouby,et al.  Mind-reading machines: automated inference of complex mental states , 2005 .

[122]  Arthur C. Graesser,et al.  Predicting Affective States expressed through an Emote-Aloud Procedure from AutoTutor's Mixed-Initiative Dialogue , 2006, Int. J. Artif. Intell. Educ..

[123]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[124]  Pierre-Yves Oudeyer,et al.  The production and recognition of emotions in speech: features and algorithms , 2003, Int. J. Hum. Comput. Stud..

[125]  Rosalind W. Picard,et al.  Towards a Learning Companion that Recognizes Affect , 2001 .

[126]  Steven J. Simske,et al.  Recognition of emotions in interactive voice response systems , 2003, INTERSPEECH.

[127]  Cynthia Breazeal,et al.  Affective Learning — A Manifesto , 2004 .

[128]  Albert Mehrabian,et al.  Encoding of attitude by a seated communicator via posture and position cues. , 1969 .

[129]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[130]  Ruth Aylett,et al.  Affective Guide with Attitude , 2005, ACII.

[131]  R. Zajonc.  Feeling and thinking : Preferences need no inferences , 1980 .

[132]  Shrikanth S. Narayanan,et al.  Classifying emotions in human-machine spoken dialogs , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[133]  J. Hietanen,et al.  Facial and emotional reactions to Duchenne and non-Duchenne smiles. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[134]  M. Rosenblum,et al.  Human emotion recognition from motion using a radial basis function network architecture , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[135]  C. Izard.  Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[136]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[137]  William Thomas James,et al.  A Study of the Expression of Bodily Posture , 1932 .

[138]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[139]  R. Riener,et al.  ARMin - design of a novel arm rehabilitation robot , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[140]  Lester M. Hyman,et al.  Which are the stimuli in facial displays of anger and happiness? Configurational bases of emotion recognition. , 1992 .

[141]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[142]  Elmar Nöth,et al.  From Emotion to Interaction: Lessons from Real Human-Machine-Dialogues , 2004, ADS.

[143]  Shuichi Fukuda,et al.  Emotion in user interface, voice interaction system , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[144]  Wilhelm Wundt,et al.  The Language of Gestures , 1973 .

[145]  R. Laban.  The mastery of movement on the stage , 1950 .

[146]  Roddy Cowie,et al.  Acoustic correlates of emotion dimensions in view of speech synthesis , 2001, INTERSPEECH.

[147]  Zhihong Zeng,et al.  Bimodal HCI-related affect recognition , 2004, ICMI '04.

[148]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[149]  Hatice Gunes,et al.  Observer annotation of affective display and evaluation of expressivity: face vs. face-and-body , 2006 .

[150]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[151]  J. Tsai,et al.  Emotional expression and physiology in European Americans and Hmong Americans. , 2002, Emotion.

[152]  Sung-Bae Cho,et al.  Estimating the efficiency of recognizing gender and affect from biological motion , 2002, Vision Research.

[153]  M. Covington.  A Motivational Analysis of Academic Life in College , 2007 .

[154]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[155]  Loïc Kessous,et al.  Modeling naturalistic affective states via facial and vocal expressions recognition , 2006, ICMI '06.

[156]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[157]  Ryohei Nakatsu,et al.  Emotion recognition and its application to computer agents with spontaneous interactive capabilities , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[158]  Jon Doyle,et al.  Prospects for Preferences , 2004, Comput. Intell..

[159]  Nick Campbell,et al.  Recording and storing of speech data , 2002 .

[160]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[161]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[162]  Andreas Stolcke,et al.  Prosody-based automatic detection of annoyance and frustration in human-computer dialog , 2002, INTERSPEECH.

[163]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..

[164]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[165]  Sanghee Yeo.  Handbook of individual differences, learning, and instruction. , 2010, Korean journal of medical education.

[166]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[167]  R. Neiss,et al.  Posthypnotic suggestion: A method for the study of nonverbal communication , 1989 .

[168]  K. Scherer,et al.  Cues and channels in emotion recognition. , 1986 .

[169]  B. de Gelder,et al.  Rapid detection of fear in body expressions, an ERP study , 2007, Brain Research.

[170]  Jean-Claude Martin,et al.  Combining Facial and Postural Expressions of Emotions in a Virtual Character , 2009, IVA.

[171]  David Matsumoto,et al.  DEVELOPMENTAL CHARACTERISTICS IN JUDGMENTS OF EMOTION FROM NONVERBAL VOCAL CUES , 1983 .

[172]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[173]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[174]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[175]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[176]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[177]  P. Ekman.  Pictures of Facial Affect , 1976 .

[178]  Nico H. Frijda,et al.  The understanding of facial expression of emotion. , 1953 .

[179]  Nadia Bianchi-Berthouze,et al.  Stirring up experience through movement in game play: effects on engagement and social behaviour , 2008, CHI.

[180]  J. Russell.  A circumplex model of affect. , 1980 .

[181]  Antonio Camurri,et al.  Interactive Systems Design: A KANSEI based Approach , 2002, NIME.

[182]  Sean Neill,et al.  Body Language for Competent Teachers , 1993 .

[183]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[184]  P. Ekman,et al.  Nonverbal leakage and clues to deception. , 1969, Psychiatry.

[185]  P. Young,et al.  Emotion and personality , 1963 .

[186]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[187]  Michael Lewis,et al.  The Development of affect , 1978 .

[188]  Stefan Kopp,et al.  A Conversational Agent as Museum Guide - Design and Evaluation of a Real-World Application , 2005, IVA.

[189]  Elmar Nöth,et al.  How to find trouble in communication , 2003, Speech Commun..

[190]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..