Affective Information Processing

Affective information processing is intended to give computers the human-like capabilities of observation, interpretation and generation of affect features. It is essential for natural and effective human-computer interaction and has become a very hot research topic. This state-of-the-art volume discusses the latest developments in affective information processing, and summarises the key technologies researched, such as facial expression recognition, face animation, emotional speech synthesis, intelligent agents, and virtual reality. The detailed and accessible coverage includes a wide range of topics, including areas which look to challenge and improve current research. The book is organised into the following themed parts to aid the readers in their understanding of the field: Cognitive Emotion Model, Affect in Speech, Affect in Face and Affect in Multimodal Interaction. Topics and Features: Reports on the state of the art research in affective information processing Summarises key technologies researched during the last few years, such as affective speech processing, affective facial expressions, affective body gesture and movement, affective multi-modal systems, etc. Offers a foundational introductory chapter that grounds readers in core concepts and principles Discusses applications of this technology, such as in education against bullying Provides summarising conclusions throughout Describes affect in multimodal information Looks at cognitive emotion modelling in natural language communication Explores emotion perception and recognition from speech, and based on multimodal information Includes face animation based on large audio-visual database Presents physiological sensing for affective computing Examines evolutionary expression of emotions in virtual humans using lights and pixels Written to provide an opportunity for scientists, engineers and graduate students to explore the difficulties, solutions and technologies in this exciting new area, this ground-breaking book provides a comprehensive overview and significant insight into the field and will prove a valuable reference tool and resource.

[1]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  M. Bartlett,et al.  Machine Analysis of Facial Expressions , 2007 .

[3]  Nicu Sebe,et al.  MULTIMODAL EMOTION RECOGNITION , 2005 .

[4]  Pierre Feyereisen,et al.  Manual Activity During Speaking in Aphasic Subjects , 1983 .

[5]  Andreas Stolcke,et al.  Combining Prosodic Lexical and Cepstral Systems for Deceptive Speech Detection , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[6]  Jörn Ostermann,et al.  Animation of synthetic faces in MPEG-4 , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[7]  Nick Campbell,et al.  On the Use of NonVerbal Speech Sounds in Human Communication , 2007, COST 2102 Workshop.

[8]  Ursula Hess,et al.  The cues decoders use in attempting to differentiate emotion-elicited and posed facial expressions , 1994 .

[9]  Tsutomu Miyasato,et al.  Multimodal human emotion/expression recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  Jeffrey F. Cohn,et al.  Foundations of human computing: facial expression and emotion , 2006, ICMI '06.

[11]  D. Matsumoto,et al.  American-Japanese cultural differences in attributions of personality based on smiles , 1993 .

[12]  Qiang Ji,et al.  Automatic Eye Detection and Its Validation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[13]  Reginald B. Adams,et al.  Facial appearance, gender, and emotion expression. , 2004, Emotion.

[14]  L. Rubin.  The Mechanism of Human Facial Expression , 1992 .

[15]  Deb Roy,et al.  Grounded Situation Models for Robots: Where words and percepts meet , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[17]  Radoslaw Niewiadomski,et al.  Intelligent Expressions of Emotions , 2005, ACII.

[18]  Sarah Sandow.  The Good King Dagobert, or Clever, Stupid, Nice, Nasty , 1997 .

[19]  C. Elliott.  The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[20]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[21]  Yuxiao Hu,et al.  Training combination strategy of multi-stream fused hidden Markov model for audio-visual affect recognition , 2006, MM '06.

[22]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Maja Pantic,et al.  Facial Action Unit Detection using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Michael Kipp,et al.  Creativity Meets Automation: Combining Nonverbal Action Authoring with Rules and Machine Learning , 2006, IVA.

[25]  C. Goodwin.  Action and embodiment within situated human interaction , 2000 .

[26]  Anna Esposito,et al.  Disfluencies in gesture: Gestural correlates to filled and unfilled speech pauses , 2001 .

[27]  C. E. Izard,et al.  Emotion communication skills in young, middle-aged, and older women. , 1987, Psychology and aging.

[28]  Andrea Kleinsmith,et al.  Recognizing Affective Dimensions from Body Posture , 2007, ACII.

[29]  Hatice Gunes,et al.  A Bimodal Face and Body Gesture Database for Automatic Analysis of Human Nonverbal Affective Behavior , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[30]  Fabio Pianesi,et al.  Recognising emotions in human and synthetic faces: the role of the upper and lower parts of the face , 2005, IUI.

[31]  Alexander Kain,et al.  High-resolution voice transformation , 2001 .

[32]  Batja Mesquita,et al.  Emotions as dynamic cultural phenomena , 2003 .

[33]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[34]  K. Oatley,et al.  Understanding emotions, 2nd ed. , 2006 .

[35]  Aggelos K. Katsaggelos,et al.  Automatic facial expression recognition using facial animation parameters and multistream HMMs , 2006, IEEE Transactions on Information Forensics and Security.

[36]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[38]  Zdravko Kacic,et al.  Context-Independent Multilingual Emotion Recognition from Speech Signals , 2003, Int. J. Speech Technol..

[39]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[40]  Loïc Kessous,et al.  Modeling Naturalistic Affective States Via Facial, Vocal, and Bodily Expressions Recognition , 2007, Artifical Intelligence for Human Computing.

[41]  Radoslaw Niewiadomski,et al.  Perception of Blended Emotions: From Video Corpus to Expressive Agent , 2006, IVA.

[42]  P. Ekman,et al.  Head and body cues in the judgment of emotion: a reformulation. , 1967, Perceptual and motor skills.

[43]  Marc Schröder,et al.  XML representation languages as a way of interconnecting TTS modules , 2004, INTERSPEECH.

[44]  U. Hess,et al.  The Influence of Facial Emotion Displays, Gender, and Ethnicity on Judgments of Dominance and Affiliation , 2000 .

[45]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[46]  K Gouta,et al.  [Emotion recognition: facial components associated with various emotions]. , 2000, Shinrigaku kenkyu : The Japanese journal of psychology.

[47]  P. Ekman,et al.  Not all smiles are created equal: the differences between enjoyment and nonenjoyment smiles , 1993 .

[49]  S. Kollias,et al.  Synthesizing Gesture Expressivity Based on Real Sequences , 2006 .

[50]  Uffe Kjærulff,et al.  dHugin: a computational system for dynamic time-sliced Bayesian networks , 1995 .

[51]  Roland Göcke,et al.  EREC-II in Use - Studies on Usability and Suitability of a Sensor System for Affect Detection and Human Performance Monitoring , 2007, HCI.

[52]  John T. Cacioppo,et al.  Microexpressive Facial Actions as a Function of Affective Stimuli: Replication and Extension , 1992 .

[53]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[54]  C. Pelachaud,et al.  GRETA. A BELIEVABLE EMBODIED CONVERSATIONAL AGENT , 2005 .

[55]  Ralf Kompe,et al.  Emotional space improves emotion recognition , 2002, INTERSPEECH.

[56]  D. Massaro,et al.  Perceiving Talking Faces , 1995 .

[57]  Keikichi Hirose,et al.  Analysis of voice fundamental frequency contours for declarative sentences of Japanese , 1984 .

[58]  J. Kaswan,et al.  Perception of contradictory meanings conveyed by verbal and nonverbal channels. , 1970, Journal of personality and social psychology.

[59]  P. Ekman.  Unmasking The Face , 1975 .

[60]  Jens Allwood,et al.  The structure of dialog , 1999 .

[61]  Bernard Rimé,et al.  Fundamentals of nonverbal behavior , 1991 .

[62]  Haibo Wang,et al.  Friendly speech analysis and perception in standard Chinese , 2004, INTERSPEECH.

[63]  Tsuhan Chen,et al.  Audio-visual integration in multimodal communication , 1998, Proc. IEEE.

[64]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[65]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[66]  Elmar Nöth,et al.  How to find trouble in communication , 2003, Speech Commun..

[67]  J. Russell,et al.  Facial and vocal expressions of emotion. , 2003, Annual review of psychology.

[68]  Anna Esposito,et al.  The Amount of Information on Emotional States Conveyed by the Verbal and Nonverbal Channels: Some Perceptual Data , 2005, WNSP.

[69]  Roddy Cowie,et al.  Multimodal databases of everyday emotion: facing up to complexity , 2005, INTERSPEECH.

[70]  Hong Yan,et al.  Modelling and combining emotions, visual speech and gestures in virtual head models , 2006, Signal Process. Image Commun..

[71]  Thomas Rist,et al.  A Review of the Development of Embodied Presentation Agents and Their Application Fields , 2004, Life-like characters.

[72]  Roddy Cowie,et al.  Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches , 2006, LREC.

[73]  Anna Esposito.  The Importance of Data for Training Intelligent Devices , 2002 .

[74]  Matthew R. Lewis,et al.  Aesthetic Evolutionary Design with Data Flow Networks , 2000 .

[75]  Andrew Sears,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2002, CHI 2002.

[76]  P. Ekman,et al.  The symmetry of emotional and deliberate facial actions. , 1981, Psychophysiology.

[77]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[78]  M. Heller,et al.  Depression and Suicide Faces , 2005 .

[79]  Wei Zhang,et al.  A Hybrid GMM and Codebook Mapping Method for Spectral Conversion , 2005, ACII.

[80]  K. Burns,et al.  Significance of vocal and visual channels in the decoding of emotional meaning. , 1973, The Journal of communication.

[81]  David A. van Leeuwen,et al.  Automatic discrimination between laughter and speech , 2007, Speech Commun..

[82]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[83]  S. Kaiser,et al.  Facial expressions as indicators of appraisal processes. , 2001 .

[84]  K. Scherer,et al.  Vocal cues in emotion encoding and decoding , 1991 .

[85]  Yuan Qi,et al.  Fully automatic upper facial action recognition , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[86]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  K. Scherer,et al.  Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures , 2001 .

[88]  Amanda C.C. Williams,et al.  Facial expression of pain: An evolutionary account , 2002, Behavioral and Brain Sciences.

[89]  Beate Meffert,et al.  Towards Real Life Applications in Emotion Recognition: Comparing Different Databases, Feature Sets, and Reinforcement Methods for Recognizing Emotions from Speech , 2004, ADS.

[90]  David J. Spiegelhalter,et al.  Sequential updating of conditional probabilities on directed graphical structures , 1990, Networks.

[91]  R. Frick.  Communicating emotion: The role of prosodic features. , 1985 .

[92]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[93]  Mary McGee Wood,et al.  A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue , 2004, ADS.

[94]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[95]  F. Deutsch,et al.  What is in a Smile? , 1987 .

[96]  H. Schlosberg.  Three dimensions of emotion. , 1954, Psychological review.

[97]  P. Ekman,et al.  The nature of emotion: Fundamental questions. , 1994 .

[98]  David Traum,et al.  Computational Models of Grounding in Collaborative Systems , 1999 .

[99]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[100]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[101]  Yuxiao Hu,et al.  Audio-Visual Spontaneous Emotion Recognition , 2007, Artifical Intelligence for Human Computing.

[102]  Björn W. Schuller,et al.  Meta-classifiers in acoustic and linguistic feature fusion-based affect recognition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[103]  Jennifer S. Beer,et al.  Facial expression of emotion. , 2003 .

[104]  Chung-Lin Huang,et al.  Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification , 1997, J. Vis. Commun. Image Represent..

[105]  Reginald B. Adams,et al.  Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger , 2005 .

[106]  Stephen Todd,et al.  Evolutionary Art and Computers , 1992 .

[107]  Maja Pantic,et al.  Facial action recognition in face profile image sequences , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[108]  Radoslaw Niewiadomski,et al.  Multimodal Complex Emotions: Gesture Expressivity and Blended Facial Expressions , 2006, Int. J. Humanoid Robotics.

[109]  Hillary Anger Elfenbein,et al.  When familiarity breeds accuracy: cultural exposure and facial emotion recognition. , 2003, Journal of personality and social psychology.

[110]  Marian Stewart Bartlett,et al.  Computer Recognition of Facial Actions: A study of co-articulation effects , 2001 .

[111]  Rachel Karniol,et al.  Reading People's Minds: A Transformation Rule Model for Predicting Other's Thoughts and Feelings , 1990 .

[112]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[113]  Arvid Kappas,et al.  An analysis of the encoding and decoding of spontaneous and posed smiles: The use of facial electromyography , 1988 .

[114]  M A Bayes,et al.  Behavioral cues of interpersonal warmth. , 1972, Journal of consulting and clinical psychology.

[115]  Narendra Ahuja,et al.  A SNoW-Based Face Detector , 1999, NIPS.

[116]  Pattie Maes,et al.  Agents with Faces: The Effects of Personification of Agents , 1996 .

[117]  Reginald B. Adams,et al.  Why Do Fear and Anger Look the Way They Do? Form and Social Function in Facial Expressions , 2005, Personality & social psychology bulletin.

[118]  Lei Xie,et al.  Speech Animation Using Coupled Hidden Markov Models , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[119]  A. Fischer.  Sex Differences in Emotionality: Fact or Stereotype? , 1993 .

[120]  G. Beattie.  Language and Nonverbal Communication, the Essential Synthesis? , 1981 .

[121]  R Stibbard.  Vocal expressions of emotions in non-laboratory speech : an investigation of the Reading/Leeds Emotion in Speech Project annotation data. , 2001 .

[122]  Cynthia Whissell,et al.  THE DICTIONARY OF AFFECT IN LANGUAGE , 1989 .

[123]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..

[124]  D avid M atsumoto,et al.  American ± Japanese Cultural Differences in Judgements of Expression Intensity and Subjective Experience , 2001 .

[125]  Chalapathy Neti,et al.  Animating expressive faces across languages , 2004, IEEE Transactions on Multimedia.

[126]  C. E. Izard.  Organizational and motivational functions of discrete emotions. , 1993 .

[127]  David R. Traum,et al.  Cooperation, dialogue and ethics , 2000, Int. J. Hum. Comput. Stud..

[128]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[129]  Kevin B. Korb,et al.  Bayesian Artificial Intelligence , 2004, Computer science and data analysis series.

[130]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[131]  Roddy Cowie,et al.  Emotional speech: Towards a new generation of databases , 2003, Speech Commun..

[132]  J. Panksepp.  At the interface of the affective, behavioral, and cognitive neurosciences: Decoding the emotional feelings of the brain , 2003, Brain and Cognition.

[133]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[134]  Ana Paiva,et al.  A Story About Gesticulation Expression , 2006, IVA.

[135]  Roddy Cowie,et al.  Automatic recognition of emotion from voice: a rough benchmark , 2000 .

[136]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[137]  Gerald Millerson.  Lighting for television and film , 1999 .

[138]  A. Esposito,et al.  Speech driven facial animation , 2001, PUI '01.

[139]  L. Cosmides.  Invariances in the acoustic expression of emotion during speech. , 1983, Journal of experimental psychology. Human perception and performance.

[140]  L. Rothkrantz,et al.  Toward an affect-sensitive multimodal human-computer interaction , 2003, Proc. IEEE.

[141]  Kristiina Jokinen,et al.  User expectations and real experience on a multimodal interactive system , 2006, INTERSPEECH.

[142]  P. Ekman.  The argument and evidence about universals in facial expressions of emotion. , 1989 .

[143]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[144]  M. T. Motley,et al.  Facial expression of emotion: A comparison of posed expressions versus spontaneous expressions in an interpersonal communication setting , 1988 .

[145]  Sebastien St-Laurent.  Shaders for Game Programmers and Artists , 2004 .

[146]  R. Levenson.  Autonomic Nervous System Differences among Emotions , 1992 .

[147]  Don H. Johnson,et al.  Toward a theory of information processing , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[148]  H. Reis,et al.  What is smiling is beautiful and good , 1990 .

[149]  Yihsiu Chen,et al.  Language and Gesture: Lexical gestures and lexical access: a process model , 2000 .

[150]  Keiichi Tokuda,et al.  Spectral conversion based on maximum likelihood estimation considering global variance of converted parameter , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[151]  Elisabeth André,et al.  Catch me if you can: exploring lying agents in social settings , 2005, AAMAS '05.

[152]  Maja Pantic,et al.  Spontaneous vs. posed facial behavior: automatic analysis of brow actions , 2006, ICMI '06.

[153]  Justine Cassell,et al.  Shared reality: spatial intelligence in intuitive user interfaces , 2002, IUI '02.

[154]  Massimo Piccardi,et al.  Fusing Face and Body Display for Bi-modal Emotion Recognition: Single Frame Analysis and Multi-frame Post Integration , 2005, ACII.

[155]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[156]  M.F.B. Wiggers,et al.  Emotion recognition in children and adults , 1984 .

[157]  Kristiina Jokinen.  Learning Dialogue Systems , 2000 .

[158]  Jonas Beskow,et al.  Picture my voice: Audio to visual speech synthesis using artificial neural networks , 1999, AVSP.

[159]  Kostas Karpouzis,et al.  Manual annotation and automatic image processing of multimodal emotional behaviors: validating the annotation of TV interviews , 2007, Personal and Ubiquitous Computing.

[160]  Qiang Ji,et al.  Facial event classification with task oriented dynamic Bayesian network , 2004, CVPR 2004.

[161]  M L Phillips,et al.  An investigation into the perception of dominance from schematic faces: A study using the World-Wide Web , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[162]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[163]  Fabio Gagliardi Cozman,et al.  Semi-supervised Learning of Classifiers : Theory , Algorithms and Their Application to Human-Computer Interaction , 2004 .

[164]  Mark C. Coulson.  Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[165]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[166]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[167]  Von-Wun Soo,et al.  Feeling Ambivalent: A Model of Mixed Emotions for Virtual Agents , 2006, IVA.

[168]  C. Izard.  Basic emotions, relations among emotions, and emotion-cognition relations. , 1992, Psychological review.

[169]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[170]  R. Plutchik.  Emotions as adaptive reactions: implications for therapy. , 1966, Psychoanalytic review.

[171]  J. Russell.  A circumplex model of affect. , 1980 .

[172]  Chung-Hsien Wu,et al.  Emotion recognition from textual input using an emotional semantic network , 2002, INTERSPEECH.

[173]  N. Ambady,et al.  On judging and being judged accurately in zero-acquaintance situations. , 1995 .

[174]  Chilin Shih,et al.  Stem-ML: language-independent prosody description , 2000, INTERSPEECH.

[175]  Noam Amir,et al.  Classifying emotions in speech: a comparison of methods , 2001, INTERSPEECH.

[176]  Valery A. Petrushin,et al.  Emotion recognition in speech signal: experimental study, development, and application , 2000, INTERSPEECH.

[177]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[178]  J. Cacioppo,et al.  Handbook of psychophysiology (2nd ed.). , 2000 .

[179]  W. Sendlmeier,et al.  Verification of acoustical correlates of emotional speech using formant-synthesis , 2000 .

[180]  Donald W. Fiske,et al.  Face-to-face interaction: Research, methods, and theory , 1977 .

[181]  Nikolaos G. Bourbakis,et al.  Analysis of Invariant Meta-features for Learning and Understanding Disable People's Emotional Behavior Related to Their Health Conditions: A Case Study , 2006, Sixth IEEE Symposium on BioInformatics and BioEngineering (BIBE'06).

[182]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[183]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[184]  Patrick Doyle,et al.  When is a Communicative Agent a Good Idea , 1999 .

[185]  Takeo Kanade,et al.  Detection, tracking, and classification of action units in facial expression , 2000, Robotics Auton. Syst..

[186]  Juley Anna Fulcher.  Vocal affect expression as an indicator of affective response , 1991 .

[187]  Yukiko I. Nakano,et al.  Non-Verbal Cues for Discourse Structure , 2022 .

[188]  Gerasimos Potamianos,et al.  Audio-visual unit selection for the synthesis of photo-realistic talking-heads , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[189]  Ashish Kapoor,et al.  Multimodal affect recognition in learning environments , 2005, ACM Multimedia.

[190]  Masanobu Abe,et al.  Voice conversion algorithm based on piecewise linear conversion rules of formant frequency and spectrum tilt , 1995, Speech Commun..

[191]  Maurizio Mancini,et al.  Formational parameters and adaptive prototype instantiation for MPEG-4 compliant gesture synthesis , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[192]  Costanza Navarretta,et al.  The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena , 2007, Lang. Resour. Evaluation.

[193]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[194]  Paolo Bonato,et al.  Faces of emotion in human-computer interaction , 2005, CHI Extended Abstracts.

[195]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[196]  Rosalind W. Picard.  The Galvactivator: A glove that senses and communicates skin conductivity , 2001 .

[197]  Ling Guan,et al.  Recognizing human emotion from audiovisual information , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[198]  Jing Xiao,et al.  Robust full‐motion recovery of head by dynamic templates and re‐registration techniques , 2003 .

[199]  Peter F. Driessen,et al.  Gesture-Based Affective Computing on Motion Capture Data , 2005, ACII.

[200]  N. Frijda.  Moods, emotion episodes, and emotions. , 1993 .

[201]  Jean-Claude Martin,et al.  Annotation of Emotions in Real-Life Video Interviews: Variability between Coders , 2006, LREC.

[202]  D. McNeill.  Gesture and Thought , 2005 .

[203]  P. Ekman.  Emotions revealed , 2004, BMJ.

[204]  David Matsumoto,et al.  American-Japanese Differences in Multiscalar Intensity Ratings of Universal Facial Expressions of Emotion , 1998 .

[205]  S. Lau.  The Effect of Smiling on Person Perception , 1982 .

[206]  Takeo Kanade,et al.  Evaluation of Gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[207]  Jean-Claude Martin,et al.  Representing Real-Life Emotions in Audiovisual Data with Non Basic Emotional Patterns and Context Features , 2005, ACII.

[208]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[209]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[210]  Harry Shum,et al.  Learning dynamic audio-visual mapping with input-output Hidden Markov models , 2006, IEEE Trans. Multim..

[211]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[212]  C. Izard.  Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[213]  P. Ekman.  Facial expressions of emotion: an old controversy and new findings. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[214]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[215]  Julia Hirschberg,et al.  A Framework for Eliciting Emotional Speech: Capitalizing on the Actor’s Process , 2006 .

[216]  K. Scherer,et al.  Experiencing emotion : a cross-cultural study , 1986 .

[217]  P. Gallaher.  Individual differences in nonverbal behavior: Dimensions of style. , 1992 .

[218]  Stacy Marsella,et al.  Nonverbal Behavior Generator for Embodied Conversational Agents , 2006, IVA.

[219]  Anna Esposito,et al.  Automatic Hand Hold Detection in Natural Conversation , 2001 .

[220]  A. Damasio,et al.  Subcortical and cortical brain activity during the feeling of self-generated emotions , 2000, Nature Neuroscience.

[221]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[222]  P. Ekman.  An argument for basic emotions , 1992 .

[223]  Shigeo Morishima,et al.  Face analysis and synthesis , 2001, IEEE Signal Process. Mag..

[224]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[225]  J. Newlove.  Laban for Actors and Dancers , 1993 .

[226]  J. Aronoff,et al.  The recognition of threatening facial stimuli. , 1988, Journal of personality and social psychology.

[227]  Qiang Ji,et al.  A probabilistic framework for modeling and real-time monitoring human fatigue , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[228]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[229]  Dehui Kong,et al.  Audio to visual signal mappings with HMM , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[230]  Mark S. Schwartz,et al.  Biofeedback: A Practitioner's Guide , 1987 .

[231]  P. Ekman.  Pictures of Facial Affect , 1976 .

[232]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..

[233]  Emily Q. Wang,et al.  Pitch targets and their realization: Evidence from Mandarin Chinese , 2001, Speech Commun..

[234]  Dik J. Hermes,et al.  Expression of emotion and attitude through temporal speech variations , 2000, INTERSPEECH.

[235]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[236]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[237]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[238]  Christian Peter,et al.  Emotion representation and physiology assignments in digital systems , 2006, Interact. Comput..

[239]  Adam Banks,et al.  Designer's Color Manual: The Complete Guide to Color Theory and Application , 2004 .

[240]  F. Machado.  Inteligência artificial e arte , 2007 .

[241]  Stefan Kopp,et al.  Content in Context: Generating Language and Iconic Gestures without a Gestionary , 2004 .

[242]  Eric Moulines,et al.  Continuous probabilistic transform for voice conversion , 1998, IEEE Trans. Speech Audio Process..

[243]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[244]  Stéphanie Buisine,et al.  Conception et évaluation d'agents conversationnels multimodaux bidirectionnels , 2005 .

[245]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[246]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[247]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[248]  Giorgio Metta,et al.  Design of the robot-cub (iCub) head , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[249]  Daniel J. Bauer,et al.  The functions of freezing in the social interactions of juvenile high- and low-aggressive mice , 2001 .

[250]  J. Cunningham,et al.  Children's decoding of emotion in expressive body movement: the development of cue attunement. , 1998, Developmental psychology.

[251]  M. Argyle.  Bodily communication, 2nd ed. , 1988 .

[252]  P. Ekman.  Expression and the Nature of Emotion , 1984 .

[253]  Catherine Pelachaud,et al.  Gesture Expressivity Modulations in an ECA Application , 2006, IVA.

[254]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[255]  T. Dalgleish.  Basic Emotions , 2004 .

[256]  Nicolai Petkov,et al.  ECVP '04 Abstracts , 2004 .

[257]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[258]  M. Bradley,et al.  Startle reflex modification: emotion or attention? , 1990, Psychophysiology.

[259]  Elizabeth A. Crane,et al.  Motion Capture and Emotion: Affect Detection in Whole Body Movement , 2007, ACII.

[260]  Christian D. Schunn,et al.  Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction , 2002, Proc. IEEE.

[261]  Harry Shum,et al.  Speech-driven cartoon animation with emotions , 2001, MULTIMEDIA '01.

[262]  Christian Peter,et al.  Application of emotion recognition methods in automotive research , 2007 .

[263]  Maja Pantic,et al.  Gaze-X: adaptive affective multimodal interface for single-user office scenarios , 2006, ICMI '06.

[264]  Ricardo Gutierrez-Osuna,et al.  Audio/visual mapping with cross-modal hidden Markov models , 2005, IEEE Transactions on Multimedia.

[265]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[266]  Yoshihisa Ishida,et al.  Transformation of spectral envelope for voice conversion based on radial basis function networks , 2002, INTERSPEECH.

[267]  Costanza Navarretta,et al.  Distinguishing the communicative functions of gestures An experiment with annotated gesture data , 2008 .

[268]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[269]  Hatice Gunes,et al.  Affect recognition from face and body: early fusion vs. late fusion , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[270]  K. Scherer,et al.  Vocal expression and communication of emotion. , 1993 .

[271]  Kris Malkiewicz,et al.  Cinematography, a guide for film makers and film teachers , 1973 .

[272]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[273]  Michael I. Jordan,et al.  Mixed Memory Markov Models: Decomposing Complex Stochastic Processes as Mixtures of Simpler Ones , 1999, Machine Learning.

[274]  Anna Esposito.  COST 2102: Cross-Modal Analysis of Verbal and Nonverbal Communication (CAVeNC) , 2007, COST 2102 Workshop.

[275]  Abigail A Marsh,et al.  Nonverbal “Accents” , 2003, Psychological science.

[276]  Michiel Wiggers,et al.  Judgments of facial expressions of emotion predicted from facial behavior , 1982 .

[277]  Maja Pantic,et al.  Case-based reasoning for user-profiled recognition of emotions from face images , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[278]  Susan Goldin.  Hearing gesture : how our hands help us think , 2003 .

[279]  M. V. Lamar,et al.  Recognizing facial actions using Gabor wavelets with neutral face average difference , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[280]  P. Laukka,et al.  A dimensional approach to vocal expression of emotion , 2005 .

[281]  Erhard Rank,et al.  Generating emotional speech with a concatenative synthesizer , 1998, ICSLP.

[282]  Ana Paiva,et al.  Multimodal expression in virtual humans , 2006, Comput. Animat. Virtual Worlds.

[283]  Glenn I. Roisman,et al.  The emotional integration of childhood experience: physiological, facial expressive, and self-reported emotional response during the adult attachment interview. , 2004, Developmental psychology.

[284]  K. Scherer.  Vocal correlates of emotional arousal and affective disturbance. , 1989 .

[285]  S. Sussman,et al.  You're Only as Pretty as You Feel: Facial Expression as a Determinant of Physical Attractiveness , 1984 .

[286]  Brian Butterworth,et al.  Gesture and Silence as Indicators of Planning in Speech , 1978 .

[287]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[288]  Ricardo Gutierrez-Osuna,et al.  A comparison of acoustic coding models for speech-driven facial animation , 2006, Speech Commun..

[289]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[290]  Nikolaos G. Bourbakis,et al.  Multi-modal Interfaces for Interaction-Communication between Hearing and Visually Impaired Individuals: Problems and Issues , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[291]  Maja Pantic,et al.  Audiovisual discrimination between laughter and speech , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[292]  I. Kant,et al.  Critique of judgment , 2000 .

[293]  A. Philip McMahon,et al.  The Principles of Art , 1939 .

[294]  Zhiwei Zhu,et al.  Toward a decision-theoretic framework for affect recognition and user assistance , 2006, Int. J. Hum. Comput. Stud..

[295]  M. D. Meijer.  The contribution of general features of body movement to the attribution of emotions , 1989 .

[296]  Michael A. Arbib,et al.  The Evolving Mirror System: A Neural Basis for Language Readiness , 2003 .

[297]  Thomas S. Huang,et al.  Audio-visual affective expression recognition , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[298]  Thomas S. Huang,et al.  Explanation-based facial motion tracking using a piecewise Bezier volume deformation model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[299]  Maja Pantic,et al.  Particle filtering with factorized likelihoods for tracking facial features , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[300]  Andrea Kleinsmith,et al.  Grounding Affective Dimensions into Posture Features , 2005, ACII.

[301]  John M. Gottman,et al.  Nonverbal communication coding systems of committed couples. , 2005 .

[302]  Roddy Cowie,et al.  FEELTRACE: an instrument for recording perceived emotion in real time , 2000 .

[303]  G. Thornton,et al.  The Effect Upon Judgments of Personality Traits of Varying a Single Factor in a Photograph , 1943 .

[304]  Thomas S. Huang,et al.  Real-time speech-driven face animation with expressions using neural networks , 2002, IEEE Trans. Neural Networks.

[305]  Andrea Kleinsmith,et al.  Towards Unsupervised Detection of Affective Body Posture Nuances , 2005, ACII.

[306]  Chun Chen,et al.  Audio-visual based emotion recognition - a new approach , 2004, CVPR 2004.

[307]  Kostas Karpouzis,et al.  Emotion Analysis in Man-Machine Interaction Systems , 2004, MLMI.

[308]  Christine L. Lisetti,et al.  MAUI: a multimodal affective user interface , 2002, MULTIMEDIA '02.

[309]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[310]  J. E. Rose,et al.  Autonomic Nervous System Activity Distinguishes Among Emotions , 2009 .

[311]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[312]  Constantine Kotropoulos,et al.  Emotional speech recognition: Resources, features, and methods , 2006, Speech Commun..

[313]  Iain R. Murray,et al.  Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. , 1993, The Journal of the Acoustical Society of America.

[314]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[315]  K. Scherer,et al.  Cue utilization in emotion attribution from auditory stimuli , 1977 .

[316]  David Clarke,et al.  A general hardware platform for sensor validation , 1999 .

[317]  J. N. Bassili.  Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[318]  B. Stein,et al.  The Merging of the Senses , 1993 .

[319]  S. Garrod,et al.  Conversation, co-ordination and convention: an empirical investigation of how groups establish linguistic conventions , 1994, Cognition.

[320]  C. Keating,et al.  Human Dominance Signals: The Primate in Us , 1985 .

[321]  C. Darwin.  The Expression of Emotion in Man and Animals , 2020 .

[322]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[323]  Anna Esposito,et al.  Holds as gestural correlates to empty and filled speech pauses , 2002, INTERSPEECH.

[324]  I. Daum,et al.  The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample , 2001 .

[325]  Satoshi Nakamura,et al.  Lip movement synthesis from speech based on hidden Markov models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[326]  Aleksandar Milenkovic,et al.  Journal of Neuroengineering and Rehabilitation Open Access a Wireless Body Area Network of Intelligent Motion Sensors for Computer Assisted Physical Rehabilitation , 2005 .

[327]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[328]  Li Aijun,et al.  CHINESE PROSODY AND PROSODIC LABELING OF SPONTANEOUS SPEECH , 2002 .

[329]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[330]  Karl Sims,et al.  Artificial evolution for computer graphics , 1991, SIGGRAPH.

[331]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[332]  Zhihong Zeng,et al.  Audio-visual affect recognition through multi-stream fused HMM for HCI , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[333]  I. Poggi.  MIND MARKERS , 2003 .

[334]  U. Hess,et al.  Who to whom and why--Cultural differences and similarities in the function of smiles. , 2002 .

[335]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[336]  Hans-Peter Seidel,et al.  Geometry-based Muscle Modeling for Facial Animation , 2001, Graphics Interface.

[337]  Hatice Gunes,et al.  How to distinguish posed from spontaneous smiles using geometric features , 2007, ICMI '07.

[338]  S. M. Ali,et al.  A General Class of Coefficients of Divergence of One Distribution from Another , 1966 .

[339]  Christoph Bartneck,et al.  Affective expressions of machines , 2001, CHI Extended Abstracts.

[340]  Tony Ezzat,et al.  MikeTalk: a talking facial display based on morphing visemes , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[341]  Shrikanth S. Narayanan,et al.  Toward detecting emotions in spoken dialogs , 2005, IEEE Transactions on Speech and Audio Processing.

[342]  H. Wallbott.  Bodily expression of emotion , 1998 .

[343]  Loïc Kessous,et al.  Modeling naturalistic affective states via facial and vocal expressions recognition , 2006, ICMI '06.

[344]  Tomaso Poggio,et al.  Trainable Videorealistic Speech Animation , 2004, FGR.

[345]  J. Singer,et al.  Cardiovascular Differentiation of Happiness, Sadness, Anger, and Fear Following Imagery and Exercise1 , 1981, Psychosomatic medicine.

[346]  R. Barry Ruback.  Perceived Honesty in the Parole Interview , 1981 .

[347]  W. Davis,et al.  What Is Art For , 1990 .

[348]  J. Mccroskey,et al.  Nonverbal Behavior in Interpersonal Relations , 1987 .

[349]  Ananth N. Iyer,et al.  Emotion Detection From Infant Facial Expressions And Cries , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[350]  Gerhard Rigoll,et al.  Bimodal fusion of emotional data in an automotive environment , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[351]  C. D. Hoffman,et al.  The eye of the very young beholder: sex typing of infants by young children. , 1980, Child development.

[352]  Ricardo Gutierrez-Osuna,et al.  Speech-driven facial animation with realistic dynamics , 2005, IEEE Transactions on Multimedia.

[353]  Lawrence S. Chen,et al.  Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction , 2000 .

[354]  Manus P. Henry.  Recent developments in self-validating (SEVA) sensors , 2001 .

[355]  B. Knutson.  Facial expressions of emotion influence interpersonal trait inferences , 1996 .

[356]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[357]  W. Apple,et al.  Speaking emotionally: The relation between verbal and vocal communication of affect. , 1982 .

[358]  Ailbhe Ní Chasaide,et al.  The role of voice quality in communicating emotion, mood and attitude , 2003, Speech Commun..

[359]  Catherine Pelachaud,et al.  Subtleties of facial expressions in embodied agents , 2002, Comput. Animat. Virtual Worlds.

[360]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[361]  J. Bachorowski.  Vocal Expression and Perception of Emotion , 1999 .

[362]  Jing Xiao,et al.  Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[363]  Jia Liu,et al.  Voice conversion with smoothed GMM and MAP adaptation , 2003, INTERSPEECH.

[364]  J. Messina,et al.  Affect, personality, and facial expressive characteristics of older people. , 1987, Psychology and aging.

[365]  Diane J. Litman,et al.  Predicting Student Emotions in Computer-Human Tutoring Dialogues , 2004, ACL.

[366]  Catherine Pelachaud,et al.  Multimodal expressive embodied conversational agents , 2005, ACM Multimedia.

[367]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, CVPR Workshops.

[368]  Inma Hernáez,et al.  An objective and subjective study of the role of semantics and prosodic features in building corpora for emotional TTS , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[369]  A. Bruce.  Emotional Expression , 1883, The American Naturalist.

[370]  Roddy Cowie,et al.  Beyond emotion archetypes: Databases for emotion modelling using neural networks , 2005, Neural Networks.

[371]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[372]  M. Friend.  Developmental changes in sensitivity to vocal paralanguage. , 2000, Developmental science.

[373]  Alex Pentland,et al.  Human computing and machine understanding of human behavior: a survey , 2006, ICMI '06.

[374]  Yasuhiro Katagiri,et al.  Interactional Alignment in Collaborative Problem Solving Dialogues , 2005 .

[375]  Jianhua Tao.  Emotion control of Chinese speech synthesis in natural environment , 2003, INTERSPEECH.

[376]  Christine L. Lisetti,et al.  Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals , 2004, EURASIP J. Adv. Signal Process..

[377]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[378]  Mel Slater,et al.  Building Expression into Virtual Characters , 2006, Eurographics.

[379]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[380]  Tomoko Koda,et al.  Agents with faces : a study on the effects of personification of software agents , 1996 .

[381]  Nicu Sebe,et al.  Emotion Recognition Based on Joint Visual and Audio Cues , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[382]  U. Hess,et al.  Differentiating emotion elicited and deliberate emotional facial expressions , 1990 .

[383]  Hugh McGinley,et al.  Smiling, body position, and interpersonal attraction , 1978 .

[384]  J Langer,et al.  A study of postural-gestural communication. , 1965, Journal of personality and social psychology.

[385]  Stephen E. Levinson,et al.  A fused hidden Markov model with application to bimodal speech processing , 2004, IEEE Transactions on Signal Processing.

[386]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[387]  Alex Pentland.  Socially Aware Computation and Communication , 2005, Computer.

[388]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[389]  Catherine Pelachaud,et al.  Computational Model of Believable Conversational Agents , 2003, Communication in Multiagent Systems.

[390]  C. Geertz,et al.  Art as a Cultural System , 1976 .

[391]  P. Ekman.  Emotion in the human face , 1982 .

[392]  Zixiang Wang,et al.  A novel voice conversion system based on codebook mapping with phoneme-tied weighting , 2004, INTERSPEECH.

[393]  R. Gallager.  Information Theory and Reliable Communication , 1968 .

[394]  Reginald B. Adams,et al.  When Two Do the Same, It Might Not Mean the Same: The Perception of Emotional Expressions Shown by Men and Women. , 2007 .

[395]  K. Scherer,et al.  Cues and channels in emotion recognition. , 1986 .

[396]  J. Stainer,et al.  The Emotions , 1922, Nature.

[397]  Jean-Claude Martin,et al.  Annotating Multimodal Behaviors Occurring During Non Basic Emotions , 2005, ACII.

[398]  Jenq-Neng Hwang,et al.  Robust speech recognition based on joint model and feature space optimization of hidden Markov models , 1997, IEEE Trans. Neural Networks.

[399]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[400]  J. Graham,et al.  A Cross-cultural Study of the Communication of Emotion by Facial and Gestural Cues. , 1975 .

[401]  R. Plutchik.  A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[402]  Lan Li,et al.  Emotion Recognition Using Physiological Signals from Multiple Subjects , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[403]  Ginevra Castellano,et al.  Recognising Human Emotions from Body Movement and Gesture Dynamics , 2007, ACII.

[404]  Jianhua Tao,et al.  Dynamic Mapping Method Based Speech Driven Face Animation System , 2005, ACII.

[405]  E. Meer,et al.  Emotion Studies in HCI – a New Approach , 2005 .

[406]  Marianne LaFrance,et al.  Why Smiles Generate Leniency , 1995 .

[407]  Tsuhan Chen,et al.  Audio-to-visual conversion for multimedia communication , 1998, IEEE Trans. Ind. Electron..

[408]  Zhihong Zeng,et al.  Audio-Visual Affect Recognition , 2007, IEEE Transactions on Multimedia.

[409]  W. Joseph King.  Human-Computer Dyads ? A Survey of Nonverbal Behavior in Human-Computer Systems , 2007 .

[410]  Dae-Jong Lee,et al.  Emotion recognition from the facial image and speech signal , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[411]  Pierre Philippot,et al.  Emotional expressivity in men and women: Stereotypes and self-perceptions , 2000 .

[412]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[413]  Thomas Wehrle,et al.  4. Facial expressions in social interactions: Beyond basic emotions , 2008 .

[414]  Pierre Philippot,et al.  Social competence and nonverbal behavior. , 1991 .

[415]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[416]  M. Swerts,et al.  Audiovisual prosody and feeling of knowing , 2005 .

[417]  Zdravko Kacic,et al.  A rule-based emotion-dependent feature extraction method for emotion analysis from speech. , 2006, The Journal of the Acoustical Society of America.

[418]  Tien-Tsin Wong,et al.  A real-time Cantonese text-to-audiovisual speech synthesizer , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.