Emotion in human-computer interaction

Understanding Emotion . . . . . . . . . . . . . . . . . . . . . . . . . . 54 Distinguishing Emotion from Related Constructs . . . . 55 Mood . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Sentiment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Effects of Affect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Attention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Assessment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Causes of Emotion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Needs and Goals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Appraisal Theories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 Contagion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 Moods and Sentiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 Previous Emotional State . . . . . . . . . . . . . . . . . . . . . . . . . . 59 Causes of Mood . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Contagion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Color . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Other Effects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Measuring Affect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Neurological Responses . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Autonomic Activity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Facial Expression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Self-Report Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Affect Recognition by Users . . . . . . . . . . . . . . . . . . . . . . . 63 Open Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 1. With which emotion should HCI designers be most concerned? . . . . . . . . . . . . . . . . . . . . . . . . . 64 2. When and how should interfaces attempt to directly address users’ emotions and basic needs (vs. application-specific goals)? . . . . . . . . . . . . 64 3. How accurate must emotion recognition be to be useful as an interface technique? . . . . . . . . . . . 64 4. When and how should users be informed that their affective states are being monitored and adapted to? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 5. How does emotion play out in computermediated communication (CMC)? . . . . . . . . . . . . . . 64 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

[1]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[2]  E. Schachtel.  On Color and Affect , 1943 .

[3]  K. Duncker,et al.  On problem-solving , 1945 .

[4]  Lois B. Wexner.  The degree to which colors (hues) are associated with mood-tones. , 1954 .

[5]  A. Maslow.  Toward a Psychology of Being , 1962 .

[6]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962 .

[7]  Magda B. Arnold,et al.  The nature of emotion , 1968 .

[8]  V. Pečjak.  Verbal synesthesiae of colors, emotions, and days of the week , 1970 .

[9]  P. Peretti.  Color-Mood Associations in Young Adults , 1974, Perceptual and motor skills.

[10]  P. Ekman.  Unmasking The Face , 1975 .

[11]  W. James,et al.  What Is an Emotion , 1977 .

[12]  K. Jacobs,et al.  Color Eroticism and Color Preference , 1978 .

[13]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[14]  Stephen G. Gilligan,et al.  Selectivity of learning caused by affective states. , 1981 .

[15]  Richard J. Davidson,et al.  Differential contributions of the two cerebral hemispheres to the perception of happy and sad faces , 1981, Neuropsychologia.

[16]  P. Kleinginna,et al.  A categorized list of emotion definitions, with suggestions for a consensual definition , 1981 .

[17]  Michael J. Apter,et al.  Color preference, arousal, and the theory of psychological reversals , 1982 .

[18]  P. Ekman,et al.  Autonomic nervous system activity distinguishes among emotions. , 1983, Science.

[19]  B. Levy,et al.  Research into the psychological meaning of color. , 1984 .

[20]  P. Johnson-Laird,et al.  Towards a Cognitive Theory of Emotions , 1987 .

[21]  A. Isen,et al.  Positive affect facilitates creative problem solving , 1987 .

[22]  W. Cannon.  The James-Lange theory of emotions: a critical examination and an alternative theory. By Walter B. Cannon, 1927. , 1927, The American journal of psychology.

[23]  N. Frijda.  The laws of emotion. , 1988, The American psychologist.

[24]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[25]  R. Levenson.  Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. , 1988 .

[26]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[27]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[28]  K. Scherer.  Criteria for emotion-antecedent appraisal: A review. , 1988 .

[29]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[30]  C. G. Ucros.  Mood state-dependent memory: A meta-analysis , 1989 .

[31]  Chuck Jones,et al.  Chuck Amuck: The Life and Times of an Animated Cartoonist , 1989 .

[32]  R. Thayer.  The biopsychology of mood and arousal , 1989 .

[33]  K. Scherer.  VOCAL MEASUREMENT OF EMOTION , 1989 .

[34]  L. Cosmides,et al.  The past explains the present: Emotional adaptations and the structure of ancestral environments , 1990 .

[35]  P. Ekman,et al.  Voluntary facial action generates emotion-specific autonomic nervous system activity. , 1990, Psychophysiology.

[36]  R. Nesse.  Evolutionary explanations of emotions , 1990, Human nature.

[37]  Wendy Heller,et al.  The Neuropsychology of Emotion: Developmental Patterns and Implications for Psychopathology , 1990 .

[38]  Harish Sujan,et al.  The influence of mood on categorization: A cognitive flexibility interpretation. , 1990 .

[39]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[40]  N. Schwarz,et al.  Happy and Mindless, But Sad and Smart? The Impact of Affective States on Analytic Reasoning , 1991 .

[41]  R. Lazarus.  Emotion and Adaptation , 1991 .

[42]  A. Isen,et al.  The Influence of Positive Affect on Clinical Problem solving , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[43]  M. Basil,et al.  Negative and Positive Television Messages , 1991 .

[44]  Batya Friedman,et al.  Human agency and responsible computing: Implications for computer system design , 1992, J. Syst. Softw..

[45]  John E. Newhagen,et al.  The Evening's Bad News: Effects of Compelling Negative Television News Images on Memory , 1992 .

[46]  Anna Wierzbicka,et al.  Talking about emotions : semantics, culture, and cognition , 1992 .

[47]  J. Panksepp.  A critical role for "affective neuroscience" in resolving what is basic about basic emotions. , 1992, Psychological review.

[48]  Daniel Reisberg,et al.  Emotion, arousal, and memory for detail. , 1992 .

[49]  P. Ekman.  An argument for basic emotions , 1992 .

[50]  R. Davidson.  Anterior cerebral asymmetry and the nature of emotion , 1992, Brain and Cognition.

[51]  C. Izard.  Basic emotions, relations among emotions, and emotion-cognition relations. , 1992, Psychological review.

[52]  Jeff T. Larsen,et al.  The psychophysiology of emotion. , 1993 .

[53]  A. Isen,et al.  Positive affect and decision making. , 1993 .

[54]  R. Zajonc,et al.  Affect, cognition, and awareness: affective priming with optimal and suboptimal stimulus exposures. , 1993, Journal of personality and social psychology.

[55]  Iain R. Murray,et al.  Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. , 1993, The Journal of the Acoustical Society of America.

[56]  D. I. Bishop,et al.  The structure of temperament questionnaire (STQ): results from a U.S. sample , 1993 .

[57]  Nico H. Frijda,et al.  Varieties of affect: Emotions and episodes, moods, and sentiments. , 1994 .

[58]  D. Wegner.  Ironic processes of mental control. , 1994, Psychological review.

[59]  P. Niedenthal.  Emotional organization of perceptual memory. , 1994 .

[60]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[61]  A. Damasio.  Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[62]  Joseph E LeDoux.  Emotion: clues from the brain. , 1995, Annual review of psychology.

[63]  J. Forgas.  Mood and judgment: the affect infusion model (AIM). , 1995, Psychological bulletin.

[64]  Ellen A. Skinner,et al.  Perceived Control, Motivation, & Coping , 1995 .

[65]  A. Gregory,et al.  The development of emotional responses to music in young children , 1996 .

[66]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Nancy J. Cooke,et al.  The effects of emotional icons on remote communication , 1996, CHI Conference Companion.

[68]  Roddy Cowie,et al.  Automatic statistical analysis of the signal and prosodic signs of emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[69]  Joseph E LeDoux.  The emotional brain , 1996 .

[70]  J. Harackiewicz,et al.  Processing goals, task interest, and the mood–performance relationship: A mediational analysis. , 1996 .

[71]  Ira J. Roseman.  Appraisal Determinants of Emotions: Constructing a More Accurate and Comprehensive Theory , 1996 .

[72]  B. Detenber,et al.  A Bio‐Informational Theory of Emotion: Motion and Image Size Effects on Viewers , 1996 .

[73]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[74]  N. Malamuth.  Sexually Explicit Media, Gender Differences, and Evolutionary Theory , 1996 .

[75]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[76]  David Salesin,et al.  Comic Chat , 1996, SIGGRAPH.

[77]  Rosalind W. Picard.  Affective Computing , 1997 .

[78]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  Barbara Hayes-Roth,et al.  Tigrito: a high-affect virtual toy , 1998, CHI Conference Summary.

[80]  Clark Elliott,et al.  Autonomous Agents as Synthetic Characters , 1998, AI Mag..

[81]  B. J. Fogg,et al.  Charismatic computers: creating more likable and persuasive interactive technologies by leveraging principles from social psychology , 1998 .

[82]  J. Gross.  Antecedent- and response-focused emotion regulation: divergent consequences for experience, expression, and physiology. , 1998, Journal of personality and social psychology.

[83]  D. Wegner,et al.  Control and automaticity in social life. , 1998 .

[84]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[85]  Jonathan Klein,et al.  This computer responds to user frustration , 1999, CHI Extended Abstracts.

[86]  Clifford Nass,et al.  Effects of Humor in Task-Oriented Human-Computer Interaction and Computer-Mediated Communication: A Direct Test of SRCT Theory , 1999, Hum. Comput. Interact..

[87]  Heidy Maldonado,et al.  The Funki Buniz Playground: facilitating multi-cultural affective collaborative play , 1999, CHI EA '99.

[88]  James J. Gross,et al.  Emotion and emotion regulation , 1999 .

[89]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[90]  J. Russell,et al.  Science Current Directions in Psychological the Structure of Current Affect : Controversies and Emerging Consensus on Behalf Of: Association for Psychological Science , 2022 .

[91]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[92]  F. Strack,et al.  "Mood contagion": the automatic transfer of mood between persons. , 2000, Journal of personality and social psychology.

[93]  Diane J. Schiano,et al.  Face to interface: facial affect in (hu)man and machine , 2000, CHI.

[94]  J. J. Jacobs,et al.  When a Car Makes You Smile: Development and Application of an Instrument to Measure Product Emotions , 2000 .

[95]  Gordon H. Bower,et al.  Affect, memory, and social cognition. , 2000 .

[96]  Gerald L. Glore,et al.  Emotions and Beliefs: Feeling is believing: Some affective influences on belief , 2000 .

[97]  Clifford Nass,et al.  Speech interfaces from an evolutionary perspective , 2000, CACM.

[98]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[99]  Aleix M. Martínez,et al.  Recognition of partially occluded and/or imprecisely localized faces using a probabilistic approach , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[100]  Clifford Nass,et al.  The Effects of Emotion of Voice in Synthesized and Recorded Speech , 2001 .

[101]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[102]  R. Erber,et al.  Mood and processing: A view from a self-regulation perspective. , 2001 .

[103]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[104]  Stevo Bozinovski,et al.  SELF-LEARNING AGENTS: A CONNECTIONIST THEORY OF EMOTION BASED ON CROSSBAR VALUE JUDGMENT , 2001 .

[105]  Karen Gasper,et al.  Affective feelings as feedback: Some cognitive consequences. , 2001 .

[106]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[107]  A. Schaefer,et al.  Emotion and memory. , 2001 .

[108]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .