EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text

The 3D virtual world of "Second Life" imitates a form of real life by providing a space for rich interactions and social events. Second Life encourages people to establish or strengthen interpersonal relations, to share ideas, to gain new experiences, and to feel genuine emotions accompanying all adventures of virtual reality. Undoubtedly, emotions play a powerful role in communication. However, to trigger visual display of user's affective state in a virtual world, user has to manually assign appropriate facial expression or gesture to own avatar. Affect sensing from text, which enables automatic expression of emotions in the virtual environment, is a method to avoid manual control by the user and to enrich remote communications effortlessly. In this paper, we describe a lexical rule-based approach to recognition of emotions from text and an application of the developed Affect Analysis Model in Second Life. Based on the result of the Affect Analysis Model, the developed EmoHeart ("object" in Second Life) triggers animations of avatar facial expressions and visualizes emotion by heart-shaped textures.

[1]  Brian McKenna,et al.  Virtual Community , 1998, Online Inf. Rev..

[2]  Joseph B. Walther,et al.  The Impacts of Emoticons on Message Interpretation in Computer-Mediated Communication , 2001 .

[3]  Osman Taner Yigit.  Emoticon Usage in Task-Oriented and Socio-Emotional Contexts in Online Discussion Boards , 2005 .

[4]  M. Chayko.  Connecting: How We Form Social Bonds and Communities in the Internet Age , 2002 .

[5]  Yifeng Hu,et al.  Friendships through IM: Examining the Relationship between Instant Messaging and Intimacy , 2006, J. Comput. Mediat. Commun..

[6]  Christos D. Katsis,et al.  A User Independent, Biosignal Based, Emotion Recognition Method , 2007, User Modeling.

[7]  Chung-Hsien Wu,et al.  Emotion Perception and Recognition from Speech , 2009, Affective Information Processing.

[8]  J. Wilce.  Language and Emotion , 2009 .

[9]  Arne Öhman,et al.  Behold the wrath: Psychophysiological responses to facial stimuli , 1996 .

[10]  Peter D. Turney,et al.  Automatic Dream Sentiment Analysis , 2006 .

[11]  Mitsuru Ishizuka,et al.  Textual Affect Sensing for Sociable and Expressive Online Communication , 2007, ACII.

[12]  D. Keltner,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Expressions of Positive Emotion in Women ' s College Yearbook Pictures and Their Relationship to Personality and Life Outcomes Across Adulthood , 2004 .

[13]  Nigel Collier,et al.  Sentiment Analysis using Support Vector Machines with Diverse Information Sources , 2004, EMNLP.

[14]  Sabine Bergler,et al.  Semantic Tag Extraction from WordNet Glosses , 2006, LREC.

[15]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[16]  Henry Lieberman,et al.  A model of textual affect sensing using real-world knowledge , 2003, IUI '03.

[17]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[18]  Stan Szpakowicz,et al.  The Design and Implementation of an Electronic Lexical Knowledge Base , 2001, Canadian Conference on AI.

[19]  Björn Granström,et al.  Multimodality in Language and Speech Systems , 2002 .

[20]  N. Frijda.  Emotions are functional, most of the time , 1994 .

[21]  I Ibáñez,et al.  Online chat rooms: virtual spaces of interaction for socially oriented people. , 2002, Cyberpsychology & behavior : the impact of the Internet, multimedia and virtual reality on behavior and society.

[22]  Per Persson,et al.  Exms: an animated and avatar-based messaging system for expressive peer communication , 2003, GROUP.

[23]  Jennifer S. Beer,et al.  Facial expression of emotion. , 2003 .

[24]  Anthony C. Boucouvalas,et al.  Real Time Text-to-Emotion Engine for Expressive Internet Communications , 2003 .

[25]  Krzysztof Slot,et al.  Emotion Recognition with Poincare Mapping of Voiced-Speech Segments of Utterances , 2006, ICAISC.

[26]  Soo-Min Kim,et al.  Determining the Sentiment of Opinions , 2004, COLING.

[27]  R. Elizabeth,et al.  Electropolis: Communication and community on internet relay chat , 1991 .

[28]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[29]  Mitsuru Ishizuka,et al.  Analysis of affect expressed through the evolving language of online communication , 2007, IUI '07.

[30]  Alan J. Fridlund,et al.  The behavioral ecology and sociality of human faces. , 1992 .

[31]  Carlo Strapparava,et al.  Dances with Words , 2007, IJCAI.

[32]  L. Wheeler,et al.  Review of personality and social psychology , 1980 .

[33]  Loïc Kessous,et al.  Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech , 2008, Affect and Emotion in Human-Computer Interaction.

[34]  Mitsuru Ishizuka,et al.  User Study of AffectIM, an Emotionally Intelligent Instant Messaging System , 2008, IVA.

[35]  Stan Szpakowicz,et al.  Identifying Expressions of Emotion in Text , 2007, TSD.

[36]  N. Frijda.  THE EMOTIONS (STUDIES IN EMOTION AND SOCIAL INTERACTION) , 2011 .

[37]  Karo Moilanen,et al.  Sentiment Composition , 2007 .

[38]  Jeonghee Yi,et al.  Sentiment analysis: capturing favorability using natural language processing , 2003, K-CAP '03.

[39]  Stan Szpakowicz,et al.  Using Roget’s Thesaurus for Fine-grained Emotion Recognition , 2008, IJCNLP.

[40]  D TurneyPeter,et al.  Measuring praise and criticism , 2003 .

[41]  Cecilia Ovesdotter Alm,et al.  Affect in Text and Speech , 2009 .

[42]  Ilias Maglogiannis,et al.  Face detection and recognition of natural human emotion using Markov random fields , 2007, Personal and Ubiquitous Computing.

[43]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[44]  J. Allwood.  BODILY COMMUNICATION DIMENSIONS OF EXPRESSION AND CONTENT , 2002 .

[45]  Rosalind W. Picard.  Affective Computing , 1997 .

[46]  Dan Klein,et al.  Fast Exact Inference with a Factored Model for Natural Language Parsing , 2002, NIPS.

[47]  Anton Nijholt,et al.  A Lexical Grammatical Implementation of Affect , 2004, TSD.

[48]  Wim Lamotte,et al.  Conveying Emotions through Facially Animated Avatars in Networked Virtual Environments , 2008, MIG.

[49]  Nancy J. Cooke,et al.  The effects of emotional icons on remote communication , 1996, CHI Conference Companion.

[50]  Julie Fitness,et al.  Communicating emotion: Social, moral, and cultural processes , 2000 .

[51]  C. Izard.  The face of emotion , 1971 .

[52]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.