Emotion rating from short blog texts

Being able to automatically perceive a variety of emotions from text alone has potentially important applications in CMC and HCI that range from identifying mood from online posts to enabling dynamically adaptive interfaces. However, such ability has not been proven in human raters or computational systems. Here we examine the ability of naive raters of emotion to detect one of eight emotional categories from 50 and 200 word samples of real blog text. Using expert raters as a 'gold standard', naive-expert rater agreement increased with longer texts, and was high for ratings of joy, disgust, anger and anticipation, but low for acceptance and 'neutral' texts. We discuss these findings in light of theories of CMC and potential applications in HCI.

[1]  P. Ekman.  Emotion in the human face , 1982 .

[2]  R. Plutchik.  The psychology and biology of emotion , 1994 .

[3]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[4]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[5]  Susan R. Fussell.  The Verbal Communication of Emotion: Introduction and Overview , 2002 .

[6]  Jon Oberlander,et al.  Weblogs, genres and individual differences , 2005 .

[7]  Alastair J. Gill,et al.  Rating e-mail personality at zero acquaintance , 2006 .

[8]  Valery A. Petrushin,et al.  RUSLANA: a database of Russian emotional utterances , 2002, INTERSPEECH.

[9]  Debi A. LaPlante,et al.  Thin-slice judgments as a measure of interpersonal sensitivity. , 2001 .

[10]  Jeffrey T. Hancock,et al.  Expressing emotion in text-based communication , 2007, CHI.

[11]  Frank J. Bernieri,et al.  Interpersonal Sensitivity : Theory and Measurement , 2001 .

[12]  J. Walther.  Interpersonal Effects in Computer-Mediated Interaction , 1992 .

[13]  J. Russell,et al.  Independence and bipolarity in the structure of current affect. , 1998 .

[14]  Gilad Mishne,et al.  Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels , 2006, EACL.

[15]  Susan R. Fussell.  The Verbal Communication of Emotions : Interdisciplinary Perspectives , 2002 .

[16]  John Short,et al.  The social psychology of telecommunications , 1976 .

[17]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .