Automatic Affective Feedback in an Email Browser

This paper demonstrates a new approach to recognizing and presenting the affect of text. The approach starts with a corpus of 400,000 responses to questions about everyday life in Open Mind Common Sense. This so-called commonsense knowledge is the basis of a textual affect sensing engine. The engine dynamically analyzes a user’s text and senses broad affective qualities of the story at the sentence level. This paper shows how a commonsense affect model was constructed and incorporated into Chernov face style feedback in an affectively responsive email browser called EmpathyBuddy. This experimental system reacts to sentences as they are typed. It is robust enough that it is being used to send email. The response of the few dozen people that have typed into it is dramatically enthusiastic. This paper debuts a new style of user interface technique for creating intelligent responses. Instead of relying on specialized handcrafted knowledge bases this approach relies on a generic commonsense repository. Instead of relying on linguistic or statistical analysis alone to “understand” the affect of text, it relies on a small society of approaches based on the commonsense repository.

[1]  S. T. Dumais,et al.  Using latent semantic analysis to improve access to textual information , 1988, CHI '88.

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  W PicardRosalind,et al.  Modeling drivers' speech under stress , 2003 .

[4]  R. Plutchik A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[5]  W. James,et al.  What Is an Emotion , 1977 .

[6]  LiebermanH.,et al.  Out of context , 2000 .

[7]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[8]  C. W. Hughes Emotion: Theory, Research and Experience , 1982 .

[9]  C. Elliott The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[10]  Andrew Ortony,et al.  The Referential Structure of the Affective Lexicon , 1987, Cogn. Sci..

[11]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[12]  T. Sejnowski,et al.  Measuring facial expressions by computer image analysis. , 1999, Psychophysiology.

[13]  C. Calhoun,et al.  What is an emotion? : classic readings in philosophical psychology , 1984 .

[14]  Jennifer S. Beer,et al.  Facial expression of emotion. , 2003 .

[15]  J. Stainer,et al.  The Emotions , 1922, Nature.

[16]  P. Maes,et al.  Artificial life meets entertainment : lifelike autonomous agents : New horizons in commercial and industrial AI , 1995 .

[17]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[18]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[19]  Pattie Maes,et al.  Artificial life meets entertainment: lifelike autonomous agents , 1995, CACM.

[20]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[21]  T. Palva,et al.  Pages 1-19 , 2001 .

[22]  Push Singh,et al.  The Public Acquisition of Commonsense Knowledge , 2002 .

[23]  Douglas B. Lenat,et al.  CYC: a large-scale investment in knowledge infrastructure , 1995, CACM.

[24]  Elmar Nöth,et al.  The Recognition of Emotion , 2000 .

[25]  Rosalind W. Picard Affective Computing , 1997 .