Measuring and modeling facial affect

In recent years, researchers in computer science and human-computer interaction have become increasingly interested in characterizing perception of facial affect. Ironically, this applied interest comes at a time when the classic findings on perception of human facial affect are being challenged in the psychological research literature, largely on methodological grounds. This paper first describes two experiments that empirically address Russell’s methodological criticisms of the classic work on measuring “basic emotions,” as well as his alternative approach toward modeling “facial affect space.” Finally, a user study on affect in a prototype model of a robot face is reported; these results are compared with the human findings from Experiment 1. This work provides new data on measuring facial affect, while also demonstrating how basic and more applied research can mutually inform one another.

[1]  Rosalind W. Picard Affective computing: (526112012-054) , 1997 .

[2]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[3]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[4]  Jack Hamm,et al.  Cartooning the Head and Figure , 1978 .

[5]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[6]  J. Russell,et al.  The psychology of facial expression: Frontmatter , 1997 .

[7]  David Salesin,et al.  Comic Chat , 1996, SIGGRAPH.

[8]  Rosalind W. Picard Affective Computing , 1997 .

[9]  Diane J. Schiano,et al.  Communicating facial affect: it's not the realism, it's the motion , 2000, CHI Extended Abstracts.

[10]  Diane J. Schiano,et al.  Face to interface: facial affect in (hu)man and machine , 2000, CHI.

[11]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[12]  P. Ekman Emotion in the human face , 1982 .

[13]  M. Katsikitis,et al.  The Classification of Facial Expressions of Emotion: A Multidimensional-Scaling Approach , 1997, Perception.

[14]  H. Yamada,et al.  Dimensions of visual information for categorizing facial expressions of emotion , 1993 .

[15]  T. Sejnowski,et al.  Measuring facial expressions by computer image analysis. , 1999, Psychophysiology.

[16]  H. Schlosberg Three dimensions of emotion. , 1954, Psychological review.

[17]  J. Russell A circumplex model of affect. , 1980 .