Linguistic Issues in Facial Animation

Our goal is to build a system of 3D animation of facial expressions of emotion correlated with the intonation of the voice. Up till now, the existing systems did not take into account the link between these two features. We will look at the rules that control these relations (intonation/emotions and facial expressions/emotions) as well as the coordination of these various modes of expressions. Given an utterance, we consider how the messages (what is new/old information in the given context) transmitted through the choice of accents and their placement, are conveyed through the face. The facial model integrates the action of each muscle or group of muscles as well as the propagation of the muscles’ movement. Our first step will be to enumerate and to differentiate facial movements linked to emotions as opposed to those linked to conversation. Then, we will examine what the rules are that drive them and how their different functions interact.

[1]  A. Bruce.  Emotional Expression , 1883, The American Naturalist.

[2]  G. Bourne,et al.  STRUCTURE AND FUNCTION OF MUSCLE , 1961 .

[3]  I. A. Boyd,et al.  Structure and Function of Muscle , 1961, Nature.

[4]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[5]  James J. Jenkins,et al.  The Perception of Language. , 1971 .

[6]  Allen T. Dittmann,et al.  Chapter 7 – The Body Movement-Speech Rhythm Relationship as a Cue to Speech Encoding , 1972 .

[7]  A. W. Siegman,et al.  Studies in dyadic communication. , 1972 .

[8]  A. Kendon.  Some Relationships Between Body Motion and Speech , 1972 .

[9]  S. Duncan,et al.  On the structure of speaker–auditor interaction during speaking turns , 1974, Language in Society.

[10]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[11]  E H Hess,et al.  The role of pupil size in communication. , 1975, Scientific American.

[12]  Jonathan Benthall,et al.  The Body as a Medium of Expression. , 1976 .

[13]  Raymond D. Kent,et al.  Coarticulation in recent speech production models , 1977 .

[14]  A Markides,et al.  Speechreading (lipreading). , 1979, Child: care, health and development.

[15]  J. Darby.  Speech evaluation in psychiatry , 1981 .

[16]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[17]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[18]  P. Ekman.  Expression and the Nature of Emotion , 1984 .

[19]  Kim E. A. Silverman,et al.  Vocal cues to speaker affect: testing two models , 1984 .

[20]  Stephen Michael Platt,et al.  A structural model of the human face (graphics, animation, object representation) , 1985 .

[21]  P. Ekman,et al.  Approaches To Emotion , 1985 .

[22]  Peter Bull,et al.  Body movement and emphasis in speech , 1985 .

[23]  Kim E. A. Silverman,et al.  Evidence for the independent function of intonation contour type, voice quality, and F0 range in signaling speaker affect , 1985 .

[24]  Brian Wyvill,et al.  Speech and expression: a computer solution to face animation , 1986 .

[25]  J. P. Lewis,et al.  Automated lip-synch and speech synthesis for character animation , 1987, CHI '87.

[26]  Julia Hirschberg,et al.  The intonational Structuring of Discourse , 1986, ACL.

[27]  Daniel Thalmann,et al.  The Direction of Synthetic Actors in the Film Rendez-Vous a Montreal , 1987, IEEE Computer Graphics and Applications.

[28]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[29]  Janet E. Cahn.  Generating expression in synthesized speech , 1989 .

[30]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[31]  Eric Moulines,et al.  A diphone synthesis system based on time-domain prosodic modifications of speech , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[32]  Gerald Farin,et al.  Curves and surfaces for computer aided geometric design , 1990 .

[33]  Mark Steedman.  Structure and Intonation , 1991 .

[34]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.