Spatial and Temporal Linearities in Posed and Spontaneous Smiles

Creating facial animations that convey an animator’s intent is a difficult task because animation techniques are necessarily an approximation of the subtle motion of the face. Some animation techniques may result in linearization of the motion of vertices in space (blendshapes, for example), and other, simpler techniques may result in linearization of the motion in time. In this article, we consider the problem of animating smiles and explore how these simplifications in space and time affect the perceived genuineness of smiles. We create realistic animations of spontaneous and posed smiles from high-resolution motion capture data for two computer-generated characters. The motion capture data is processed to linearize the spatial or temporal properties of the original animation. Through perceptual experiments, we evaluate the genuineness of the resulting smiles. Both space and time impact the perceived genuineness. We also investigate the effect of head motion in the perception of smiles and show similar results for the impact of linearization on animations with and without head motion. Our results indicate that spontaneous smiles are more heavily affected by linearizing the spatial and temporal properties than posed smiles. Moreover, the spontaneous smiles were more affected by temporal linearization than spatial linearization. Our results are in accordance with previous research on linearities in facial animation and allow us to conclude that a model of smiles must include a nonlinear model of velocities.

[1]  Anuj Srivastava,et al.  Statistical Shape Analysis , 2014, Computer Vision, A Reference Guide.

[2]  Yaser Sheikh,et al.  Bilinear spatiotemporal basis models , 2012, TOGS.

[3]  Eva Krumhuber,et al.  Moving Smiles: The Role of Dynamic Components for the Perception of the Genuineness of Smiles , 2005 .

[4]  Zhaoqi Wang,et al.  Exploring Non‐Linear Relationship of Blendshape Facial Animation , 2011, Comput. Graph. Forum.

[5]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[6]  Heinrich H. Bülthoff,et al.  Render me real? , 2012, ACM Trans. Graph..

[7]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[8]  Heinrich H. Bülthoff,et al.  Evaluating the perceptual realism of animated facial expressions , 2008, TAP.

[9]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[10]  Eva Krumhuber,et al.  Perception of linear and nonlinear motion properties using a FACS validated 3D facial model , 2010, APGV '10.

[11]  Ursula Hess,et al.  The cues decoders use in attempting to differentiate emotion-elicited and posed facial expressions , 1994 .

[12]  Jessica K. Hodgins,et al.  The temporal connection between smiles and blinks , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[13]  L. Fleischer Telling Lies Clues To Deceit In The Marketplace Politics And Marriage , 2016 .

[14]  David Kalwick Animating Facial Features & Expressions, Second Edition (Graphics Series) , 2006 .

[15]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, ACM Trans. Graph..

[16]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[17]  J. Cohn,et al.  All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous , 2009, Journal of nonverbal behavior.

[18]  David J. Kalwick Animating facial features & expressions , 2006 .

[19]  A. Manstead,et al.  Can Duchenne smiles be feigned? New evidence on felt and false smiles. , 2009, Emotion.

[20]  P. Ekman Telling lies: clues to deceit in the marketplace , 1985 .

[21]  K HodginsJessica,et al.  Spatial and Temporal Linearities in Posed and Spontaneous Smiles , 2014, TAP 2014.

[22]  Iain Matthews,et al.  Modeling and animating eye blinks , 2011, TAP.

[23]  Jessica K. Hodgins,et al.  Perceptual effects of damped and exaggerated facial motion in animated characters , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[24]  Yanxi Liu,et al.  The role of structural facial asymmetry in asymmetry of peak facial expressions , 2006, Laterality.