The evaluation of stylized facial expressions

Stylized rendering aims to abstract information in an image making it useful not only for artistic but also for visualization purposes. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery efficiently. So far, however, few attempts have been made to characterize the perceptual impact and effectiveness of stylization. In this paper, we report several experiments that evaluate three different stylization techniques in the context of dynamic facial expressions. Going beyond the usual questionnaire approach, the experiments compare the techniques according to several criteria ranging from introspective measures (subjective preference) to task-dependent measures (recognizability, intensity). Our results shed light on how stylization of image contents affects the perception and subjective evaluation of facial expressions.

[1]  Heinrich H. Bülthoff,et al.  View dependence of complex versus simple facial motions , 2004, APGV '04.

[2]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[3]  Heinrich H. Bülthoff,et al.  Psychophysical evaluation of animated facial expressions , 2005, APGV '05.

[4]  Dirk Bartz,et al.  Model-based hybrid tracking for medical augmented reality , 2006, EGVE'06.

[5]  Heinrich H. Bülthoff,et al.  The role of image size in the recognition of conversational facial expressions: Research Articles , 2004 .

[6]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[7]  Heinrich H. Bülthoff,et al.  Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions , 2005, TAP.

[8]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[9]  Thomas Strothotte,et al.  Real-Time Halftoning: A Primitive for Non-Photorealistic Shading , 2002, Rendering Techniques.

[10]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[11]  Douglas DeCarlo,et al.  Visual interest and NPR: an evaluation and manifesto , 2004, NPAR '04.

[12]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[13]  Heinrich H. Bülthoff,et al.  Facial Animation Based on 3D Scans and Motion Capture , 2003, SIGGRAPH 2003.

[14]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[15]  Dirk Bartz,et al.  Illustrative display of hidden iso-surface structures , 2005, VIS 05. IEEE Visualization, 2005..

[16]  Donald P. Greenberg,et al.  Perceptual illumination components: a new approach to efficient, high quality global illumination rendering , 2004, SIGGRAPH 2004.

[17]  Dirk Bartz,et al.  Artistic reality: fast brush stroke stylization for augmented reality , 2005, VRST '05.

[18]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[19]  Heinrich H. Bülthoff,et al.  How believable are real faces? Towards a perceptual basis for conversational animation , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[20]  Dirk Bartz,et al.  Real-time cartoon-like stylization of AR video streams on the GPU , 2005 .

[21]  Heinrich H. Bülthoff,et al.  The role of image size in the recognition of conversational facial expressions , 2004, Comput. Animat. Virtual Worlds.

[22]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[23]  Heinrich H. Bülthoff,et al.  Measuring the discernability of virtual objects in conventional and stylized augmented reality , 2006, EGVE'06.

[24]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[25]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Peter Willemsen,et al.  Evaluating space perception in NPR immersive environments , 2002, NPAR '02.

[27]  Chris Stolte,et al.  Rendering effective route maps: improving usability through generalization , 2001, SIGGRAPH.