Evaluation of real-world and computer-generated stylized facial expressions

The goal of stylization is to provide an abstracted representation of an image that highlights specific types of visual information. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery efficiently making stylization into a useful technique, not only for artistic, but also for visualization applications. In this paper, we report results from two sets of experiments that aim at characterizing the perceptual impact and effectiveness of three different stylization techniques in the context of dynamic facial expressions. In the first set of experiments, animated facial expressions are stylized using three common techniques (brush, cartoon, and illustrative stylization) and investigated using different experimental measures. Going beyond the usual questionnaire approach, these experiments compare the techniques according to several criteria ranging from subjective preference to task-dependent measures (such as recognizability, intensity) allowing us to compare behavioral and introspective approaches. The second set of experiments use the same stylization techniques on real-world video sequences in order to compare the effect of stylization on natural and artificial stimuli. Our results shed light on how stylization of image contents affects the perception and subjective evaluation of both real and computer-generated facial expressions.

[1]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .

[2]  Thomas Strothotte,et al.  Real-Time Halftoning: A Primitive for Non-Photorealistic Shading , 2002, Rendering Techniques.

[3]  Heinrich H. Bülthoff,et al.  The role of image size in the recognition of conversational facial expressions , 2004, Comput. Animat. Virtual Worlds.

[4]  Dirk Bartz,et al.  Artistic reality: fast brush stroke stylization for augmented reality , 2005, VRST '05.

[5]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[6]  Heinrich H. Bülthoff,et al.  Psychophysical evaluation of animated facial expressions , 2005, APGV '05.

[7]  Heinrich H. Bülthoff,et al.  The MPI VideoLab: A system for high quality synchronous recording of video and audio from multiple viewpoints , 2004 .

[8]  Peter Willemsen,et al.  Evaluating space perception in NPR immersive environments , 2002, NPAR '02.

[9]  Chris Stolte,et al.  Rendering effective route maps: improving usability through generalization , 2001, SIGGRAPH.

[10]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[11]  Heinrich H. Bülthoff,et al.  Measuring the discernability of virtual objects in conventional and stylized augmented reality , 2006, EGVE'06.

[12]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, ACM Trans. Graph..

[13]  Christian Wallraven,et al.  Proceedings of the 4th symposium on Applied perception in graphics and visualization , 2007, APGV.

[14]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Heinrich H. Bülthoff,et al.  The role of image size in the recognition of conversational facial expressions: Research Articles , 2004 .

[16]  Heinrich H. Bülthoff,et al.  Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions , 2005, TAP.

[17]  Donald P. Greenberg,et al.  Perceptual illumination components , 2004, ACM Trans. Graph..

[18]  Douglas DeCarlo,et al.  Visual interest and NPR: an evaluation and manifesto , 2004, NPAR '04.

[19]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[20]  Heinrich H. Bülthoff,et al.  Facial Animation Based on 3D Scans and Motion Capture , 2003, SIGGRAPH 2003.

[21]  Dirk Bartz,et al.  Illustrative display of hidden iso-surface structures , 2005, VIS 05. IEEE Visualization, 2005..

[22]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[23]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[24]  Heinrich H. Bülthoff,et al.  How believable are real faces? Towards a perceptual basis for conversational animation , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[25]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[26]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[27]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[28]  Heinrich H. Bülthoff,et al.  View dependence of complex versus simple facial motions , 2004, APGV '04.

[29]  Dirk Bartz,et al.  Model-based hybrid tracking for medical augmented reality , 2006, EGVE'06.

[30]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.