Caricature Drawing System by Understanding User Facial Attributes

We have developed a system which generates a 2D caricature face of a user by understanding his facial attribute. In recent, there have been many approaches to make a user caricature face. They, however, analyzed a face with a 2D sparse facial feature alignment method and it caused lack of his facial attribute information. In this research, we tried to automatically analyze the facial attribute of a user using a bilinear face model, enabling to make the caricature reflecting the user facial attribute. It also provides to change the facial expression of the caricature intuitively since it is parameterized by identity and expression parameters. When user gives his face image to the system, it reconstructs his 3D face model automatically without any user input. The result 3D face model is expressed as identity parameter. We mapped the identity parameter to facial attribute parameter space, which makes the system notice what kind of notable facial attributes the user face has. As emphasizing or reducing the expression power of remark facial attributes, the system makes the 3D face model reflect the facial attribute of the user dramatically. It also enables the user to change the facial expression of his caricature as changing the expression parameter values. As the 3D model of the user caricature is projected to the 2D space with a cartoon-like texture effect, user can get his own traditional caricature drawing.

[1]  Pan Zhigeng,et al.  The 3D caricature face modeling based on aesthetic formulae , 2010, VRCAI '10.

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[4]  Bon-Ki Koo,et al.  Intuitive 3D caricature face maker , 2010, SA '10.

[5]  Yiying Tong,et al.  FaceWarehouse: A 3D Facial Expression Database for Visual Computing , 2014, IEEE Transactions on Visualization and Computer Graphics.

[6]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[7]  Joaquim B. Cavalcante Neto,et al.  Three-Dimensional Face Caricaturing by Anthropometric Distortions , 2013, 2013 XXVI Conference on Graphics, Patterns and Images.

[8]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.