Photo Realistic 3D Cartoon Face Modeling Based on Active Shape Model

We present a novel framework to automatically build 3D carton face model from a single frontal face image. We use the improved ASM algorithm to automatically detect the deformed key feature control points in the face image. The deformation of the control points is compared to that of a standard (average) face, and exaggerated based on face shape and the type of organs and their pitch. RBF-based smooth interpolation is used to generate a 3D model from the exaggerated control points. The resulting 3D human face model not only preserves the identity of the subject in the photo, but also looks cartoonish with exaggerated facial features. Experiments with a large number of real photographs show that our framework is feasible.

[1]  Tim Cootes,et al.  An Introduction to Active Shape Models , 2000 .

[2]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[3]  Tony F. Chan,et al.  Image processing and analysis , 2005 .

[4]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[5]  Guan Xin-pu Application of Improved Active Shape Model in Face Positioning , 2007 .

[6]  Michael Cohen,et al.  Rapid modeling of animated faces from video images , 2000, ACM Multimedia.

[7]  Tat-Seng Chua,et al.  Morphable face reconstruction with multiple images , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Luo Shu-qian Two-dimensional grey-level models for an active shape model , 2007 .

[9]  Ergun Akleman,et al.  Making caricatures with morphing , 1997, SIGGRAPH '97.

[10]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hiroyasu Koshimizu,et al.  Web-PICASSO: Internet Implementation of Facial Caricature System PICASSO , 2000, ICMI.

[12]  In-Kwon Lee,et al.  Caricature video , 2007 .

[13]  Yuan Baozong,et al.  Feature extraction in human face recognition system , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[14]  Peng Zhenyun Detecting facial features based on color segmentation and KL transform , 2001 .

[15]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[16]  Yang Jie,et al.  Application of an Improved Active Shape Model Method in Face Features Location , 2007 .