Semi-supervised Learning of Caricature Pattern from Manifold Regularization

Automatic caricature synthesis is to transform the input face to an exaggerated one. It is becoming an interesting research topic, but it remains an open issue to specify the caricature's pattern for the input face. This paper proposed a novel pattern prediction method based on MR (manifold regularization), which comprises three steps. Firstly, we learn the caricature pattern by manifold dimension reduction, and select some low dimensional caricature pattern as the labels for corresponsive true faces. Secondly, manifold regularization is performed to build a semi-supervised regression between true faces and the pattern labels. In the third step of offline phase, the input face is mapped to a pattern label by the learnt regressive model, and the pattern label is further transformed to caricature parameters by a locally linear reconstruction algorithm. This approach takes advantage of manifold structure lying in both true faces and caricatures. Experiments show that, low dimensional manifold represents the caricature pattern well and the semi-supervised regressive model from manifold regularization can predict the target caricature pattern successfully.

[1]  Ergun Akleman,et al.  Making caricatures with morphing , 1997, SIGGRAPH '97.

[2]  Harry Shum,et al.  Example-based caricature generation with exaggeration , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[3]  Mario Costa Sousa,et al.  Depicting shape features with directional strokes and spotlighting , 2004 .

[4]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[5]  Nanning Zheng,et al.  Example-based facial sketch generation with non-parametric sampling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[8]  Tsai-Yen Li,et al.  Automatic Caricature Generation by Analyzing Facial Features , 2004 .

[9]  George Wolberg,et al.  Digital image warping , 1990 .

[10]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[11]  Paul W. H. Chung,et al.  Use of Neural Networks in Automatic Caricature Generation: An Approach Based on Drawing Style Capture , 2005, IbPRIA.

[12]  Wen Gao,et al.  Mapping learning in eigenspace for harmonious caricature generation , 2006, MM '06.

[13]  Takayuki Fujiwara,et al.  On KANSEI facial image processing for computerized facial caricaturing system PICASSO , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[14]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[15]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.