Computational caricaturization of surfaces

We propose a caricaturization framework that is robust to natural poses and expressions.The proposed model links between the two schools of thoughts of computerized caricaturization.It is simple to implement and works efficiently as part of a realtime system.We used the proposed caricaturization method for generating musical video clips. The question whether a caricature of a 2D sketch, or an object in 3D can be generated automatically is probably as old as the attempt to answer the question of what defines art. In an attempt to provide a partial answer, we propose a computational approach for automatic caricaturization. The idea is to rely on intrinsic geometric properties of a given model that are invariant to poses, articulations, and gestures. A property of a surface that is preserved while it undergoes such deformations is self-isometry. In other words, while smiling, running, and posing, we do not change much the intrinsic geometry of our facial surface, the area of our body, or the size of our hands. The proposed method locally amplifies the area of a given surface based on its Gaussian curvature. It is shown to produce a natural comic exaggeration effect which can be efficiently computed as a solution of a Poisson equation. We demonstrate the power of the proposed method by applying it to a variety of meshes such as human faces, statues, and animals. The results demonstrate enhancement and exaggeration of the shape's features into an artistic caricature. As most poses and postures are almost isometries, the use of the Gaussian curvature as the scaling factor allows the proposed method to handle animated sequences while preserving the identity of the animated creature.

[1]  Luiz Velho,et al.  Interactive 3D caricature from harmonic exaggeration , 2011, Comput. Graph..

[2]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[3]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[4]  Luc Van Gool,et al.  Face/Off: live facial puppetry , 2009, SCA '09.

[5]  Ergun Akleman,et al.  Modeling expressive 3D caricatures , 2004, SIGGRAPH '04.

[6]  Pierre Alliez,et al.  Polygon Mesh Processing , 2010 .

[7]  Jana Fuhrmann,et al.  A History Of Caricature And Grotesque In Literature And Art , 2016 .

[8]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[9]  Leif Kobbelt,et al.  An intuitive framework for real-time freeform modeling , 2004, ACM Trans. Graph..

[10]  Alfred M. Bruckstein,et al.  Planar shape enhancement and exaggeration , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[12]  Susan E. Brennan,et al.  From the Leonardo Archive , 2007, Leonardo.

[13]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[14]  Olga Sorkine-Hornung,et al.  Interference-aware geometric modeling , 2011, ACM Trans. Graph..

[15]  M. Kazhdan,et al.  Interactive and anisotropic geometry processing using the screened Poisson equation , 2011, SIGGRAPH 2011.

[16]  Markus Gross,et al.  Deformation Transfer for Detail-Preserving Surface Editing , 2006 .

[17]  H. Piaggio Differential Geometry of Curves and Surfaces , 1952, Nature.

[18]  R. Kurzweil How to Create a Mind: The Secret of Human Thought Revealed , 2012 .

[19]  Bülent Özgüç,et al.  Perceptual Caricaturization of 3D Models , 2012, ISCIS.

[20]  Michael Kubovy,et al.  Caricature and face recognition , 1992, Memory & cognition.

[21]  Min Chen,et al.  Automatic Generation of 3D Caricatures Based on Artistic Deformation Styles , 2011, IEEE Transactions on Visualization and Computer Graphics.

[22]  David Cohen-Steiner,et al.  Restricted delaunay triangulations and normal cycle , 2003, SCG '03.

[23]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, SIGGRAPH 2004.

[24]  Alexander M. Bronstein,et al.  Expression-Invariant Representations of Faces , 2007, IEEE Transactions on Image Processing.

[25]  Gershon Elber,et al.  A comparison of Gaussian and mean curvatures estimation methods on triangular meshes , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[26]  Jarek Rossignac,et al.  GeoFilter: Geometric Selection of Mesh Filter Parameters , 2005, Comput. Graph. Forum.

[27]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[28]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[29]  Alexander Fedorov,et al.  3D Caricature Generation System on the Mobile Handset Using a Single Photograph , 2007, 2007 International Conference on Parallel Processing Workshops (ICPPW 2007).

[30]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[31]  Ergun Akleman,et al.  Making Extreme Caricatures with a New Interactive 2D Deformation Technique with Simplicial Complexes , 2006 .

[32]  Santiago V. Lombeyda,et al.  Discrete multiscale vector field decomposition , 2003, ACM Trans. Graph..

[33]  G. Anastassiou,et al.  Differential Geometry of Curves and Surfaces , 2014 .

[34]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[35]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[36]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[37]  Mark Pauly,et al.  Curvature‐Domain Shape Processing , 2008, Comput. Graph. Forum.