Style and abstraction in portrait sketching

We use a data-driven approach to study both style and abstraction in sketching of a human face. We gather and analyze data from a number of artists as they sketch a human face from a reference photograph. To achieve different levels of abstraction in the sketches, decreasing time limits were imposed -- from four and a half minutes to fifteen seconds. We analyzed the data at two levels: strokes and geometric shape. In each, we create a model that captures both the style of the different artists and the process of abstraction. These models are then used for a portrait sketch synthesis application. Starting from a novel face photograph, we can synthesize a sketch in the various artistic styles and in different levels of abstraction.

[1]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[2]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[3]  Nuria Oliver,et al.  Curve Analogies , 2002, Rendering Techniques.

[4]  M. B. Stegmann,et al.  A Brief Introduction to Statistical Shape Analysis , 2002 .

[5]  Harry Shum,et al.  Example-based caricature generation with exaggeration , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[6]  Harry Shum,et al.  PicToon: a personalized image-based cartoon system , 2002, MULTIMEDIA '02.

[7]  Joshua B. Tenenbaum,et al.  Learning style translation for the lines of a drawing , 2003, TOGS.

[8]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[9]  Tsai-Yen Li,et al.  Automatic Caricature Generation by Analyzing Facial Features , 2004 .

[10]  David Salesin,et al.  Image-Based Hair Capture by Inverse Lighting , 2002, Graphics Interface.

[11]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[12]  Denise C. Park,et al.  A lifespan database of adult facial stimuli , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[13]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[14]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[15]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[16]  Seungyong Lee,et al.  Shape‐simplifying Image Abstraction , 2008, Comput. Graph. Forum.

[17]  Adam Finkelstein,et al.  Where do people draw lines , 2008, SIGGRAPH 2008.

[18]  Niloy J. Mitra,et al.  Abstraction of man-made shapes , 2009, ACM Trans. Graph..

[19]  Song-Chun Zhu,et al.  Artistic paper-cut of human portraits , 2010, ACM Multimedia.

[20]  Jian J. Zhang,et al.  Caricature Synthesis Based on Mean Value Coordinates , 2010 .

[21]  Simon Colton,et al.  Stroke Matching for Paint Dances , 2010, CAe.

[22]  Yuehu Liu,et al.  A Parameterized Representation for the Cartoon Sample Space , 2010, MMM.

[23]  Yong Zhang,et al.  Hand-Drawn Face Sketch Recognition by Humans and a PCA-Based Algorithm for Forensic Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[24]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[25]  Henry Kang,et al.  Image and Video Abstraction by Coherence‐Enhancing Filtering , 2011, Comput. Graph. Forum.

[26]  Song-Chun Zhu,et al.  Portrait painting using active templates , 2011, NPAR '11.

[27]  I-Cheng Chang,et al.  Caricaturation for human face pictures , 2011, 2011 International Conference on Machine Learning and Cybernetics.

[28]  Golam Ashraf,et al.  Shape Stylized Face Caricatures , 2011, MMM.

[29]  Daniel Cohen-Or,et al.  Conjoining Gestalt rules for abstraction of architectural drawings , 2011, ACM Trans. Graph..

[30]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Thai Hoang Le,et al.  Face Alignment Using Active Shape Model And Support Vector Machine , 2012, ArXiv.

[32]  Levent Burak Kara,et al.  Co-abstraction of shape collections , 2012, ACM Trans. Graph..

[33]  J. Collomosse,et al.  State of the ‘Art’: A Taxonomy of Artistic Stylization Techniques for Images and Video (cid:63) , 2012 .

[34]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[35]  Stephen DiVerdi,et al.  HelpingHand: example-based stroke stylization , 2012, ACM Trans. Graph..

[36]  Amit R.Sharma,et al.  Face Photo-Sketch Synthesis and Recognition , 2012 .

[37]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[38]  Cewu Lu,et al.  Combining sketch and tone for pencil drawing production , 2012, NPAR '12.

[39]  Markus H. Gross,et al.  Topology-driven vectorization of clean line drawings , 2013, ACM Trans. Graph..

[40]  Adrien Treuille,et al.  Real-time drawing assistance through crowdsourcing , 2013, HCOMP.

[41]  Frederic Fol Leymarie,et al.  Portrait drawing by Paul the robot , 2013, Comput. Graph..

[42]  Tobias Isenberg,et al.  State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video , 2013, IEEE Transactions on Visualization and Computer Graphics.