Computational models for the analysis and synthesis of graffiti tag strokes

In this paper we describe a system aimed at the generation and analysis of graffiti tags. We argue that the dynamics of the movement involved in generating tags is in large part --- and at a higher degree with respect to many other visual art forms --- determinant of their stylistic quality. To capture this notion computationally, we rely on a biophysically plausible model of handwriting gestures (the Sigma Lognormal Model proposed by Réjean Plamondon et al.) that permits the generation of curves which are aesthetically and kinetically similar to the ones made by a human hand when writing. We build upon this model and extend it in order to facilitate the interactive construction and manipulation of digital tags. We then describe a method that reconstructs any planar curve or a sequence of planar points with a set of corresponding model parameters. By doing so, we seek to recover plausible velocity and temporal information for a static trace. We present a number of applications of our system: (i) the interactive design of curves that closely resemble the ones typically observed in graffiti art; (ii) the stylisation and beautification of input point sequences via curves that evoke a smooth and rapidly executed movement; (iii) the generation of multiple instances of a synthetic tag from a single example. This last application is a step in the direction of our longer term plan of realising a system which is capable of automatically generating convincing images in the graffiti style space.

[1]  H. Kao,et al.  Graphonomics : contemporary research in handwriting , 1986 .

[2]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Tobias Isenberg,et al.  Automatically Mimicking Unique Hand-Drawn Pencil Lines , 2009, Comput. Graph..

[4]  Nuria Oliver,et al.  Curve Analogies , 2002, Rendering Techniques.

[5]  P Viviani,et al.  Segmentation and coupling in complex movements. , 1985, Journal of experimental psychology. Human perception and performance.

[6]  Adel M. Alimi,et al.  Generation and analysis of handwriting script with the beta-elliptic model , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[7]  Dereck S. Meek,et al.  An Improved Euler Spiral Algorithm for Shape Completion , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[8]  Lilia Krivodonova,et al.  Interpolation of two-dimensional curves with Euler spirals , 2014, J. Comput. Appl. Math..

[9]  Jessica Fuerst Visual Perception Of Form , 2016 .

[10]  Holger Winnemöller,et al.  PortraitSketch: face sketching assistance for novices , 2014, UIST.

[11]  V. Gallese,et al.  Motion, emotion and empathy in esthetic experience , 2007, Trends in Cognitive Sciences.

[12]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[13]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[14]  D. Walton,et al.  G 1 interpolation with a single Cornu spiral segment , 2008 .

[15]  Karan Singh,et al.  Sketching piecewise clothoid curves , 2008, SBM'08.

[16]  Christian O'Reilly,et al.  The lognormal handwriter: learning, performing, and declining , 2013, Front. Psychol..

[17]  J. Hollerbach An oscillation theory of handwriting , 2004, Biological Cybernetics.

[18]  P. Morasso,et al.  Trajectory formation and handwriting: A computational model , 1982, Biological Cybernetics.

[19]  R Plamondon,et al.  Studying the variability of handwriting patterns using the Kinematic Theory. , 2009, Human movement science.

[20]  Stephen DiVerdi,et al.  HelpingHand: example-based stroke stylization , 2012, ACM Trans. Graph..

[21]  Sven Havemann,et al.  Curvature-controlled curve editing using piecewise clothoid curves , 2013, Comput. Graph..

[22]  Christian O'Reilly,et al.  Recent developments in the study of rapid human movements with the kinematic theory: Applications to handwriting and signature synthesis , 2014, Pattern Recognit. Lett..

[23]  D Teresi The g-word. , 1993, Science.

[24]  Raph Levien,et al.  The Euler spiral: a mathematical history , 2008 .

[25]  A. Thomassen,et al.  Time, Size and Shape in Handwriting: Exploring Spatio-temporal Relationships at Different Levels , 1985 .

[26]  P. Viviani,et al.  Biological movements look uniform: evidence of motor-perceptual interactions. , 1992, Journal of experimental psychology. Human perception and performance.

[27]  Réjean Plamondon,et al.  La Théorie Cinématique des mouvements humains rapides : développements récents Recent Developments in the Study of Rapid Human Movements with the Kinematic Theory , 2008 .

[28]  Lambert Schomaker,et al.  Invariant properties between stroke features in handwriting. , 1993, Acta psychologica.

[29]  Ravin Balakrishnan,et al.  Elasticurves: exploiting stroke dynamics and inertia for the real-time neatening of sketched 2D curves , 2011, UIST '11.

[30]  Horst Bunke Template-based Synthetic Handwriting Generation for the Training of Recognition Systems , 2005 .

[31]  Réjean Plamondon,et al.  A kinematic theory of rapid human movement. Part IV: a formal mathematical proof and new insights , 2003, Biological Cybernetics.

[32]  J. Wagemans,et al.  Perceptual saliency of points along the contour of everyday objects: A large-scale study , 2008 .

[33]  R. Plamondon,et al.  A multi-level representation paradigm for handwriting stroke generation. , 2006, Human movement science.

[34]  Enrico Bertolazzi,et al.  Fast and accurate $G^1$ fitting of clothoid curves , 2013, 1305.6644.

[35]  Benjamin B. Kimia,et al.  Euler Spiral for Shape Completion , 2003, International Journal of Computer Vision.

[36]  Jean-Luc Velay,et al.  Visual presentation of single letters activates a premotor area involved in writing , 2003, NeuroImage.

[37]  Frank Bunker Gilbreth,et al.  Applied motion study : a collection of papers on the efficient method to industrial preparedness , 1919 .

[38]  Raphael L. Levien,et al.  From Spiral to Spline: Optimal Techniques in Interactive Curve Design , 2009 .

[39]  Stephen Grossberg,et al.  A neural network model for cursive script production , 1993, Biological Cybernetics.

[40]  C. Lawrence Zitnick,et al.  Handwriting beautification using token means , 2013, ACM Trans. Graph..

[41]  Marc Parizeau,et al.  Segmentation and reconstruction of on-line handwritten scripts , 1998, Pattern Recognit..

[42]  P. Viviani,et al.  The law relating the kinematic and figural aspects of drawing movements. , 1983, Acta psychologica.

[43]  P. Viviani,et al.  The relation between linear extent and velocity in drawing movements , 1983, Neuroscience.