A Modular Framework for Digital Painting

While there has been tremendous research in the simulation of natural media painting, little academic work has been written to understand how all these contributions interrelate and to use this knowledge to direct future work. In this paper, we survey the set of interesting artistic tools to categorize their effects and motivate a modular framework for digital painting that can reproduce those effects in a loosely coupled way. We use this framework as a lens through which we survey the literature and classify the achievements of previous efforts. We examine our own contributions in the field in more detail, discussing how the framework motivated those results and how it impacted our accomplishments. Finally, we discuss the open challenges that remain for the research community, and how the framework can help to make contributions towards those challenges.

[1]  Stephen DiVerdi,et al.  Industrial-strength painting with a virtual bristle brush , 2010, VRST '10.

[2]  Baoquan Chen,et al.  Paint Inspired Color Mixing and Compositing for Visualization , 2004, IEEE Symposium on Information Visualization.

[3]  Gary W. Meyer,et al.  Automotive Spray Paint Simulation , 2008, ISVC.

[4]  William V. Baxter,et al.  Simple data-driven modeling of brushes , 2010, I3D '10.

[5]  Reiji Tsuruno,et al.  Segmental Brush Synthesis with Stroke Images , 2010, Eurographics.

[6]  Johannes Taelman,et al.  IntuPaint: Bridging the gap between physical and digital painting , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[7]  Frank Van Reeth,et al.  Real-time simulation of watery paint , 2005, Comput. Animat. Virtual Worlds.

[8]  T. V. Laerhoven,et al.  From Dust till Drawn A Real-time Bidirectional Pastel Simulation , 2007 .

[9]  Eric Neufeld,et al.  A Bidirectional Deposition Model of Wax Crayons , 2005, Comput. Graph. Forum.

[10]  Stephen DiVerdi,et al.  RealBrush: painting with examples of physical media , 2013, ACM Trans. Graph..

[11]  Stephen DiVerdi,et al.  HelpingHand: example-based stroke stylization , 2012, ACM Trans. Graph..

[12]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[13]  William V. Baxter,et al.  Detail-preserving paint modeling for 3D brushes , 2010, NPAR.

[14]  Paul L. Rosin,et al.  Image and Video-Based Artistic Stylisation , 2012, Computational Imaging and Vision.

[15]  William V. Baxter,et al.  IMPaSTo: a realistic, interactive model for paint , 2004, NPAR '04.

[16]  Miao Xu,et al.  GENERATING NEW STYLES OF CHINESE STROKES BASED ON STATISTICAL MODEL , 2007 .

[17]  Yunhe Pan,et al.  A Generic Pigment Model for Digital Painting , 2007, Comput. Graph. Forum.

[18]  Bendu Bai,et al.  Chinese Hairy Brush: A physically-based model for calligraphy , 2009 .

[19]  Stephen DiVerdi,et al.  A Brush Stroke Synthesis Toolbox , 2013, Image and Video-Based Artistic Stylisation.

[20]  Jie Xu,et al.  The droplet virtual brush for Chinese calligraphic character modeling , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[21]  Yunhe Pan,et al.  A Solid Model Based Virtual Hairy Brush , 2002, Comput. Graph. Forum.

[22]  Tomoyuki Nishita,et al.  A virtual painting knife , 2008, The Visual Computer.

[23]  Stephen DiVerdi,et al.  A lightweight, procedural, vector watercolor painting engine , 2012, I3D '12.

[24]  Johannes Taelman,et al.  FluidPaint: an interactive digital painting system using real wet brushes , 2009, ITS '09.

[25]  Fumihisa Shibata,et al.  MAI painting brush: an interactive device that realizes the feeling of real painting , 2010, UIST.

[26]  Yanning Zhang,et al.  An Efficient Physically-Based Model for Chinese Brush , 2007, FAW.

[27]  Hyun Joon Shin,et al.  An Example‐based Approach to Synthesize Artistic Strokes using Graphs , 2010, Comput. Graph. Forum.

[28]  Nelson Siu-Hang Chu,et al.  Real-time painting with an expressive virtual Chinese brush , 2004, IEEE Computer Graphics and Applications.

[29]  Masayuki Nakajima,et al.  3D physics-based brush model for painting , 1999, SIGGRAPH '99.

[30]  Yunhe Pan,et al.  Virtual hairy brush for painterly rendering , 2004, Graph. Model..

[31]  William V. Baxter,et al.  DAB: Interactive Haptic Painting with 3D Virtual Brushes , 2001, SIGGRAPH Courses.

[32]  Alvy Ray Smith.  Digital Paint Systems: An Anecdotal and Historical Overview , 2001, IEEE Ann. Hist. Comput..

[33]  Mario Costa Sousa,et al.  Observational Model of Blenders and Erasers in Computer-Generated Pencil Rendering , 1999, Graphics Interface.

[34]  Chiew-Lan Tai,et al.  MoXi: real-time ink dispersion in absorbent paper , 2005, SIGGRAPH '05.

[35]  William V. Baxter,et al.  A versatile interactive 3D brush model , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[36]  William V. Baxter,et al.  A viscous paint model for interactive applications , 2004, SIGGRAPH '04.

[37]  Stephen DiVerdi,et al.  Painting with Polygons: A Procedural Watercolor Engine , 2013, IEEE Transactions on Visualization and Computer Graphics.

[38]  James A. Ferwerda,et al.  TangiPaint: A Tangible Digital Painting System , 2011, Color Imaging Conference.

[39]  P. Kubelka,et al.  New Contributions to the Optics of Intensely Light-Scattering Materials. Part I , 1948 .

[40]  Yunhe Pan,et al.  Advanced Design for a Realistic Virtual Brush , 2003, Comput. Graph. Forum.

[41]  Thierry Pudet,et al.  Real Time Fitting of Hand‐Sketched Pressure Brushstrokes , 1994, Comput. Graph. Forum.

[42]  Gary W. Meyer,et al.  Airbrush simulation for artwork and computer modeling , 2009, NPAR '09.

[43]  Mario Costa Sousa,et al.  Computer‐Generated Graphite Pencil Rendering of 3D Polygonal Models , 1999, Comput. Graph. Forum.

[44]  Stephen DiVerdi,et al.  RealPigment: paint compositing by example , 2014, NPAR '14.

[45]  Zhiyong Huang,et al.  A GPU-based method for real-time simulation of Eastern painting , 2007, GRAPHITE '07.

[46]  T. V. Laerhoven,et al.  Brush Up Your Painting Skills Realistic Brush Design for Interactive Painting Applications , 2007 .

[47]  P. Kubelka,et al.  New contributions to the optics of intensely light-scattering materials. , 1954, Journal of the Optical Society of America.

[48]  Masayuki Nakajima,et al.  Volumetric modeling of colored pencil drawing , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[49]  Xiaofeng Mi,et al.  Droplet: A virtual brush model to simulate Chinese calligraphy and painting , 2008, Journal of Computer Science and Technology.