Watercolour Robotic Painting: a Novel Automatic System for Artistic Rendering

In this paper, we present a novel robotic system that produces watercolour paintings by means of a 6-degree-of-freedom collaborative robot. After an analysis of traditional watercolour, different non-photorealistic rendering techniques are applied in order to elaborate digital images into artworks. Several algorithms, aimed at processing both the backgrounds and the details, are implemented. Then, the resulting rendering is converted into a sequence of trajectories that the robot reproduces on paper. During the process, the artist controlling the system can change both the algorithm parameters and the hardware variables (e.g. brush type, colour dilution, etc.) in order to obtain a different artistic rendering. The challenge is indeed not to faithfully reproduce an image but to introduce a personal and original contribution to the artwork. The robotic painting system described in this paper was named “Busker Robot” and it is the first automatic system that uses the watercolour technique for artistic rendering. It was installed at the “Algorithmic Arts and Robotics” exhibition during the international event “Trieste Next” (Trieste, Italy, September 2017) and won an Honorable Mention at the 2018 International Robotic Art Competition (RobotArt).

[1]  Yeung Yam,et al.  Preliminary study on vision-based pen-and-ink drawing by a robotic manipulator , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[2]  Aude Billard,et al.  A humanoid robot drawing human portraits , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[3]  Joëlle Thollot,et al.  Edge- and substrate-based effects for watercolor stylization , 2017, NPAR '17.

[4]  Frank Van Reeth,et al.  Real-time watercolor painting on a distributed paper model , 2004, Proceedings Computer Graphics International, 2004..

[5]  Adrien Bousseau,et al.  Interactive watercolor rendering with temporal coherence and abstraction , 2006, NPAR.

[6]  G. Jean-Pierre,et al.  The artist robot: A robot drawing like a human artist , 2012, 2012 IEEE International Conference on Industrial Technology.

[7]  F. Leymarie,et al.  The Machine as Artist: An Introduction , 2017 .

[8]  Paolo Gallina,et al.  Automatic Path-Planning Algorithm for Realistic Decorative Robotic Painting , 2013 .

[9]  Oliver Deussen,et al.  Feedback-guided stroke placement for a painting machine , 2012, CAe '12.

[10]  Yangsheng Xu,et al.  A calligraphy robot — Callibot: Design, analysis and applications , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Paolo Gallina,et al.  Airbrush Robotic Painting System: Experimental Validation of a Colour Spray Model , 2017, RAAD.

[12]  Harold Cohen.  The further exploits of Aaron, painter , 1995 .

[13]  Oliver Deussen,et al.  Hardware‐Based Non‐Photorealistic Rendering Using a Painting Robot , 2015, Comput. Graph. Forum.

[14]  Young J. Kim,et al.  Artistic Pen Drawing on an Arbitrary Surface Using an Impedance-Controlled Robot , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[16]  Khellil Sefiane,et al.  Patterns from drying drops. , 2014, Advances in colloid and interface science.

[17]  Laura Rachman,et al.  Enhancing aesthetic appreciation by priming canvases with actions that match the artist's painting style , 2014, Front. Hum. Neurosci..

[18]  Tobias Isenberg,et al.  State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video , 2013, IEEE Transactions on Visualization and Computer Graphics.

[19]  Olaf Kübler,et al.  Hierarchic Voronoi skeletons , 1995, Pattern Recognit..

[20]  Jiamei Tang,et al.  A Development of Art Robot System for Representation of Brightness of Image , 2012, IAS.

[21]  Kwan-Liu Ma,et al.  Non-photorealistic rendering using watercolor inspired textures and illumination , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[22]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[23]  Katsushi Ikeuchi,et al.  Painting Robot with Multi-Fingered Hands and Stereo Vision , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[24]  Prashant Gupta,et al.  A force-controlled portrait drawing robot , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[25]  Geoff Wyvill,et al.  A system for real-time watercolour rendering , 2005, International 2005 Computer Graphics.

[26]  Hans-Martin Rall,et al.  Art-directed watercolor rendered animation , 2016 .

[27]  Sylvain Calinon,et al.  Learning dynamic graffiti strokes with a compliant robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Fenghui Yao,et al.  Painting brush control techniques in Chinese painting robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[29]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Song-Chun Zhu,et al.  From image parsing to painterly rendering , 2009, TOGS.

[31]  Hod Lipson,et al.  A robotic system for interpreting images into painted artwork , 2008 .

[32]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[33]  Ray Smith.  The Artist's Handbook , 1987 .

[34]  Ren C. Luo,et al.  Robot Artist for colorful picture painting with visual control system , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[35]  Oliver Deussen,et al.  Real-Time Watercolor for Animation , 2006, Journal of Computer Science and Technology.

[36]  Frederic Fol Leymarie,et al.  Portrait drawing by Paul the robot , 2013, Comput. Graph..