Stippling with aerial robots

We describe a method for creating stippled prints using a quadrotor flying robot. At a low level, we use motion capture to measure the position of the robot and the canvas, and a robust control algorithm to command the robot to fly to different stipple positions to make contact with the canvas using an ink soaked sponge. We describe a collection of important details and challenges that must be addressed for successful control in our implementation, including robot model estimation, Kalman filtering for state estimation, latency between motion capture and control, radio communication interference, and control parameter tuning. We use a centroidal Voronoi diagram to generate stipple drawings, and compute a greedy approximation of the traveling salesman problem to draw as many stipples per flight as possible, while accounting for desired stipple size and dynamically adjusting future stipples based on past errors. An exponential function models the natural decay of stipple sizes as ink is used in a flight. We evaluate our dynamic adjustment of stipple locations with synthetic experiments. Stipples per second and variance of stipple placement are presented to evaluate our physical prints and robot control performance.

[1]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[2]  Chyi-Yeu Lin,et al.  Human portrait generation system for robot arm drawing , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[3]  Oliver Deussen,et al.  Image stylization with a painting machine using semantic hints , 2013, Comput. Graph..

[4]  Hua Li,et al.  Structure-preserving stippling by priority-based error diffusion , 2011, Graphics Interface.

[5]  Robert Bosch,et al.  Continuous line drawings via the traveling salesman problem , 2004, Oper. Res. Lett..

[6]  Olga Sorkine-Hornung,et al.  Large-scale painting of photographs by interactive optimization , 2016, Comput. Graph..

[7]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Craig S. Kaplan TSP Art , 2005 .

[9]  Adrian Secord,et al.  Weighted Voronoi stippling , 2002, NPAR '02.

[10]  Karan Singh,et al.  Organic labyrinths and mazes , 2006, NPAR.

[11]  Frederic Fol Leymarie,et al.  Computational models for the analysis and synthesis of graffiti tag strokes , 2015, CAE '15.

[12]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Oliver Deussen,et al.  Hardware‐Based Non‐Photorealistic Rendering Using a Painting Robot , 2015, Comput. Graph. Forum.

[14]  Frederic Fol Leymarie,et al.  Sketches by Paul the robot , 2012, CAe '12.

[15]  Frederic Fol Leymarie,et al.  Portrait drawing by Paul the robot , 2013, Comput. Graph..

[16]  Oliver Deussen,et al.  Feedback-guided stroke placement for a painting machine , 2012, CAe '12.

[17]  David Mould,et al.  Stipple Placement using Distance in a Weighted Graph , 2007, CAe.

[18]  Frédo Durand,et al.  Computational rim illumination with aerial robots , 2014, CAe@Expressive.

[19]  Yeung Yam,et al.  Preliminary study on vision-based pen-and-ink drawing by a robotic manipulator , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[20]  Debasish Ghose,et al.  Optimal path planning for an aerial vehicle in 3D space , 2010, 49th IEEE Conference on Decision and Control (CDC).