Interactive Multi-Robot Painting Through Colored Motion Trails

In this paper, we present a robotic painting system whereby a team of mobile robots equipped with different color paints create pictorial compositions by leaving trails of color as they move throughout a canvas. We envision this system to be used by an external user who can control the concentration of different colors over the painting by specifying density maps associated with the desired colors over the painting domain, which may vary over time. The robots distribute themselves according to such color densities by means of a heterogeneous distributed coverage control paradigm, whereby only those robots equipped with the appropriate paint will track the corresponding color density function. The painting composition therefore arises as the integration of the motion trajectories of the robots, which lay paint as they move throughout the canvas tracking the color density functions. The proposed interactive painting system is evaluated on a team of mobile robots. Different experimental setups in terms of paint capabilities given to the robots highlight the effects and benefits of considering heterogeneous teams when the painting resources are limited.

[1]  Elizabeth Ann Jochum,et al.  HEAT: The Harmony Exoskeleton Self - Assessment Test , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[2]  Paul A. Beardsley,et al.  Human - Robot Swarm Interaction for Entertainment : From animation display to gesture based control , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Magnus Egerstedt,et al.  From Motions to Emotions: Can the Fundamental Emotions be Expressed in a Robot Swarm? , 2019, ArXiv.

[4]  Gary Greenfield,et al.  Evolutionary Methods for Ant Colony Paintings , 2005, EvoWorkshops.

[5]  Yancy Diaz-Mercado,et al.  Distributed dynamic density coverage for human-swarm interactions , 2015, 2015 American Control Conference (ACC).

[6]  Qiang Du,et al.  Centroidal Voronoi Tessellations: Applications and Algorithms , 1999, SIAM Rev..

[7]  Elizabeth Ann Jochum,et al.  Cultivating the Uncanny: The Telegarden and Other Oddities , 2016 .

[8]  Amy LaViers,et al.  Style-Based Robotic Motion in Contemporary Dance Performance , 2014 .

[9]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[10]  Leonel Moura.  Machines That Make Art , 2016 .

[11]  Guy Hoffman,et al.  Gesture-based human-robot Jazz improvisation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Siddharth Mayya,et al.  The Robotarium: Globally Impactful Opportunities, Challenges, and Lessons Learned in Remote-Access, Distributed Control of Multirobot Systems , 2020, IEEE Control Systems.

[13]  Peter Fankhauser,et al.  Real-Time Dance Generation to Music for a Legged Robot , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  R. Berns.  Billmeyer and Saltzman's Principles of Color Technology , 2000 .

[15]  David St-Onge,et al.  More Than the Sum of its Parts: Assessing the Coherence and Expressivity of a Robotic Swarm , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[16]  Seung-Woo Son,et al.  Large-Scale Quantitative Analysis of Painting Arts , 2014, Scientific Reports.

[17]  R. Olfati-Saber.  Near-Identity Diffeomorphisms and Exponential E-Tracking and 6-Stabilization of First-Order Nonholonomic SE( 2) Vehicles , 2002 .

[18]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[19]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[20]  Magnus Egerstedt,et al.  A measure of heterogeneity in multi-agent systems , 2014, 2014 American Control Conference.

[21]  Mari Velonaki,et al.  Cultural Robotics: Robots as Participants and Creators of Culture , 2015, CR@RO-MAN.

[22]  Konstantinos N. Plataniotis,et al.  Distance measures for color image retrieval , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[23]  Raffaello D'Andrea,et al.  So You Think You Can Dance? Rhythmic Flight Performances with Quadrocopters , 2014 .

[24]  Oliver Deussen,et al.  Image stylization with a painting machine using semantic hints , 2013, Comput. Graph..

[25]  Katsushi Ikeuchi,et al.  Painting Robot with Multi-Fingered Hands and Stereo Vision , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[26]  Frederic Fol Leymarie,et al.  Portrait drawing by Paul the robot , 2013, Comput. Graph..

[27]  David St-Onge,et al.  Collective expression: how robotic swarms convey information with group motion , 2019, Paladyn J. Behav. Robotics.

[28]  Magnus Egerstedt,et al.  Coverage Control for Multirobot Teams With Heterogeneous Sensing Capabilities , 2018, IEEE Robotics and Automation Letters.

[29]  Paulo Urbano,et al.  Playing in the Pheromone Playground: Experiences in Swarm Painting , 2005, EvoWorkshops.

[30]  Aaron Albin,et al.  Musical abstractions in distributed multi-robot systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Paolo Gallina,et al.  Watercolour Robotic Painting: a Novel Automatic System for Artistic Rendering , 2018, J. Intell. Robotic Syst..

[32]  Lawrence H. Kim,et al.  Human Perception of Swarm Robot Motion , 2017, CHI Extended Abstracts.

[33]  G. Venturini,et al.  Interactive evolution of ant paintings , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[34]  Alexander Schubert.  An optimal control based analysis of human action painting motions , 2017 .

[35]  Magnus Egerstedt,et al.  Coverage Control for Multi-Robot Teams with Heterogeneous Sensing Capabilities Using Limited Communications* , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Colour.  Billmeyer and Saltzman's Principles of Colour Technology, 3rd ed. , 2006 .

[37]  Kazuhito Yokoi,et al.  Imitating human dance motions through motion structure analysis , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.