Robot Programming without Coding

An approach toward intuitive and easy robot programming, consists to transfer skills from humans to machines, through demonstration. A vast literature exists on learning from multiple demonstrations.This paper, on the other hand, tackles the problem of providing all needed information to execute a certain task by resorting to one single demonstration - hence, a problem closer to programming than to learning. We use wearable consumer devices - but no keyboard nor coding - as programming tools, to let the programmer tele-operate the robot, which in turn records the most salient features and affordances from the object, environment, robot, and human.To enable this goal we combine off-the-shelf soft-articulated robotic components with the framework of Dynamic Movement Primitives, which we contribute to extend to generalize human trajectories and impedance regulation skills.This framework enables to teach robot quickly and in a intuitive way without coding. Experimental tests have been performed on a dual-arm system composed by two 7-dofs collaborative robots equipped with anthropomorphic end-effectors. Experiments show the functionality of the framework and verify the effectiveness of the impedance extension.

[1]  Wolfram Burgard,et al.  The limits and potentials of deep learning for robotics , 2018, Int. J. Robotics Res..

[2]  Henrik I. Christensen,et al.  Efficient Organized Point Cloud Segmentation with Connected Components , 2013 .

[3]  Manuel G. Catalano,et al.  Shared-Autonomy Control for Intuitive Bimanual Tele-Manipulation , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[4]  Cheng Fang,et al.  A DMPs-Based Framework for Robot Learning and Generalization of Humanlike Variable Impedance Skills , 2018, IEEE/ASME Transactions on Mechatronics.

[5]  Ales Ude,et al.  Solving peg-in-hole tasks by human demonstration and exception strategies , 2014 .

[6]  J. Fagard,et al.  Learning through practice versus learning by observation in infants , 2009 .

[7]  M. Jeannerod.  Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[8]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[9]  Stefan Schaal,et al.  Model-Free Reinforcement Learning of Impedance Control in Stochastic Environments , 2012, IEEE Transactions on Autonomous Mental Development.

[10]  Anthony M. Zador,et al.  A critique of pure learning and what artificial neural networks can learn from animal brains , 2019, Nature Communications.

[11]  Angelo Cangelosi,et al.  Posture Affects How Robots and Infants Map Words to Objects , 2015, PloS one.

[12]  Katharina J. Rohlfing,et al.  Toward designing a robot that learns actions from parental demonstrations , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  Eric L. Sauser,et al.  A probabilistic approach based on dynamical systems to learn and reproduce gestures by imitation , 2009 .

[14]  Andrej Gams,et al.  Generalization of orientation trajectories and force-torque profiles for robotic assembly , 2017, Robotics Auton. Syst..

[15]  Stefan Schaal,et al.  Learning and generalization of motor skills by learning from demonstration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Joris De Schutter,et al.  Combining Imitation Learning With Constraint-Based Task Specification and Control , 2019, IEEE Robotics and Automation Letters.

[17]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[18]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[19]  Jacob H. Palnick.  Plane Detection and Segmentation For DARPA Robotics Challange , 2014 .

[20]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[21]  Henrik I. Christensen,et al.  RGB-D object tracking: A particle filter approach on GPU , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Cosimo Della Santina,et al.  Soft Robots that Mimic the Neuromusculoskeletal System , 2017 .

[23]  Jochen J. Steil,et al.  Learning movement primitives for force interaction tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Ken Goldberg,et al.  Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation , 2017, ICRA.

[25]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[26]  S. Bennett,et al.  Goal-directed imitation: the means to an end. , 2008, Acta psychologica.