Towards Endowing Collaborative Robots with Fast Learning for Minimizing Tutors' Demonstrations: What and When to Do?

Programming by demonstration allows non-experts in robot programming to train the robots in an intuitive manner. However, this learning paradigm requires multiple demonstrations of the same task, which can be time-consuming and annoying for the human tutor. To overcome this limitation, we propose a fast learning system – based on neural dynamics – that permits collaborative robots to memorize sequential information from single task demonstrations by a human-tutor. Important, the learning system allows not only to memorize long sequences of sub-goals in a task but also the time interval between them. We implement this learning system in Sawyer (a collaborative robot from Rethink Robotics) and test it in a construction task, where the robot observes several human-tutors with different preferences on the sequential order to perform the task and different behavioral time scales. After learning, memory recall (of what and when to do a sub-task) allows the robot to instruct inexperienced human workers, in a particular human-centered task scenario.

[1]  Estela Bicho,et al.  The dynamic neural field approach to cognitive robotics , 2006, Journal of neural engineering.

[2]  G. Schöner The Cambridge Handbook of Computational Psychology: Dynamical Systems Approaches to Cognition , 2008 .

[3]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[4]  Weidong Li,et al.  Cobot programming for collaborative industrial tasks: An overview , 2019, Robotics Auton. Syst..

[5]  Sotiris Makris,et al.  Towards seamless human robot collaboration: integrating multimodal interaction , 2019, The International Journal of Advanced Manufacturing Technology.

[6]  Estela Bicho,et al.  Learning a musical sequence by observation: A robotics implementation of a dynamic neural field model , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[7]  Estela Bicho,et al.  Multi-bump solutions in a neural field model with external inputs , 2016 .

[8]  Stefan Schaal,et al.  The New Robotics—towards Human-centered Machines , 2007 .

[9]  Estela Bicho,et al.  A Dynamic Field Model of Ordinal and Timing Properties of Sequential Events , 2011, ICANN.

[10]  Dominik Henrich,et al.  Robot programming by non-experts: Intuitiveness and robustness of One-Shot robot programming , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[11]  Stephan K. U. Zibner,et al.  Using Dynamic Field Theory to extend the embodiment stance toward higher cognition , 2013 .

[12]  Estela Bicho,et al.  Off-line simulation inspires insight: A neurodynamics approach to efficient robot task learning , 2015, Neural Networks.

[13]  Estela Bicho,et al.  Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study. , 2011, Human movement science.

[14]  Estela Bicho,et al.  Towards temporal cognition for robots: A neurodynamics approach , 2017, 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[15]  Estela Bicho,et al.  Goal-directed imitation for robots: A bio-inspired approach to action understanding and skill learning , 2006, Robotics Auton. Syst..

[16]  Maria Kyrarini,et al.  Robot learning of industrial assembly task via human demonstrations , 2019, Auton. Robots.