Learning to Sequence Multiple Tasks with Competing Constraints

Imitation learning offers a general framework where robots can efficiently acquire novel motor skills from demonstrations of a human teacher. While many promising achievements have been shown, the majority of them are only focused on single-stroke movements, without taking into account the problem of multi-tasks sequencing. Conceivably, sequencing different atomic tasks can further augment the robot’s capabilities as well as avoid repetitive demonstrations. In this paper, we propose to address the issue of multi-tasks sequencing with emphasis on handling the so-called competing constraints, which emerge due to the existence of the concurrent constraints from Cartesian and joint trajectories. Specifically, we explore the null space of the robot from an information-theoretic perspective in order to maintain imitation fidelity during transition between consecutive tasks. The effectiveness of the proposed method is validated through simulated and real experiments on the iCub humanoid robot.

[1]  Jan Peters,et al.  Learning to sequence movement primitives from demonstrations , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Minija Tamosiunaite,et al.  Joining Movement Sequences: Modified Dynamic Movement Primitives for Robotics Applications Exemplified on Handwriting , 2012, IEEE Transactions on Robotics.

[3]  Lionel P. Robert,et al.  Human–Robot Similarity and Willingness to Work with a Robotic Co-worker , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Darwin G. Caldwell,et al.  Hybrid Probabilistic Trajectory Optimization Using Null-Space Exploration , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[6]  Aude Billard,et al.  Statistical Learning by Imitation of Competing Constraints in Joint Space and Task Space , 2009, Adv. Robotics.

[7]  Edward Grant,et al.  Learning for Control , 2019 .

[8]  Sergey Levine,et al.  One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks , 2018, ArXiv.

[9]  Ales Ude,et al.  Action sequencing using dynamic movement primitives , 2011, Robotica.

[10]  Darwin G. Caldwell,et al.  Generalized Orientation Learning in Robot Task Space , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[11]  Darwin G. Caldwell,et al.  Kernelized movement primitives , 2017, Int. J. Robotics Res..

[12]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2015, Intelligent Service Robotics.

[13]  Daniele Pucci,et al.  iCub Whole-Body Control through Force Regulation on Rigid Non-Coplanar Contacts , 2015, Front. Robot. AI.

[14]  Dana Kulic,et al.  Incremental learning of full body motion primitives and their sequencing through human motion observation , 2012, Int. J. Robotics Res..

[15]  Olivier Sigaud,et al.  Robot Skill Learning: From Reinforcement Learning to Evolution Strategies , 2013, Paladyn J. Behav. Robotics.

[16]  Oliver Kroemer,et al.  Learning Manipulation by Sequencing Motor Primitives with a Two-Armed Robot , 2014, IAS.

[17]  Daniele Pucci,et al.  Constrained DMPs for Feasible Skill Learning on Humanoid Robots , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[18]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[19]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[20]  Jean-Philippe Thiran,et al.  Lower and upper bounds for approximation of the Kullback-Leibler divergence between Gaussian Mixture Models , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  John R. Hershey,et al.  Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  Darwin G. Caldwell,et al.  Towards Minimal Intervention Control with Competing Constraints , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Tobias Luksch,et al.  Adaptive movement sequences and predictive decisions based on hierarchical dynamical systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[25]  Bernhard Schölkopf,et al.  Jointly learning trajectory generation and hitting point prediction in robot table tennis , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[26]  Daniele Pucci,et al.  iCub: The not-yet-finished story of building a robot child , 2017, Science Robotics.

[27]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.