An image-based trajectory planning approach for robust robot programming by demonstration

Abstract The article proposes a new robot programming-by-demonstration framework, which integrates a visual servoing tracking control to robustly follow a trajectory generated from observed demonstrations. The constraints originating from the use of a visual servoing controller are incorporated into the trajectory learning phase, to guarantee feasibility of the generated plan for task execution. The observational learning is solved as a constrained optimization problem, with an objective to generalize from a set of trajectories of salient features in the image space of a vision camera. The proposed approach is evaluated experimentally for learning trajectories acquired from kinesthetic demonstrations.

[1]  Andrew T. Irish,et al.  A PbD approach for learning pseudo-periodic robot trajectories over curved surfaces , 2010, 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[2]  Andrew T. Irish,et al.  Trajectory Learning for Robot Programming by Demonstration Using Hidden Markov Model and Dynamic Time Warping , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Scott Niekum,et al.  Learning grounded finite-state representations from unstructured demonstrations , 2015, Int. J. Robotics Res..

[4]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[5]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[6]  Graziano Chesi,et al.  Conferring Robustness to Path-Planning for Image-Based Control , 2012, IEEE Transactions on Control Systems Technology.

[7]  Darwin G. Caldwell,et al.  Learning optimal controllers in human-robot cooperative transportation tasks with position and force constraints , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[9]  M. Asada,et al.  Learning by Observation without Three-Dimensional Reconstruction , 2004 .

[10]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[11]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[12]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[13]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[14]  Zoran Miljkovic,et al.  Bio-inspired approach to learning robot motion trajectories and visual control commands , 2015, Expert Syst. Appl..

[15]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[16]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[17]  Sylvain Calinon,et al.  Robot Programming by Demonstration - a Probabilistic Approach , 2009 .

[18]  Farrokh Janabi-Sharifi,et al.  Visual Servoing: Theory and Applications , 2002 .

[19]  Torsten Bertram,et al.  Get Out of the Way – Obstacle Avoidance and Learning by Demonstration for Manipulation , 2011 .

[20]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[21]  Yogesh Angal,et al.  A SURVEY OF LEARNING FROM DEMONSTRATION USED IN ROBOTICS , 2015 .

[22]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[23]  Darwin G. Caldwell,et al.  Upper-body kinesthetic teaching of a free-standing humanoid robot , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Minoru Asada,et al.  Vision-based Learning and Development for Emergence of Robot Behaviors , 2004 .

[25]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[26]  Jörn Malzahn,et al.  Tool centered learning from demonstration for robotic arms with visual feedback , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[27]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[28]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[29]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[30]  Martin Jägersand,et al.  Towards Practical Visual Servoing in Robotics , 2013, 2013 International Conference on Computer and Robot Vision.

[31]  Pieter Abbeel,et al.  Learning for control from multiple demonstrations , 2008, ICML '08.

[32]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[33]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[34]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[35]  Aude Billard,et al.  Learning from Humans , 2016, Springer Handbook of Robotics, 2nd Ed..

[36]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[37]  Torsten Bertram,et al.  Acquisition of Behavioral Dynamics for Vision Based Mobile Robot Navigation from Demonstrations , 2013 .

[38]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..