A novel optical tracking based tele-control system for tabletop object manipulation tasks

For a robot serving in a complex environment such as in a restaurant, it is difficult to perform a task like tabletop object manipulation completely by itself, in that some information may be missing. An approach to deal with this is to use a tele-control system and method to control the robot or demonstrate. In this paper, a LeapMotion sensor based non-contact tele-control method is developed for a robot to perform tabletop object manipulation tasks. A coordinate system for mapping from the operation space of the LeapMotion sensor to the workspace of the robot is established. A gesture recognition and action generating algorithm is proposed for control or to demonstrate the motion to the robot. To evaluate the performance of the LeapMotion sensor and proposed method for tele-control of a robot, a comprehensive assessment index based on entropy weighting is proposed. Three common tele-control modes, including demonstration mode, teleoperation mode and semi-teleoperation mode, are developed on a PR2 robot. The experimental results show that the proposed tele-control system is more appropriate for use in task demonstration.

[1]  Jochen J. Steil,et al.  Robots Show Us How to Teach Them: Feedback from Robots Shapes Tutoring Behavior during Action Learning , 2014, PloS one.

[2]  Jing-Guo Ge.  Programming by demonstration by optical tracking system for dual arm robot , 2013, IEEE ISR 2013.

[3]  Wei Xiong,et al.  Design of a new type of pneumatic force feedback data glove , 2011, Proceedings of 2011 International Conference on Fluid Power and Mechatronics.

[4]  Katsushi Ikeuchi,et al.  Generation of a task model by integrating multiple observations of human demonstrations , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[6]  Axel Krieger,et al.  Experimental evaluation of contact-less hand tracking systems for tele-operation of surgical tasks , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Sang Hyoung Lee,et al.  Behavior programming by kinesthetic demonstration for a chef robot , 2011, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[8]  Andrew T. Irish,et al.  Trajectory Learning for Robot Programming by Demonstration Using Hidden Markov Model and Dynamic Time Warping , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Chin-Shyurng Fahn,et al.  Development of a data glove with reducing sensors based on magnetic induction , 2005, IEEE Transactions on Industrial Electronics.

[10]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[12]  Heni Ben Amor,et al.  Grasp Recognition with Uncalibrated Data Gloves - A Comparison of Classification Methods , 2007, 2007 IEEE Virtual Reality Conference.

[13]  Carme Torras,et al.  Robot learning from demonstration of force-based tasks with multiple solution trajectories , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[14]  Aude Billard,et al.  Learning robotic eye–arm–hand coordination from human demonstration: a coupled dynamical systems approach , 2014, Biological Cybernetics.

[15]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[16]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[17]  Alexander Verl,et al.  Learning Probabilistic Models to Enhance the Efficiency of Programming-by Demonstration for Industrial Robots , 2010, ISR/ROBOTIK.

[18]  Wei-Kai Chen,et al.  Learning a pick-and-place robot task from human demonstration , 2013, 2013 CACS International Automatic Control Conference (CACS).