Interactive grasp learning based on human demonstration

We describe our effort in development of an artificial cognitive system, able of performing complex manipulation tasks in a teleoperated or collaborative manner. Some of the work is motivated by human control strategies that, in general, involve comparison between sensory feedback and a-priori known, internal models. According to recent neuroscientific findings, predictions help to reduce the delays in obtaining the sensory information and to perform more complex tasks. This paper deals with the issue of robotic manipulation and grasping in particular. Two main contributions of the paper are: i) evaluation, recognition and modeling of human grasps during the arm transportation sequence, and ii) learning and representation of grasp strategies for different robotic hands.

[1]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[2]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[3]  Katsushi Ikeuchi,et al.  Robot task programming by human demonstration: mapping human grasps to manipulator grasps , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[4]  Avinash C. Kak,et al.  Automatic learning of assembly tasks using a DataGlove system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[5]  Gregory B. Newby,et al.  Virtual reality: Scientific and technological challenges , 1996 .

[6]  Rüdiger Dillmann,et al.  Interactive Robot Programming Based on Human Demonstration and Advice , 1998, Sensor Based Intelligent Robots.

[7]  Gerd Hirzinger,et al.  Learning techniques in a dataglove based telemanipulation system for the DLR hand , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Chris Lovchik,et al.  The Robonaut hand: a dexterous robot hand for space , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Peter K. Allen,et al.  GraspIt!: A Versatile Simulator for Grasp Analysis , 2000, Dynamic Systems and Control: Volume 2.

[10]  Lars Petersson,et al.  Systems integration for real-world manipulation tasks , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Gregory D. Hager,et al.  Task modeling and specification for modular sensory based human-machine cooperative systems , 2003, IROS.

[12]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .