Grasp recognition in virtual reality for robot pregrasp planning by demonstration

This paper describes a virtual reality based programming by demonstration system for grasp recognition in manipulation tasks and robot pregrasp planning. The system classifies the human hand postures taking advantage of virtual grasping and information about the contact points and normals computed in the virtual reality environment. A pregrasp planning algorithm mimicking the human hand motion is also proposed. Reconstruction of human hand trajectories, approaching the objects in the environment, is based on NURBS curves and a data smoothing algorithm. Some experiments involving grasp classification and pregrasp planning, while avoiding obstacles in the workspace, show the viability and effectiveness of the approach

[1]  Thea Iberall,et al.  The nature of human prehension: Three dextrous hands in one , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[2]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[3]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[4]  Les A. Piegl,et al.  On NURBS: a survey , 1991, IEEE Computer Graphics and Applications.

[5]  Tomoichi Takahashi,et al.  Teaching robot's movement in virtual reality , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[6]  Tomoichi Takahashi,et al.  Robotic assembly operation teaching in a virtual environment , 1994, IEEE Trans. Robotics Autom..

[7]  Katsushi Ikeuchi,et al.  Toward an assembly plan from observation. I. Task recognition with polyhedral objects , 1994, IEEE Trans. Robotics Autom..

[8]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps , 1997, IEEE Trans. Robotics Autom..

[9]  Dinesh K. Pai,et al.  Programming contact tasks using a reality-based virtual environment integrated with vision , 1999, IEEE Trans. Robotics Autom..

[10]  Peter K. Allen,et al.  GraspIt!: A Versatile Simulator for Grasp Analysis , 2000, Dynamic Systems and Control: Volume 2.

[11]  Rüdiger Dillmann,et al.  Understanding users intention: programming fine manipulation tasks by demonstration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Danica Kragic,et al.  Interactive grasp learning based on human demonstration , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  Aude Billard,et al.  Stochastic gesture production and recognition model for a humanoid robot , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Kenzo Nonami,et al.  Hand posture detection by neural network and grasp mapping for a master slave hand system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[15]  Stefano Caselli,et al.  Leveraging on a virtual environment for robot programming by demonstration , 2004, Robotics Auton. Syst..

[16]  Danica Kragic,et al.  Grasp Recognition for Programming by Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Katsushi Ikeuchi,et al.  A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models , 2005, IEEE Transactions on Robotics.