Shape recognition and grasping by robotic hands with soft fingers and omnidirectional camera

The purpose of this paper is to establish a method of shape recognition and grasping of unknown objects using a robotic hand with two soft fingers and one omnidirectional camera. For shape recognition, we propose to use a simple 2D version of the visual volume intersection method which takes advantage of a special feature of the omnidiretional camera attached to the hand. For grasping we propose a simple grasp quality criterion to obtain the best grasping position for the two soft fingers based on a visual hull in a horizontal grasp plane. We conducted several experiments and the results show the validity of the proposed method.

[1]  IIYAMA Masaaki,et al.  4/spl pi/ measurement system: a complete volume reconstruction system for freely-moving objects , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[2]  Zoe Doulgeri,et al.  Grasping control of rolling manipulations with deformable fingertips , 2003 .

[3]  Minoru Asada,et al.  Anthropomorphic robotic soft fingertip with randomly distributed receptors , 2006, Robotics Auton. Syst..

[4]  Imin Kao,et al.  Modeling of Contact Mechanics and Friction Limit Surfaces for Soft Fingers in Robotics, with Experimental Results , 1999, Int. J. Robotics Res..

[5]  Tsuneo Yoshikawa,et al.  Grasping Optimization Using a Required External Force Set , 2007, IEEE Transactions on Automation Science and Engineering.

[6]  Shinichi Hirai,et al.  Study on hemispherical soft-fingered handling for fine manipulation by minimum D.O.F. robotic hand , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[8]  Suguru Arimoto,et al.  Dynamics and control of a set of dual fingers with soft tips , 2000, Robotica.

[9]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[10]  Ronald W. Schafer,et al.  Image-based photo hulls , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[11]  Tsuneo Yoshikawa,et al.  Vision-aided object manipulation by a multifingered hand with soft fingertips , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[12]  Mark R. Cutkosky,et al.  Manipulating with soft fingers: modeling contacts and dynamics , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[13]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Kouji Murakami,et al.  Novel fingertip equipped with soft skin and hard nail for dexterous multi-fingered robotic manipulation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[15]  Peter K. Allen,et al.  GraspIt!: A Versatile Simulator for Grasp Analysis , 2000, Dynamic Systems and Control: Volume 2.

[16]  John F. Canny,et al.  Easily computable optimum grasps in 2-D and 3-D , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.