Copycat hand — robot hand imitating human motions at high speed and with high accuracy

We developed a method enabling them to search similar images at high speed with high accuracy and in uniform processing time, even in the case of using a large-scale database, by clustering databases with uniform numbers of data through self-organizing including self-multiplication and self-extinction, and by collating the input image with the data in the database by means of low-order amounts of characteristics of images, while narrowing the search space in accordance with the past history. By estimating the continuous hand finger shape image string by using the method, we succeeded in realizing processing with an estimation error of the joint angle within several degrees, at a processing time of 150–160 f.p.s, and in an operating time without dispersion, in the case of using a PC having a CPU clock frequency of 2.8 GHz and a memory capacity of 1GB. As the image information and the joint angle information are paired in the database, the robot hand, called the 'Copycat hand', was able to reproduce the same motions as those of the hand and fingers of a human being, without any delay in time, by outputting the results of estimation at the robot hand.

[1]  Stan Sclaroff,et al.  An appearance-based framework for 3D hand shape classification and camera viewpoint estimation , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Gordon Cheng,et al.  Unconstrained Real-time Markerless Hand Tracking for Humanoid Interaction , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[3]  Kiyoshi Hoshino,et al.  Pinching at Fingertips for Humanoid Robot Hand , 2005, J. Robotics Mechatronics.

[4]  H. Sakata,et al.  Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. , 2000, Journal of neurophysiology.

[5]  Shan Lu,et al.  Using multiple cues for hand tracking and model refinement , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  G. Rizzolatti,et al.  Functional organization of inferior area 6 in the macaque monkey , 2004, Experimental Brain Research.

[7]  Ying Wu,et al.  Analyzing and capturing articulated hand motion in image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Teuvo Kohonen,et al.  The 'neural' phonetic typewriter , 1988, Computer.

[9]  Takio Kurita,et al.  A New Scheme for Practical Flexible and Intelligent Vision Systems , 1988, MVA.

[10]  Katsushi Ikeuchi,et al.  A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models , 2005, IEEE Transactions on Robotics.

[11]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[12]  Kiyoshi Hoshino,et al.  Pinching at finger tips by humanoid robot hand , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[13]  Kiyoshi Hoshino,et al.  Real time search for similar hand images from database for robotic hand control , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).