Recognition of Human Combined Motion from Haptic Information Using Similarly Structured Master and Slave Robot Hands

SUMMARY In this paper, a motion recognition method that uses haptic information of the human hand is proposed. The haptic information is measured by master and slave robot hands. The robot has five degrees of freedom, and bilateral control of the robot is implemented. The operator wears the master robot hand and manipulates an object through the slave robot hand. A motion database is prepared, containing haptic information in the form of reference vectors for eight kinds of human motion. The motion database utilizes the cosine similarity to distinguish different human motions on the basis of the haptic information acquired by the master robot. Expansion and contraction of the time axes are corrected by dynamic programming matching, and combination motion is then recognized. The validity of the proposed method is experimentally confirmed. © 2013 Wiley Periodicals, Inc. Electron Comm Jpn, 96(12): 15–23, 2013; Published online in Wiley Online Library (wileyonlinelibrary.com). DOI 10.1002/ecj.11566

[1]  Kouhei Ohnishi,et al.  Verification of Flexible Actuator From Position and Force Transfer Characteristic and Its Application to Bilateral Teleoperation System , 2009, IEEE Transactions on Industrial Electronics.

[2]  Kouhei Ohnishi,et al.  Motion control for advanced mechatronics , 1996 .

[3]  Tatsuhito Watanabe,et al.  Character recognition method by time-frequency analyses using writing pressure , 2010 .

[4]  Hideo Saito,et al.  Virtual 3-D interface system via hand motion recognition from two cameras , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Naoki Kawakami,et al.  An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[6]  Seiichiro Katsura,et al.  A realization of motion acquisition system based on interaction mode control , 2007 .

[7]  Kouhei Ohnishi,et al.  A method for haptic motion abstraction and display based on action force directionality , 2009 .

[8]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[9]  Tatsuhito Watanabe,et al.  Recognition and classification of road condition on the basis of friction force by using a mobile robot , 2011 .

[10]  Kouhei Ohnishi,et al.  Modal-power-based haptic motion recognition , 2010 .

[11]  Hong Liu,et al.  An exoskeleton master hand for controlling DLR/HIT hand , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Kouhei Ohnishi,et al.  Realization of advanced hybrid control through oblique coordinate control , 2010 .

[13]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[14]  Jun Ota,et al.  Motion Recognition using DP Matching. , 1997 .

[15]  Katsushi Ikeuchi,et al.  Extraction of essential interactions through multiple observations of human demonstrations , 2003, IEEE Trans. Ind. Electron..

[16]  Kouhei Ohnishi,et al.  A controller design method for human-assist robot with force filtering process , 2007 .

[17]  Toshiyuki Murakami,et al.  Torque sensorless control in multidegree-of-freedom manipulator , 1993, IEEE Trans. Ind. Electron..

[18]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..