Recognizing Gestures for Humanoid Robot Using Proto-Symbol Space

This paper describes the non Verbal communication method for developing a gesture-based system using Mimesis model. The proposed method is applicable to any hand gesture represented by a multi-dimensional signal. The entire work concentrates mainly on hand gestures recognition. It develops a way to communicate between Humans and the Humanoid Robots through gestural medium. The Mimesis is the technique of performing human gestures through imitation, recognition and generation. Different Gestures are being converted into code words through the use of code book. These code words are then converted into Proto-Symbols, these proto symbol then forms basis for training of the Humanoid robot. The recognition part is performed through a “distance vector”, a novel algorithm developed by us which is a combination of Euclidean distance and K-nearest neighbor. The generation part is done through the use of WEBOTS which include use of Humanoid robot HOAP 2 having 25 degrees of freedom. All the process of training, recognition and generation are simulated through MATLAB.

[1]  Yoshihiko Nakamura,et al.  Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  W. Takano,et al.  Key feature extraction for probabilistic categorization of human motion patterns , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[3]  Tomio Hirata,et al.  A systolic algorithm for Euclidean distance transform , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[5]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[6]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[7]  Kazuhito Yokoi,et al.  Balance control of a piped robot combining off-line pattern with real-time modification , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Yoshihiko Nakamura,et al.  Mimesis embodiment and proto-symbol acquisition for humanoids , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[9]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[10]  Shiliang Sun,et al.  An adaptive k-nearest neighbor algorithm , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.