Sign Language Recognition in Robot Teleoperation using Centroid Distance Fourier Descriptors

in robot teleoperation system can be done in several ways, including the use of sign language. In this paper, the use of centroid distance Fourier descriptors as hand shape descriptor in sign language recognition from visually captured hand gesture is considered. The sign language adopts the American Sign Language finger spelling. Only static gestures in the sign language are used. To obtain hand images, depth imager is used in this research. Hand image is extracted from depth image by applying threshold operation. Centroid distance signature is constructed from the segmented hand contours as a shape signature. Fourier transformation of the centroid distance signature results in fourier descriptors of the hand shape. The fourier descriptors of hand gesture are then compared with the gesture dictionary to perform gesture recognition. The performance of the gesture recognition using different distance metrics as classifiers is investigated. The test results show that the use of 15 Fourier descriptors and Manhattan distance-based classifier achieves the best recognition rates of 95% with small computation latency about 6.0573 ms. Recognition error is occurred due to the similarity of Fourier descriptors from some gesture. KeywordsGesture, Sign Language, Fingerspelling, CeFD, Fourier Descriptor.

[1]  Caroline Fossati,et al.  Comparison of shape descriptors for hand posture recognition in video , 2012, Signal Image Video Process..

[2]  Salah Bourennane,et al.  Comparison of fourier descriptors and Hu moments for hand posture recognition , 2007, 2007 15th European Signal Processing Conference.

[3]  Ge Yan,et al.  Hand Gesture Recognition Using Neural Networks For Robotic Arm Control , 2007 .

[4]  Frank Y. Shih,et al.  Image Processing and Pattern Recognition: Fundamentals and Techniques , 2010 .

[5]  Dengsheng Zhang.  Image retrieval based on shape , 2002 .

[6]  Kwan S. Kwok.  Research on the Use of Robotics in Hazardous Environments at Sandia National Laboratories , 1999 .

[7]  Yael Edan,et al.  Real-time hand gesture telerobotic system using fuzzy c-means clustering , 2002, Proceedings of the 5th Biannual World Automation Congress.

[8]  Napoleon H. Reyes,et al.  Analysis of Feature Invariance and Discrimination for Hand Images: Fourier Descriptors versus Momen , 2011 .

[9]  Surendra Ranganath,et al.  Real-time gesture recognition system and application , 2002, Image Vis. Comput..

[10]  Yu Sun,et al.  Static Hand Gesture Recognition and its Application based on Support Vector Machines , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[11]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[12]  Guojun Lu,et al.  A Comparative Study of Fourier Descriptors for Shape Representation and Retrieval , 2002 .

[13]  Rayi Yanu Tara,et al.  Hand Segmentation from Depth Image using Anthropometric Approach in Natural Interface Development , 2012 .

[14]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.