American Sign Language recognition by using 3D geometric invariant feature and ANN classification

Communication between normal and disabled person has been developed in several researches. The hand gesture is one of important communication for the deaf, especially American Sign Language (ASL) which is used in order to represent each alphabet (A-Z). This paper aims to translate ASL from static postures. Besides, this research also designs the glove with six different colored markers and develops algorithm for alphabet classification. Moreover the system is set by two cameras in order to extract 3D coordinate points from each marker. There are three main important processes for algorithm consisting of marker detection by using Circle Hough Transform, computation of all feasible triangle area patches constructed from 3D coordinate triplet that is novel feature, and feature classification using feedforward backpropagation of Artificial Neural Network. The experimental result shows average of accuracy is 95 percent that is high performance and feasibility for proposed method.

[1]  Richard Bowden,et al.  Sign Language Recognition , 2011, Visual Analysis of Humans.

[2]  Sang-Heon Lee,et al.  3D hand gesture recognition from one example , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[3]  Liya Ding,et al.  Three-Dimensional Shape and Motion Reconstruction for the Analysis of American Sign Language , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Surapa Thiemjarus,et al.  Design of an Assistive Communication Glove Using Combined Sensory Channels , 2012, 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks.

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  DaeEun Kim,et al.  Finger-gesture Recognition Glove using Velostat (ICCAS 2011) , 2011, 2011 11th International Conference on Control, Automation and Systems.

[7]  Kin Fun Li,et al.  A Web-Based Sign Language Translator Using 3D Video Processing , 2011, 2011 14th International Conference on Network-Based Information Systems.

[8]  A. Al-Hamadi,et al.  Spatio-temporal feature extraction-based hand gesture recognition for isolated American Sign Language and Arabic numbers , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[9]  R. Akmeliawati,et al.  Pattern matching for automatic sign language translation system using LabVIEW , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[10]  Adhi Susanto,et al.  Preliminary design of static indonesian sign language recognition system , 2013, 2013 International Conference on Information Technology and Electrical Engineering (ICITEE).

[11]  R. Akmeliawati,et al.  Real-Time Malaysian Sign Language Translation using Colour Segmentation and Neural Network , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[12]  S. Majumder,et al.  Shape, texture and local movement hand gesture features for Indian Sign Language recognition , 2011, 3rd International Conference on Trendz in Information Sciences & Computing (TISC2011).

[13]  M. S. Sinith,et al.  Sign Gesture Recongnition Using Support Vector Machine , 2012, 2012 International Conference on Advances in Computing and Communications.

[14]  Sansanee Auephanwiriyakul,et al.  Thai sign language translation system using upright speed-up robust feature and c-means clustering , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[15]  Hong Yan,et al.  Sign Language Finger Alphabet Recognition from Gabor-PCA Representation of Hand Gestures , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[16]  Xiaodong Yang,et al.  Histogram of 3D Facets: A characteristic descriptor for hand gesture recognition , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).