Vision Based Static Hand Pose, Hand Movement Recognition System For Sign Language Using Eigen Vector Theory In MATLAB

This paper presents a vision based system that provides a feasible solution to Indian Sign Language (ISL) recognition of static gestures of alphabets. It deals with images of bare hands, which allows the user to interact with the system in a natural way. An image is processed and converted to a Eigen vector that will be compared with the Eigen vectors of a training set mean of signs. The most important part of the recognition method is a feature extraction process using Eigen value algorithm in MATLAB coding. An image is processed and converted to a feature vector that will be compared with the feature vectors of a training set mean of signs. The system was implemented and tested using a data set of 650 samples of hand sign images; 25 images for each sign. The system recognizes one handed alphabet signs from Indian sign language (ISL). The proposed system achieved a recognition accuracy of 100 %.

[1]  Aliaa A. A. Youssif,et al.  Arabic Sign Language (ArSL) Recognition System Using HMM , 2011 .

[2]  Wu-Chih Hu,et al.  Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination , 2011, Expert Syst. Appl..

[3]  D. Tewari,et al.  A Visual Recognition of Static Hand Gestures in Indian Sign Language based on Kohonen Self-Organizing Map Algorithm , 2012 .

[4]  Saudi Arabia,et al.  Real-Time Arabic Sign Language (ArSL) Recognition , 2012 .

[5]  Roger J. Hubbold,et al.  A real-time hand tracker using variable-length Markov models of behaviour , 2007, Comput. Vis. Image Underst..

[6]  Eung-Joo Lee,et al.  Continuous Gesture Recognition System Using Improved HMM Algorithm Based on 2D and 3D Space , 2012 .

[7]  Israr Ahmed,et al.  Pakistan Sign Language Recognition Using Statistical Template Matching , 2007 .

[8]  Fakhreddin Mamedov,et al.  Character Recognition using Neural Networks , 2006, IC-AI.

[9]  Khaled Assaleh,et al.  Vision-based system for continuous Arabic Sign Language recognition in user dependent mode , 2008, 2008 5th International Symposium on Mechatronics and Its Applications.

[10]  Poth Miklos,et al.  Character recognition using neural networks , 2010, 2010 11th International Symposium on Computational Intelligence and Informatics (CINTI).

[11]  Samir I. Shaheen,et al.  Sign language recognition using a combination of new vision based features , 2011, Pattern Recognit. Lett..

[12]  Munib Qutaishat,et al.  American sign language (ASL) recognition based on Hough transform and neural networks , 2007, Expert Syst. Appl..

[13]  R. Mas,et al.  Real – Time Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2000 .

[14]  Ibrahim Patel,et al.  Technologies automated speech recognition approach to finger spelling , 2010, 2010 Second International conference on Computing, Communication and Networking Technologies.

[15]  Nitin V. Pujari,et al.  Finger Detection for Sign Language Recognition , 2009 .

[16]  P. Subha Rajam,et al.  Recognition of Tamil Sign Language Alphabet using Image Processing to aid Deaf-Dumb People , 2012 .

[17]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Wan Fatimah Wan Ahmad,et al.  Static Hand Gesture Recognition Using Local Gabor Filter , 2012 .

[19]  Siddharth Swarup Rautaray,et al.  Real Time Multiple Hand Gesture Recognition System for Human Computer Interaction , 2012 .

[20]  Yoshiaki Shirai,et al.  Extraction of Hand Features for Recognition of Sign Language Words , 2002 .

[21]  Bian Wu,et al.  A hand gesture recognition system based on local linear embedding , 2005, J. Vis. Lang. Comput..

[22]  Ramon Mas,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2005 .

[23]  M. Deriche,et al.  A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model , 2012, Comput. Electr. Eng..

[24]  Toshiaki Ejima,et al.  Real-Time Hand Tracking and Gesture Recognition System , 2005 .

[25]  Daniel Kelly,et al.  A person independent system for recognition of hand postures used in sign language , 2010, Pattern Recognit. Lett..

[26]  Kostas Karpouzis,et al.  Non-manual cues in automatic sign language recognition , 2011, PETRA.

[27]  Aboul Ella Hassanien,et al.  ArSLAT: Arabic Sign Language Alphabets Translator , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[28]  R. Manmatha,et al.  Finding words in alphabet soup: Inference on freeform character recognition for historical scripts , 2009, Pattern Recognit..