Implementation and evaluation of DWT and MFCC based ISL gesture recognition

In recent days, Indian Sign Language (ISL) has been assumed to have more appealing gestures for speech and hearing impaired community present in India. It helps us to understand the inherent meaning of this language for establishing a gesture based communicating system. In this paper a novel Discrete Wavelet Transform (DWT) and Mel Frequency Ceptral Coefficients (MFCC) based ISL gesture recognition technique is proposed. Here DWT is used for reducing the dimensionality of the data as well as for finding the most appropriate boundary points of hand gestures. After that MFCC is applied as a feature extraction technique for finding the spectral envelope of each image frame. This spectral envelope quality is useful for recognizing hand gestures in complex environment. Here support vector machine (SVM) and K Nearest Neighbour (KNN) is used as a classifier for classifying an unknown gesture. From experimental results it has been observed that DWT with MFCC provides high recognition rate with SVM as compare to KNN.

[1]  Karen Das,et al.  Hand Gesture Recognition Based on Karhunen-Loeve Transform , 2013, ArXiv.

[2]  Tamás Szirányi,et al.  Hand-Gesture Based Film Restoration , 2002, PRIS.

[3]  Gora Chand Nandi,et al.  A Speech Recognition Technique Using MFCC with DWT in Isolated Hindi Words , 2013, ICACNI.

[4]  R. Watson.  A Survey of Gesture Recognition Techniques , 1993 .

[5]  Jérôme Martin,et al.  An Appearance-Based Approach to Gesture-Recognition , 1997, ICIAP.

[6]  Tin Hninn Hninn Maung,et al.  Real-Time Hand Tracking and Gesture Recognition System Using Neural Networks , 2009 .

[7]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[8]  Jafreezal Jaafar,et al.  FEATURE EXTRACTION USING MFCC , 2013 .

[9]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[10]  Lars Bretzner,et al.  Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[11]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[12]  R. Watson.  A Survey of Gesture RecognitionTechniques. , 1993 .

[13]  Alan Wexelblat,et al.  An approach to natural gesture in virtual environments , 1995, TCHI.

[14]  G. C. Nandi,et al.  Recognizing & interpreting Indian Sign Language gesture for Human Robot Interaction , 2010, 2010 International Conference on Computer and Communication Technology (ICCCT).

[15]  G. C. Nandi,et al.  Indian Sign Language gesture recognition using Discrete Wavelet Packet Transform , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).