Hand shape classification using DTW and LCSS as similarity measures for vision-based gesture recognition system

In this paper an approach to classify hand shapes into different classes according to the similarity measures between features is proposed. We show how to use an Exploratory Data Analysis to extract novel, single feature of hand from images. Based on the obtained curve-like shape of the feature, hands are classified into one of 21 possible classes of Croatian sign language using Dynamic Time Warping and Longest Common Subsequence as similarity measures. Performance of the system was evaluated with 1260 images. Results show that high classification accuracy can be obtained from a single feature recognition and a small number of training sample.

[1]  Chung-Lin Huang,et al.  A model-based hand gesture recognition system , 2001, Machine Vision and Applications.

[2]  Sumantra Dutta Roy,et al.  Hand gesture modelling and recognition involving changing shapes and trajectories, using a Predictive EigenTracker , 2007, Pattern Recognit. Lett..

[3]  Munib Qutaishat,et al.  American sign language (ASL) recognition based on Hough transform and neural networks , 2007, Expert Syst. Appl..

[4]  Robyn A. Owens,et al.  Australian sign language recognition , 2005, Machine Vision and Applications.

[5]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[6]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[7]  Lalit Gupta,et al.  Gesture-based interaction and communication: automated classification of hand gesture contours , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[8]  Chin-Chen Chang,et al.  Adaptive multiple sets of CSS features for hand posture recognition , 2006, Neurocomputing.

[9]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[10]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[11]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[12]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Tim Morris,et al.  Hand Segmentation from Live Video , 2002 .

[14]  Suat Akyol,et al.  Hands Tracking from Frontal View for Vision-Based Gesture Recognition , 2002, DAGM-Symposium.

[15]  Shaogang Gong,et al.  Resolving Visual Uncertainty and Occlusion through Probabilistic Reasoning , 2000, BMVC.

[16]  Michael G. Strintzis,et al.  A gesture recognition system using 3D data , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[17]  Ana Kuzmanić.  Modeling Feature Signals for Vision-Based Hand Posture Classification , 2005 .

[18]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..