Vision based hand gesture recognition using finite state machines and fuzzy logic

This paper proposes a finite state and fuzzy logic based approach to hand gesture learning and recognition. The location of 2D image positions of the hands of the user is obtained by Edge detection and vector extraction. These are used to identify the hand posture as well as the center of the hand of the user. We first learn the spatial information without data segmentation and alignment. Then the data is grouped into clusters that are associated with information for temporal alignment. The points thus obtained are clustered using Fuzzy c-mean clustering algorithm. These clusters of hand posture further determine the states of the Finite State Machine(s) through which the succeeding gesture has to be matched. To build a Gesture Recognizer (GR) the temporal information is integrated. Each hand gesture is defined to be an ordered sequence of states in spatial-temporal space i.e. FSM corresponding to it. The number of states/clusters in an FSM represents a trade-off between the accuracy of gesture recognizer and the amount of spatial-temporal data it stores.

[1]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yuntao Cui,et al.  Learning-based hand sign recognition using SHOSLIF-M , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Thomas S. Huang,et al.  Gesture modeling and recognition using finite state machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  Hatice Gunes,et al.  Face and Body Gesture Recognition for a Vision-Based Multimodal Analyzer , 2004, VIP.

[6]  Adam Kendon,et al.  How gestures can become like words , 1988 .

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  James M. Keller,et al.  A new hybrid c-means clustering model , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[9]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  Francis K. H. Quek,et al.  Toward a vision-based hand gesture interface , 1994 .