This paper describes a method for the recognition of dynamic gestures using a combination Neural Network/ discrete Hidden Markov Model. This work deals with four topics. First a reliable and robust person localization task is presented. Then we focus on the view-based recognition of the user’s static gestural instructions from a predefined vocabulary based on both a skin color model and statistical normalized moment invariants. The segmentation of the postures occurs by means of the skin color model based on the Mahalanobis metric. From the resulting binary image containing only regions which have been classified as skin candidates we extract translation and scale invariant moments. Further a Kohonen Self Organizing Map (SOM) is used to cluster the feature space. After the self-organizing process we modify the SOM weight vectors using the Learning Vector Quantization (LVQ) method causing the weights to approach the decision boundaries and we quantize each of them into a symbol. Finally, the symbol sequence extracted from time-sequential images is used as input for a system of discrete Hidden Markov Models (DHMMs).
[1]
L. Rabiner,et al.
An introduction to hidden Markov models
,
1986,
IEEE ASSP Magazine.
[2]
R. Watson.
A Survey of Gesture RecognitionTechniques.
,
1993
.
[3]
Andrea Corradini,et al.
Visual Person Localization with Dynamic Neural Fields: Towards a Gesture Recognition System
,
1999
.
[4]
Ming-Kuei Hu,et al.
Visual pattern recognition by moment invariants
,
1962,
IRE Trans. Inf. Theory.
[5]
KwangYun Wohn,et al.
Recognition of space-time hand-gestures using hidden Markov model
,
1996,
VRST.
[6]
Horst-Michael Groß,et al.
Contour-Based Person Localizaion by 3D Neural Fields and Steerable Filters
,
1998,
MVA.
[7]
Dean Rubine,et al.
Specifying gestures by example
,
1991,
SIGGRAPH.
[8]
L. Baum,et al.
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
,
1966
.
[9]
Teuvo Kohonen,et al.
Self-Organizing Maps
,
2010
.