Hand gesture recognition based on free-form contours and probabilistic inference

Hand gesture recognition based on free-form contours and probabilistic inference A computer vision system is described that captures color image sequences, detects and recognizes static hand poses (i.e., "letters") and interprets pose sequences in terms of gestures (i.e., "words"). The hand object is detected with a double-active contour-based method. A tracking of the hand pose in a short sequence allows detecting "modified poses", like diacritic letters in national alphabets. The static hand pose set corresponds to hand signs of a thumb alphabet. Finally, by tracking hand poses in a longer image sequence, the pose sequence is interpreted in terms of gestures. Dynamic Bayesian models and their inference methods (particle filter and Viterbi search) are applied at this stage, allowing a bi-driven control of the entire system.

[1]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[2]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[3]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[4]  Włodzimierz Kasprzak,et al.  Hand image interpretation based on double active contour tracking , 2006 .

[5]  Ewaryst Rafajlowicz,et al.  Local Detection Of Defects From Image Sequences , 2008, Int. J. Appl. Math. Comput. Sci..

[6]  Demetri Terzopoulos.  Deformable Models: Classic, Topology-Adaptive and Generalized Formulations , 2003 .

[7]  Chiou-Shann Fuh,et al.  Hierarchical color image region segmentation for content-based image retrieval system , 2000, IEEE Trans. Image Process..

[8]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[9]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[10]  Ioannis Pitas,et al.  Digital Image Processing Algorithms and Applications , 2000 .

[11]  Damian Borys,et al.  NODE ASSIGNMENT PROBLEM IN BAYESIAN NETWORKS , 2006 .

[12]  Ana González-Marcos,et al.  Biometric Identification through Hand Geometry Measurements , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  James M. Rehg,et al.  Digiteyes: Vision-based Human Hand Tracking Contents 1 Introduction 2 2 the Articulated Mechanism Tracking Problem 2 3 State Model for Articulated Mechanisms 4 , 1993 .

[14]  János Csirik,et al.  On naive Bayes in speech recognition , 2005 .

[15]  Heinrich Niemann,et al.  Klassifikation von Mustern , 1983 .

[16]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[17]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[18]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[19]  Mariusz Flasinski,et al.  On the use of graph parsing for recognition of isolated hand postures of Polish Sign Language , 2010, Pattern Recognit..

[20]  Hossein Ebrahimnezhad,et al.  Integrated region-based segmentation using color components and texture features with prior shape knowledge , 2010, Int. J. Appl. Math. Comput. Sci..