Gesture Data Modeling and Classification Based on Critical Points Approximation

Human-Computer Interaction (HCI) using natural gestures is one of the promising developments in User Interface technology. One of key issues in its design is reliable modeling and classification of gesture data. In this article, we present a method for abstraction of gesture movement information, by reducing it to a sequence of approximated critical points (locations and types). The sequence of such critical points has good feature extraction properties. We present the method, results of classification, and discussion of the properties of the representation based on example gesture dataset recorded with motion capture equpiment.

[1]  Michal Romaszewski,et al.  Choosing and Modeling the Hand Gesture Database for a Natural User Interface , 2011, Gesture Workshop.

[2]  Its'hak Dinstein,et al.  Using Simple Decomposition for Smoothing and Feature Point Detection of Noisy Digital Curves , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Zhilin Li,et al.  An Examination of Algorithms for the Detection of Critical Points on Digital Cartographic Lines , 1995 .

[4]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Jan-Olof Eklundh,et al.  Shape Representation by Multiscale Contour Approximation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  M. Gavrikov,et al.  On a pattern recognition method based on polynomial regression , 2006 .

[7]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[8]  Rashid Ansari,et al.  Multimodal human discourse: gesture and speech , 2002, TCHI.

[9]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Michal Romaszewski,et al.  The Effect of Multiple Training Sequences on HMM Classification of Motion Capture Gesture Data , 2011, Computer Recognition Systems 4.

[11]  Rafael Molina,et al.  A method for invariant pattern recognition using the scale-vector representation of planar curves , 1995, Signal Process..

[12]  Herbert Freeman,et al.  Shape description via the use of critical points , 1978, Pattern Recognit..