Gesture unit segmentation using support vector machines: segmenting gestures from rest positions

Gesture analysis has been widely used for developing new methods of human-computer interaction. The advancement reached in the gesture analysis area is also motivating its application to automate tasks related to discourse analysis, such as the gesture phases segmentation task. In this paper, we present an initiative that aims at segmenting gestures, especially considering the "units" -- the larger grain involved in gesture phases segmentation. Thereunto, we have captured the gestures using a Xbox Kinect#8482; device, modeled the problem as a classification task, and applied Support Vector Machines. Moreover, aiming at taking advantage from the temporal aspects involved in the problem, we have used several types of data pre-processing in order to consider time domain and frequency domain features.

[1]  Przemyslaw Lenkiewicz,et al.  Towards Automatic Gesture Stroke Detection , 2012, LREC.

[2]  Anna Esposito,et al.  Automatic Hand Hold Detection in Natural Conversation , 2001 .

[3]  Clodoaldo Ap. M. Lima,et al.  Kernel machines for epilepsy diagnosis via EEG signal classification: A comparative study , 2011, Artif. Intell. Medicine.

[4]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[5]  Pornchai Phukpattaranont,et al.  A Novel Feature Extraction for Robust EMG Pattern Recognition , 2009, ArXiv.

[6]  Victor B. Zordan,et al.  Automatic splicing for hand and body animations , 2006, SCA '06.

[7]  Craig H. Martell,et al.  Corpus-Based Gesture Analysis: an Extension of the Form Dataset for the Automatic Detection of Phases in a Gesture , 2007, Int. J. Semantic Comput..

[8]  Tsung-Han Tsai,et al.  Visual Hand Gesture Segmentation Using Three-Phase Model Tracking Technique for Real-Time Gesture Interpretation System , 2012, J. Inf. Hiding Multim. Signal Process..

[9]  Justine Cassell,et al.  Recovering the temporal structure of natural gesture , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Min Han,et al.  Support Vector Echo-State Machine for Chaotic Time-Series Prediction , 2007, IEEE Transactions on Neural Networks.

[12]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[13]  Sergey Levine,et al.  Real-time prosody-driven synthesis of body language , 2009, ACM Trans. Graph..

[14]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[15]  Benjamin Schrauwen,et al.  Recurrent Kernel Machines: Computing with Infinite Echo State Networks , 2012, Neural Computation.

[16]  D. McNeill.  Gesture and Thought , 2005 .

[17]  Michael Neff,et al.  Segmentation of hand gestures using motion capture data , 2013, AAMAS.