Gesture Unit Segmentation Using Spatial-Temporal Information and Machine Learning

Currently, automated gesture analysis is being widely used in different research areas, such as human-computer interaction or human-behavior analysis. With regard to the latter area in particular, gesture analysis is closely related to studies on human communication. Linguists and psycholinguists analyze gestures from several standpoints, and one of them is the analysis of gesture segments. The aim of this paper is to outline an approach to automate gesture unit segmentation, as a way of assisting linguistic studies. This objective was attained by employing a Machine Learning technique with the aid of a spatial-temporal data representation.

[1]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[2]  Anna Esposito,et al.  Automatic Hand Hold Detection in Natural Conversation , 2001 .

[3]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[4]  Mitchell P. Marcus,et al.  Form: an experiment in the annotation of the kinetics of gesture , 2005 .

[5]  Sarajane Marques Peres,et al.  Gesture unit segmentation using support vector machines: segmenting gestures from rest positions , 2013, SAC '13.

[6]  A. Kendon.  Gesticulation and Speech: Two Aspects of the Process of Utterance , 1981 .

[7]  Michael Neff,et al.  Segmentation of hand gestures using motion capture data , 2013, AAMAS.

[8]  Craig H. Martell,et al.  Corpus-Based Gesture Analysis: an Extension of the Form Dataset for the Automatic Detection of Phases in a Gesture , 2007, Int. J. Semantic Comput..

[9]  Ron Artstein,et al.  Survey Article: Inter-Coder Agreement for Computational Linguistics , 2008, CL.

[10]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[11]  Przemyslaw Lenkiewicz,et al.  Towards Automatic Gesture Stroke Detection , 2012, LREC.

[12]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[13]  D. McNeill.  Gesture and Thought , 2005 .

[14]  Priscilla Koch Wagner,et al.  A Review of Temporal Aspects of Hand Gesture Analysis Applied to Discourse Analysis and Natural Conversation , 2013, International Journal of Computer Science and Information Technology.

[15]  Justine Cassell,et al.  Recovering the temporal structure of natural gesture , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[16]  Alex Pentland,et al.  Social signal processing: state-of-the-art and future perspectives of an emerging domain , 2008, ACM Multimedia.