A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction

In order to infer intent from gesture, a broad classification of types of gestures into five main classes is introduced. The classification is intended as a generally applicable basis for incorporating the understanding of gesture into human-robot interaction (HRI). Examples from human-robot interaction show the need to take into account not only the kinematics of gesture, but also the interactional context. Requirements for the operational classification of gesture by a robot interacting with humans are suggested and initial steps in its deployment are discussed.

[1]  S. Kita.  Pointing: Where language, culture, and cognition meet , 2003 .

[2]  Christiaan J. J. Paredis,et al.  Interactive Multimodal Robot Programming , 2005, Int. J. Robotics Res..

[3]  Gordon Cheng,et al.  Discovering optimal imitation strategies , 2004, Robotics Auton. Syst..

[4]  Cynthia Breazeal,et al.  Recognition of Affective Communicative Intent in Robot-Directed Speech , 2002, Auton. Robots.

[5]  Daniel Polani,et al.  Meaningful Information, Sensor Evolution, and the Temporal Horizon of Embodied Organisms , 2002 .

[6]  R. Millikan.  Varieties of Meaning: The 2002 Jean Nicod Lectures , 2004 .

[7]  Tracy L. Westeyn,et al.  Georgia tech gesture toolkit: supporting experiments in gesture recognition , 2003, ICMI '03.

[8]  Katsushi Ikeuchi,et al.  A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models , 2005, IEEE Transactions on Robotics.

[9]  A. Kendon.  Movement coordination in social interaction: some examples described. , 1970, Acta psychologica.

[10]  Jacob L. Mey,et al.  Pragmatics: An Introduction , 2001 .

[11]  Luciana Porcher Nedel,et al.  Beyond user experimentation: notational-based systematic evaluation of interaction techniques in virtual reality environments , 2005, Virtual Reality.

[12]  E. Hall.  The dance of life : the other dimension of time , 1984 .

[13]  W. S. Condon,et al.  A segmentation of behavior , 1967 .

[14]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[15]  Michael Tomasello,et al.  Gesture and the emergence and development of language , 2004 .

[16]  E. Hall,et al.  The Dance of Life: The Other Dimension of Time , 1984 .