Gesture-Based Communication in Human-Computer Interaction

The aim of the paper is to suggest components of a model for the processing of human movement information introducing the concept of ‘motion integrators’. Two approaches to the perception of biological motion are contrasted: the low-level and the high-level processing approach. It is suggested that conceptually-driven processes play a prominent role in motion recognition. Examples from experimental psychology and neurobiology are discussed. Our quasi-automatic perception of biological motion seems to involve resource-dependent cognitive processes and an ‘interactive-encoding’ hypothesis is elaborated further. In particular, the role of attentional mechanisms and the influence of concept use are highlighted. Finally, recent findings are interpreted in connection to specific encoding strategies.

[1]  Matthew Turk,et al.  Visual interaction with lifelike characters , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  Harry Wechsler,et al.  Hand Gesture Recognition Using Ensembles of Radial Basis Function (RBF) Networks and Decision Trees , 1997, Int. J. Pattern Recognit. Artif. Intell..

[3]  James L. Crowley,et al.  Statistical Recognition of Parameter Trajectories for Hand Gestures and Face Expressions , 1998 .

[4]  Bernt Schiele,et al.  Reconnaissance d'objets utilisant des histogrammes multidimensionnels de champs réceptifs. (Object Recognition using Multidimensional Receptive Field Histograms) , 1997 .

[5]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Vladimir Pavlovic,et al.  Hand Gesture Modeling, Analysis, and Synthesis , 1995 .

[7]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[8]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[9]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[11]  Alex Pentland,et al.  Recognition of Space-Time Gestures using a Distributed Representation , 1993 .

[12]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[14]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Claudio S. Pinhanez,et al.  Approximate World Models: Incorporating Qualitative and Linguistic Information into Vision Systems , 1996, AAAI/IAAI, Vol. 2.

[16]  Shaogang Gong,et al.  Face Recognition in Dynamic Scenes , 1997, BMVC.

[17]  Vladimir Pavlovic,et al.  Integration of audio/visual information for use in human-computer intelligent interaction , 1997, Proceedings of International Conference on Image Processing.

[18]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[19]  Shaogang Gong,et al.  Gesture Recognition for Visually Mediated Interaction using Probabilistic Event Trajectories , 1998, BMVC.

[20]  Kazuo Kyuma,et al.  Computer vision for computer games , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[21]  Richard A. Foulds,et al.  Recognition approach to gesture language understanding , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[22]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[23]  Shaogang Gong,et al.  Modelling spatio-temporal trajectories and face signatures on partially recurrent neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[24]  Shaogang Gong,et al.  Tracking faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.