The acquisition and use of interaction behaviour models

Providing a machine with the ability to learn and use models of natural interaction is a challenging and largely unaddressed problem. A framework is developed enabling both the acquisition of interaction behaviours from the observation of humans, and the use of the acquired behaviour models to simulate a plausible partner during interaction. Statistically based interaction behaviour models are acquired automatically from the observation of interacting humans. Interaction with a virtual human is achieved using the model together with a stochastic tracking algorithm. Experimental results demonstrate the generation and use of the model for a simple human interaction.

[1]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[2]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[3]  David C. Hogg,et al.  Learning Flexible Models from Image Sequences , 1994, ECCV.

[4]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[5]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[7]  Aaron F. Bobick,et al.  A state-based technique for the summarization and recognition of gesture , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Alex Pentland,et al.  Machine Understanding of Human Action , 1995 .

[9]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[10]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[11]  Ryuichi Oka,et al.  A theoretical consideration of pattern space trajectory for gesture spotting recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  Noboru Babaguchi,et al.  Recognition of social dancing from auditory and visual information , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[14]  James W. Davis,et al.  Action Recognition Using Temporal Templates , 1997 .

[15]  Aaron F. Bobick,et al.  Using Configuration States for the Representation and Recognition of Gesture , 2000 .